One of the core reasons that organizations invest in analytic solutions is because they want to get everyone in their organization on the same page. They want everyone to understand what's happening and why it's happening so that individuals know what they need to do to be successful and drive outcomes for the organization.

Let’s try to figure out what happens with the application when the source file is much bigger than the available memory. The memory in the below tests is limited to 900MB […]. Naively we could think that a file bigger than available memory will fail the processing with OOM memory error. And this supposition is true.

Many of us have experienced the feeling of hopelessly digging through log files on multiple servers to fix a critical production issue. We can probably all agree that this is far from ideal. Locating and searching log files is even more challenging when dealing with real-time processing applications where the debugging process itself can be extremely time-sensitive.

The opportunity to create new economic, social and environmental value by unlocking the “good” in data is immense. While the problems we face as a society may be getting harder to solve, the advances we can make when we break down the silos between the physical and digital worlds are profound.

Once upon a time there was only one way to use Apache Spark but support for additional programming languages and APIs have been introduced in recent times. A novice can be confused by the different options that have become available since Spark 1.6 and intimidated by the idea of setting up a project to explore these APIs.

Where did the last decade go? Seems like it was just 2010 and I was writing about the future of business in 2020, well it is nowhere! I’ve spent much of my career in finance/accounting and management consulting and the last decade+ helping companies link their business and technology strategies with a focus on data and analytics. Where will we head in 2020 and this next decade?

RELATED BLOG POSTS Unraveling the Complex Streaming Data Pipelines of Cybersecurity Best Practices Blog 5 Min Read Security is top of mind for every enterprise these days. There are so many threats they can hardly be counted, but one commonality exists: data is always the target. Unravel’s mission is to help organizations better understand and improve the performance of their data-based applications. We’re a data business, so we appreciate the scope and implications of these threats.

I’m excited to share today that we announced the acquisition of RoxAI and its Ping intelligent alerting software at our 2020 sales kickoff. This is becoming an exciting annual tradition – last year we similarly announced from the SKO stage our intent to acquire Crunch Data, which has been rebranded as Insight Bot. Like that announcement, RoxAI and Ping will help increase the value of data through insights delivered to users where they work.

A very important question is how long something takes and the answer to that is fairly straightforward in normal life: Check the current time, then perform the unit of work that should be measured, then check the time again. The end time minus the start time would equal the amount of time that the task took, the elapsed time or wallclock time.

In the ideal world, when a developer builds a dashboard, they want that dashboard to be used to its fullest extent. Dashboards would engage users with their design, provide users with both information and the means to take immediate action (without leaving the dashboard), and become part of users’ everyday workflows.