In this blog post, I’ll set up and run a couple of experiments to demonstrate the effects of different kinds of partition pruning in Spark.

Data is often compared to oil – it powers today’s organizations, just like the fossil fuel powered companies of the past. Just like oil, the data that companies collect needs to be refined, structured, and easily analyzed in order for it to really provide value in the form of gaining actionable insights. Every organization today is in the process of harnessing the power of their data using advanced analytics, which is likely running on a modern data stack.

In this episode of CDO Battlescars, Sandeep Uttamchandani, Unravel Data’s CDO, speaks with Meenal Iyer, Sr. Director of Enterprise Analytics and Data at Tailored Brands. They discuss battlescars in two areas, data and metrics: Growing Data Literacy and Developing a Data-Driven Culture and Standardization of Business Metrics.

It’s hard to believe that Unravel Data was founded eight years ago — though the first few years were dedicated to defining and building our initial product. Since this time, the company has raised several rounds of funding, released several versions of our flagship DataOps Platform, and is being used by some of the world’s leading brands to improve the efficiency and reliability of their data pipelines.

In this episode of CDO Battlescars, Sandeep Uttamchandani, Unravel Data’s CDO, speaks with Keyur Desai, CDO of TD Ameritrade. They discuss battlescars in two areas: Building a Data Strategy and Pervasive Self-Service Analytics Platforms. Keyur is a data executive with over 30 years of experience managing and monetizing data and analytics.

In this episode of CDO Battlescars, Sandeep Uttamchandani, Unravel Data’s CDO, speaks with Keyur Desai, CDO of TD Ameritrade. They discuss battlescars in two areas: Building a Data Strategy and Pervasive Self-Service Analytics Platforms. Keyur is a data executive with over 30 years of experience managing and monetizing data and analytics.

According to a recent press release by the National Retail Federation, “nearly seventy-three percent of consumers celebrating Valentine’s Day this year feel it’s important to do so given the current state of the pandemic.” The release also states that “consumers still feel it’s important to spoil their loved ones in light of the pandemic.” We couldn’t agree more on the importance of celebrating the day.

As your organization begins planning and budgeting for 2021 initiatives, it’s time to take a critical look at your cloud migration strategy. If you’re planning to move your on-premises big data workloads to the cloud this year, you’re undoubtedly faced with a number of questions and challenges.

CDO Battlescars is a podcast series hosted by Sandeep Uttamchandani, Unravel Data’s CDO. He talks to data leaders across data engineering, analytics, and data science about the challenges they encountered in their journey of transforming raw data into insights. The motivation of this podcast series is to give back to the data community the hard-learned lessons that Sandeep and his peer data leaders have learned over the years.

Are you familiar with the emerging discipline known as DataOps (data operations)?