Over the past few months industry analysts have been making some pretty controversial recommendations for data management in the cloud. For a thoughtful and entertaining analysis, I strongly recommend you spend a few minutes watching the keynote session by Pat Moorhead, CEO Moor Insights & Strategy, at the Evolve 2022 Data event in New York. His takeaway: “The world is very much going to be hybrid and multi-cloud.” His delivery—priceless.

Many times, a business treats an engaged customer like a random prospect. Marketing systems may not correctly target with relevance, finance systems may apply discount rules across the board, or customer support systems may treat every client with the same indifference.

The growth of big data has scattered data sources throughout the enterprise, tucking them away in silos and making them hard to find. But there is more to data than just storing information in an operational data store or running analytics from a data warehouse. For example, regulated industries have requirements needing tighter control over the data.

Cloudera has been providing enterprise support for Apache NiFi since 2015, helping hundreds of organizations take control of their data movement pipelines on premises and in the public cloud. Working with these organizations has taught us a lot about the needs of developers and administrators when it comes to developing new dataflows and supporting them in mission-critical production environments.