Systems | Development | Analytics | API | Testing

Building Streaming Data Pipelines, Part 2: Data Processing and Enrichment With SQL

In my last blog post, I looked at the essential first part of building any data pipeline—exploring the raw source data to understand its characteristics and relationships. The data is information about river levels, rainfall, and other weather information provided by the UK Environment Agency on a REST API. I used the HTTP Source connector to stream this into Apache Kafka topics (one per REST endpoint), and then Tableflow to expose these as Apache Iceberg tables.

AI at Scale Needs Control: Inside ClearML's Resource Allocation Policy Manager

By Erez Schnaider, Technical Product Marketing Manager, ClearML AI engineering today goes far beyond simply training a model. Teams are fine-tuning large language models on high-end GPUs, running massive, distributed experiments, and orchestrating hybrid workflows spanning on-premises clusters, private and public clouds. With great power comes great responsibility, and with powerful hardware comes complexity. Without robust controls, things can quickly descend into costly chaos: Who’s using what?

Orchestrating Multi-Agent Workflows with MCP & A2A - MLOps Live #39 with Google Cloud

In this webinar we explored cutting-edge tools enabling scalable AI workflows. Discover how MCP (Model Context Protocol) and A2A (Agent-to-Agent communication layer) empower teams to design, build, and manage multi-agent workflows with precision. Key Takeaways.

Ep 31 | Reimagining Business Intelligence: From Dashboards to Decision Engines w/ John Santaferraro

The next era of business intelligence is here. Traditional dashboards and static reports give way to AI-driven systems built for faster, more informed decision-making. John Santaferraro, CEO and founder of Ferraro Consulting and host of The Digital Analyst podcast, joins The AI Forecast to share how enterprises can modernize BI to unlock real business value. Because in today’s data-rich world, turning insight into action still depends on a clear ‘story’ that helps decision-makers understand what to do next.

Why Hosted Apache Kafka Leaves You Holding the Bag

Many teams begin their data streaming journey through their cloud provider, drawn to the simplicity of the one‑click “Create Kafka Cluster” button in their cloud console. It’s fast, feels integrated, and promises to “just work”—abstracting away all the operational tasks that only get more complicated in the cloud.

How Confluent Helps You Deliver New Customer Experiences and Act on Insights Faster

What’s your AI strategy? How are you making your service as easy to use as those from major cloud companies? How quickly can you roll out new features to customers? These are common questions technology executives face on a daily basis. They must accelerate innovation across the board––from deploying new features and making decisions to generating revenue and saving money.

From Static to Adaptive: Why Agentic AI is the Future of Enterprise Software

Over the first half of this year, I’ve had the unique privilege of traveling across EMEA, APAC, and the US, leading our global Agentic AI workshop series. From London to Singapore to Mumbai, I’ve had a front-row seat to how enterprises—across industries and continents—are rethinking what software can be in an age of intelligent systems. And I can confidently say: the era of Agentic AI has arrived.

Analytics vs. Reporting: How Are They Different and Why You Should Focus on Both

Analytics and reporting can help businesses transform data into actionable insights, identify customer behavior patterns, measure each department’s performance, and improve operational efficiency. And this is just the tip of the iceberg. However, while these two terms are often used interchangeably, they represent different approaches to understanding and communicating data.