Systems | Development | Analytics | API | Testing

Your Enterprise Data Needs an Agent

Snowflake is expanding its AI capabilities with the public preview of Cortex Agents, to help retrieve data insights by orchestrating across structured and unstructured datasets. Cortex Agents streamlines agentic application data access and orchestration for more reliable AI-driven decisions by building on top of enhancements to our Cortex AI retrieval services.

Guide to Data Pipeline Architecture for Data Analysts

Have you ever spent hours troubleshooting a failed ETL job only to realize the issue was due to poor pipeline design? If so, you're not alone. Data pipeline architecture is the backbone of any data integration process, ensuring data flows efficiently from source to destination while maintaining quality, accuracy, and speed.

How to Run an Automated CI/CD Workflow for ML Models with ClearML

If you are working with ML models, having a reliable CI/CD (Continuous Integration and Continuous Deployment) workflow isn’t just a nice-to-have, it’s essential. Your team needs a robust, automated process to validate data, train models, and deploy them without human error slowing things down. That’s where ClearML comes in, offering a seamless solution to orchestrate, monitor, and automate your ML pipelines.

Building High Throughput Apache Kafka Applications with Confluent and Provisioned Mode for AWS Lambda Event Source Mapping (ESM)

Confluent and AWS Lambda can be used to build scalable and real-time event-driven architectures (EDAs) that respond to specific business events. Confluent provides a streaming SaaS solution based on Apache Kafka and built on Kora: The Cloud-Native Engine for Apache Kafka, allowing you to focus on building event-driven applications without operating the underlying infrastructure.

Motivating Engineers to Solve Data Challenges with a Growth Mindset

With almost two years at Confluent under her belt, Suguna Ravanappa has taken impressive strides as a people manager. Her eight-person team of engineers in the Global Support organization helps customers tackle technical challenges in their data streaming environments. According to Suguna, leading this team and being part of Confluent’s unique company culture has helped her develop stronger skills as both a leader and a collaborator. Learn more about her experience.

Lenses.io Introduces Streaming Data Replicator

New York City, US - February 12, 2025 - Lenses.io, a data streaming innovation leader whose software helps developers power the world’s largest businesses, today announces the development of an enterprise grade and vendor-agnostic Kafka-to-Kafka replicator. It will enable organizations to share streaming data across different domains, in order to keep up with real-time data demands as AI adoption grows.

EP 10: 2025 Predictions

What’s the Forecast? A look at data and AI in 2025 2025 is set to be a year of growth and change, particularly in the AI space. Over the last couple of years, AI has evolved from a niche technology to a driving force behind business strategies, innovation, and efficiency in almost every industry. Its impact is felt far and wide. It is not only shaping how we search for information, but how we digest and react to the world around us.