|
By Alex Durham
It was lovely to see so many of the community and hear about the latest data streaming initiatives at Kafka Summit this year. We always try to distill the sea of content from the industry’s premier event into a digestible blog post. This time we’ll do it slightly differently and summarize some broader learnings, not only from the sessions we saw, but the conversations we had across the two days.
|
By Andrew Stevenson
In this age of AI, the demand for real-time data integration is greater than ever. For many, these data pipelines should no longer be configured and deployed by centralized teams, but distributed, so that each owner creates their flows independently. But how to simplify this, whilst practicing good software and data governance? We are introducing Lenses 5.5.
|
By Guillaume Aymé
If 2023 was the year we woke up to how generative AI would change our world, 2024 is the year we realize the change. The real-time AI-driven enterprise may not be pixel-perfect yet, but we’re well on the way. Gen AI has a knock-on effect on all the trends and challenges we will see in 2024. Here’s our take.
Amazon S3 is a standout storage service known for its ease of use, power, and affordability. When combined with Apache Kafka, a popular streaming platform, it can significantly reduce costs and enhance service levels. In this post, we’ll explore various ways S3 is put to work in streaming data platforms.
|
By Stefan Bocutiu
An effective data platform thrives on solid data integration, and for Kafka, S3 data flows are paramount. Data engineers often grapple with diverse data requests related to S3. Enter Lenses. By partnering with major enterprises, we've levelled up our S3 connector, making it the market's leading choice. We've also incorporated it into our Lenses 5.3 release, boosting Kafka topic backup/restore.
|
By Adamos Loizou
Navigating the intricacies of Apache Kafka just got a lot more intuitive. With Lenses 5.3 we bring you peace of mind, regardless of where you are in your Kafka journey. Our newest release is all about smoothing out the bumps, and making sure you're equipped to handle Kafka's challenges with confidence. Here's a sprinkle of what's in store, ahead of our big 6.0 release later this year.
|
By Adamos Loizou
We like to reduce the most mundane, complex and time-consuming work associated with managing a Kafka platform. One such task is backing up topic data. With a growing reliance on Kafka for various workloads, having a solid backup strategy is not just a nice-to-have, but a necessity. If you haven’t backed up your Kafka and you live in fear of disaster striking, worry no more.
One of the most important questions in architecting a data platform is where to store and archive data. In a blog series, we’ll cover the different storage strategies for Kafka and introduce you to Lenses’ S3 Connector for backup/restore. But in this first blog, we must introduce the different Cloud storage options available. Later blogs will focus on specific solutions, explain in more depth how this maps to Kafka and then how Lenses manage your Kafka topic backups.
|
By Adamos Loizou
Kafka adoption is growing fast. Very fast. At Lenses, we’re pushing out new features to increase developer productivity, reduce manual effort & improve the cost & hygiene of operating your Kafka platform. Only a few weeks since Lenses 5.1, yet here we are again with more goodies in our release 5.2.
|
By Adamos Loizou
Hello again. We strive to improve the productivity of developers building event-driven applications on the technology choices that best fit your organization. AWS continues to be a real powerhorse for our customers. Not just for running the workloads, but in supporting them with their native services: MSK Kafka, MSK Connect and now increasingly Glue Schema Registry. This is bringing a strong alternative to Confluent and their Kafka infrastructure offerings.
|
By Lenses
See the new Lenses Kafka to HTTP Sink Connector in action with Lenses.io and @itsmake. In this 30 minute session, we show you how to trigger APIs that automate your business processes: a message in Kafka calls a Make workflow, then triggering an automation in Salesforce.
|
By Lenses
DataOps is the art of progressing from data to value in seconds. For us, its all about making data operations as easy and fast as using the email.
|
By Lenses
Apache Kafka is a popular and powerful component of modern data platforms. But it's complicated. Complicated to run, complex to manage and crucially - it's near impossible to drive Kafka adoption from the command line across your organization. So here's your how-to for seeing it through to production (... and possibly fame and fortune). We cover key principles for Kafka observability and monitoring.
|
By Lenses
Lenses, a DataOps platform, accelerates time to value, opening up data streams to a wide audience. Lenses enables rapid construction and deployment of data pipelines at scale, for enterprises, with governance and security.
|
By Lenses
Lenses, a DataOps platform, accelerates time to value, opening up data streams to a wide audience. Lenses enables rapid construction and deployment of data pipelines at scale, for enterprises, with governance and security.
- April 2024 (3)
- March 2024 (6)
- February 2024 (5)
- January 2024 (4)
- December 2023 (4)
- November 2023 (3)
- October 2023 (1)
- September 2023 (4)
- May 2023 (1)
- April 2023 (3)
- March 2022 (1)
- February 2022 (1)
- October 2021 (2)
- September 2021 (1)
- August 2021 (3)
- July 2021 (2)
- June 2021 (1)
- May 2021 (1)
- April 2021 (4)
- March 2021 (3)
- February 2021 (2)
- January 2021 (5)
- December 2020 (5)
- November 2020 (6)
- October 2020 (4)
- September 2020 (2)
- August 2020 (7)
- July 2020 (14)
- June 2020 (8)
- May 2020 (14)
Lenses ® is a DataOps platform that provides cutting edge visibility into data streams, integrations, processing, operations and enables ethical and secure data usage for the modern data-driven enterprise.
Accelerate time to value, open up data in motion to a wide audience, enable rapid construction and deployment of data pipelines at scale, for enterprises, with governance and security.
Why Lenses?
- Confidence in production: Everyone’s scared of the dark. Lenses gives you visibility into your streams and data platform that you’ve never had. That means you don’t need to worry running in production.
- Keeping things simple: Life’s hard enough without having to learn new languages and manage code deployments. Build data flows in minutes with just SQL. Reduce the skills needed to develop, package and deploy applications.
- Being more productive: Build, debug and deploy new flows in minutes not days/weeks. In fact, many of our customers build and deploy apps to production 95% faster.
25,000+ Developers Trust Lenses for data operations over Kafka.