Systems | Development | Analytics | API | Testing

Logging

Episode 5 | Data Platform | Data Journey | 7 Challenges of Big Data Analytics

What are data platforms? A data platform (or more topical, “cloud data platform”) is an integrated set of technologies that collectively meet an organization’s end-to-end data needs. In totality, it enables the storage, delivery, and governance of company data, as well as a security layer for users and applications. The heart of a platform is an actual database where it might be better called a data “analytics” platform or in our case big data analytics platform. Learn more about data platforms and how the ChaosSearch platform solves the challenges faced in big data analytics.

Transforming Kong Logs for Ingestion into Your Observability Stack

As a Solutions Engineer here at Kong, one question that frequently comes across my desk is “how can I transform a Kong logging plugin message into a format that my insert-observability-stack-here understands, i.e. ELK, Loki, Splunk, etc.?” In this blog, I’m going to show you how to easily accomplish converting a Kong logging payload to the Elastic Common Schema. In order to accomplish this task, we’re going to be running Kong Gateway in Kubernetes and using two Kong plugins.

Episode 3 & 4 | Data Destination & Data Governance | Data Journey

What are data destinations? In a very abstract sense, data destination is another input along the series of process elements in a data pipeline. However, when calling out an element as the destination, it is really seen as the final destination such as a database, data lake or data warehouse. And yet, any element within the data pipeline has aspects of a final destination (and scaling challenges).

Episode 1 | Data Pipelines | Data Journey | 7 Challenges of Big Data Analytics

Where does a data journey begin? With the data pipeline. Thomas Hazel begins this 7-part series on solving the biggest data analytics challenges today by starting with the building, scaling and maintenance of data pipelines. Avoid building the Taj Mahal … every 6 months … and join the data journey with us to learn about the unique approach ChaosSearch has taken.