Systems | Development | Analytics | API | Testing

Episode 3 & 4 | Data Destination & Data Governance | Data Journey

What are data destinations? In a very abstract sense, data destination is another input along the series of process elements in a data pipeline. However, when calling out an element as the destination, it is really seen as the final destination such as a database, data lake or data warehouse. And yet, any element within the data pipeline has aspects of a final destination (and scaling challenges).

Transforming Kong Logs for Ingestion into Your Observability Stack

As a Solutions Engineer here at Kong, one question that frequently comes across my desk is “how can I transform a Kong logging plugin message into a format that my insert-observability-stack-here understands, i.e. ELK, Loki, Splunk, etc.?” In this blog, I’m going to show you how to easily accomplish converting a Kong logging payload to the Elastic Common Schema. In order to accomplish this task, we’re going to be running Kong Gateway in Kubernetes and using two Kong plugins.

Episode 1 | Data Pipelines | Data Journey | 7 Challenges of Big Data Analytics

Where does a data journey begin? With the data pipeline. Thomas Hazel begins this 7-part series on solving the biggest data analytics challenges today by starting with the building, scaling and maintenance of data pipelines. Avoid building the Taj Mahal … every 6 months … and join the data journey with us to learn about the unique approach ChaosSearch has taken.

Data Journey | 7 Challenges of Big Data Analytics | Episode 0

How do you truly solve the challenges of today’s ever growing big data analytic needs? Join us on a data journey with ChaosSearch's CTO & Founder, Thomas Hazel as he gets technical on how to solve 7 of the biggest data challenges teams are facing - from source to insights.

Moving to Log Analytics for BigQuery export users

If you’ve already centralized your log analysis on BigQuery as your single pane of glass for logs & events…congratulations! With the introduction of Log Analytics (Public Preview), something great is now even better. It leverages BigQuery while also reducing your costs and accelerating your time to value with respect to exporting and analyzing your Google Cloud logs in BigQuery.