Moving data from an organization’s systems into data warehouses and data lakes are essential to fuel business intelligence and analytics tools. These insights guide businesses into making decisions backed by data, allowing them to choose actions that have the best chance of positive growth. However, getting data from the source systems to these data stores can be a harrowing process.

The four key things to know about the difference between a data engineer and a software engineer are...

You will have to consider multiple solutions and their tradeoffs when setting up your enterprise data architecture. In this article, we contrast a data lake and a data warehouse side-by-side to make your choice easier.

In the final episode of season two of The Data Chief podcast, we talk with authors of four must-read books for data and analytics leaders — two new and two time-tested. As you invest in your continuous learning, here is the full round up of the latest top books I recommend for today’s data and analytics leaders.

French multinational automotive manufacturer Renault Group has been investing in Industry 4.0 since the early days. A primary objective of this transformation has been to leverage manufacturing and industrial equipment data through a robust and scalable platform. Renault designed an industrial data acquisition layer and connected it to Google Cloud, using optimized big data products and services that together form Renault's Industrial Data Platform.

Last week, we shared information on BigQuery APIs and how to use them, along with another blog on workload management best practices. This blog focuses on effectively monitoring BigQuery usage and related metrics to operationalize workload management we discussed so far.

Troubleshooting cloud services and infrastructure is an ongoing challenge for organizations of all sizes. As organizations adopt more cloud services and their cloud environments grow more complex, they naturally produce more telemetry data – including application, system and security logs that document all types of events. All cloud services and infrastructure components generate their own, distinct logs.

Modern business requires a range of digital components to communicate effectively when transferring data and delivering critical messages. Application programming interfaces, or APIs, are sets of rules that regulate exactly how certain apps or machines connect. If you work with data at all, you’ll have heard of REST or RESTful, and REST APIs — but what is REST API design? We explain below.

According to Forbes , 95% of companies need to manage unstructured data and use it to gain actionable insights. Data processing is the way to do just that. Unfortunately, poor data management occurs when companies don't make full use of the information they collect.

Apache Ozone is a scalable distributed object store that can efficiently manage billions of small and large files. Ozone natively provides Amazon S3 and Hadoop Filesystem compatible endpoints in addition to its own native object store API endpoint and is designed to work seamlessly with enterprise scale data warehousing, machine learning and streaming workloads. The object store is readily available alongside HDFS in CDP (Cloudera Data Platform) Private Cloud Base 7.1.3+.