Moving data from an organization’s systems into data warehouses and data lakes are essential to fuel business intelligence and analytics tools. These insights guide businesses into making decisions backed by data, allowing them to choose actions that have the best chance of positive growth. However, getting data from the source systems to these data stores can be a harrowing process.

The four key things to know about the difference between a data engineer and a software engineer are...

You will have to consider multiple solutions and their tradeoffs when setting up your enterprise data architecture. In this article, we contrast a data lake and a data warehouse side-by-side to make your choice easier.

In the final episode of season two of The Data Chief podcast, we talk with authors of four must-read books for data and analytics leaders — two new and two time-tested. As you invest in your continuous learning, here is the full round up of the latest top books I recommend for today’s data and analytics leaders.

With the growing demands for online communication platforms, the need for testing various scenarios has drastically increased. Therefore when testing WebRTC application implementations most of the time there is a need to provide a video and audio feed to the application to test various aspects of the functionality implementation. To address this need, Loadero was providing several preset audio and video feed configuration combinations.

We’re sure you’ve heard your DevOps team often talk about test orchestration. This testing approach has quickly become a crucial element of test automation because it streamlines the automation process. For agile teams, applying test orchestration to their testing strategy is quite rewarding as it accelerates testing and offers a holistic view of the testing process.

If you’ve done any reading about service meshes, you’ve probably come across mentions of an open source project named Envoy. And if you’ve done any reading about Envoy, you’ve probably seen references to service meshes. How are these two technologies related? How are they different? Do they work together? I’ll attempt to answer all those questions in this blog post’s first and second parts, plus possibly a few more.

Earlier this year, Perforce hosted the Embedded DevOps Summit, exploring solutions to modern challenges in the planning, development, and testing stages of embedded software. As part of this event, Warren Savage, Visiting Researcher at the Applied Research Laboratory for Intelligence and Security (ARLIS) at the University of Maryland, presented Secure Collaboration in Cloud-Based Chip Design Environments.

Last week, we shared information on BigQuery APIs and how to use them, along with another blog on workload management best practices. This blog focuses on effectively monitoring BigQuery usage and related metrics to operationalize workload management we discussed so far.

Troubleshooting cloud services and infrastructure is an ongoing challenge for organizations of all sizes. As organizations adopt more cloud services and their cloud environments grow more complex, they naturally produce more telemetry data – including application, system and security logs that document all types of events. All cloud services and infrastructure components generate their own, distinct logs.