Systems | Development | Analytics | API | Testing

Latest News

3x better performance with CDP Data Warehouse compared to EMR in TPC-DS benchmark

In a previous blog post on CDW performance, we compared Azure HDInsight to CDW. In this blog post, we compare Cloudera Data Warehouse (CDW) on Cloudera Data Platform (CDP) using Apache Hive-LLAP to EMR 6.0 (also powered by Apache Hive-LLAP) on Amazon using the TPC-DS 2.9 benchmark. Amazon recently announced their latest EMR version 6.1.0 with support for ACID transactions. This benchmark is run on EMR version 6.0 as we couldn’t get queries to run successfully on version 6.1.0.

Data Lake Export Public Preview Is Now Available on Snowflake

Public preview of the data lake export feature is now available. Snowflake announced a private preview of data lake export at the Snowflake virtual summit in June 2020. Data lake export is one of the key features of the data lake workload in the Snowflake Data Cloud. The feature makes Snowflake data accessible to the external data lake, and it enables customers to take advantage of Snowflake’s reliable and performant processing capabilities.

10X Engineering Leadership Series: 21 Playbooks to Lead in the Online Era

Managing online teams has become the new normal! In an online world, how do you give effective feedback, have a difficult conversation, increase team accountability, communicate to stakeholders effectively, and so on? At Unravel, we are a fast-growing AI startup with a globally distributed engineering team across the US, EMEA, and India. Even before the pandemic this year, the global nature of our team has prepared us for effectively leading outcomes across online engineering teams.

Structured vs Unstructured Data: A Short Guide

Data is the oil that fuels the growth of modern enterprises. But unless you have the tools to unlock the potential of data, you might be left stuck on the tracks as your competitors speed ahead. With the rise of Big Data, the nature of the data that we work with has changed drastically. Data scientists like to refer to the ‘3 Vs’ of Big Data: The 3 Vs of Big Data reshaped the data landscape as we knew it.

Do chatbots and voice assistants make mobile shopping more expansive?

E-commerce is on a steep rise with 95% of purchases expected to be made online by 2040, and mobile shopping responsible for a 500bn average year-on-year growth since 2017. AI-enabled agents can differentiate your mobile strategy while elevating your conversion rates and the customer journey.

Embedding Source Code Version Information in Docker Images

As organizations place focus on innovation and digital transformation across enterprise IT, we continue to see increased adoption of containers and microservice application development patterns. Containers have brought developers new levels of flexibility and portability, but oftentimes still leave developers with questions about the best way to configure and build those containers.

Podcast: Achieving Operational Excellence in Oil and Gas

In the Oil and Gas sector, operational excellence is always strived for, but can be very challenging to achieve. With siloed systems, manual tasks and data handoffs, changing regulatory requirements, and a large web of people involved in process execution, it is getting increasingly difficult to efficiently and accurately orchestrate operations.