The most valuable and transformative business use cases require multiple analytics workloads and data science tools and machine learning algorithms to run against the same diverse data sets. It’s how the most innovative enterprises unlock value from their data. Turning data into useful insights is not easy, to say the least. The workloads need to be optimised for hybrid and multi-cloud environments, delivering the same data management capabilities across bare metal, private and public clouds. In this session, we will discuss how businesses can leverage the combination of best-in-class software and public cloud to help businesses turn raw data into actionable insights, without the overheads and without compromising performance, security and governance.

In this video, you'll see a simple demo on how you can build a web application on top of a Cloudera Operational Database. We'll leverage the Apache Phoenix integration to easily write SQL statements against our database and use the python flask library to power the back end API calls. The web application will be hosted within Cloudera Machine Learning, showcasing some of the benefits of having your data within a hybrid data platform.

AND has the power to move you. And the hybrid data cloud will take you there. Any cloud, with any analytics, and any data across your entire business.

In this video, you will see how you can use PySpark to process medical images from an MRI and convert them from DICOM format to PNG. The data is read from and written to AWS S3 and we leverage numpy and the pydicom libraries to do the data transformation. We are using data from the "RSNA-MICCAI Brain Tumor Radiogenomic Classification" Kaggle competition but this approach can be used for general purpose DICOM processing.

Data Engineering is undergoing a huge evolution requiring faster and more reliable data pipelines. Apache Spark and Python are core foundational components of this new architecture enabling data engineers to quickly develop these pipelines. They also introduce challenges when moving to production. Come join us as we: Ask questions and learn. We will also have a raffle of Cloudera swag.