In this article, we will walk you through steps to run a Jenkins server in docker and deploy the MLRun project using Jenkins pipeline. Before we dive into the actual set up, let’s have a brief background on the MLRun and Jenkins.
It says something about a company and its people when they drop the process of formulaic job interviews and just let you pitch ideas for the job you want. That’s what happened when I applied to Continual as a Technical Marketing Manager. Five weeks in, I’m pleased to say I’m working on those same ideas, which I’ll detail in a couple minutes.
Cloudera has a strong track record of providing a comprehensive solution for stream processing. Cloudera Stream Processing (CSP), powered by Apache Flink and Apache Kafka, provides a complete stream management and stateful processing solution. In CSP, Kafka serves as the storage streaming substrate, and Flink as the core in-stream processing engine that supports SQL and REST interfaces.
Data is the fuel for today’s modern economy – it drives everything from large-scale manufacturing, financial services, energy and transportation to healthcare, media and entertainment and everything in between. This new philosophy of data-centricity has evolved the way organizations think about their IT environments, infrastructure, applications, solutions and even cloud providers.