Machine learning (ML), more than any other workflow, has imposed the most stress on modern data architectures. Its success is often contingent on the collaboration of polyglot data teams stitching together SQL- and Python-based pipelines to execute the many steps that take place from data ingestion to ML model inference.
It’s hard to believe enterprise BI platforms have been around for three decades. In that time, they have served the purpose of collecting and analyzing large amounts of data to help businesses make more informed decisions. But in today’s data-driven economy, analysts struggle to keep up with the myriad of business intelligence reports from traditional BI tools – which fail to effectively and efficiently analyze and interpret data in real-time.
When we think of the various people and teams making use of ML and DBMS, we can place them on a spectrum based on the composition of their work.