There's been a lot of discussion around the proliferation of data sources in organizations, and for good reason. There are so many ways to consume data now. When I first started working we would send out paper reports. Then Excel came along and we started sending out spreadsheets. Then organizations tried to control things a bit more, so dashboards were created. While there are more new channels to receive data, none of the older ones have become obsolete.

AI and its enabled tools continue to enthrall business with its promise of efficiency and innovation. But, one of the things AI is also clearly enabling is the bias. We’ve all read the news and heard the scaremongering stories around potential flaws and biases in Artificial Intelligence systems. I believe for this technology to reach its full potential, addressing bias will need to be a top priority.

Stitch is a very simple yet very powerful cloud service which connects to a diversity of data sources. It is a very user-friendly ingestion system and works in a very simple format. Stitch connects to the data sources, pulls the data and loads the data to a target. In this blog, I am going to connect to Amazon S3, read a file and load the data to Snowflake but first let’s understand few concepts of Stitch. For Stitch to work you need an Integration and a Destination.

Talend Cloud is an Integration platform as a service (iPaaS) offering by Talend. It is a fully managed cloud option which has the capabilities of data integration, data stewardship, data preparation, API designer and Tester and Pipeline designer. These tools can be used for lightweight ETL and detecting the schema on the fly. One of the unique features of Talend Cloud is it provides both on premise and cloud execution environments.

We know that data is a key driver of success in today data-driven world. In fact, according to Forrester, data and insight-driven businesses are growing at an average of more than 30% annually. However, becoming a data driven organization is not easy. Companies often struggle with speed in accessing and analyzing their data, as well with ensuring delivery of trustworthy data that is free of critical errors.

One of the things I'm really passionate about is data and how it can be used to influence decision-making. But everyone has their own personal biases and opinions that they use to create a narrative and this can affect how they look at data. So even when the data tells us one thing, we may see something completely different.