Systems | Development | Analytics | API | Testing

No pipelines needed. Stream data with Pub/Sub direct to BigQuery

Pub/Sub’s ingestion of data into BigQuery can be critical to making your latest business data immediately available for analysis. Until today, you had to create intermediate Dataflow jobs before your data could be ingested into BigQuery with the proper schema. While Dataflow pipelines (including ones built with Dataflow Templates) get the job done well, sometimes they can be more than what is needed for use cases that simply require raw data with no transformation to be exported to BigQuery.

Snowflake's New Engine and Platform Announcements

Snowflake’s Data Cloud is powered by a single engine. From day 1, we have been focusing on consistently evolving and improving this engine to allow existing workloads to run more efficiently and enable new workloads to run on Snowflake. The single engine approach translates into a single experience—from one consistent pricing model to an integrated approach combining performance, security, governance, and the foundation to seamlessly enable cross-region or cross-cloud scenarios.

Bridging the Gap Between Oracle Operational Reporting and Analytics with Angles for Oracle ERP

As Business Intelligence (BI) tools, data warehousing solutions, and enterprise data and application landscapes have advanced, it’s worth taking the time to rethink that old model, starting with the dichotomy between operational reporting (OR) and strategic analytics. There is a clear difference between operational reporting and BI, but they can and should work together. Companies use one or the other, and if they have both, there is a gap between them.

WestJet Airlines Scales Easily & Quickly With The Snowflake Data Cloud

WestJet Airlines Ltd. is a Canadian airline headquartered in Calgary, Alberta. It is the second-largest Canadian airline, operating over 700 flights a day and carrying more than 22 million guests a year. Learn why Breyten Van Tonder, Senior Manager of Data Engineering at WestJet and his team utilize the Snowflake Data Cloud to enable their user community to be more analytical and innovative with their data.

Take control of your data consumption spend without killing your innovation

In this 5 minute video Talend customer Aurizon shows how they take control of their consumption costs with data requirements running 24/7, how they are enabled to continue to innovate without the need to ask for more budget and how to design a foundation for data and analytics with healthy data that delivers business outcomes.

The Human Side of the Equation - How Stories Bring Data to Life (Part 1)

As data science has taken center stage in a lot of organizations, many are relearning what they’ve already known – that dry, mathematical calculations don’t inspire and don’t stick. It’s the story that matters. In this first of a two-part blog series, we look at the history and neuroscience of storytelling and how it can help us understand data at a more human level.

Flow Creation in Edge Flow Manager

This video shows the usage of Edge Flow Manager’s flow designer and using the example flow it explains the concept of agent classes and publishing. It goes through the Dashboard view for agent classes and the canvas for the flow designer where processors, remote process groups and funnels are also explained. To see all of this in action, a very basic flow is created with two processors and published to the MiNiFi agents under the agent class the flow is designed for. After publishing, the means of tracking the flow deployment progress are also covered.