Lightweight Batch Streaming
What’s an easy, low-cost way to batch stream data into Snowflake in near real-time? In this episode of Snowflake Bytes, Felipe Hoffa uses RSVP data from Meetup to demonstrate how you can use Google Cloud Pub/Sub and Snowpipe to do just that. Meetup publishes about 4 thousand RSVPs for events per hour that it can use to analyze what’s happening around the world. In the video, you’ll find a link to Hoffa’s blog post, which shares the code he used to create a lightweight pipeline to automatically ingest each of these files into Snowflake so that they can be queried.