Systems | Development | Analytics | API | Testing

Change Data Capture: CDC for E-Commerce

Change data capture is one of the fundamental underpinnings of modern data management. Without knowing when their enterprise data has changed or refreshed with new information, businesses wouldn’t be able to access up-to-the-minute insights that help them stay competitive in a constantly shifting landscape. In change data capture (CDC), users are promptly notified (either in real-time or near real-time) when changes have been made to a source table or source database.

With Stitch, Simba is losing no sleep over aggressive growth plans

“If we didn’t have Stitch, we would have to recruit and hire data engineers, buy space for hundreds of millions of rows that we’re sinking into the database, and on and on. For us, Stitch is essential.” –Tomasz Eitner, BI and Data Analyst, Simba Sleep Simba Sleep has always been a data-driven company. Before the firm was even formally launched, the founders purchased research profiles from more than 10 million sleepers—including 180 million body profile data points.

The Role of the Empowered Citizen Integrator in Democratizing Technology Across the Enterprise

For organizations to succeed today, they have to make data-driven decisions and get the most value out of the information. “To monetize data, companies must first transform it so that it can be reused and recombined to enable new value creation.” Most organizations have a ton of information that is spread across multiple departments. Making sense of the information is no easy task. Inaccurate analytics or delayed insights can put the business in a vulnerable position.

6 Database Schema Designs and How to Use Them

In this guide, we'll discuss what a database schema is, six database schema designs, and how and why they are used. We know a lot of thought goes into database construction. Before creating any database, developers plan what it should include and how the different aspects work together. This planning ensures a database has the necessary design for its intended use. Coders then use the schema to implement the database’s design.

5 Tips for Pushing Data from Your Warehouse to SAP

Reverse ETL flips the targets and destinations of the standard ETL (extract, transform, load) process. Instead of collecting your data within a centralized data warehouse, reverse ETL transfers information out of this warehouse and into third-party operational systems for ease of access and better analytics and reporting. That’s all very well and good — but what does reverse ETL look like in practice with systems and software such as SAP?

Automated Competition Scraping with Apify and Keboola

Whether you saw or missed our webinar, we thought it would be useful to provide a step-by-step guide on how to set up quick competition monitoring (or, any other web scraping and data processing automation) with Apify and Keboola. Thank you Apify and Revolt.bi for the collaboration! So what can you do with automated competition data processing? In this article, we’ll take an example of daily monitoring of the best-sellers list at Amazon.

Migrating Data Pipelines from Enterprise Schedulers to Airflow

At Airflow Summit 2021, Unravel’s co-founder and CTO, Shivnath Babu and Hari Nyer, Senior Software Engineer, delivered a talk titled Lessons Learned while Migrating Data Pipelines from Enterprise Schedulers to Airflow. This story, along with the slides and videos included in it, comes from the presentation.