Systems | Development | Analytics | API | Testing

Every computer application must have a method of storing, managing and using data. This requires an application and at least one database that can communicate with each other. Managing this connection can be difficult, especially with multiple databases. Fortunately, there are platforms that can manage databases and connections applications more efficiently. Heroku offers a Postgres management system for creating, managing, and using databases.

The shift to cloud has been accelerating, and with it, a push to modernize data pipelines that fuel key applications. That is why cloud native solutions which take advantage of the capabilities such as disaggregated storage & compute, elasticity, and containerization are more paramount than ever. At Cloudera, we introduced Cloudera Data Engineering (CDE) as part of our Enterprise Data Cloud product — Cloudera Data Platform (CDP) — to meet these challenges.

“There is a shortage of data scientists, as the demand for analytics rises.”

At Airflow Summit 2021, Unravel’s co-founder and CTO, Shivnath Babu and Hari Nyer, Senior Software Engineer, delivered a talk titled Lessons Learned while Migrating Data Pipelines from Enterprise Schedulers to Airflow. This story, along with the slides and videos included in it, comes from the presentation.

Web accessibility testing, also known as digital accessibility testing, is a subset of usability testing that ensures anyone can access and use your digital content (website, apps, etc.) at any time. This includes people with disabilities such as vision, hearing, literacy, physical, and cognitive disabilities. With around (or over 1 billion people) living with a disability, the calls for inclusion are growing louder by the day.

Whether you saw or missed our webinar, we thought it would be useful to provide a step-by-step guide on how to set up quick competition monitoring (or, any other web scraping and data processing automation) with Apify and Keboola. Thank you Apify and Revolt.bi for the collaboration! So what can you do with automated competition data processing? In this article, we’ll take an example of daily monitoring of the best-sellers list at Amazon.

Four technology leaders discuss the modern data stack — and agree that multi-cloud is the best option.

Good logging practices are crucial for monitoring and troubleshooting your Node.js servers. They help you track errors in the application, discover performance optimization opportunities, and carry out different kinds of analysis on the system (such as in the case of outages or security issues) to make critical product decisions. Even though logging is an essential aspect of building robust web applications, it’s often ignored or glossed over in discussions about development best practices.