Systems | Development | Analytics | API | Testing

Latest News

How-to: Index Data from S3 via NiFi Using CDP Data Hubs

Data Discovery and Exploration (DDE) was recently released in tech preview in Cloudera Data Platform in public cloud. In this blog we will go through the process of indexing data from S3 into Solr in DDE with the help of NiFi in Data Flow. The scenario is the same as it was in the previous blog but the ingest pipeline differs. Spark as the ingest pipeline tool for Search (i.e.

COVID-19, the Data Deluge and Optimizing Splunk for Time and Cost

The new normal has changed the way we work and the way we conduct business. More and more employees are working from home, customers are shopping online, and everyone’s phone is still attached to their ears. Bottom line: everything we’re doing in business and in our personal lives is leaving a digital trail. In fact, now devices are getting in the game and creating more data than people, 277 times more, according to Cisco.

What Grocers and CPG Companies Need to Know About Post-Pandemic Shopping

The COVID-19 pandemic has changed nearly everything. It’s affected nearly all Americans, and as such, it’s impacted every organization they interact with, both B2C and B2B. One industry that has had its operations turned upside down is the grocery industry. Grocery stores and their consumer packaged goods (CPG) suppliers and partners had to improvise and adapt nearly overnight to accommodate the changing demands of shoppers.

Qlik vs. Power BI - Free Doesn't Mean Freedom for Your Data or Users

Every professional has used Microsoft products in their work life. The ubiquity of Microsoft Office in the enterprise is one of the main reasons many analytics users are familiar with Power BI, given how the company bundles its business intelligence software with other licenses in the same way Excel and PowerPoint comes with Office.

You can now run projects in Keboola Connection for free

Over the past few months, we’ve been considering how to create a platform that’s accessible to everyone. With that said, we’re happy to announce that you can now use Keboola Connection for free! No contract, no talking to our (albeit incredibly lovely) sales team - just jump in and start building.

Accelerate your Hyperparameter Optimization with PyTorch's Ecosystem Tools

The design and training of neural networks are still challenging and unpredictable procedures. The difficulty of tuning these models makes training and reproducing more of an art than a science, based on the researcher’s knowledge and experience. One of the reasons for this difficulty is that the training procedure of machine learning models includes multiple hyperparameters that affect how the training process fits the model to the data.

George Fraser and Tristan Handy Discuss the Fivetran-Fishtown Partnership

In a Slack discussion, the two CEOs explain why the Fivetran-dbt integration is great for data analytics engineering enthusiasts. After the recent launch of Fivetran dbt Transformations, both the Fivetran and Fishtown Analytics teams received questions about the newly available feature. (Fishtown is the team behind dbt.) Fivetran CEO George Fraser and Fishtown Analytics CEO Tristan Handy addressed those questions on Slack, and discussed the harmonious relationship between the two companies.

Emery Sapp & Sons Builds Civil Infrastructure, Not Data Pipelines

Growing heavy civil construction business brings on a modern data stack of Fivetran, BigQuery and Looker to gain a competitive edge. Want to hear more from Emery Sapp & Son's Clayton Hicklin? Join him and a number of other incredible data professionals at the 2020 Modern Data Stack Conference October 21-22. Register here.

A Complete Guide to Choose Test Cases for Automation

Although automation testing is becoming more popular, there remain certain difficulties for automation teams, including selecting which test cases to automate. According to the World Quality Report in 2019, 24% of teams encounter obstacles prohibiting them from deciding on the right test scenario. This article will detail how to choose test cases for automation and maximize your testing journey.

Asynchronous Javascript: From Promises to Async/Await

Javascript is a funny language. It claims to be (and very much is) a single-threaded language (i.e., it executes statements in order, one at a time, one after another, in a synchronous fashion). Despite just having the one native thread to work with, it somehow allows you to write concurrent, asynchronous code that is non-blocking in nature.