Systems | Development | Analytics | API | Testing

Latest Posts

What is File Transfer Protocol?

Transferring files between two or more machines is an essential part of the ETL (extract, transform, load) process. Of course, there are multiple ways to move data, including flat file databases. For example, you can physically copy the data onto a USB drive or send it to the recipient via email. But methods like these are far less efficient than sending data via FTP. So what is FTP exactly, and how do you use it to transfer files and data? Keep reading for all the answers.

What is Data as a Service (DaaS)?

As the amount of data companies are faced with snowballs, the need for efficient data governance grows. An increasing number of organizations are turning to cloud service providers for data management. In this context, data as a service, often referred to as DaaS, is becoming an essential tool for managing data integration, data storage, and data analytics.

The Complete Guide to GDPR Compliance

The General Data Protection Regulation (GDPR) is a landmark piece of legislation that affects how organizations can handle, process, and store the personal data of European Union (EU) citizens and residents. But what does the GDPR require exactly, and how can you be sure that your organization complies with it? We go over everything you need to know in this all-in-one guide to GDPR compliance.

Say Goodbye to Data Quality with ELT

ELT is a three-step process that first extracts raw, structured, and unstructured data from source databases, applications, data stores, and other repositories. It then loads that data into a data lake and transforms it as needed by analysts. Since it doesn't move the data to an intermediate staging area or transform it before loading, the extraction process is speedy. You don’t need to pick and choose what data loads into the data lake or wait for it to be processed.

PII Masking Can Protect Your Business

Businesses large and small depend on access to information in order to make smarter, data-driven decisions. And much of that data is personal, sensitive, or confidential. So how can you balance this demand for big data with the need to protect the individuals whom this data describes? When it comes to personally identifiable information (PII), there are multiple very good reasons why you should keep it securely under lock and key.

ETLT with Snowflake, dbt, and Xplenty

What do Xplenty, Snowflake software, and dbt (data build tool) have in common? When used together, they merge the best of ETL (extract, transform, load) and ELT (extract, load, transform) into a powerful, flexible and cost-effective ETLT (extract, transform, load, transform) strategy. In this guide, we’ll show you how to create an ETLT strategy with Xplenty, Snowflake software, and dbt. But first, we’ll explain why you'd want to use this strategy to build an ETLT data transformation stack.

How to Launch Your New Data Engineering Strategy

When you secure a new data engineering position, it’s important to get off on the right foot. You need to respond to new data sources, data types, data sets, and applications efficiently. In the era of Big Data, this can be more than challenging. During this early stage of your job transition, you need to impress, and you can do this by re-thinking your data engineering strategy.

10 Best Data Analysis Tools for Data Management

Data analysis is a key component for operating a successful business in today's tech-savvy world. When analyzing data sets, however, every business has its own needs. While some companies employ data scientists to work with complex big data, others have fewer and less complicated data sources that even non-technical users can navigate. Your specific needs will influence the type of tool your company chooses for data management.