Data Engineering: Beyond Big Data

Data QA: The Need of the Hour

Mage: Your New Go-To Tool for Data Orchestration

Apache Flink - A Solution for Real-Time Analytics

An Introduction to Stream Processing & Analytics

Modern Data Stack: The What, Why and How?

ClickHouse - The Newest Data Store in Your Big Data Arsenal

Building an ETL Workflow Using Apache NiFi and Hive

The blog is about building a data pipeline to extract, filter, transform, and load the data into Hive using Apache NiFi.

Unit Testing Data at Scale using Deequ and Apache Spark

Learn about the main features of AWS Lab’s Deequ and how it can be really useful and handy to ensure unit testing data.