Chevron Left
Back to ETL and Data Pipelines with Shell, Airflow and Kafka

Learner Reviews & Feedback for ETL and Data Pipelines with Shell, Airflow and Kafka by IBM

4.8
stars
37 ratings
9 reviews

About the Course

After taking this course, you will be able to describe two different approaches to converting raw data into analytics-ready data. One approach is the Extract, Transform, Load (ETL) process. The other contrasting approach is the Extract, Load, and Transform (ELT) process. ETL processes apply to data warehouses and data marts. ELT processes apply to data lakes, where the data is transformed on demand by the requesting/calling application. Both ETL and ELT extract data from source systems, move the data through the data pipeline, and store the data in destination systems. During this course, you will experience how ELT and ETL processing differ and identify use cases for both. You will identify methods and tools used for extracting the data, merging extracted data either logically or physically, and for importing data into data repositories. You will also define transformations to apply to source data to make the data credible, contextual, and accessible to data users. You will be able to outline some of the multiple methods for loading data into the destination system, verifying data quality, monitoring load failures, and the use of recovery mechanisms in case of failure. Finally, you will complete a shareable final project that enables you to demonstrate the skills you acquired in each module....

Top reviews

Filter by:

1 - 9 of 9 Reviews for ETL and Data Pipelines with Shell, Airflow and Kafka

By Nataliya S

Oct 12, 2021

Thanks to IBM and Coursera for the great "ETL and Data Pipelines with Shell, Airflow and Kafka" course, that I passed with Grade Achieved: 100%. It's the third course, that I've passed, as a part of "IBM Data Engineering Specialization". I was so carried away by the course that I literally sat up until 2 am almost every day. In this course I could apply my knowledge of Python, Pandas, SQL, Bash commands to build ETL Batch and Stream pipelines.

By Evgeny D

Sep 29, 2021

I​t's one of the most challenging courses I've been enrolled!

By Dmitry K

Sep 17, 2021

Buggy practice. Not possible to complete without fixing airflow start script yourself. Nobody monitor or fixing issues here

By RLee

Jan 13, 2022

The final project to connect Airflow as a pipeline management tool to Kafka server is a very useful hands-on project. More details or explanations on the syntax of Python calling Kafka producer and consumer, which are in the files of toll_traffic_generator.py and streaming_data_reader.py, would be more valuable rather than just providing these two files to run on its own.

By Ilya K

Jan 13, 2022

Perfect environment to make experiments! Very easy and powerful in use.

By Natale F

Dec 15, 2021

Interesting course with enough labs.

By Hugo A O O

Dec 6, 2021

i really liked the labs

By Omar H

Jan 26, 2022

It's great introduction for airflow and kafka but still an introduction it is shallow doesn't offer much but at the end you will understand what you need to continue further in both technologies.

By YANGYANG C

Jan 17, 2022

Love the labs, but do not like the robotic lectures.