ETL and Data Pipelines with Shell, Airflow and Kafka
Completed by Diwei Bao
March 1, 2025
17 hours (approximately)
Diwei Bao's account is verified. Coursera certifies their successful completion of ETL and Data Pipelines with Shell, Airflow and Kafka
What you will learn
Describe and contrast Extract, Transform, Load (ETL) processes and Extract, Load, Transform (ELT) processes.
Explain batch vs concurrent modes of execution.
Implement ETL workflow through bash and Python functions.
Describe data pipeline components, processes, tools, and technologies.
Skills you will gain
- Category: Data Integration
- Category: Apache Airflow
- Category: Performance Tuning
- Category: Data Lakes
- Category: Data Mart
- Category: Shell Script
- Category: Data Warehousing
- Category: Extract, Transform, Load
- Category: Data Processing
- Category: Command-Line Interface
- Category: Bash (Scripting Language)
- Category: Data Cleansing
