ETL and Data Pipelines with Shell, Airflow and Kafka
Completed by Mengyuan Liu
October 8, 2024
17 hours (approximately)
Mengyuan Liu's account is verified. Coursera certifies their successful completion of ETL and Data Pipelines with Shell, Airflow and Kafka
What you will learn
Describe and contrast Extract, Transform, Load (ETL) processes and Extract, Load, Transform (ELT) processes.
Explain batch vs concurrent modes of execution.
Implement ETL workflow through bash and Python functions.
Describe data pipeline components, processes, tools, and technologies.
Skills you will gain
- Category: Apache Airflow
- Category: Shell Script
- Category: Performance Tuning
- Category: Extract, Transform, Load
- Category: Data Integration
- Category: Bash (Scripting Language)
- Category: Data Warehousing
- Category: Data Cleansing
- Category: Data Pipelines
- Category: Data Processing
- Category: Data Mart
- Category: Data Lakes
