ETL and Data Pipelines with Shell, Airflow and Kafka
Completed by SHU CEN LIN
April 26, 2024
17 hours (approximately)
SHU CEN LIN's account is verified. Coursera certifies their successful completion of ETL and Data Pipelines with Shell, Airflow and Kafka
What you will learn
Describe and contrast Extract, Transform, Load (ETL) processes and Extract, Load, Transform (ELT) processes.
Explain batch vs concurrent modes of execution.
Implement ETL workflow through bash and Python functions.
Describe data pipeline components, processes, tools, and technologies.
Skills you will gain
- Category: Data Lakes
- Category: Data Cleansing
- Category: Data Integration
- Category: Performance Tuning
- Category: Command-Line Interface
- Category: Shell Script
- Category: Data Processing
- Category: Bash (Scripting Language)
- Category: Data Pipelines
- Category: Extract, Transform, Load
- Category: Data Mart
- Category: Apache Kafka
