Back to Source Systems, Data Ingestion, and Pipelines
DeepLearning.AI

Source Systems, Data Ingestion, and Pipelines

In this course, you will explore various types of source systems, learn how they generate and update data, and troubleshoot common issues you might encounter when trying to connect to these systems in the real world. You’ll dive into the details of common ingestion patterns and implement batch and streaming pipelines. You’ll automate and orchestrate your data pipelines using infrastructure as code and pipelines as code tools. You’ll also explore AWS and open source tools for monitoring your data systems and data quality.

Status: Infrastructure as Code (IaC)
Status: Dataflow
IntermediateCourse34 hours

Featured reviews

TS

5.0Reviewed Nov 23, 2024

Really valuable, and I got an idea of data-related concepts and infrastructure management.

MK

5.0Reviewed Jan 18, 2025

great learning and exercises. appreciate the community.

DD

5.0Reviewed Mar 23, 2025

best course and best projects to practice for data engineering

IH

5.0Reviewed Nov 15, 2024

Excellent course, with up to date technology, interesting labs and challenging quizzes. Highly recommended.

DS

5.0Reviewed Sep 17, 2025

This course is great, a good approach to learning and development new skills about the tools in the data engineering market

FW

5.0Reviewed Dec 19, 2025

its good , time has change to write code urself , if you can understand code than you can do it

MH

5.0Reviewed Jun 8, 2025

to the point and clear information related to that how data systems work and ingestion process and pipleine that is the main crux of the data engineering

AH

5.0Reviewed Feb 5, 2026

full of professional data engineering knowledge. kudos to the team

YZ

5.0Reviewed Jul 12, 2025

Great overview of the data pipeline life cycle. If you are new to this area it gives you a good introduction and best practices from the beginning.

All reviews

Showing: 20 of 29

Syd Frederick
1.0
Reviewed Nov 1, 2024
Héctor Maldonado
2.0
Reviewed Nov 28, 2024
Younes ALOUANI
2.0
Reviewed Nov 17, 2024
Ronobir Das
4.0
Reviewed Dec 1, 2024
Francisco Zaragoza Lara
5.0
Reviewed Oct 24, 2024
oleg borovykh
1.0
Reviewed Nov 18, 2025
Aamir Khan
5.0
Reviewed Apr 28, 2025
Miguel Quintana
5.0
Reviewed Mar 18, 2025
João Paulo Coelho Pinto
5.0
Reviewed Jan 22, 2025
Eric Dario Marquez Leon
5.0
Reviewed Sep 14, 2025
Muhammad Hassan
5.0
Reviewed Jun 9, 2025
Ying Zou
5.0
Reviewed Jul 12, 2025
Diego Enrique Molina Sanchez
5.0
Reviewed Sep 17, 2025
Iain N Hosking
5.0
Reviewed Nov 15, 2024
Furqan Waris
5.0
Reviewed Dec 20, 2025
Tharuka Vishwajith Sarathchandra
5.0
Reviewed Nov 24, 2024
AKANO HAMMED
5.0
Reviewed Feb 6, 2026
Duc Duy Doan
5.0
Reviewed Mar 24, 2025
rashid ali
5.0
Reviewed Nov 20, 2024
Mutlu Kurtoglu
5.0
Reviewed Jan 19, 2025