In this course, you will explore various types of source systems, learn how they generate and update data, and troubleshoot common issues you might encounter when trying to connect to these systems in the real world. You’ll dive into the details of common ingestion patterns and implement batch and streaming pipelines. You’ll automate and orchestrate your data pipelines using infrastructure as code and pipelines as code tools. You’ll also explore AWS and open source tools for monitoring your data systems and data quality.
Source Systems, Data Ingestion, and Pipelines


Source Systems, Data Ingestion, and Pipelines
This course is part of DeepLearning.AI Data Engineering Professional Certificate

Instructor: Joe Reis
Top Instructor
Access provided by Trybe
12,456 already enrolled
134 reviews
Recommended experience
What you'll learn
Gather stakeholder needs and translate them into system requirements.
Implement a batch and a streaming ingestion process on AWS to ingest data from various source systems.
Integrate aspects of security, data management, DataOps and orchestration into the data systems you build.
Skills you'll gain
Tools you'll learn
Details to know

Add to your LinkedIn profile
4 assignments
See how employees at top companies are mastering in-demand skills

Build your Cloud Computing expertise
- Learn new concepts from industry experts
- Gain a foundational understanding of a subject or tool
- Develop job-relevant skills with hands-on projects
- Earn a shareable career certificate from DeepLearning.AI

There are 4 modules in this course
Earn a career certificate
Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.
Instructor

Why people choose Coursera for their career

Felipe M.

Jennifer J.

Larry W.

Chaitanya A.
Learner reviews
- 5 stars
89.55%
- 4 stars
4.47%
- 3 stars
0%
- 2 stars
3.73%
- 1 star
2.23%
Showing 3 of 134
Reviewed on Jan 18, 2025
great learning and exercises. appreciate the community.
Reviewed on Nov 23, 2024
Really valuable, and I got an idea of data-related concepts and infrastructure management.
Reviewed on Mar 23, 2025
best course and best projects to practice for data engineering


