When you enroll in this course, you'll also be asked to select a specific program.
Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate
There are 3 modules in this course
The modern data landscape demands professionals who can seamlessly bridge the gap between data lakes and data warehouses. This course transforms your ability to architect, implement, and optimize lakehouse platforms that deliver both flexibility and performance.
This Short Course was created to help data engineering professionals accomplish scalable data platform implementation using advanced SQL and lakehouse patterns.
By completing this course, you'll be able to register massive file-based datasets as queryable external tables, make informed decisions between Delta Lake, Iceberg, and Hudi formats, and automate robust data ingestion pipelines that keep your warehouse synchronized with your lake.
By the end of this course, you will be able to:
- Apply configurations to register file-based datasets as external tables
- Analyze the technical capabilities of different open-source table formats
- Create a data ingestion pipeline within a lakehouse architecture
This course is unique because it combines hands-on SQL implementation with strategic architectural decision-making, giving you both the technical skills and analytical framework needed for enterprise-scale data platforms.
To be successful in this course, you should have a background in SQL, data warehousing concepts, and distributed systems fundamentals.
Learners will master the technical implementation of external table configurations to enable direct querying of file-based datasets in cloud storage.
Learners will develop analytical frameworks to evaluate and compare the technical capabilities of Delta Lake, Apache Iceberg, and Apache Hudi for specific business requirements.
What's included
2 videos1 reading2 assignments
Show info about module content
2 videos•Total 13 minutes
Feature Comparison Matrix: Schema Evolution and Time Travel•5 minutes
Building Technical Capability Comparison Matrices•8 minutes
1 reading•Total 10 minutes
Comprehensive Analysis of Delta Lake, Iceberg, and Hudi Capabilities•10 minutes
2 assignments•Total 23 minutes
Develop Strategic Table Format Recommendation Framework•20 minutes
Table Format Analysis and Selection Knowledge Check•3 minutes
Module 3: Data Ingestion Pipeline Implementation
Module 3•1 hour to complete
Module details
Learners will architect and implement automated data ingestion pipelines that orchestrate data movement across medallion architecture zones within lakehouse platforms.
What's included
2 videos1 reading2 assignments1 ungraded lab
Show info about module content
2 videos•Total 10 minutes
The Cost of Manual Data Pipeline Management•3 minutes
COPY INTO Commands and Incremental Loading Strategies•7 minutes
1 reading•Total 10 minutes
Medallion Architecture and Pipeline Orchestration Patterns•10 minutes
2 assignments•Total 18 minutes
Data Ingestion Pipeline Implementation Knowledge Check•3 minutes
Lakehouse Data Pipeline Implementation Assessment•15 minutes
1 ungraded lab•Total 20 minutes
Build Automated Data Ingestion Pipeline for Lakehouse Architecture•20 minutes
Earn a career certificate
Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.
Coursera brings together a diverse network of subject matter experts who have demonstrated their expertise through professional industry experience or strong academic backgrounds. These instructors design and teach courses that make practical, career-relevant skills accessible to learners worldwide.
When will I have access to the lectures and assignments?
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Specialization?
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.