Back to Spark, Hadoop, and Snowflake for Data Engineering
Duke University

Spark, Hadoop, and Snowflake for Data Engineering

e.g. This is primarily aimed at first- and second-year undergraduates interested in engineering or science, along with high school students and professionals with an interest in programmingGain the skills for building efficient and scalable data pipelines. Explore essential data engineering platforms (Hadoop, Spark, and Snowflake) as well as learn how to optimize and manage them. Delve into Databricks, a powerful platform for executing data analytics and machine learning tasks, while honing your Python data science skills with PySpark. Finally, discover the key concepts of MLflow, an open-source platform for managing the end-to-end machine learning lifecycle, and learn how to integrate it with Databricks. This course is designed for learners who want to pursue or advance their career in data science or data engineering, or for software developers or engineers who want to grow their data management skill set. In addition to the technologies you will learn, you will also gain methodologies to help you hone your project management and workflow skills for data engineering, including applying Kaizen, DevOps, and Data Ops methodologies and best practices. With quizzes to test your knowledge throughout, this comprehensive course will help guide your learning journey to become a proficient data engineer, ready to tackle the challenges of today's data-driven world.

Status: Big Data
Status: PySpark
AdvancedCourse30 hours

Featured reviews

VD

5.0Reviewed Jan 15, 2024

A course that cover all aspects basic of data engineer, i love it

MK

5.0Reviewed Aug 6, 2024

Great course, detailed steps by step walkthrough that really simplifies understanding

All reviews

Showing: 20 of 23

Lilian Do Khac
3.0
Reviewed Apr 11, 2024
Nela Brockington
4.0
Reviewed Jan 12, 2024
Gerardo Zelaya
3.0
Reviewed Feb 21, 2024
FRANCISCO MANUEL BARRIOS PANIAGUA
2.0
Reviewed Apr 1, 2025
Othmani zeineb
1.0
Reviewed Jan 24, 2024
Gaurav Dani
3.0
Reviewed Aug 16, 2024
Ricardo Martinez
1.0
Reviewed Mar 11, 2024
Fareed Ansari
1.0
Reviewed Sep 18, 2024
Rick Kaptein
3.0
Reviewed Jan 24, 2024
Mike K
5.0
Reviewed Aug 7, 2024
Valentin Domé
5.0
Reviewed Jan 16, 2024
Joseph Chilango
5.0
Reviewed Mar 2, 2026
Daniel Medeiros Rocha
5.0
Reviewed Jul 7, 2024
Hovhannes Arustamyan
5.0
Reviewed Apr 17, 2024
Yimmi Alexander Moreno Alviar
5.0
Reviewed Jun 17, 2024
David Mares
5.0
Reviewed Sep 9, 2025
CG - DIAZ SANTOS JONATHAN
5.0
Reviewed Sep 14, 2024
Victor Chliapnikov
5.0
Reviewed Jan 29, 2024
Gianluca Giraudo
4.0
Reviewed Nov 8, 2025
Amir Boltaev
3.0
Reviewed Jul 21, 2025