This course is all about big data. It’s for students with SQL experience that want to take the next step on their data journey by learning distributed computing using Apache Spark. Students will gain a thorough understanding of this open-source standard for working with large datasets. Students will gain an understanding of the fundamentals of data analysis using SQL on Spark, setting the foundation for how to combine data with advanced analytics at scale and in production environments. The four modules build on one another and by the end of the course you will understand: the Spark architecture, queries within Spark, common ways to optimize Spark SQL, and how to build reliable data pipelines.
This course is part of the Learn SQL Basics for Data Science Specialization
About this Course
What you will learn
Use the collaborative Databricks workspace to write scalable Spark SQL code that executes against a cluster of machines
Inspect the Spark UI to analyze query performance and identify bottlenecks
Create an end-to-end pipeline that reads data, transforms it, and saves the result
Build a medallion (bronze, silver, gold) lakehouse architecture with Delta Lake to ensure the reliability, scalability, and performance of your data
Skills you will gain
- Data Science
- Apache Spark
- Delta Lake
Syllabus - What you will learn from this course
Introduction to Spark
Spark Core Concepts
Engineering Data Pipelines
Data Lakes, Warehouses and Lakehouses
- 5 stars66.08%
- 4 stars23.13%
- 3 stars6.60%
- 2 stars1.91%
- 1 star2.26%
TOP REVIEWS FROM DISTRIBUTED COMPUTING WITH SPARK SQL
A good introduction to Spark SQL.
A pity that the course assignment was not very challenging but more focused on understanding of Spark itself.
Great introduction to Spark SQL and ML Flow. I love that they give extra resources if you want to learn more. It was a fun learning journey.
This has been an amazing course. What is worth mentioning is how the content was delivered. Nice hands on. Highly recommended for anyone who is new to Spark
I would like to thank all the instructors of the course and the Coursera team for preparing such a nice and very well understandable course for beginners.
About the Learn SQL Basics for Data Science Specialization
Frequently Asked Questions
When will I have access to the lectures and assignments?
What will I get if I subscribe to this Specialization?
What is the refund policy?
Is financial aid available?
More questions? Visit the Learner Help Center.