Embark on a journey to master big data processing with Apache Spark and Scala. This course begins with setting up your development environment, ensuring you have a solid foundation in both Spark and Scala. You will dive into a Scala crash course that covers syntax, flow control, functions, and data structures, giving you the essential skills needed to work with Spark.
Give your career the gift of Coursera Plus with $160 off, billed annually. Save today.
Apache Spark with Scala – Hands-On with Big Data!
Instructor: Packt - Course Instructors
Included with
Recommended experience
What you'll learn
Design and implement advanced Spark applications tailored to complex data processing needs.
Develop and execute Spark scripts to process large datasets and stream real-time data.
Compare and optimize Spark algorithms for better performance in big data applications.
Assess machine learning models' effectiveness using Spark MLlib for accurate predictions.
Skills you'll gain
Details to know
Add to your LinkedIn profile
October 2024
4 assignments
See how employees at top companies are mastering in-demand skills
Earn a career certificate
Add this credential to your LinkedIn profile, resume, or CV
Share it on social media and in your performance review
There are 10 modules in this course
In this module, we will focus on installing the necessary tools like IntelliJ and Scala on your local system, followed by a brief introduction to the Apache Spark framework and its key concepts.
What's included
2 videos1 reading
In this module, we will dive into Scala programming, covering its unique syntax, control flow, and key data structures like Map and List. You’ll get plenty of practice to ensure you’re comfortable with the language before jumping into Spark.
What's included
4 videos
In this module, we will break down the structure and usage of RDDs, the building blocks of Spark applications. You’ll work on real-world examples, including building histograms and analyzing social network data.
What's included
13 videos1 assignment
In this module, we will introduce SparkSQL, DataFrames, and Datasets, which provide a higher-level abstraction for working with structured data. You’ll also compare and contrast the use of RDDs with these APIs.
What's included
9 videos
In this module, we will tackle advanced Spark programming examples, such as finding popular movies and superheroes in a social graph. We will also cover optimization techniques using broadcast variables and accumulators.
What's included
11 videos
In this module, we will move from running Spark on a local desktop to deploying and scaling it on a real cluster using Amazon Elastic MapReduce (EMR). You’ll learn how to submit jobs, manage dependencies, and troubleshoot issues.
What's included
9 videos1 assignment
In this module, we will explore Spark MLlib for machine learning. You’ll work through examples like generating movie recommendations and performing linear regression on large datasets.
What's included
6 videos
In this module, we will focus on real-time data processing using Spark Streaming. You’ll build streaming applications and learn to handle data in motion, both with DStreams and the newer Structured Streaming API.
What's included
6 videos
In this module, we will cover Spark’s GraphX library for graph-parallel processing, using it to explore social network data and understand how connected entities are through complex algorithms like breadth-first search.
What's included
3 videos1 assignment
In this final module, we will provide additional learning resources and give you tips on leveraging your new skills to advance your career in the field of big data.
What's included
1 video1 assignment
Instructor
Offered by
Recommended if you're interested in Data Management
École Polytechnique Fédérale de Lausanne
École Polytechnique Fédérale de Lausanne
Why people choose Coursera for their career
New to Data Management? Start here.
Open new doors with Coursera Plus
Unlimited access to 7,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription
Advance your career with an online degree
Earn a degree from world-class universities - 100% online
Join over 3,400 global companies that choose Coursera for Business
Upskill your employees to excel in the digital economy
Frequently asked questions
Yes, you can preview the first video and view the syllabus before you enroll. You must purchase the course to access content not included in the preview.
If you decide to enroll in the course before the session start date, you will have access to all of the lecture videos and readings for the course. You’ll be able to submit assignments once the session starts.
Once you enroll and your session begins, you will have access to all videos and other resources, including reading items and the course discussion forum. You’ll be able to view and submit practice assessments, and complete required graded assignments to earn a grade and a Course Certificate.