When you enroll in this course, you'll also be enrolled in this Specialization.
Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate
There are 4 modules in this course
With every smartphone and computer now boasting multiple processors, the use of functional ideas to facilitate parallel programming is becoming increasingly widespread. In this course, you'll learn the fundamentals of parallel programming, from task parallelism to data parallelism. In particular, you'll see how many familiar ideas from functional programming map perfectly to to the data parallel paradigm. We'll start the nuts and bolts how to effectively parallelize familiar collections operations, and we'll build up to parallel collections, a production-ready data parallel collections library available in the Scala standard library. Throughout, we'll apply these concepts through several hands-on examples that analyze real-world data, such as popular algorithms like k-means clustering.
Learning Outcomes. By the end of this course you will be able to:
- reason about task and data parallel programs,
- express common algorithms in a functional style and solve them in parallel,
- competently microbenchmark parallel code,
- write programs that effectively use parallel collections to achieve performance
Recommended background: You should have at least one year programming experience. Proficiency with Java or C# is ideal, but experience with other languages such as C/C++, Python, Javascript or Ruby is also sufficient. You should have some familiarity using the command line. This course is intended to be taken after Functional Program Design in Scala: https://www.coursera.org/learn/progfun2.
We motivate parallel programming and introduce the basic constructs for building parallel programs on JVM and Scala. Examples such as array norm and Monte Carlo computations illustrate these concepts. We show how to estimate work and depth of parallel programs as well as how to benchmark the implementations.
What's included
9 videos5 readings3 programming assignments
Show info about module content
9 videos•Total 106 minutes
Course Overview•2 minutes
Introduction to Parallel Computing•15 minutes
Parallelism on the JVM I•13 minutes
Parallelism on the JVM II•9 minutes
Running Computations in Parallel•13 minutes
Monte Carlo Method to Estimate Pi•4 minutes
First-Class Tasks•7 minutes
How Fast are Parallel Programs?•25 minutes
Benchmarking Parallel Programs•17 minutes
5 readings•Total 45 minutes
Working on Assignments•5 minutes
Tools Setup (Please read)•10 minutes
SBT tutorial and Submission of Assignments (Please read)•10 minutes
Cheat Sheet•10 minutes
Scala Style Guide•10 minutes
3 programming assignments•Total 540 minutes
Parallel Box Blur Filter•180 minutes
Example•180 minutes
Parallel Box Blur Filter•180 minutes
Basic Task Parallel Algorithms
Module 2•8 hours to complete
Module details
We continue with examples of parallel algorithms by presenting a parallel merge sort. We then explain how operations such as map, reduce, and scan can be computed in parallel. We present associativity as the key condition enabling parallel implementation of reduce and scan.
What's included
6 videos2 programming assignments
Show info about module content
6 videos•Total 100 minutes
Parallel Sorting•7 minutes
Data Operations and Parallel Mapping•19 minutes
Parallel Fold (Reduce) Operation•18 minutes
Associativity I•14 minutes
Associativity II•18 minutes
Parallel Scan (Prefix Sum) Operation•24 minutes
2 programming assignments•Total 360 minutes
Reductions and Prefix Sums•180 minutes
Reductions and Prefix Sums•180 minutes
Data-Parallelism
Module 3•7 hours to complete
Module details
We show how data parallel operations enable the development of elegant data-parallel code in Scala. We give an overview of the parallel collections hierarchy, including the traits of splitters and combiners that complement iterators and builders from the sequential case.
What's included
5 videos2 programming assignments
Show info about module content
5 videos•Total 51 minutes
Data-Parallel Programming•12 minutes
Data-Parallel Operations I•7 minutes
Data-Parallel Operations II•9 minutes
Scala Parallel Collections•16 minutes
Splitters and Combiners•8 minutes
2 programming assignments•Total 360 minutes
K-Means•180 minutes
K-Means•180 minutes
Data Structures for Parallel Computing
Module 4•7 hours to complete
Module details
We give a glimpse of the internals of data structures for parallel computing, which helps us understand what is happening under the hood of parallel collections.
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."
Learner reviews
4.4
1,844 reviews
5 stars
59.59%
4 stars
28.14%
3 stars
9.21%
2 stars
2.22%
1 star
0.81%
Showing 3 of 1844
S
SG
4·
Reviewed on Sep 16, 2016
Good explanations, relevant assignments. But too small, too little graded assignments as for subject. Be better if the assignments has less starter code.
R
RD
4·
Reviewed on Mar 31, 2017
Its a very good course! perhaps the in the practice code, before jumping into the problems they can provide a couple of simple examples/questions such that the main ideas are learnt.
Y
YS
4·
Reviewed on May 16, 2017
The assignment could be optimized and avoid to be more academic since it may make student lost focus and spend too much time on the question itself rather than the parallel programming
When will I have access to the lectures and assignments?
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Specialization?
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.