Fundamentals of Parallelism on Intel Architecture

Intel

About this Course

20,696 recent views

This course will introduce you to the multiple forms of parallelism found in modern Intel architecture processors and teach you the programming frameworks for handling this parallelism in applications.  You will get access to a cluster of modern manycore processors (Intel Xeon Phi architecture) for experiments with graded programming exercises.
This course can apply to various HPC and datacenter workloads and framework including artificial intelligence (AI). You will learn how to handle data parallelism with vector instructions, task parallelism in shared memory with threads, parallelism in distributed memory with message passing, and memory architecture parallelism with optimized data containers. This knowledge will help you to accelerate computational applications by orders of magnitude, all the while keeping your code portable and future-proof.

Prerequisite: programming in C/C++ or Fortran in the Linux environment and Linux shell proficiency (navigation, file copying, editing files in text-based editors, compilation).

Shareable Certificate

Earn a Certificate upon completion

100% online

Start instantly and learn at your own schedule.

Flexible deadlines

Reset deadlines in accordance to your schedule.

Intermediate Level

Approx. 15 hours to complete

English

Subtitles: English

Skills you will gain

Distributed ComputingComputer ArchitectureOpenmpParallel Computing

Shareable Certificate

Earn a Certificate upon completion

100% online

Start instantly and learn at your own schedule.

Flexible deadlines

Reset deadlines in accordance to your schedule.

Intermediate Level

Approx. 15 hours to complete

English

Subtitles: English

Instructor

Instructor rating

4.7/5 (69 Ratings)

Andrey Vladimirov

Head of High-Performance Computing Research

Colfax International

12,862 Learners

1 Course

Offered by

Intel

The Intel® Developer Zone offers tools and how-to information to enable cross-platform app development through platform and technology information, code samples, and peer expertise in order to help developers innovate and succeed. Join communities for the Internet of Things, Artificial Intelligence, Virtual Reality, Persistent Memory & Game Dev to download tools, access dev kits, share ideas with like-minded developers, and participate in hackathons, contests, roadshows, and local events.

Syllabus - What you will learn from this course

Content Rating97%(1,031 ratings)

Week

Week 1

3 hours to complete

Modern Code

In the Introduction we will learn...

3 hours to complete

7 videos (Total 41 min), 1 reading, 3 quizzes

7 videos

1.0 Introduction3m

1.1 Why this course?5m

1.2 How Computers Get Faster6m

1.3 Intel Architecture6m

1.4 Modern Code5m

1.5 What You Are Going To Learn1m

1.6 Remote Access11m

1 reading

Modern Code10m

1 practice exercise

Modern code30m

Week

Week 2

3 hours to complete

Vectorization

3 hours to complete

13 videos (Total 72 min), 3 readings, 2 quizzes

13 videos

2.1 Vector Operations5m

2.2 Vectorizing Your Code5m

2.3.1 Automatic Vectorization5m

2.3.2 Will This Vectorize?15m

2.4 Guided Automatic Vectorization4m

2.8.1 Stencil Introduction2m

2.8 Stencil9m

2.5 SIMD-Enabled Functions3m

2.6 Vector Dependence5m

2.7 Strip Mining1m

Numerical Integration Introduction2m

2.9 Integral Vectorization8m

2.10 Learn More1m

3 readings

Vectorization10m

Code Download10m

1 practice exercise

Vectorization30m

Week

Week 3

3 hours to complete

Multithreading with OpenMP

3 hours to complete

10 videos (Total 41 min), 3 readings, 2 quizzes

10 videos

3.1 Cores and Threads3m

Demo: Forks9m

3.2 Creating Threads4m

3.3 Variable Sharing1m

3.4 Parallel Loops5m

3.5 Data Races Mutexes4m

3.7 Parallel Reduction4m

Stencil Introduction2m

Stencil Demonstration3m

Learn More1m

3 readings

Multithreading with OpenMP10m

Code Download10m

1 practice exercise

OpenMP30m

Week

Week 4

3 hours to complete

Memory Traffic

3 hours to complete

14 videos (Total 57 min), 3 readings, 2 quizzes

14 videos

4.1 Cheap Flops6m

4.2 Memory Hierarchy7m

4.3 High Bandwidth Memory3m

4.4 Memory Allocation1m

Stencil Introduction2m

Demo: Stencil with numactl3m

Demo: Stencil with Memkind3m

4.5 Bypassing Caches2m

Stencil Demonstration-Nontemporal1m

Stencil Demonstration-Char3m

4.6 Locality in Space7m

4.7 Locality in Time8m

Integral Introduction2m

Integral Demonstration28s

3 readings

Memory Traffic10m

Code Download10m

1 practice exercise

Memory traffic30m

Frequently Asked Questions

When will I have access to the lectures and assignments?
Access to lectures and assignments depends on your type of enrollment. If you take a course in audit mode, you will be able to see most course materials for free. To access graded assignments and to earn a Certificate, you will need to purchase the Certificate experience, during or after your audit. If you don't see the audit option:
The course may not offer an audit option. You can try a Free Trial instead, or apply for Financial Aid.
The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I purchase the Certificate?
When you purchase a Certificate you get access to all course materials, including graded assignments. Upon completing the course, your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile. If you only want to read and view the course content, you can audit the course for free.
Is financial aid available?
Yes, Coursera provides financial aid to learners who cannot afford the fee. Apply for it by clicking on the Financial Aid link beneath the "Enroll" button on the left. You’ll be prompted to complete an application and will be notified if you are approved. Learn more.
Will I earn university credit for completing the Course?
This Course doesn't carry university credit, but some universities may choose to accept Course Certificates for credit. Check with your institution to learn more. Online Degrees and Mastertrack™ Certificates on Coursera provide the opportunity to earn university credit.

More questions? Visit the Learner Help Center.

Fundamentals of Parallelism on Intel Architecture

Fundamentals of Parallelism on Intel Architecture