Image and Video Processing: From Mars to Hollywood with a Stop at the Hospital

4.7
stars
970 ratings

Guillermo Sapiro

Offered By

Image and Video Processing: From Mars to Hollywood with a Stop at the Hospital

Duke University

About this Course

In this course, you will learn the science behind how digital images and video are made, altered, stored, and used. We will look at the vast world of digital imaging, from how computers and digital cameras form images to how digital special effects are used in Hollywood movies to how the Mars Rover was able to send photographs across millions of miles of space.
The course starts by looking at how the human visual system works and then teaches you about the engineering, mathematics, and computer science that makes digital images work. You will learn the basic algorithms used for adjusting images, explore JPEG and MPEG standards for encoding and compressing video images, and go on to learn about image segmentation, noise removal and filtering. Finally, we will end with image processing techniques used in medicine.
 
This course consists of 7 basic modules and 2 bonus (non-graded) modules. There are optional MATLAB exercises; learners will have access to MATLAB Online for the course duration. Each module is independent, so you can follow your interests.

Learner Career Outcomes

25%

started a new career after completing these courses

14%

got a tangible career benefit from this course

14%

got a pay increase or promotion

Shareable Certificate

Earn a Certificate upon completion

100% online

Start instantly and learn at your own schedule.

Flexible deadlines

Reset deadlines in accordance to your schedule.

Approx. 21 hours to complete

English

Subtitles: Arabic, French, Portuguese (European), Chinese (Simplified), Italian, Vietnamese, German, Russian, English, Spanish

Skills you will gain

Image ProcessingImage CompressionImage RestorationImage Segmentation

Learner Career Outcomes

25%

started a new career after completing these courses

14%

got a tangible career benefit from this course

14%

got a pay increase or promotion

Shareable Certificate

Earn a Certificate upon completion

100% online

Start instantly and learn at your own schedule.

Flexible deadlines

Reset deadlines in accordance to your schedule.

Approx. 21 hours to complete

English

Subtitles: Arabic, French, Portuguese (European), Chinese (Simplified), Italian, Vietnamese, German, Russian, English, Spanish

Instructor

Instructor rating

4.8/5 (88 Ratings)

Guillermo Sapiro

Professor

Electrical and Computer Engineering

49,042 Learners

1 Course

Offered by

Duke University

Duke University has about 13,000 undergraduate and graduate students and a world-class faculty helping to expand the frontiers of knowledge. The university has a strong commitment to applying knowledge in service to society, both near its North Carolina campus and around the world.

Syllabus - What you will learn from this course

Content Rating96%(4,554 ratings)

Week

Week 1

2 hours to complete

Introduction to image and video processing

Learn what is image and video processing. Learn the very basic concepts of human perception needed for understanding image processing. Learn simple tools in signal processing needed to understand following units.

2 hours to complete

8 videos (Total 94 min), 1 reading, 1 quiz

8 videos

0 - Welcome and Start Here33s

1 - What is image and video processing (part 1)10m

1 - What is image and video processing (part 2)10m

2 - Course logistics2m

3 - Images are everywhere - Duration 06:316m

4 - Human visual system - Duration 17:1017m

5 - Image formation - Sampling & Quantization - Duration 28:1728m

6 - Simple image operations - Duration 17:0517m

1 reading

Optional programming exercises10m

1 practice exercise

Quiz #130m

Week

Week 2

3 hours to complete

Image and video compression

JPEG and MPEG are the most successful algorithms in the area, widely used by everybody in a daily basis, and the goal of this unit is to understand how they work. Also to understand why these techniques are important and why they are enabling technologies. Also will describe what is done in the Mars expedition.

3 hours to complete

7 videos (Total 114 min), 1 reading, 1 quiz

7 videos

1 - The why and how of compression - Duration 14:1614m

2 - Huffman coding - Duration 20:11 - Optional break at 06:5320m

3 - JPEG's 8x8 blocks - Duration 05:375m

4 - The Discrete Cosine Transform (DCT) - Duration 25:32 - Optional break at 12:1325m

5 - Quantization - Duration 24:02 - Optional breaks at 08:48 and 17:1824m

6 - JPEG_LS and MPEG - Duration 19:32 - Optional break at 13:4519m

7 - Bonus: Run-length compression - Duration 04:294m

1 reading

Optional programming exercises10m

1 practice exercise

Quiz #230m

Week

Week 3

3 hours to complete

Spatial processing

Some of the most basic tools in image processing, like median filtering and histogram equalization, are still among the most powerful. We will describe these and provide a modern interpretation of these basic tools. Students will then become familiar with simple and still popular approaches. We will also include non-local means, a more modern technique that still uses classical tools.

3 hours to complete

14 videos (Total 114 min), 1 reading, 1 quiz

14 videos

1 - Introduction to image enhancement - Duration 19:11 - Optional break at 08:3319m

2 - Demo - Enhancement & Histogram modification - Duration 03:533m

3 - Histogram equalization - Duration 19:56 - Optional breaks at 04:40 and 11:3019m

4 - Histogram matching - Duration 08:318m

5 - Introduction to local neighborhood operations - Duration 06:466m

6 - Mathematical properties of averaging - Duration 11:0011m

7 - Non-Local means - Duration 07:277m

8 - IPOL Demo - Non-Local means - Duration 03:383m

9 - Median filter - Duration 07:207m

10 - Demo - Median filter - Duration 01:311m

11 - Derivatives, Laplacian & Unsharp masking - Duration 14:24 - Optional breaks at 05:21 and 11:3314m

12 - Demo - Unsharp masking - Duration 03:103m

13 - Gradients of scalar and vector images - Duration 05:575m

14 - Concluding remarks - Duration 01:121m

1 reading

Optional programming exercises10m

1 practice exercise

Quiz #330m

Week

Week 4

2 hours to complete

Image restoration

The goal of this unit is to complement Unit 3 by adding prior information about the sources of degradation. Students will learn that if we know about the degradation process, we can do better. The objective of this unit is to complete the training with basic and powerful classical tools.

2 hours to complete

9 videos (Total 67 min), 1 reading, 1 quiz

9 videos

1 - What is image restoration - Duration 07:497m

2 - Noise types - Duration 12:4312m

3 - Demo - Types of noise - Duration 03:033m

4 - Noise and histograms - Duration 04:524m

5 - Estimating noise - Duration 10:41 - Optional break at 05:0310m

6 - Degradation Function - Duration 11:4011m

7 - Wiener filtering - Duration 12:34 - Optional break at 06:5412m

8 - Demo - Wiener and Box filters - Duration 03:193m

9 - Concluding remarks - Duration 00:3333s

1 reading

Optional programming exercises10m

1 practice exercise

Quiz #430m

Week

Week 5

3 hours to complete

Image segmentation

Not all parts of the image are the same, and students will learn the basic techniques to partition an image, from simple threshold to more advanced graph cuts and active contours. This is the first unit where student will learn about image analysis and image interpretation, and will learn why this is important, e.g., in medical imaging and object recognition.

3 hours to complete

12 videos (Total 123 min), 1 reading, 1 quiz

12 videos

1 - Introduction to Segmentation - Duration 04:174m

2 - On Edges and Regions - Duration 05:175m

3 - Hough Transform with Matlab Demo - Duration 20:5920m

4 - Line Segment Detector with Demo - Duration 03:203m

5 - Otsu's Segmentation with Demo - Duration 14:2514m

6 - Congratulations - Duration 00:1717s

7 - Interactive Image Segmentation - Duration 21:1321m

8 - Graph Cuts and Ms Office - Duration 09:349m

9 - Mumford-Shah - Duration 05:505m

10 - Active Contours - Introduction with ipol.im and Photoshop Demos - Duration 05:585m

11 - Behind the Scenes of Adobe's Roto Brush - Duration 31:29 - Optional breaks at 20:30 and 27:2631m

12 - End of the Week - Duration 00:2121s

1 reading

Optional programming exercises10m

1 practice exercise

Quiz #530m

Week

Week 6

3 hours to complete

Geometric PDEs

This is all optional material. It will help the students that are more mathematically oriented and want to better understand the math behind next unit's lectures. But you will be able to handle without it.The quiz is therefore practice only.This is the first “advanced” unit and smoothly follows from the previous one. Students will learn very modern tools, widely used today, and will contrast with units 3,4 to illustrate how significantly more advanced mathematical tools are also very useful in image and video analysis. We will connect some of these advanced tools with classical ones, e.g., average with heat flow and median with anisotropic diffusion. This will help to provide unified views to the students.

3 hours to complete

9 videos (Total 168 min), 1 reading, 1 quiz

9 videos

1 - Introduction to PDEs in Image and Video Processing - Duration 10:2210m

2 - Planar Differential Geometry - Duration 38:33 - Optional breaks at 12:46, 21:03, and 29:4138m

3 - Surface Differential Geometry - Duration 11:4311m

4 - Curve Evolution - Duration 31:10 - Optional breaks at 08:50, 19:25, and 24:2231m

5 - Level Sets and Curve Evolution - Duration 25:34 - Optional break at 14:3025m

6 - Calculus of Variations - Duration 14:03 - Optional break at 06:2314m

7 - Anisotropic Diffusion - Duration 11:1711m

8 - Active Contours - Duration 16:57 - Optional break at 06:2316m

9 - Bonus: Cool Contrast Enhancement via PDEs - Duration 08:328m

1 reading

Optional programming exercises10m

1 practice exercise

Quiz #630m

Week

Week 7

2 hours to complete

Image and video inpainting

Students will get involved with a very exciting topic, since image and video inpainting is one of the most used tools in the movie industry. They will learn the problem, and also how they can approach it from multiple directions. This will also help to illustrate how the same problem can be approached from multiple mathematical angles. We will connect this with Shanon’s work providing yet another angle. If you watched the lectures on PDEs you will have more mathematical background, but you will enjoy this unit and learn without it as well.

2 hours to complete

7 videos (Total 66 min), 1 reading, 1 quiz

7 videos

1 - Introduction to Image Inpainting - Duration 08:168m

2 - Inpainting in Nature - Duration 05:015m

3 - PDEs and Inpainting - Duration 21:59 - Optional break at 13:3121m

4 - Inpainting via Calculus of Variations - Duration 15:32 - Optional break at 10:0615m

5 - Smart Cut and Paste - Duration 07:517m

6 - Demo - Photoshop Inpainting Healing Brush - Duration 02:312m

7 - Video Inpainting and Conclusions - Duration 05:135m

1 reading

Optional programming exercises10m

1 practice exercise

Quiz #730m

Week

Week 8

3 hours to complete

Sparse modeling and compressed sensing

Here the goal is to present one of the most modern tools in image and video processing, and students will learn something that is today at the top of active research. This will also help to illustrate the use of linear algebra and optimization in image and video processing. This is the last formal unit of the course.

3 hours to complete

8 videos (Total 128 min), 1 reading, 1 quiz

8 videos

1 - Introduction to Sparse Modeling - Part 1 - Duration 10:3910m

2 - Introduction to Sparse Modeling - Part 2 - Duration 18:1618m

3 - Sparse Modeling - Implementation - Duration 24:30 - Optional break at 11:5824m

4 - Dictionary Learning - Duration 17:13 - Optional break at 06:0317m

5 - Sparse Modeling Image Processing Examples - Duration 20:57 - Optional break at 09:2520m

6 - A Note on Compressed Sensing - Duration 05:105m

7 - GMM and Structured Sparsity - Duration 15:4015m

8 - Bonus: Sparse Modeling and Classification - Activity Recognition - Duration 15:1015m

1 reading

Optional programming exercises10m

1 practice exercise

Quiz #830m

Week

Week 9

1 hour to complete

Medical imaging

This is a bonus unit. Enjoy it. Image processing has been very successful in medical imaging, and we will use examples from HIV and brain research to illustrate the importance of image processing in solving societal problems. We will describe the basic tools in these exciting applications, from the acquisition to the analysis.

1 hour to complete

5 videos (Total 75 min)

Reviews

4.7

187 reviews

5 stars
79.27%
4 stars
16.28%
3 stars
2.47%
2 stars
0.72%
1 star
1.23%

Frequently Asked Questions

When will I have access to the lectures and assignments?
Access to lectures and assignments depends on your type of enrollment. If you take a course in audit mode, you will be able to see most course materials for free. To access graded assignments and to earn a Certificate, you will need to purchase the Certificate experience, during or after your audit. If you don't see the audit option:
The course may not offer an audit option. You can try a Free Trial instead, or apply for Financial Aid.
The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I purchase the Certificate?
When you purchase a Certificate you get access to all course materials, including graded assignments. Upon completing the course, your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile. If you only want to read and view the course content, you can audit the course for free.
Is financial aid available?
Yes, Coursera provides financial aid to learners who cannot afford the fee. Apply for it by clicking on the Financial Aid link beneath the "Enroll" button on the left. You’ll be prompted to complete an application and will be notified if you are approved. Learn more.
Will I have fun?
Yes
Do I need strong math background for this class?
Some but not much. If you have you will get a more in depth understanding. We hope you know linear algebra for example. Again, some concepts you will grasp even without strong mathematical background. Some will consider this an advanced undergrad class.
Who uses image processing in industry?
Who doesn't?
Do I need any programming skills?
We suggest some optional (not graded) programming exercises. The forums discuss them a lot and this is fun.
Will I receive a transcript from Duke University for completing this course?
No. Completion of a Coursera course does not earn you academic credit from Duke; therefore, Duke is not able to provide you with a university transcript. However, your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Will I earn university credit for completing the Course?
This Course doesn't carry university credit, but some universities may choose to accept Course Certificates for credit. Check with your institution to learn more. Online Degrees and Mastertrack™ Certificates on Coursera provide the opportunity to earn university credit.

More questions? Visit the Learner Help Center.

Image and Video Processing: From Mars to Hollywood with a Stop at the Hospital

Image and Video Processing: From Mars to Hollywood with a Stop at the Hospital

About this Course

Learner Career Outcomes

25%

14%

14%

Skills you will gain

Learner Career Outcomes

25%

14%

14%

Instructor

Guillermo Sapiro

Offered by

Duke University

Syllabus - What you will learn from this course

Week 1

Introduction to image and video processing

Week 2

Image and video compression

Week 3

Spatial processing

Week 4

Image restoration

Week 5

Image segmentation

Week 6

Geometric PDEs

Week 7

Image and video inpainting

Week 8

Sparse modeling and compressed sensing

Week 9

Medical imaging

Reviews

TOP REVIEWS FROM IMAGE AND VIDEO PROCESSING: FROM MARS TO HOLLYWOOD WITH A STOP AT THE HOSPITAL

Frequently Asked Questions

Coursera Footer

Top Online Courses

Top Online Specializations

Online Certificates

Online Degree Programs

Coursera

Community

More