Back to Mathematics for Machine Learning: PCA

4.0

stars

1,910 ratings

•

455 reviews

This intermediate-level course introduces the mathematical foundations to derive Principal Component Analysis (PCA), a fundamental dimensionality reduction technique. We'll cover some basic statistics of data sets, such as mean values and variances, we'll compute distances and angles between vectors using inner products and derive orthogonal projections of data onto lower-dimensional subspaces. Using all these tools, we'll then derive PCA as a method that minimizes the average squared reconstruction error between data points and their reconstruction.
At the end of this course, you'll be familiar with important mathematical concepts and you can implement PCA all by yourself. If you’re struggling, you'll find a set of jupyter notebooks that will allow you to explore properties of the techniques and walk you through what you need to do to get on track. If you are already an expert, this course may refresh some of your knowledge.
The lectures, examples and exercises require:
1. Some ability of abstract thinking
2. Good background in linear algebra (e.g., matrix and vector algebra, linear independence, basis)
3. Basic background in multivariate calculus (e.g., partial derivatives, basic optimization)
4. Basic knowledge in python programming and numpy
Disclaimer: This course is substantially more abstract and requires more programming than the other two courses of the specialization. However, this type of abstract thinking, algebraic manipulation and programming is necessary if you want to understand and develop machine learning algorithms....

Jul 17, 2018

This is one hell of an inspiring course that demystified the difficult concepts and math behind PCA. Excellent instructors in imparting the these knowledge with easy-to-understand illustrations.

Jun 19, 2020

Relatively tougher than previous two courses in the specialization. I'd suggest giving more time and being patient in pursuit of completing this course and understanding the concepts involved.

Filter by:

By Sai M B

•Aug 03, 2020

The lectures were not clear. I had to use other sources to understand lectures.

By Pawan K S

•Jun 20, 2020

This course was the hardest I encountered in this specialisation.

By Kirill T

•Jul 26, 2020

Way worse than the previous courses. Lacks explanations

By Aravindan B

•Sep 24, 2019

Need to improve the content and delivery of content.

By Mohammed A A

•Jul 19, 2020

the course is too shallow with difficult code exame

By Scoodood

•Jul 28, 2018

Video lecture not as intuitive as previous courses.

By Michael B

•Nov 21, 2019

Programming assignments not well explained

By youssef s a s

•Jul 27, 2020

very poor explanation of things

By Salah E

•Aug 04, 2020

again too hard

By ABHI G

•Aug 22, 2018

not so good

:(

By Pradeep K

•Apr 30, 2020

Very Poor course on PCA, My recommendation. Don't watch it, Please don't waste your money on it.

Reasons:

1) The course on algebra and calculus was intuitive geometrically and well taught. Here the instructor bothered only doing derivations. No intuition based thinking, no analogy to real world. Just plain hard notations.

2) I don't think even the instructor would understand what was taught in the course. The excercises were completely unrelated to what was taught. Not much given examples. The examples choosen uses values like 0,1,2. Why can't you pick some odd numbers to make it bit more non confusion and clear.

3) At the end there was a review / Survey for every course. The review for this course is disabled. Clearly everyone knows how bad this is. Remove this course or make it better that is what the recommendation. There is no provision for zero stars, Had there one I would not given that also.

Really frustrated with the PCA course. Please don't waste your time and money . Get Gilbert Strang's book. That will do justice for every penny. I was able to complete the course, All thanks to Gilbert's book on Linear Algebra. Thanks

By Ivan F G

•Jul 01, 2020

The technical issues with Jupyter Notebooks really made me waste too many days, a lot of my time not learning but just fighting a poorly implemented exercise. And the technical issues did not help the teacher, the notebooks had a role to give us a place to learn new concepts that he mentioned in the fly, but there were no small sets of data to test the functions. I wasn't very patient with the way he will say things like "this is the formula from the previous video", and show a different formula from what he had on the previous video. Really? Why making things obscure on purpose? You can just have said, we had our previous formula and them used properties of the transpose of a product to get this other formula. Please make an effort to redo the notebooks. Even better, do some of the examples in Phyton during class for what you do in paper, and then let us take those examples and make a general function on the notebooks. Give smaller databases, something easy to plot and test, without waiting 20+minutes to have a result.

By Alistair K

•May 16, 2020

The instructor is extremely dry and monosyllabic and does a very poor job of explaining topics, he frequently introduces topics by jumping straight into formulas without bothering to explain the topic or the use of the subject he is supposed to be explaining.

The majority of lectures are no more that the lecturer reading our a formula parrot-fashion onto the screen, he makes no effort to make the subject informative or explain what is going on. In many cases, he doesn't even bother creating a lecture, he simply posts a link to Wikipedia.

Lectures, quizzes and assignments are littered with bugs and omissions.

A negative mark on an otherwise excellent specialisation. This lecturer has no place teaching, he made the whole subject unapproachable.

By Pavel S

•Dec 13, 2019

The course has two problems:

complete lack of participation of staff in maintaining it. This leads to students giving each other incorrect advice and sharing incorrect code which passes the grader function check ( the grades are assigned automatically). The advice students give each other are frankly so wrong it is shocking.

the teacher focuses on formalised proof rather than concepts. Hence the lectures turn into lecturer applying mathematical transfomations which end in a formal argument without any intuitive understanding of the underlying subject. This course is the worst of the module with linear algebra and multivariate calculus being much better

By Alan

•Aug 04, 2020

Very disappointing compared to the other courses. Recommend a complete revision of the course materials. Quizzes often had nothing to do with the preceding video. I worked through a week two quiz using the extensive notes in the discussion forum and by searching the internet. The next lecture proceeded in the same vein: the instructor failed to cover the material in video leaving me to figure out what the material was and then figure out how to find that material on the internet or in reference books. At that point, it just was not worth the time to take the course.

By 熊华东

•Jun 08, 2018

This course is far far far behind my expectations.The other two course in the specializition is fantastic. There is no visualization in this course, Instructor is always doing his algebra, concepts are poorly explained. I can't understand a lot of concepts in this course because of my poor math background.But why do i take ths course if i have a solid background in math? Programming assignments is not difficult but hard to complete because of vaguely clarification.Plenty of time wasted to find what should i do, its' really frustrating.

By Raghav G

•Jul 13, 2020

The course is very monotonic and boring and it is quite difficult to understand much of what the extremely mathematical terms that the instructor does. I am an M.Sc. Mathematics student and even I could not understand nor enjoy more than half of the course. I would strongly advise against taking this course, however the other two courses from this specialization are good and interesting.

By Horacio G D

•Jul 31, 2019

Feedback for the assignments sucks! The discussion forums don't help. I have to submit the last assignment last 6 times until it work, and I still don't know why my previous versions didn't pass. Other than that, the lectures are actually very good, but the only one worth the time is the fourth one, the other three are just the first course (Linear Algebra) all over again.

By Galina F

•Jan 08, 2020

Mathematical concepts are clear, but no explanation how to apply them to python to solve machine learning ussies. But you need this for python assignments.

Scripts checking assignments work uncorrectly such a way that one can submit the same piece of working(!) code and get 0/10 and then submit the same code and get 10/10.

All in all, it's very annoying and disappointing.

By Matt C

•Jul 01, 2018

I was expecting to learn a lot in this course. I did not. The lectures don't really explain much at all and then you're thrown a quizzes and assignments that do not match what was in the actual lectures. The rest of the specialization was great but this course falls of the other two.The explanations in the videos are very poor. Really disappointed.

By Cynthia M

•Jun 09, 2018

The course is mathematics for Machine Learning. Yet, they require that you are proficient in python. I understand the mathematics. However, no one will answer my questions on the python we are suppose to code. I passed both of the previous courses. I've taken and passed Statistics with python on edX. I've very disappointed in this course.

By Kannan S

•Apr 11, 2018

There are no numerical examples as the course progresses. The instructor does everything algebraically. As a result I was not able appreciate the practical use of PCA. Later on I saw there are very nice videos in Youtube that illustrate the concept more lucidly using numerical examples. I am disappointed.

By Yan Z

•Oct 13, 2019

Marc Peter Deisenroth jumps too much at the important computation steps. Some steps might be simple to him, but it could be very misleading to students.

Often times, he will just throw out some equations without letting the student know what exactly we are trying to achieve.

By Kristina S

•Aug 24, 2018

One of the worst online courses I have had. Inconsistent teaching, relaying on students having previous knowledge about Python and rads (where the heck did that come from?), failing to convey what and where this is practically used for.

- AI for Everyone
- Introduction to TensorFlow
- Neural Networks and Deep Learning
- Algorithms, Part 1
- Algorithms, Part 2
- Machine Learning
- Machine Learning with Python
- Machine Learning Using Sas Viya
- R Programming
- Intro to Programming with Matlab
- Data Analysis with Python
- AWS Fundamentals: Going Cloud Native
- Google Cloud Platform Fundamentals
- Site Reliability Engineering
- Speak English Professionally
- The Science of Well Being
- Learning How to Learn
- Financial Markets
- Hypothesis Testing in Public Health
- Foundations of Everyday Leadership

- Deep Learning
- Python for Everybody
- Data Science
- Applied Data Science with Python
- Business Foundations
- Architecting with Google Cloud Platform
- Data Engineering on Google Cloud Platform
- Excel to MySQL
- Advanced Machine Learning
- Mathematics for Machine Learning
- Self-Driving Cars
- Blockchain Revolution for the Enterprise
- Business Analytics
- Excel Skills for Business
- Digital Marketing
- Statistical Analysis with R for Public Health
- Fundamentals of Immunology
- Anatomy
- Managing Innovation and Design Thinking
- Foundations of Positive Psychology