About this Course
61,229 recent views

100% online

Start instantly and learn at your own schedule.

Flexible deadlines

Reset deadlines in accordance to your schedule.

Advanced Level

Approx. 39 hours to complete

Suggested: 6 weeks of study, 3-6 hours/week for base track, 6-9 with all the horrors of honors section...

English

Subtitles: English, Korean

100% online

Start instantly and learn at your own schedule.

Flexible deadlines

Reset deadlines in accordance to your schedule.

Advanced Level

Approx. 39 hours to complete

Suggested: 6 weeks of study, 3-6 hours/week for base track, 6-9 with all the horrors of honors section...

English

Subtitles: English, Korean

Learners taking this Course are

  • Data Scientists
  • Machine Learning Engineers
  • Research Assistants
  • Researchers
  • Scientists

Syllabus - What you will learn from this course

Week
1
5 hours to complete

Intro: why should i care?

13 videos (Total 84 min), 8 readings, 3 quizzes
13 videos
Reinforcement learning vs all3m
Multi-armed bandit4m
Decision process & applications6m
Markov Decision Process5m
Crossentropy method9m
Approximate crossentropy method5m
More on approximate crossentropy method6m
Evolution strategies: core idea6m
Evolution strategies: math problems5m
Evolution strategies: log-derivative trick8m
Evolution strategies: duct tape6m
Blackbox optimization: drawbacks4m
8 readings
What you're getting into1m
Setting up course environment10m
Note: this course vs github course1m
Lecture slides10m
Course teaser placeholder10m
Primers1m
About honors track1m
Extras10m
Week
2
3 hours to complete

At the heart of RL: Dynamic Programming

5 videos (Total 54 min), 2 readings, 4 quizzes
5 videos
State and Action Value Functions13m
Measuring Policy Optimality6m
Policy: evaluation & improvement10m
Policy and value iteration8m
2 readings
Advanced Reward Design10m
Discrete Stochastic Dynamic Programming10m
3 practice exercises
Reward design8m
Optimality in RL10m
Policy Iteration14m
Week
3
5 hours to complete

Model-free methods

6 videos (Total 47 min), 1 reading, 4 quizzes
6 videos
Monte-Carlo & Temporal Difference; Q-learning8m
Exploration vs Exploitation8m
Footnote: Monte-Carlo vs Temporal Difference2m
Accounting for exploration. Expected Value SARSA.11m
On-policy vs off-policy; Experience replay7m
1 reading
Extras10m
1 practice exercise
Model-free reinforcement learning10m
Week
4
5 hours to complete

Approximate Value Based Methods

9 videos (Total 104 min), 3 readings, 5 quizzes
9 videos
Loss functions in value based RL11m
Difficulties with Approximate Methods15m
DQN – bird's eye view9m
DQN – the internals9m
DQN: statistical issues6m
Double Q-learning6m
More DQN tricks10m
Partial observability17m
3 readings
TD vs MC10m
Extras10m
DQN follow-ups10m
3 practice exercises
MC & TD8m
SARSA and QLeaning8m
DQN12m
4.1
67 ReviewsChevron Right

33%

started a new career after completing these courses

56%

got a tangible career benefit from this course

33%

got a pay increase or promotion

Top reviews from Practical Reinforcement Learning

By AKMay 28th 2019

This is one of the Best Course available on Reinforcement Learning. I have gone through various study material but the depth and practical knowledge given in the course is awesome.

By FZFeb 14th 2019

A great course with very practical assignments to help you learn how to implement RL algorithms. But it also has some stupid quiz questions which makes you feel confusing.

Instructors

Avatar

Pavel Shvechikov

Researcher at HSE and Sberbank AI Lab
HSE Faculty of Computer Science
Avatar

Alexander Panin

Lecturer
HSE Faculty of Computer Science

About National Research University Higher School of Economics

National Research University - Higher School of Economics (HSE) is one of the top research universities in Russia. Established in 1992 to promote new research and teaching in economics and related disciplines, it now offers programs at all levels of university education across an extraordinary range of fields of study including business, sociology, cultural studies, philosophy, political science, international relations, law, Asian studies, media and communicamathematics, engineering, and more. Learn more on www.hse.ru...

About the Advanced Machine Learning Specialization

This specialization gives an introduction to deep learning, reinforcement learning, natural language understanding, computer vision and Bayesian methods. Top Kaggle machine learning practitioners and CERN scientists will share their experience of solving real-world problems and help you to fill the gaps between theory and practice. Upon completion of 7 courses you will be able to apply modern machine learning methods in enterprise and understand the caveats of real-world data and settings....
Advanced Machine Learning

Frequently Asked Questions

  • Once you enroll for a Certificate, you’ll have access to all videos, quizzes, and programming assignments (if applicable). Peer review assignments can only be submitted and reviewed once your session has begun. If you choose to explore the course without purchasing, you may not be able to access certain assignments.

  • When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile. If you only want to read and view the course content, you can audit the course for free.

More questions? Visit the Learner Help Center.