About this Course
The lectures of this course are based on the first 11 chapters of Prof. Raymond Yeung’s textbook entitled Information Theory and Network Coding (Springer 2008). This book and its predecessor, A First Course in Information Theory (Kluwer 2002, essentially the first edition of the 2008 book), have been adopted by over 60 universities around the world as either a textbook or reference text. At the completion of this course, the student should be able to: 1) Demonstrate knowledge and understanding of the fundamentals of information theory. 2) Appreciate the notion of fundamental limits in communication systems and more generally all systems. 3) Develop deeper understanding of communication systems. 4) Apply the concepts of information theory to various disciplines in information science.
Globe

100% online course

Start instantly and learn at your own schedule.
Clock

Approx. 49 hours to complete

Suggested: 6 hours/week
Comment Dots

English

Subtitles: English
Globe

100% online course

Start instantly and learn at your own schedule.
Clock

Approx. 49 hours to complete

Suggested: 6 hours/week
Comment Dots

English

Subtitles: English

Syllabus - What you will learn from this course

1

Section
Clock
15 minutes to complete

Course Preliminaries

...
Reading
1 video (Total 5 min), 1 reading
Video1 videos
Reading1 readings
Grading Scheme10m
Clock
7 minutes to complete

Chapter 1 Information Measures

...
Reading
2 videos (Total 7 min)
Video2 videos
Chapter 16m
Clock
3 hours to complete

Chapter 2 Information Measures - Part 1

...
Reading
6 videos (Total 38 min), 1 reading, 1 quiz
Video6 videos
Chapter 2 - Section 2.1 B5m
Chapter 2 - Section 2.1 C4m
Chapter 2 - Section 2.218m
Chapter 2 - Section 2.33m
Assignment 1 Video Preview0m
Reading1 readings
Homework Assignment 1 Solution10m

2

Section
Clock
3 hours to complete

Chapter 2 Information Measures - Part 2

...
Reading
8 videos (Total 74 min), 1 reading, 1 quiz
Video8 videos
Chapter 2 - Section 2.45m
Chapter 2 - Section 2.512m
Chapter 2 - Section 2.67m
Chapter 2 - Section 2.711m
Chapter 2 - Section 2.816m
Chapter 2 - Section 2.1019m
Assignment 2 Video Preview0m
Reading1 readings
Homework Assignment 2 Solution10m

3

Section
Clock
3 hours to complete

Chapter 3 The I-Measure - Part 1

...
Reading
7 videos (Total 50 min), 1 reading, 1 quiz
Video7 videos
Chapter 3 - Section 3.18m
Chapter 3 - Section 3.3 A15m
Chapter 3 - Section 3.3 B9m
Chapter 3 - Section 3.47m
Chapter 3 - Section 3.5 A7m
Assignment 3 Video Preview0m
Reading1 readings
Homework Assignment 3 Solution10m

4

Section
Clock
1 hour to complete

Chapter 3 The I-Measure - Part 2

...
Reading
4 videos (Total 39 min)
Video4 videos
Chapter 3 - Section 3.5 B12m
Chapter 3 - Section 3.6 A12m
Chapter 3 - Section 3.6 B11m
Clock
3 hours to complete

Chapter 4 Zero-Error Data Compression - Part 1

...
Reading
3 videos (Total 34 min), 1 reading, 1 quiz
Video3 videos
Chapter 4 - Section 4.2 A15m
Assignment 4 Video Preview0m
Reading1 readings
Homework Assignment 4 Solution10m

5

Section
Clock
1 hour to complete

Chapter 4 Zero-Error Data Compression - Part 2

...
Reading
4 videos (Total 52 min)
Video4 videos
Chapter 4 - Section 4.2 B16m
Chapter 4 - Section 4.2 C9m
Chapter 4 - Section 4.324m
Clock
3 hours to complete

Chapter 5 Weak Typicality

...
Reading
3 videos (Total 30 min), 1 reading, 1 quiz
Video3 videos
Chapter 5 -Section 5.210m
Assignment 5 Video Preview0m
Reading1 readings
Homework Assignment 5 Solution10m

6

Section
Clock
3 hours to complete

Chapter 6 Strong Typicality

...
Reading
8 videos (Total 70 min), 1 reading, 1 quiz
Video8 videos
Chapter 6 - Section 6.1 A4m
Chapter 6 - Section 6.1 B17m
Chapter 6 - Section 6.29m
Chapter 6 - Section 6.3 A13m
Chapter 6 - Section 6.3 B18m
Chapter 6 - Section 6.45m
Assignment 6 Video Preview0m
Reading1 readings
Homework Assignment 6 Solution10m

7

Section
Clock
3 hours to complete

Chapter 7 Discrete Memoryless Channels - Part 1

...
Reading
7 videos (Total 71 min), 1 reading, 1 quiz
Video7 videos
Chapter 7 - Section 7.1 A14m
Chapter 7 - Section 7.1 B18m
Chapter 7 - Section 7.28m
Chapter 7 - Section 7.3 A13m
Chapter 7 - Section 7.3 B13m
Assignment 7 Video Preview0m
Reading1 readings
Homework Assignment 7 Solution10m

8

Section
Clock
3 hours to complete

Chapter 7 Discrete Memoryless Channels - Part 2

...
Reading
7 videos (Total 55 min), 1 reading, 1 quiz
Video7 videos
Chapter 7 - Section 7.4 A13m
Chapter 7 - Section 7.4 B16m
Chapter 7 - Section 7.54m
Chapter 7 - Section 7.613m
Chapter 7 - Section 7.75m
Assignment 8 Video Preview0m
Reading1 readings
Homework Assignment 8 Solution10m

9

Section
Clock
3 hours to complete

Chapter 8 Rate-Distortion Theory - Part 1

...
Reading
7 videos (Total 62 min), 1 reading, 1 quiz
Video7 videos
Chapter 8 - Section 8.113m
Chapter 8 - Section 8.29m
Chapter 8 - Section 8.3 A9m
Chapter 8 - Section 8.3 B19m
Chapter 8 - Section 8.49m
Assignment 9 Video Preview0m
Reading1 readings
Homework Assignment 9 Solution10m

10

Section
Clock
28 minutes to complete

Chapter 8 Rate-Distortion Theory - Part 2

...
Reading
3 videos (Total 28 min)
Video3 videos
Chapter 8 - Section 8.5 A16m
Chapter 8 - Section 8.5 B10m
Clock
3 hours to complete

Chapter 9 The Blahut-Arimoto Algorithms - Part 1

...
Reading
4 videos (Total 34 min), 1 reading, 1 quiz
Video4 videos
Chapter 9 - Section 9.2 A12m
Chapter 9 - Section 9.2 B11m
Assignment 10 Video Preview0m
Reading1 readings
Homework Assignment 10 Solution10m

11

Section
Clock
28 minutes to complete

Chapter 9 The Blahut-Arimoto Algorithms - Part 2

...
Reading
3 videos (Total 28 min)
Video3 videos
Chapter 9 - Section 9.2 C12m
Chapter 9 - Section 9.314m
Clock
3 hours to complete

Chapter 10 Differential Entropy - Part 1

...
Reading
3 videos (Total 31 min), 1 reading, 1 quiz
Video3 videos
Chapter 10 - Section 10.1 B19m
Assignment 11 Video Preview0m
Reading1 readings
Homework Assignment 11 Solution10m

12

Section
Clock
3 hours to complete

Chapter 10 Differential Entropy - Part 2

...
Reading
8 videos (Total 69 min), 1 reading, 1 quiz
Video8 videos
Chapter 10 - Section 10.215m
Chapter 10 - Section 10.3 A14m
Chapter 10 - Section 10.3 B7m
Chapter 10 - Section 10.43m
Chapter 10 - Section 10.51m
Chapter 10 - Section 10.624m
Assignment 12 Video Preview0m
Reading1 readings
Homework Assignment 12 Solution10m

13

Section
Clock
3 hours to complete

Chapter 11 Continuous-Valued Channels - Part 1

...
Reading
6 videos (Total 46 min), 1 reading, 1 quiz
Video6 videos
Chapter 11 - Section 11.115m
Chapter 11 - Section 11.24m
Chapter 11 - Section 11.3 A18m
Chapter 11 - Section 11.3 B7m
Assignment 13 Video Preview0m
Reading1 readings
Homework Assignment 13 Solution10m

14

Section
Clock
3 hours to complete

Chapter 11 Continuous-Valued Channels - Part 2

...
Reading
5 videos (Total 42 min), 1 reading, 1 quiz
Video5 videos
Chapter 11 - Section 11.413m
Chapter 11 - Section 11.516m
Chapter 11 - Section 11.610m
Assignment 14 Video Preview0m
Reading1 readings
Homework Assignment 14 Solution10m

15

Section
Clock
3 hours to complete

Chapter 11 Continuous-Valued Channels - Part 3

...
Reading
6 videos (Total 60 min), 1 reading, 1 quiz
Video6 videos
Chapter 11 - Section 11.7 A18m
Chapter 11 - Section 11.7 B13m
Chapter 11 - Section 11.811m
Chapter 11 - Section 11.915m
Assignment 15 Video Preview0m
Reading1 readings
Homework Assignment 15 Solution10m

Instructor

Avatar

Prof. Raymond W. Yeung

Choh-Ming Li Professor of Information Engineering, and Co-Director, Institute of Network Coding

About The Chinese University of Hong Kong

Founded in 1963, The Chinese University of Hong Kong (CUHK) is a forward looking comprehensive research university with a global vision and a mission to combine tradition with modernity, and to bring together China and the West. CUHK teachers and students hail from all corners of the world. CUHK graduates are connected worldwide through an expansive alumni network....

Frequently Asked Questions

  • Once you enroll for a Certificate, you’ll have access to all videos, quizzes, and programming assignments (if applicable). Peer review assignments can only be submitted and reviewed once your session has begun. If you choose to explore the course without purchasing, you may not be able to access certain assignments.

  • If you pay for this course, you will have access to all of the features and content you need to earn a Course Certificate. If you complete the course successfully, your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile. Note that the Course Certificate does not represent official academic credit from the partner institution offering the course.

  • Yes! Coursera provides financial aid to learners who would like to complete a course but cannot afford the course fee. To apply for aid, select "Learn more and apply" in the Financial Aid section below the "Enroll" button. You'll be prompted to complete a simple application; no other paperwork is required.

More questions? Visit the Learner Help Center