The lectures of this course are based on the first 11 chapters of Prof. Raymond Yeung’s textbook entitled Information Theory and Network Coding (Springer 2008). This book and its predecessor, A First Course in Information Theory (Kluwer 2002, essentially the first edition of the 2008 book), have been adopted by over 60 universities around the world as either a textbook or reference text.
At the completion of this course, the student should be able to:
1) Demonstrate knowledge and understanding of the fundamentals of information theory.
2) Appreciate the notion of fundamental limits in communication systems and more generally all systems.
3) Develop deeper understanding of communication systems.
4) Apply the concepts of information theory to various disciplines in information science.
What's included
1 video1 reading
Show info about module content
1 video•Total 5 minutes
About this course•5 minutes
1 reading•Total 10 minutes
Grading Scheme•10 minutes
Chapter 1 Information Measures
Module 2•7 minutes to complete
Module details
What's included
2 videos
Show info about module content
2 videos•Total 7 minutes
Week 1 Introduction•1 minute
Chapter 1•6 minutes
Chapter 2 Information Measures - Part 1
Module 3•3 hours to complete
Module details
What's included
6 videos1 reading1 peer review
Show info about module content
6 videos•Total 38 minutes
Chapter 2 - Section 2.1 A•5 minutes
Chapter 2 - Section 2.1 B•6 minutes
Chapter 2 - Section 2.1 C•4 minutes
Chapter 2 - Section 2.2•19 minutes
Chapter 2 - Section 2.3•4 minutes
Assignment 1 Video Preview•0 minutes
1 reading•Total 10 minutes
Homework Assignment 1 Solution•10 minutes
1 peer review•Total 120 minutes
Homework Assignment 1 Submission•120 minutes
Chapter 2 Information Measures - Part 2
Module 4•2 hours to complete
Module details
What's included
8 videos1 reading1 peer review
Show info about module content
8 videos•Total 74 minutes
Week 2 Introduction•1 minute
Chapter 2 - Section 2.4•5 minutes
Chapter 2 - Section 2.5•13 minutes
Chapter 2 - Section 2.6•8 minutes
Chapter 2 - Section 2.7•11 minutes
Chapter 2 - Section 2.8•16 minutes
Chapter 2 - Section 2.10•19 minutes
Assignment 2 Video Preview•0 minutes
1 reading•Total 10 minutes
Homework Assignment 2 Solution•10 minutes
1 peer review•Total 60 minutes
Homework Assignment 2 Submission•60 minutes
Chapter 3 The I-Measure - Part 1
Module 5•2 hours to complete
Module details
What's included
7 videos1 reading1 peer review
Show info about module content
7 videos•Total 50 minutes
Week 3 Introduction•1 minute
Chapter 3 - Section 3.1•8 minutes
Chapter 3 - Section 3.3 A•16 minutes
Chapter 3 - Section 3.3 B•10 minutes
Chapter 3 - Section 3.4•7 minutes
Chapter 3 - Section 3.5 A•8 minutes
Assignment 3 Video Preview•0 minutes
1 reading•Total 10 minutes
Homework Assignment 3 Solution•10 minutes
1 peer review•Total 60 minutes
Homework Assignment 3 Submission•60 minutes
Chapter 3 The I-Measure - Part 2
Module 6•1 hour to complete
Module details
What's included
4 videos
Show info about module content
4 videos•Total 39 minutes
Week 4 Introduction•2 minutes
Chapter 3 - Section 3.5 B•12 minutes
Chapter 3 - Section 3.6 A•13 minutes
Chapter 3 - Section 3.6 B•11 minutes
Chapter 4 Zero-Error Data Compression - Part 1
Module 7•3 hours to complete
Module details
What's included
3 videos1 reading1 peer review
Show info about module content
3 videos•Total 34 minutes
Chapter 4 - Section 4.1•18 minutes
Chapter 4 - Section 4.2 A•16 minutes
Assignment 4 Video Preview•0 minutes
1 reading•Total 10 minutes
Homework Assignment 4 Solution•10 minutes
1 peer review•Total 120 minutes
Homework Assignment 4 Submission•120 minutes
Chapter 4 Zero-Error Data Compression - Part 2
Module 8•1 hour to complete
Module details
What's included
4 videos
Show info about module content
4 videos•Total 52 minutes
Week 5 Introduction•2 minutes
Chapter 4 - Section 4.2 B•16 minutes
Chapter 4 - Section 4.2 C•9 minutes
Chapter 4 - Section 4.3•25 minutes
Chapter 5 Weak Typicality
Module 9•3 hours to complete
Module details
What's included
3 videos1 reading1 peer review
Show info about module content
3 videos•Total 30 minutes
Chapter 5 - Section 5.1•19 minutes
Chapter 5 -Section 5.2•11 minutes
Assignment 5 Video Preview•0 minutes
1 reading•Total 10 minutes
Homework Assignment 5 Solution•10 minutes
1 peer review•Total 120 minutes
Homework Assignment 5 Submission•120 minutes
Chapter 6 Strong Typicality
Module 10•2 hours to complete
Module details
What's included
8 videos1 reading1 peer review
Show info about module content
8 videos•Total 70 minutes
Week 6 - Introduction•1 minute
Chapter 6 - Section 6.1 A•5 minutes
Chapter 6 - Section 6.1 B•18 minutes
Chapter 6 - Section 6.2•9 minutes
Chapter 6 - Section 6.3 A•13 minutes
Chapter 6 - Section 6.3 B•19 minutes
Chapter 6 - Section 6.4•5 minutes
Assignment 6 Video Preview•0 minutes
1 reading•Total 10 minutes
Homework Assignment 6 Solution•10 minutes
1 peer review•Total 60 minutes
Homework Assignment 6 Submission•60 minutes
Chapter 7 Discrete Memoryless Channels - Part 1
Module 11•2 hours to complete
Module details
What's included
7 videos1 reading1 peer review
Show info about module content
7 videos•Total 71 minutes
Week 7 Introduction•2 minutes
Chapter 7 - Section 7.1 A•15 minutes
Chapter 7 - Section 7.1 B•19 minutes
Chapter 7 - Section 7.2•8 minutes
Chapter 7 - Section 7.3 A•14 minutes
Chapter 7 - Section 7.3 B•13 minutes
Assignment 7 Video Preview•0 minutes
1 reading•Total 10 minutes
Homework Assignment 7 Solution•10 minutes
1 peer review•Total 60 minutes
Homework Assignment 7 Submission•60 minutes
Chapter 7 Discrete Memoryless Channels - Part 2
Module 12•2 hours to complete
Module details
What's included
7 videos1 reading1 peer review
Show info about module content
7 videos•Total 55 minutes
Week 8 Introduction•1 minute
Chapter 7 - Section 7.4 A•13 minutes
Chapter 7 - Section 7.4 B•17 minutes
Chapter 7 - Section 7.5•4 minutes
Chapter 7 - Section 7.6•14 minutes
Chapter 7 - Section 7.7•6 minutes
Assignment 8 Video Preview•0 minutes
1 reading•Total 10 minutes
Homework Assignment 8 Solution•10 minutes
1 peer review•Total 60 minutes
Homework Assignment 8 Submission•60 minutes
Chapter 8 Rate-Distortion Theory - Part 1
Module 13•2 hours to complete
Module details
What's included
7 videos1 reading1 peer review
Show info about module content
7 videos•Total 62 minutes
Week 9 Introduction•1 minute
Chapter 8 - Section 8.1•14 minutes
Chapter 8 - Section 8.2•10 minutes
Chapter 8 - Section 8.3 A•9 minutes
Chapter 8 - Section 8.3 B•19 minutes
Chapter 8 - Section 8.4•9 minutes
Assignment 9 Video Preview•0 minutes
1 reading•Total 10 minutes
Homework Assignment 9 Solution•10 minutes
1 peer review•Total 60 minutes
Homework Assignment 9 Submission•60 minutes
Chapter 8 Rate-Distortion Theory - Part 2
Module 14•28 minutes to complete
Module details
What's included
3 videos
Show info about module content
3 videos•Total 28 minutes
Week 10 Introduction•1 minute
Chapter 8 - Section 8.5 A•17 minutes
Chapter 8 - Section 8.5 B•10 minutes
Chapter 9 The Blahut-Arimoto Algorithms - Part 1
Module 15•2 hours to complete
Module details
What's included
4 videos1 reading1 peer review
Show info about module content
4 videos•Total 34 minutes
Chapter 9 - Section 9.1•10 minutes
Chapter 9 - Section 9.2 A•13 minutes
Chapter 9 - Section 9.2 B•12 minutes
Assignment 10 Video Preview•0 minutes
1 reading•Total 10 minutes
Homework Assignment 10 Solution•10 minutes
1 peer review•Total 60 minutes
Homework Assignment 10 Submission•60 minutes
Chapter 9 The Blahut-Arimoto Algorithms - Part 2
Module 16•28 minutes to complete
Module details
What's included
3 videos
Show info about module content
3 videos•Total 28 minutes
Week 11 Introduction•1 minute
Chapter 9 - Section 9.2 C•13 minutes
Chapter 9 - Section 9.3•14 minutes
Chapter 10 Differential Entropy - Part 1
Module 17•2 hours to complete
Module details
What's included
3 videos1 reading1 peer review
Show info about module content
3 videos•Total 31 minutes
Chapter 10 - Section 10.1 A•11 minutes
Chapter 10 - Section 10.1 B•20 minutes
Assignment 11 Video Preview•0 minutes
1 reading•Total 10 minutes
Homework Assignment 11 Solution•10 minutes
1 peer review•Total 60 minutes
Homework Assignment 11 Submission•60 minutes
Chapter 10 Differential Entropy - Part 2
Module 18•2 hours to complete
Module details
What's included
8 videos1 reading1 peer review
Show info about module content
8 videos•Total 69 minutes
Week 12 Introduction•1 minute
Chapter 10 - Section 10.2•15 minutes
Chapter 10 - Section 10.3 A•15 minutes
Chapter 10 - Section 10.3 B•8 minutes
Chapter 10 - Section 10.4•4 minutes
Chapter 10 - Section 10.5•2 minutes
Chapter 10 - Section 10.6•24 minutes
Assignment 12 Video Preview•0 minutes
1 reading•Total 10 minutes
Homework Assignment 12 Solution•10 minutes
1 peer review•Total 60 minutes
Homework Assignment 12 Submission•60 minutes
Chapter 11 Continuous-Valued Channels - Part 1
Module 19•2 hours to complete
Module details
What's included
6 videos1 reading1 peer review
Show info about module content
6 videos•Total 46 minutes
Week 13 Introduction•1 minute
Chapter 11 - Section 11.1•15 minutes
Chapter 11 - Section 11.2•4 minutes
Chapter 11 - Section 11.3 A•19 minutes
Chapter 11 - Section 11.3 B•7 minutes
Assignment 13 Video Preview•0 minutes
1 reading•Total 10 minutes
Homework Assignment 13 Solution•10 minutes
1 peer review•Total 60 minutes
Homework Assignment 13 Submission•60 minutes
Chapter 11 Continuous-Valued Channels - Part 2
Module 20•3 hours to complete
Module details
What's included
5 videos1 reading1 peer review
Show info about module content
5 videos•Total 42 minutes
Week 14 Introduction•1 minute
Chapter 11 - Section 11.4•13 minutes
Chapter 11 - Section 11.5•17 minutes
Chapter 11 - Section 11.6•11 minutes
Assignment 14 Video Preview•0 minutes
1 reading•Total 10 minutes
Homework Assignment 14 Solution•10 minutes
1 peer review•Total 120 minutes
Homework Assignment 14 Submission•120 minutes
Chapter 11 Continuous-Valued Channels - Part 3
Module 21•3 hours to complete
Module details
What's included
6 videos1 reading1 peer review
Show info about module content
6 videos•Total 60 minutes
Week 15 Introduction•2 minutes
Chapter 11 - Section 11.7 A•19 minutes
Chapter 11 - Section 11.7 B•13 minutes
Chapter 11 - Section 11.8•11 minutes
Chapter 11 - Section 11.9•15 minutes
Assignment 15 Video Preview•0 minutes
1 reading•Total 10 minutes
Homework Assignment 15 Solution•10 minutes
1 peer review•Total 120 minutes
Homework Assignment 15 Submission•120 minutes
Instructor
Instructor ratings
Instructor ratings
We asked all learners to give feedback on our instructors based on the quality of their teaching style.
Founded in 1963, The Chinese University of Hong Kong (CUHK) is a forward looking comprehensive research university with a global vision and a mission to combine tradition with modernity, and to bring together China and the West. CUHK teachers and students hail from all corners of the world. CUHK graduates are connected worldwide through an expansive alumni network.
When will I have access to the lectures and assignments?
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I purchase the Certificate?
When you purchase a Certificate you get access to all course materials, including graded assignments. Upon completing the course, your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.