In this class you will learn the basic principles and tools used to process images and videos, and how to apply them in solving practical problems of commercial and scientific interests.
Digital images and videos are everywhere these days â€“ in thousands of scientific (e.g., astronomical, bio-medical), consumer, industrial, and artistic applications. Moreover they come in a wide range of the electromagnetic spectrum - from visible light and infrared to gamma rays and beyond. The ability to process image and video signals is therefore an incredibly important skill to master for engineering/science students, software developers, and practicing scientists. Digital image and video processing continues to enable the multimedia technology revolution we are experiencing today. Some important examples of image and video processing include the removal of degradations images suffer during acquisition (e.g., removing blur from a picture of a fast moving car), and the compression and transmission of images and videos (if you watch videos online, or share photos via a social media website, you use this everyday!), for economical storage and efficient transmission.
This course will cover the fundamentals of image and video processing. We will provide a mathematical framework to describe and analyze images and videos as two- and three-dimensional signals in the spatial, spatio-temporal, and frequency domains. In this class not only will you learn the theory behind fundamental processing tasks including image/video enhancement, recovery, and compression - but you will also learn how to perform these key processing tasks in practice using state-of-the-art techniques and tools. We will introduce and use a wide variety of such tools â€“ from optimization toolboxes to statistical techniques. Emphasis on the special role sparsity plays in modern image and video processing will also be given. In all cases, example images and videos pertaining to specific application domains will be utilized.

From the lesson

Signals and Systems

In this module we introduce the fundamentals of 2D signals and systems. Topics include complex exponential signals, linear space-invariant systems, 2D convolution, and filtering in the spatial domain.

So, in summary, what we have seen in the last two slides is that unlike

Â

the continuous time complex exponential which are always periodic

Â

in the time or spatial domain and not periodic in the frequency domain.

Â

The discrete time complex exponentials are periodic in the frequency domain and may

Â

or may not be periodic in the spatial or time domain as we just saw right here.

Â

To illustrate the previous 2 properties of a discrete cosine we show here an

Â

1 dimensional cosine function cosine omega n for values, values of a frequency omega.

Â

Now, omega, in all cases, involves pi therefore,

Â

this cosine is periodic in the time domain.

Â

Time is the horizontal axis.

Â

So discrete time, m, right?

Â

So, for example, here, for omega equals pi over 8, the period is

Â

2pi over omega, which is equal to 16.

Â

The period here is equal to 8, equal to 4, equal to 2 and so on.

Â

So the period keeps decreasing as you move

Â

to the right, therefore the frequency keeps increasing.

Â

So for omega equals 0.

Â

Cosine of 0 is equal to 1.

Â

This is the signal that does not have any other frequency other than the 0

Â

frequency, the busy signal where omega equals

Â

pi over 8 we that the frequency increases.

Â

We see, right from here to here, is one period of the signal.

Â

5 over 4 keep increasing and omega equals pi this is the

Â

highest possible frequency of the discrete cosine.

Â

And as a matter of fact cosine pi m equals to minus 1 to the n.

Â

So the values of the signal keep alternating.

Â

It switches from 1 to minus 1 and back to 1 and so on.

Â

So this is the highest possible variation of the signal.

Â

Now as the frequency keeps incre, increasing

Â

from omega plus pi to 2 pi, right?

Â

We see that the frequency of the variation of the cosine keeps decreasing.

Â

As a matter of fact this and this signal is identical,

Â

because 3 pi over 2, plus pi over 2, equals 2 pi.

Â

So these are two complementary angles and cosine of

Â

pi over 2 equals cosine of 2 pi minus pi over 2 which equals 3 pi over 2, right?

Â

So generally I have cosine a equals cosine of 2 pi minus a.

Â

Alright?

Â

And similarly, these two are the same

Â

signals and these two are the same signals.

Â

So the, this particular discrete cosine is periodic the

Â

time domain because we chose the frequency omega carefully.

Â

And then the other properties that this discrete cosine is periodic in the

Â

frequency domain with, with its, with frequency periodic with period 2pi.

Â

And therefore the range of frequencies that this

Â

cosine can change are from zero to pi.

Â

Zero is the, the lowest frequency pi is

Â

the highest frequency, I move to two pi, keep

Â

decreasing the frequency, and then omega equals 2 pi,

Â

cosine of 2 pi is also equal to 1.

Â

This is the constant signal equals the cosine at zero here.

Â

I've completed the full a full period that way in the frequency domain.

Â

Similarly to the previous slide, we show

Â

here the values of the three-dimensional cosine, cosine

Â

omega1 and 1 plus omega2 and 2, for

Â

various values of the frequencies omega1 and omega2.

Â

So we can see that the frequency's 0 pi over 8, pi over 4, pi over 2 and pi.

Â

And since pi is involved, the resulting cosine is periodic in the spatial domain.

Â

Instead of showing it as a 3D plot, we show this

Â

cosine as a two dimensional gray scale image where white

Â

corresponds to the value one, black to the value

Â

minus 1 and grey to the value 0.

Â

The axis are, should have

Â

this orientation shown here and each of these blocks is an eight by eight block.

Â

Okay?

Â

So if we look at this image for example, then, this shows cosine 0 and 1 plus

Â

0 and 2, so cosine 0 is 1, so this a constant D merged with the value of 1.

Â

If we look at the first row here of images, then they all have

Â

omega one zero, [SOUND] so therefore they show

Â

cosine omega two n two for various values of omega two.

Â

If I look, for example at this image here, then,

Â

this is an image of cosine pi over 2 and 2, right?

Â

For this particular round the, the period is 2 pi

Â

over pi over 2 equals 4 pixels or 4 samples.

Â

Right?

Â

So if I take one line of this image.

Â

And see how it looks.

Â

Then, we see that there's a value of one, followed by value of

Â

zero, followed by the value of minus 1, followed by the value of zero.

Â

So this is one period of the cosine pi over 2 n 2.

Â

And since this cosine is independent of the value of n1 it means that for all

Â

n1s the same value of this cosine will

Â

be through therefore you see this vertical stripes right?

Â

It's the one pixel white so all these values for example here are equal to 1.

Â

And if I look also at this cosine, this represents cosine

Â

pi n2, which is, which as we saw, is equal to minus one to the

Â

n2, so this is the highest cosine in the n2 direction.

Â

I have one and minus one out of [UNKNOWN].

Â

And if I finally look at this cosine here, this is cosine pi n1 plus pi n2.

Â

And you can easily verify that this is equal

Â

to minus 1 to the n1, minus1 to the n2.

Â

So clearly the pixels ultimate between minus 1 and 1,

Â

and this is the highest two-dimensional cosine that uh,we can have.

Â

We are going to encounter these images later

Â

on in the course going to talk about compression.

Â

This will be the basis function signals of the discrete cosine drafts form which

Â

we will use to correlate data in

Â

JPG as well as in media compression.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000

Â

Explore our Catalog

Join for free and get personalized recommendations, updates and offers.