Okay. We are in the middle of about a half hour, 45 minutes of statistics, actually it's more because we'll keep going back to it after we have introduced the concepts. But I'm also assuming, by the way, if you have never done statistics before, you would have, before watching the next step, made yourself very comfortable with calculating means and standard deviations, which includes calculating variance. Before which to relationships because the reason I'm saying that is because I've given you a note, on the side which goes through numbers. I shouldn't spend time in the video going through numbers doing mean and variance. I believe that is taking up more valuable time doing, talking about things that are, I think more important. Means and variances are not difficult, having said that, please do examples and the easier number crunching in your assessment. Okay, now I think I tried to convince you a little bit about why relationships matter. If you are not fully convinced believe me after you've done your portfolio theory. In fact, by the end of next week you will see that that's the only thing that matters. Not just in life, relationships not just matter in life, they matter in finance. No wonder I love it. Okay. So, let's start with relationships. There are two things you listen, there are multiple ways you listen but two fundamental things about relationships is this how do you measure them right? So suppose I have, y over here and I have x over here. As soon as I have relationships I have two right? At least two. So I'm going to call this y and you'll see in a second why I'm calling this y and x because in statistics there is a fundamental structure and symbols which are very similar used in almost every textbook and y and x is very common. So let's make y now. What is bushels of corn? The amount, it is a measurement unit of corn. And, let's call this, x inches, of rainfall. Again, I'm doing an example, which you can relate to without, whether it's important to finance or not, right? Because that's the beauty of statistics. I sometimes feel like statistics is, may go slightly ahead of finance in the love hierarchy of things. I can't believe I said it but anyways, so that's the way, okay. So, now, why are you interested in this relationship? You're interested in this relationship simply to figure out whether rainfall has impact on the production of corn one, and what is the nature of the impact, okay? So the reason why we are interested in relationships in a portfolio, in the finance context will become more apparent once we have started doing the financial application. First thing you do is calculate the average value. y bar. Second thing you do here is calculate the average value x bar, another way of saying the x bar and y bar are the values you expect to happen. So on average how many bushels of corn are you expected to produce? And on average how many inches of rainfall are you expected to get? We can throw numbers there if you want, 120, 60. Whatever, I'm sure I'm just sixteen inches of rainfall might be a lot or a little I don't have a clue, right? We aren't interested in the averages, stand alone you are, but now what you are asking is the following question, how are these two related? So the very simple way of thinking about it is the following. Ask yourself when rainfall is below the average. And remember, here are the probabilities. When rainfall is below the average, what the heck is corn doing? Let's assume that for this particular data point corn, it happens to be, Above its average, right? For this data point, how would you measure that deviation, this deviation? It will be y, sorry x, xi minus x bar is the amount measurement of this. Then you multiply that by y i minus y bar. In this case what is x i minus x bar? It happens to be positive. And but accidentally or maybe somehow the y i minus y bar is negative. But when you do most of these, what will you tend to see? That this tends to be positive on this side. So what will you do? You'll then sum all these up and you'll get what is called covariance. And what it's measuring is, multiplied by the probabilities of course. What it's measuring, what is the tendency of corn to be when rainfall is off its normal behavior? Corn off its normal behavior too. So I took a reverse example here where rainfall was positive corn became a little negative. That could happen, right? If there's excess rainfall. However, on average, what do you expect this to be? This number to be greater than zero. Why? Because hopefully rainfall helps the production of corn. Maybe if I took rice here and I'm just out of my league. I'm talking about agriculture. Maybe their relationship is more strong, positive, right? Because it needs more water. But you understand what I will measure. I measure, when I deviate from the average in this, how does this deviate exactly for that situation point by point, point by point, that's what the probabilities are about. This is the fundamental measure of relationships, and it's called covariance, how do you covary with something. So let's assume every time I turn, come on live and I have a smile on my face. You also automatically have a smile on your face or you tend to smile. We have a positive covariance going on. On the other hand if you dislike my guts for some reason and every time I smile you kind of frown. Then maybe we don't have something positive going on. So what I'm saying is you can use the same phenomena and a normal is no smile at all. So, covariance captures that relationship but there's a tragedy with covariance. And that is two things are wrong with it and I'll just emphasize that in a second. Let me just start off the clear. So covariance has one issue. One issue is magnitude, Is not communicative. Let me take a con example. So it's called sigma yx. Covariance of y with x is this. Summation p i (y i- y bar) (x i- x bar). It's very important to take deviations from normal behavior. That's, I said, when I smile, it's my, what is my nominal behavior? No smile, right? Okay, that's fair. And the probabilities are in there, right. Look, what will happen to this? Right now I had this in bushels, if I believe, yup. And I had this rainfall in inches. Could I change this number? And suppose this number was 55. Whatever. Can I make this number larger, just without changing anything dramatically fundamental? The answer is, yes. Start measuring your rainfall instead of inches, in millimeters, what will happen? This number will become big because there are a lot more millimeters in an inch, right? So, it doesn't have magnitude, it doesn't tell me anything. The only thing is good is it's telling sign is okay. But magnitude is not reflective of strength or weakness. The second tragedy with it, is this. It is unit dependent. So what are the units of covariance? The units of the covariance are the units of both the things being measured. All right. When we do return analysis, both the returns are measured in percentage. So it's not a big deal. But I wanted, that's why I had to show you why statistics is so awesome. And why you have to deal with things which are more difficult than in finance. So bushel inches, what is that suppose to mean? I mean it shouldn't be. An ideal measure of relationships shouldn't have units. So how can I compare bushel inches with say the productivity of people and whether they have had a school education or not? The units are totally different. Relationships should be comparable across different phenomena. So here's the tragedy of covariance. Though it's trying to measure the right thing, its magnitude doesn't mean much. And it's unit dependant. So what did we do? What did statisticians do? A very little about this to talk about that's important to us, but this one is extremely important. So we took covariance of y and x which units was what? Bushels per inches? And magnitude was what? Didn't reflect much but sign was okay. In other words, this positive and negative relationship is being reflected. Because you're taking deviations from mean and then multiply. So, what are did we do? We came up with the method called correlation. And what is correlation? Correlation simply takes sigma y x. Remember what are the units? And then does what? Standardizes it. By sigma y which is the standard deviation of y. We know how to measure it. And sigma x. What does this do? This does two things for us. What is the units of this? Remember this is bushels, inches. What is the unit of this? Bushels. What is the unit of this? Inches. So what happens? This becomes unit free. And the second thing happens, which is a little bit, I'm not going to go into. A correlation which is written like this, y, x is between minus 1 and plus 1. So you see the awesomeness of correlation? It's taken covariance retained its value of positive negative sign being important, got rid of its issues of the units by dividing by the standard deviations of the two and creating a number that can be compared across different phenomena. Okay? So let's take a break again and I'll come back with one last statistical, and an extremely important, statistical concept called regression which is needed in finance and almost in any other discipline, again a way of capturing relationships but an important one for us. See you.
