Welcome back. You're looking over the shoulder of Aaron, our first usability test subject, as we're going to do this, our first of a sequence of usability videos. And I'm going to give you a quick introduction to what we're going to do. Then I'm going to introduce Aaron to what we're going to do. And now we're going to go do it. So, this is going to be a think aloud study. A study where we're going to ask Aaron to think aloud as he's going through a task that we're going to assign him. I'm going to take us through as if he didn't know what we're about to do. We won't do this with every video. But it's a good way to start. And then you will hear Lana and me talk through the study as we're doing it, to give you an idea of what you get as you're watching these. Some of the later ones, we're going to be quiet and let you guys figure it out for yourselves. Aaron, welcome, and thank you for being here. >> You're welcome. >> So I want to start with explaining what we're going to do and going through the process of consent. And so we've asked you here to help us evaluate a user interface, and in particular we're looking at a city government website. I'm going to give you a particular task to do. I'll give it to you on paper. I'm actually going to ask you to read it aloud. And I'm going to ask you to do that, starting at the website. And, as best as you can, as you're going through it, think out loud. If you're making a decision. If you got a question, say it. We're in a usability lab here where we are recording you. The camera's probably a dead giveaway. >> [LAUGH] >> But, we're recording you anyway. We're recording the screen. And we have people behind that mirror, as you well know, that are watching and learning from this. >> Yeah. >> Our goal is to figure out, is this website usable? And if not, how might we design in differently? >> Wow. >> We're not asking you to try to critique it for us. I know you're actually pretty qualified to do that. >> [LAUGH] >> But just to go through the process of trying to use it, and we'll learn from you going through that process. >> Okay. >> Encourage you to ask questions, even though we probably won't answer them. And when you're done and you feel that you have the answer for this, say so, and I'll come back in. And if you reach a point where you just feel like you're completely stuck, you can say that, too. >> Okay. >> And we're delighted to find out about that, because it just points out where things might not be as easy for people to use as we would like. >> Yeah. >> The last thing I want to make clear, you're here voluntarily, You know you're being recorded. If at any time you say you don't want to be recorded, we will stop. If you say, I just don't feel good about this, we'll let you leave. And we just want you to know that there's nothing about this that's testing you. >> Yeah. This is all the way of understanding whether this website is working. And, frankly, helping our learners online who are going to understand this process, and try to replicate it for themselves. >> Yeah. >> So with that, why don't you read for us this particular task description. >> Okay. So, curbside pickup. You've just moved into St Paul, into a house at 1018 Randolph Avenue, between Lexington Parkway in Chatsworth Street, congratulations! You've seen recycling bins around, so you assume the city picks it up. You'd like to find out when you should put it out, and whether you have to pay for this service. Starting at stpaul.gov, find your recycling schedule and fees, if any. >> Great, any questions before I leave you and go inside? >> I don't think so. >> Wonderful. Go ahead and remember as best you can, think aloud. >> All right, cool. So I'm at the stpaul.gov website. We have this search bars here, so I could just go ahead and search for recycling. I think that that would be a good idea, and it might get me to where I want to be. So we have Recycling and Waste Reduction. Be All In- Recycle! So now I'm kind of looking for how is this applicable to me and where I live? Will they have drop-off events? And then you have to read this. I'm wondering, okay, how do I find Information that is address specific? I don't really see it here. Find ideas and resources. This is for events, so I think this is maybe a little more general than I'm looking for. But, I don't know maybe there's something here. So I'm looking and I'm trying to see, is there's something relevant? And I don't see anything specifically. This is a lot of text, so kind of little bit, right? I'm not a super fast reader. So [LAUGH] just trying to parse through it. Let's see, anything else related to recycling? So, where's this, okay, so they had this sort of section here, it's off to the side, Drop-off Events. I'm guessing that they have, okay so they have annual drop-off. But I'm looking for something a little more frequent. So I don't see that there [LAUGH] boy. [LAUGH] This is fun. Maybe maps maybe, there's something in the maps here. City council wards, construction inspectors. Okay, there's consents for land surveying. Where is the recycling box? Okay, district councils. So okay, and recycling pick-up dates. That's what I want. Okay, let's see. It's loading, all right. So it turns out there are a bunch of districts and I'll have to figure out, okay, what is my district? I just moved here, so I'm at 1018 Randolph Ave. Let's see. Okay, so that's me in 1018. So it kind of zoomed me in a little far. So now I'm wondering, okay, what district am I really in? So it's blocking, so my result's actually blocking my district number, so I'm trying to figure out. Okay look, what? So can I minimize it? No, don't want that. So I guess I'm in District 9, like the movie, and my recycling schedule is Friday. So I guess every Friday I am going to do that. Now, I also want to see how much that costs. So I guess I'll click here. And I go back to that recycling site that I was on before. Do they have anything about cost here? Okay, so information about drop-sites for District 10. I'm District 9, so, at least as far as I know. So is it free? Do I pay for it? Let's see. Come on. [LAUGH] I know that it's gotta be around here somewhere. Yeah. [LAUGH] Maybe it's in one of these. Recycling Information, maybe that's it. Okay, Residential Curbside Program. Okay, let's do this. Recycling is collected in St Paul, okay, depends on where you live, I saw that. This would've been a good site to be on right away, so that would've been really great. No later than 7:00 AM, okay. And two events, so those are free. So, okay, I guess as long as I have those, and I can put the others ones out. So it sounds like I don't have to pay for it, so I think that's the end of my task. I'm in District 9, it comes every Friday. And as long as I can fit it in those blue bins or put it in bags, I think that's it. Or maybe, yeah, okay. >> Well, thank you. >> Yeah, you're welcome. >> So, this was great. >> [LAUGH] How did I do? >> Well, you did wonderfully. >> Okay. >> You did two things wonderfully. One, you found a whole bunch of places where this information should have been and wasn't. >> Yeah. >> And you pointed that out to us along the way, which is fantastic. Two, you actually found the information, which, I'll be honest, is sort of impressive. >> Yeah. >> And if you ever decide to move to that location in St Paul, we'll be there. Let me ask the same question the other way around, how did the site do? >> Well, I definitely think it could've done better I searched recycling and I was really looking for this. This recycling information page was pretty useful, but that wasn't my first search result. Also, this district map blocked my, I don't know why it's this segmented. because there's this result here, but then this is info that, at least my schedule information, that I would really want. And yeah, it's sort of confusing. And yeah, having this modal over my district name is not good. >> And then, to be honest, it may have been a little bit cruel for me to pick a spot that was right near the border on this. >> Yeah, no, that's okay though, it's a good way for me to figure out how does this work? >> Well, thank you, we're going to hold this one to an end. And we're going to see you again in a minute or two as we take a look at a very different type of task. >> Al right. >> So that's the end of this experience, taking a look at a usability test in the lab.