When you enroll in this course, you'll also be enrolled in this Specialization.
Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate
There are 9 modules in this course
You may never be sure whether you have an effective user experience until you have tested it with users. In this course, you’ll learn how to design user-centered experiments, how to run such experiments, and how to analyze data from these experiments in order to evaluate and validate user experiences. You will work through real-world examples of experiments from the fields of UX, IxD, and HCI, understanding issues in experiment design and analysis. You will analyze multiple data sets using recipes given to you in the R statistical programming language -- no prior programming experience is assumed or required, but you will be required to read, understand, and modify code snippets provided to you. By the end of the course, you will be able to knowledgeably design, run, and analyze your own experiments that give statistical weight to your designs.
In this module, you will learn basic concepts relevant to the design and analysis of experiments, including mean comparisons, variance, statistical significance, practical significance, sampling, inclusion and exclusion criteria, and informed consent. You’ll also learn to think of an experiment in terms of usability, its participants, apparatus, procedure, and design & analysis. This module covers lecture videos 1-2.
What's included
2 videos1 reading1 assignment
Show info about module content
2 videos•Total 19 minutes
01. What You Will Learn in this Course•10 minutes
02. Basic Experiment Design Concepts•9 minutes
1 reading•Total 10 minutes
ALL COURSE MATERIALS•10 minutes
1 assignment•Total 30 minutes
Understanding the Basics•30 minutes
Tests of Proportions
Module 2•2 hours to complete
Module details
In this module, you will learn how to analyze user preferences (or other tallies) using tests of proportions. You will also get up and running with R and RStudio. Topics covered include independent and dependent variables, variable types, exploratory data analysis, p-values, asymptotic tests, exact tests, one-sample tests, two-sample tests, Chi-Square test, G-test, Fisher’s exact test, binomial test, multinomial test, post hoc tests, and pairwise comparisons. This module covers lecture videos 3-9.
What's included
7 videos2 assignments
Show info about module content
7 videos•Total 41 minutes
03. Description of a Study of User Preferences•1 minute
04. Getting Started with R and RStudio•3 minutes
05. Exploring Data and a First Test of Proportions•7 minutes
06. Understanding and Reporting Your First Statistical Test•6 minutes
07. Exact Tests, Asymptotic Tests, and the Binomial Test•3 minutes
08. More One-Sample Tests of Proportions•9 minutes
09. Two-Sample Tests of Proportions•12 minutes
2 assignments•Total 60 minutes
Understanding Tests of Proportions•30 minutes
Doing Tests of Proportions•30 minutes
The T-Test
Module 3•1 hour to complete
Module details
In this module, you will learn how to design and analyze a simple website A/B test. Topics include measurement error, independent variables as factors, factor levels, between-subjects factors, within-subjects factors, dependent variables as responses, response types, balanced designs, and how to report a t-test. You will perform your first analysis of variance in the form of an independent-samples t-test. This module covers lecture videos 10-11.
What's included
2 videos2 assignments
Show info about module content
2 videos•Total 25 minutes
10. Experiment Design Concepts in a Simple A/B Test•14 minutes
11. Analyzing a Simple A/B Test with a T-Test•11 minutes
2 assignments•Total 60 minutes
Understanding Experiment Designs•30 minutes
Doing Independent-Samples T-Tests•30 minutes
Validity in Design and Analysis
Module 4•2 hours to complete
Module details
In this module, you will learn about how to ensure that your data is valid through the design of experiments, and that your analyses are valid by understanding and testing for certain assumptions. Topics include how to achieve experimental control, confounds, ecological validity, the three assumptions of ANOVA, data distributions, residuals, normality, homoscedasticity, parametric versus nonparametric tests, the Shapiro-Wilk test, the Kolmogorov-Smirnov test, Levene’s test, the Brown-Forsythe test, and the Mann-Whitney U test. This module covers lecture videos 12-15.
What's included
4 videos2 assignments
Show info about module content
4 videos•Total 41 minutes
12. Designing for Experimental Control•14 minutes
13. Data Assumptions and Distributions•15 minutes
14. Testing for ANOVA Assumptions•10 minutes
15. Mann-Whitney, a Nonparametric T-Test•2 minutes
2 assignments•Total 60 minutes
Understanding Validity•30 minutes
Doing Tests of Assumptions•30 minutes
One-Factor Between-Subjects Experiments
Module 5•1 hour to complete
Module details
In this module, you will learn about one-factor between-subjects experiments. The experiment examined will be a between-subjects study of task completion time with various programming tools. You will understand and analyze data from two-level factors and three-level factors using the independent-samples t-test, Mann-Whitney U test, one-way ANOVA, and Kruskal-Wallis test. You will learn how to report an F-test. You will also understand omnibus tests and how they relate to post hoc pairwise comparisons with adjustments for multiple comparisons. This module covers lecture videos 16-18.
What's included
3 videos2 assignments
Show info about module content
3 videos•Total 14 minutes
16. Description of a Study for a Oneway ANOVA•1 minute
17. Analyzing and Reporting a Oneway ANOVA•10 minutes
18. Kruskal-Wallis, a Nonparametric Oneway ANOVA•3 minutes
2 assignments•Total 42 minutes
Understanding Oneway Designs•12 minutes
Doing Oneway ANOVAs•30 minutes
One-Factor Within-Subjects Experiments
Module 6•2 hours to complete
Module details
In this module, you will learn about one-factor within-subjects experiments, also known as repeated measures designs. The experiment examined will be a within-subjects study of subjects searching for contacts in a smartphone contacts manager, including the analysis of times, errors, and effort Likert-type scale ratings. You will learn counterbalancing strategies to avoid carryover effects, including full counterbalancing, Latin Squares, and balanced Latin Squares. You will understand and analyze data from two-level factors and three-level factors using the paired-samples t-test, Wilcoxon signed-rank test, one-way repeated measures ANOVA, and Friedman test. This module covers lecture videos 19-23.
What's included
5 videos2 assignments
Show info about module content
5 videos•Total 49 minutes
19. Description of a Study for a Oneway Repeated Measures ANOVA•9 minutes
In this module, you will learn about experiments with multiple factors and factorial ANOVAs. The experiment examined will be text entry performance on different smartphone keyboards while sitting, standing, and walking. Topics include mixed factorial designs, interaction effects, factorial ANOVAs, and the Aligned Rank Transform as a nonparametric factorial ANOVA. This module covers lecture videos 24-27.
What's included
4 videos2 assignments
Show info about module content
4 videos•Total 40 minutes
24. Description of a Study for a Factorial ANOVA•7 minutes
25. Understanding Interaction Effects•6 minutes
26. Analyzing a Factorial ANOVA•13 minutes
27. The ART, a Nonparametric Factorial ANOVA•15 minutes
2 assignments•Total 120 minutes
Understanding Factorial Designs•30 minutes
Doing Factorial ANOVAs•90 minutes
Generalizing the Response
Module 8•1 hour to complete
Module details
In this module, you will learn about analyses for non-normal or non-numeric responses for between-subjects experiments using Generalized Linear Models (GLM). We will revisit three previous experiments and analyze them using generalized models. Topics include a review of response distributions, nominal logistic regression, ordinal logistic regression, and Poisson regression. This module covers lecture videos 28-29.
What's included
2 videos2 assignments
Show info about module content
2 videos•Total 25 minutes
28. Introduction to Generalized Linear Models•6 minutes
29. Analyzing Three Generalized Linear Models•19 minutes
2 assignments•Total 60 minutes
Understanding Generalized Linear Models•30 minutes
Doing Generalized Linear Models•30 minutes
The Power of Mixed Effects Models
Module 9•3 hours to complete
Module details
In this module, you will learn about mixed effects models, specifically Linear Mixed Models (LMM) and Generalized Linear Mixed Models (GLMM). We will revisit our prior experiment on text entry performance on smartphones but this time, keeping every single measurement trial as part of the analysis. The full set of analyses covered in this course will also be reviewed. This module covers lecture videos 30-33.
What's included
4 videos2 assignments
Show info about module content
4 videos•Total 35 minutes
30. Introduction to Mixed Effects Models•11 minutes
31. Analyzing a Linear Mixed Model•11 minutes
32. Analyzing a Generalized Linear Mixed Model•10 minutes
33. Course in Review•2 minutes
2 assignments•Total 120 minutes
Understanding Mixed Effects Models•30 minutes
Doing Mixed Effects Models•90 minutes
Earn a career certificate
Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.
Instructors
Instructor ratings
Instructor ratings
We asked all learners to give feedback on our instructors based on the quality of their teaching style.
UC San Diego is an academic powerhouse and economic engine, recognized as one of the top 10 public universities by U.S. News and World Report. Innovation is central to who we are and what we do. Here, students learn that knowledge isn't just acquired in the classroom—life is their laboratory.
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."
Learner reviews
3.6
596 reviews
5 stars
40.53%
4 stars
19.26%
3 stars
14.07%
2 stars
9.04%
1 star
17.08%
Showing 3 of 596
S
SS
5·
Reviewed on Feb 21, 2022
Thrown in to this with little programming background. Sink or swim situation. I swam. It was a challenge and I learned so much!
R
RR
4·
Reviewed on Feb 26, 2019
Without any background in R programming and experiment design, I am able to learn a lot of useful stuff in this course. I wish the last three lessons and quizzes are a little more beginner friendly.
A
AL
4·
Reviewed on Jun 16, 2016
The instructor for this course was great. He was very responsive to students' questions concerns.
When will I have access to the lectures and assignments?
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Specialization?
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.