This course aims to help you to ask better statistical questions when performing empirical research. We will discuss how to design informative studies, both when your predictions are correct, as when your predictions are wrong. We will question norms, and reflect on how we can improve research practices to ask more interesting questions. In practical hands on assignments you will learn techniques and tools that can be immediately implemented in your own research, such as thinking about the smallest effect size you are interested in, justifying your sample size, evaluate findings in the literature while keeping publication bias into account, performing a meta-analysis, and making your analyses computationally reproducible.
If you have the time, it is recommended that you complete my course 'Improving Your Statistical Inferences' before enrolling in this course, although this course is completely self-contained.
One of the biggest improvements most researchers can make is to more clearly specify their statistical questions. When you perform a study, what is it you really want to know?
What are different types of questions we can ask? Which question does a hypothesis test really answer, and is this answer actually what you are interested in, or is the question you are asking more about exploration, description, or prediction? How can we make riskier predictions than null-hypothesis tests, and why is this useful?
What's included
3 videos2 readings3 assignments
Show info about module content
3 videos•Total 40 minutes
Lecture 1.1: Improving Your Statistical Questions•12 minutes
Lecture 1.2: Do You Really Want to Test a Hypothesis?•15 minutes
Lecture 1.3: Risky Predictions•13 minutes
2 readings•Total 40 minutes
Download Course Materials and Course Structure (Must Read)•10 minutes
Assignment 1.1: Testing Range Predictions•30 minutes
3 assignments•Total 17 minutes
Answer Form Assignment 1.1: Testing Range Predictions•2 minutes
Consent Form for Use of Data•10 minutes
Welcome: Short Survey•5 minutes
Module 2: Falsifying Predictions
Module 2•4 hours to complete
Module details
There is little use in making predictions if you can never be wrong - so how do we make sure your predictions are falsifiable? We discuss why falsifiable predictions are important, and how to make your predictions falsifiable in practice. One important aspect of making predictions falsifiable is to specify a range of values that is not predicted, and we will examine different approaches to specifying a smallest effect size of interest.
What's included
3 videos3 readings3 assignments
Show info about module content
3 videos•Total 46 minutes
Lecture 2.1: Falsifying Predictions in Theory•16 minutes
Lecture 2.2: Setting the Smallest Effect Size Of Interest•14 minutes
Lecture 2.3: Falsifying Predictions in Practice•16 minutes
3 readings•Total 90 minutes
Assignment 2.1: The Small Telescopes Approach to Setting a SESOI•30 minutes
Assignment 2.2: Setting the SESOI Based on Resources•30 minutes
Assignment 2.3: Equivalence Testing•30 minutes
3 assignments•Total 90 minutes
Answer Form Assignment 2.1: The Small Telescopes Approach to Setting a SESOI•30 minutes
Answer Form Assignment 2.2: Setting the SESOI Based on Resources•30 minutes
Answer Form Assignment 2.3: Equivalence Testing•30 minutes
Module 3: Designing Informative Studies
Module 3•3 hours to complete
Module details
If studies are designed to answer a question, you should make sure the answer you will get after collecting data is informative. Instead of mindlessly setting Type 1 and Type 2 error rates, we will learn why it is important to be able to justify error rates, and some approaches how to do so. We discuss the benefits of using your smallest effect size of interest in power analyses, and why learning to simulate data is a useful tool. Simulations can help you to improve your understanding of statistics, enable you to design informative studies, and even ask novel questions.
What's included
3 videos2 readings2 assignments
Show info about module content
3 videos•Total 48 minutes
Lecture 3.1: Justifying Error Rates•19 minutes
Lecture 3.2: Power Analysis•13 minutes
Lecture 3.3: Simulation•15 minutes
2 readings•Total 90 minutes
Assignment 3.1: Confidence Intervals for Standard Deviations•30 minutes
Assignment 3.2: Power Analysis for ANOVA Designs•60 minutes
2 assignments•Total 60 minutes
Answer Form Assignment 3.1: Confidence Intervals for Standard Deviations•30 minutes
Answer Form Assignment 3.2: Power Analysis for ANOVA Designs•30 minutes
Module 4: Meta-Analysis and Bias Detection
Module 4•4 hours to complete
Module details
Regrettably we work in a scientific enterprise where the published literature does not reflect real research. Publication bias and selection biases lead to a scientific literature that can’t be interpreted without taking these biases into account. We will discuss what real research lines look like, and how to meta-analytically evaluate the literature while keeping bias in mind.
What's included
3 videos4 readings3 assignments
Show info about module content
3 videos•Total 48 minutes
Lecture 4.1: Mixed Results•15 minutes
Lecture 4.2: Intro to Meta-Analysis•17 minutes
Lecture 4.3: Bias Detection•15 minutes
4 readings•Total 115 minutes
Assignment 4.1: Likelihood of Significant Findings•30 minutes
Assignment 4.2: Introduction to Meta-Analysis•30 minutes
Answer Form Assignment 4.1: Likelihood of Significant Findings•30 minutes
Answer Form Assignment 4.2: Introduction to Meta-Analysis•30 minutes
Answer Form Assignment 4.3: Detecting Publication Bias•30 minutes
Module 5: Computational Reproducibility, Philosophy of Science, and Scientific Integrity
Module 5•4 hours to complete
Module details
We discuss three last topics. First, we will make sure other people can use your data to ask new questions, by making sure your data analysis is computationally reproducible. Then, we will reflect on how your philosophy of science influences the types of questions you will ask, and what you value as you do research. Finally, we discuss scientific integrity, and reflect on why our research practice is not always aligned with the best possible ways to provide reliable answers to scientific questions.
Assignment 5.2: Does Your Philosophy of Science Matter in Practice?•45 minutes
2 plugins•Total 60 minutes
Assignment 5.2: Does Your Philosophy of Science Matter in Practice?•30 minutes
Assignment 5.3: Applied Research Ethics•30 minutes
Module 6: Final Exam
Module 6•1 hour to complete
Module details
This module contains a graded exam. It covers content from the entire course. We recommend making this exam only after you went through all the other modules.
What's included
1 assignment
Show info about module content
1 assignment•Total 52 minutes
Graded Final Exam•52 minutes
Instructor
Instructor ratings
Instructor ratings
We asked all learners to give feedback on our instructors based on the quality of their teaching style.
Eindhoven University of Technology (TU/e) is a young university, founded in 1956 by industry, local government and academia. Today, their spirit of collaboration is still at the heart of the university community. We foster an open culture where everyone feels free to exchange ideas and take initiatives.
We offer academic education that is driven by fundamental and applied research. Our educational philosophy is based on personal attention and room for individual ambitions and talents. Our research meets the highest international standards of quality. We push the limits of science, which puts us at the forefront of rapidly emerging areas of research.
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."
Learner reviews
4.9
112 reviews
5 stars
90.17%
4 stars
7.14%
3 stars
2.67%
2 stars
0%
1 star
0%
Showing 3 of 112
K
KD
5·
Reviewed on Dec 18, 2023
This was the best course that I have ever taken. Professor Lakens's excellent expression and wonderful lesson plan have created a thought-provoking review. I sincerely thank him
H
HS
5·
Reviewed on Dec 3, 2019
I recommend this course to everyone who wants to improve their grasp of statistics. The course involves content that is timely and relevant within an easy-to-digest form and amount.
S
SW
5·
Reviewed on Dec 31, 2019
Cracking - very informative, nice mixture of modes of learning, and engaging
The course assumes basic knowledge about statistical inferences (t-tests, ANOVA) and some knowledge of designing research studies. The course is for intermediate level. Coursera offers basic introductions to statistics (which this course is not), and my previous MOOC 'Improving Your Statistical Inferences' might be a better starting point if you lack training in statistics. You do not need knowledge programming in R - we will use it as a fancy calculator by changing code (but not programming).
When will I have access to the lectures and assignments?
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I purchase the Certificate?
When you purchase a Certificate you get access to all course materials, including graded assignments. Upon completing the course, your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.