Threats to validity

Readings

• Guido Imbens, “Statistical Significance, p-Values, and the Reporting of Uncertainty.”¹ This is available on iCollege, and it’s also free here.
• Randall Munroe, “Significant”
• Alexander Coppock, “10 Things to Know About Statistical Power”
• Play around with FiveThirtyEight, “Hack Your Way To Scientific Glory”
• Chapter 9 in Impact Evaluation in Practice²
• Chapter 11 in The Effect³

Slides

The slides for today’s lesson are available online as an HTML file. Use the buttons below to open the slides either as an interactive website or as a static PDF (for printing or storing for later). You can also click in the slides below and navigate through them with your left and right arrow keys.

View all slides in new window Download PDF of all slides

• Introduction
• Construct validity
• Statistical conclusion validity
• Internal validity
• External validity

Videos

Videos for each section of the lecture are available at this YouTube playlist.

• Introduction
• Construct validity
• Statistical conclusion validity
• Internal validity
• External validity

You can also watch the playlist (and skip around to different sections) here:

In-class stuff

Here are all the materials we’ll use in class:

• Session 6 FAQ slides (PDF)
• Zilch!
• Bayes theorem, the geometry of changing beliefs
• Bayes and Covid
• Restaurant ratings