Jump to ContentJump to Main Navigation
Teaching StatisticsA Bag of Tricks$

Andrew Gelman and Deborah Nolan

Print publication date: 2017

Print ISBN-13: 9780198785699

Published to Oxford Scholarship Online: September 2017

DOI: 10.1093/oso/9780198785699.001.0001

Show Summary Details
Page of

PRINTED FROM OXFORD SCHOLARSHIP ONLINE (www.oxfordscholarship.com). (c) Copyright Oxford University Press, 2018. All Rights Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a monograph in OSO for personal use (for details see www.oxfordscholarship.com/page/privacy-policy).date: 12 December 2018



(p.1) 1 Introduction
Teaching Statistics

Andrew Gelman

Deborah Nolan

Oxford University Press

Abstract and Keywords

This introduction to Teaching Statistics describes how an instructor might use this book, the general philosophy behind incorporating demonstrations, examples, and projects into a course, and what makes a good example. This chapter also provides a list of the most popular activities and a table that maps statistical concepts to activities that can be found throughout the book.

Keywords:   Activities, instructor guide, teaching statistics

1.1 The challenge of teaching introductory statistics

We have taught introductory statistics to college students for several years. There are a variety of good textbooks at this level, all of which cover the material pretty well. However, we found it a challenge to keep students motivated in class. Statistics is problem-solving. Watching the instructor solve a problem on the blackboard is not as effective or satisfying for students as actively involving themselves in problems. To improve participation, we and our colleagues have been collecting and developing tools, tricks, and examples for statistics teaching.

Many teachers have their own special teaching methods but they are not always disseminated widely; as a result, some of the best ideas (for example, the survey of family sizes presented here on page 66 and the coin-flipping demonstration on page 119) have been rediscovered several times. We put together this book to collect all the good ideas that we have heard about or developed in our own courses.

By collecting many demonstrations and examples in one place and focusing on the techniques used to involve students as active participants, we intend this book to be a convenient resource for instructors of introductory probability and statistics at the high school and college level. Where possible, we give references to earlier descriptions of these demonstrations, but we recognize that many of them have been used by teachers long before they appeared in any of these cited publications.

This book contains a range of teaching tools. What we find most important about a teaching tool is the basic idea, along with details about how to implement it in class. This can often be explained in a few paragraphs. We try to do this where possible but without skimping on the little details that keep the students involved.

1.2 Fitting demonstrations and examples into a course

The demonstrations, examples, and project ideas presented here are most effective for relatively small classes (fewer than 60 students); with a large lecture course, some of the demonstrations can be done in the discussion sections. These materials are not intended to stand alone. We use them along with a traditional statistics text, lectures, homeworks, quizzes, and exams.

(p.2) The chapters in Part I of the book cover the topics roughly in order of when they occur during the semester, with enough so that there can be a class-participation activity of some sort during every lecture. Many of the activities are relevant to multiple statistical concepts, and so for convenience we have listed them on pages 6–8 by subject. Part III presents some demonstrations and activities for more advanced courses in statistics. In between, we discuss issues of implementing the class-participation activities, along with a detailed schedule of how they fit in to a course. Finally, background information on many of the examples is given in the Notes at the end of the book.

We have found student-participation demonstrations to be effective in dramatizing concepts that students often find difficult (for example, numeracy, conditional probability, the difference between an experiment and a survey, statistical and practical significance, the sampling distribution of confidence intervals). Students are made aware that they and others are subject to cognitive illusions (see, for example, the United Nations demonstration on page 78, the coin-flipping demonstration on page 119, and the lie detection example on page 127). In addition, the experiments that involve data-gathering illustrate general concerns of bias and variance (for example, in the age-guessing example on page 11 and the candy weighing on page 134) and also involve important practical issues such as time trends (shooting baskets on page 148), displaying data (guessing exam scores on page 25), experimental protocol (weighted coins on page 129 and helicopter design on page 337), and the relation between models and data (average family size on page 66). One reason that we believe these demonstrations are important is that the active settings emphasize that statistics is, in reality, a participatory process with many actors (typically, different people design a study, collect data, are experimental subjects, analyze data, interpret results, and so forth).

Perhaps most important, the demonstrations get all the students involved and help to create an environment where students feel free to participate and ask questions in class.

The goal of class-participation tools is to improve learning within class and also to encourage more learning outside of class. Our demonstrations are intended to involve students in traditional lecture material and are not intended as a substitute for more detailed student-involved investigations or group projects. In Section 6.2 we include step-by-step instructions on how to run a class survey project, and in Section 6.4.3 we provide directions for running a simple taste-testing experiment. Chapter 12 gives advice on coordinating projects in which groups of students work on projects of their own design.

At the center of any course on introductory statistics are worked examples illustrating the important concepts and methods in real-data situations that are interesting to students. Good statistics texts are full of such examples, and a good lecture course will introduce new examples rather than simply working out material already in the textbook. Interesting examples can often be found directly from newspapers, magazines, and scientific articles; Chapter 7 presents some examples that have worked well in our classes.

(p.3) There are many other excellent examples in statistics textbooks and other sources. We discuss various places to find additional material in Section 12.6.

1.3 What makes a good example?

We enjoy discussing in class the issue of what makes a good example, opening up some of our teaching strategies to the students.

When a topic is introduced, we like the first example to be simple so that the mechanics of the method are transparent. It is also good to prepare a handout showing the steps of the procedure so that the students can follow along without having to scribble everything down from the blackboard. You can put some fill-in-the-blanks on the handout so the students have to pay attention during the exposition.

It can be good to use fake data for a first example and to discuss how you set up the fake data and why you did it the way you did. For example, we first introduce the log-log transformation with the simple example of the relation between the area of a square and its circumference (page 33). Once students are familiar with the log-log transformation, we use it to model real data and to introduce some realistic complexity (for example, the data on metabolic rates on page 35).

1.4 Why is statistics important?

Finally, it is useful before studying these demonstrations and examples to remind ourselves why we think it is important for students to learn statistics. We use statistics when we make decisions, both at an individual and a public level, and we use statistics to understand the world. Many of the major decisions affecting the lives of everything on this planet have some statistical justification or basis, and the methods we teach are relevant to understanding these decisions. These points are well illustrated by the kinds of studies reported in the press that students chose to read about for a course project (see page 93). For example, a pre-med student who ate fish frequently was interested in the observational study described in “Study finds fish-heavy diet offers no heart protection,” New York Times, April 13, 1995. Another student who commuted to school wanted to learn more about a commuter survey reported on in the article entitled, “For MUNI riders, familiarity breeds contempt, study says,” San Francisco Examiner, August 27, 1998, and yet another chose to follow up on the article, “Audit finds stockbrokers treat women differently,” San Francisco Chronicle, March 22, 1995, because of her political convictions. Of course, studies of college students, such as “More students drinking to get drunk, study finds,” San Francisco Examiner, September 11, 1998, generate interest among most students.

Studies reported in the newspaper typically use statistics to analyze data collected by survey, experiment, or observationally (examples of each of these appear in Chapter 6). But in some cases, the simple act of collecting and reporting numerical data has a positive effect. For example, around 1990, Texas began requiring every school and school district in the state to report average test (p.4) scores for all grades in each of several ethnic groups. This provides an incentive for schools to improve performance across these sub-populations.

Another example of the value of public statistics is the Toxics Release Inventory, the result of laws in 1984 and 1990 that require industrial plants to release information on pollutants released and recycled each year. Both the Texas schools and the environmental releases improved after these innovations. Although one cannot be sure of causal links in these observational settings (see page 85), our point is that gathering and disseminating information can stimulate understanding and action.

1.5 The best of the best

This book collects our favorite demonstrations, activities, and examples. But among these we have some particular favorites that get the students thinking hard about problems from unexpected angles. If you only want to use a few of our activities, we suggest you try these first.

  • Where are the cancers? (page 13)

  • World record times for the mile run (page 20)

  • Handedness of students (page 21)

  • Guessing exam scores (page 25)

  • Who opposed the Vietnam War? (page 27)

  • Metabolic rates of animals (page 35)

  • Tall people have higher incomes (pages 49 and 151)

  • Sampling from the telephone book (page 58)

  • How large is your family? (page 66)

  • An experiment that looks like a survey (page 78)

  • Randomizing the order of exam questions (page 81)

  • Real vs. fake coin flips (page 119)

  • What color is the card? (page 125)

  • Weighing a “random” sample (page 134)

  • Where are the missing girls? (page 135)

  • Coverage and noncoverage of confidence intervals (pages 140–142)

  • Shooting baskets (page 148)

  • Examples of lying with statistics (page 162)

  • How many quarters are in the jar? (page 278)

  • What is the value of a life? (page 284)

  • Subjective probability intervals (page 290)

  • Helicopter design project (page 337)

1.6 Our motivation for writing this book

This book grew out of our shared interest in teaching. We describe three events in our teaching career that influenced its creation.

(p.5) The first time that one of us taught a statistics course, we took ten minutes halfway through the course and asked the students for anonymous written comments. As we feared, most of comments were negative; the course was in fact a disaster, largely because we did not follow the textbook closely, and the homeworks were a mix of too easy and too hard. Our lectures were focused too much on concepts and not enough on skills, with the result that the students learned little of either. This experience inspired us, in the immediate time frame, to organize our courses better (and, indeed, our courses were much more successful after that). We were also inspired to begin gathering the demonstrations, examples, and teaching tools that ultimately were collected in this book, as a means of getting the students more actively involved in their own learning.

Another time, one of us was asked to teach a special seminar in probability for a small number of advanced undergraduate students who showed promise for graduate study. We were asked to break from the traditional lecture style and have students read original research papers even though they had no probability background before starting the seminar. This was a tall order, but the students did not disappoint us. The experience opened our eyes to the variety and level of work that students could tackle with the right kind of guidance, and as a result, we started to experiment with projects and advanced work in our regular courses.

Then in 1994, we jointly led an undergraduate research project in statistical literacy. The students’ enthusiasm for the project surprised and inspired us, and led to the design of our course packets in statistical literacy (Chapter 7). This project further sparked discussions on ideas for making classroom lectures more fun for students and on ways to design meaningful course projects, and after years of sharing ideas and techniques, we decided to write this book to provide a resource for other instructors of statistics. We hope you find it useful.


Table 1.1 Demonstrations, examples, and projects that can be used in the first part of an introductory statistics course. See also Tables 1.21.3 and Chapter 13. Some activities are listed more than once because we return to them throughout the course.



Introducing data collection


Guessing ages


Collecting handedness data



Estimating a big number

Relevance of statistics


Why is statistics important?


Where are the cancers?


What’s in the news?

Time plots, interpolation and extrapolation


World record times for the mile run


World population



Handedness of students


Soft drink consumption

Means and medians


Average soft drink consumption


The average student



Guessing exam scores


Psychometric analysis of exam scores

Two-way tables


Who opposed the Vietnam War?

Normal distribution


Heights of men and women


Heights of conscripts


Scores on two exams

Linear transformations


College admissions


Social and economic indexes


Age adjustment

Logarithmic transformations


Amoebas, squares, and cubes


World population


Metabolic rates


First digits and Benford’s law

Linear regression with one predictor


Tall people have higher incomes


World population



Correlations of body measurements


Exam scores and number of pages written


Psychometric analysis of exam scores

Regression to the mean


Memory quizzes


Scores on two exams


Heights of mothers and daughters


Table 1.2 Demonstrations, examples, and projects that can be used in the middle part of an introductory statistics course. See also Tables 1.11.3 and Chapter 13. Some activities are listed more than once because we return to them throughout the course.



Introduction to sampling


Sampling from the telephone book


First digits and Benford’s law


Simple examples of sampling bias


How large is your family?


Weighing a “random” sample

Applied survey sampling


Wacky surveys


An election exit poll


Class projects in survey sampling


1 in 4 youths abused, survey finds


Activities in survey sampling



An experiment that looks like a survey


Randomizing the order of exam questions


Soda and coffee tasting


IV fluids for trauma victims


Ethics and statistics


Designing a paper “helicopter”

Observational studies


Tall people have higher incomes


The Surgeon General’s report on smoking


Large population studies


Coaching for the SAT


Monster in the crib


Regression of income on height and sex

Statistical literacy


Statistical literacy and the news media


Lying with statistics

Probability and randomness


Random numbers via dice or handouts


Probabilities of boy and girl births


Real vs. fake coin flips



Conditional probability


Was Elvis an identical twin?


What color is the other side of the card?


Lie detectors and false positives

Applied probability modeling


Lengths of baseball World Series


Voting and coalitions


Probability of space shuttle failure


Crooked dice and biased coins


Success rates of golf putts


How many quarters?


Utility of money


What is the value of a life?


Probabilistic answers to exam questions


Does the Poisson distribution fit real data?


Table 1.3 Demonstrations, examples, and projects that can be used in the last part of an introductory statistics course. See also Tables 1.11.2 and Chapter 13. Some activities are listed more than once because we return to them throughout the course.



Distribution of the sample mean


Where are the missing girls?


Real-time gambler’s ruin


Poll differentials

Bias and variance of an estimate


Guessing ages


Weighing a “random” sample


Biases in age guessing

Confidence intervals


An experiment that looks like a survey


Land or water?


Poll differentials


Coverage of confidence intervals


Noncoverage of confidence intervals


How good is your memory?


How common is your name?


Subjective probability intervals


Hierarchical modeling and shrinkage

Hypothesis testing


Randomizing the order of exam questions


Real vs. fake coin flips


Golf: can you putt like the pros?


Land or water?


Evidence for the anchoring effect


Detecting a flawed sampling method


Taste testing projects


Testing Benford’s law


Lengths of baseball World Series

Statistical power


Where are the missing girls?


Shooting baskets

Multiple comparisons


Do-it-yourself data dredging


Praying for your health

Multiple regression


Regression of income on height and sex


Exam scores


Quality control

Nonlinear regression


Success rate of golf putts


Pythagoras goes linear


Designing a paper “helicopter”

Lying with statistics and statistical communication


Many examples from the news media


Selection bias


1 in 2 marriages end in divorce?


Ethics and statistics