Visualize as You Randomize: Design-Based Statistical Graphs for Experiments

• In Event: Advances in Experimental Methods and Designs Across the Subfields

Abstract

A good statistical graph for a randomized experiment simultaneously conveys the study's design, analysis, and results. It reveals the experimental design by mapping design elements to aesthetic parameters. It illuminates the analysis by plotting the statistical model in "dataspace." When the design and analysis of an experiment are encoded in a plot, the interpretation
of the experimental results is clarified. "Analyze as you randomize" is a dictum attributed to Fisher that guides interpretations of experimental data. This chapter extends that principle to visualizations of randomized experiments. While not every experiment requires a visualization, those that do should be visualized in ways that communicate the design and results together.

Author

• Alexander Coppock, Yale University