Don’t Throw the MTurk Out with the Farmers: The Shape of and Solutions to the MTurk Quality Crisis

• In Event: Data Integrity and Research Ethics

Brief Overview

This paper audits 19 studies conducted on Amazon's Mechanical Turk (MTurk), dating back to 2015. It shows the severity, sources, and solutions to the MTurk quality panic.

Authors

• Scott Clifford, University of Houston

• Ryan Jewell, University of Houston

• Ryan P. Kennedy, University of Houston

• Philip Waggoner, University of Chicago