DP13015 Testing the Waters: Behavior across Participant Pools
|Author(s):||Erik Snowberg, Leeat Yariv|
|Publication Date:||June 2018|
|Keyword(s):||Experiments, External Validity, Lab Selection|
|JEL(s):||B41, C80, C90|
|Programme Areas:||Labour Economics, Public Economics, Industrial Organization|
|Link to this Page:||cepr.org/active/publications/discussion_papers/dp.php?dpno=13015|
We leverage a large-scale incentivized survey eliciting behaviors from (almost) an entire university student population, a representative sample of the U.S. population, and Amazon Mechanical Turk (MTurk) to address concerns about the external validity of experiments with student participants. Behavior in the student population offers bounds on behaviors in other populations, and correlations between behaviors are largely similar across samples. Furthermore, non-student samples exhibit higher measurement error. Adding historical lab participation data, we find a small set of attributes over which lab participants differ from non-lab participants. Using an additional set of lab experiments, we see no evidence of observer effects.