Easy feels true: on surveys

Erika Hall:

Surveys are the most dangerous research tool?—?misunderstood and misused. They frequently straddle the qualitative and quantitative, and at their worst represent the worst of both.
 
 In tort law the attractive nuisance doctrine refers to a hazardous object likely to attract those who are unable to appreciate the risk posed by the object. In the world of design research, surveys can be just such a nuisance.
 
 Easy Feels True
 It is too easy to run a survey. That is why surveys are so dangerous. They are so easy to create and so easy to distribute, and the results are so easy to tally. And our poor human brains are such that information that is easier for us to process and comprehend feels more true. This is our cognitive bias. This ease makes survey results feel true and valid, no matter how false and misleading. And that ease is hard to argue with.