Instructional manipulation check

An instructional manipulation check, often abbreviated IMC, is a special kind of question inserted in a questionnaire among the regular questions, designed to check whether respondents are paying attention to the instructions.[2] Discarding responses by participants who fail to read the instructions reduces the signal-to-noise ratio and can thereby increase the statistical power of an experiment. The tool was developed by Oppenheimer et al.[1]

Blue-dot task, a check designed to detect participants who fail to read the instructions. After Oppenheimer et al.[1]

Eliminating random responses this way before performing statistical hypothesis testing may be considered a legitimate form of data manipulation, but should be duly mentioned in publications reporting on the outcome of the experiment in question.[3]

Blue-dot task

Among several forms an IMC can take, a popular one is the so-called blue-dot task,[3] suitable for on-line questionnaires. A number of larger blue circles are arranged according to a Likert scale from (say) "very rarely" to "very frequently". Participants who ignore the instructions and merely want to finish the task will just click any one of these circles. The instructions, however, ask the participants to ignore the larger circles and instead click a little blue dot at the bottom of the screen. Oppenheimer et al. report that in a large sample of undergraduate participants, approximately 7% failed this task.[1]

References
  1. Daniel M. Oppenheimer; Tom Meyvis; Nicolas Davidenko (July 2009). "Instructional manipulation checks: Detecting satisficing to increase statistical power". Journal of Experimental Social Psychology. 45 (4): 867–872. doi:10.1016/j.jesp.2009.03.009.
  2. Bernard E. Whitley, Jr.; Mary E. Kite (2012). Principles of Research in Behavioral Science (Third Edition). Routledge. pp. 248–249. ISBN 978-1-136-19658-4.
  3. Wolfgang Stroebe; Tom Postmes; Russell Spears (2012). "Scientific Misconduct and the Myth of Self-correction in Science". Perspectives on Psychological Science. 7 (6). Note 2. doi:10.1177/1745691612460687.


This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.