Bad control

In statistics, bad controls are variables that introduce an unintended discrepancy between regression coefficients and the effects that said coefficients are supposed to measure. These are contrasted with confounders which are "good controls" and need to be included to remove omitted variable bias.[1][2][3] This issue arises when a bad control is an outcome variable (or similar to) in a causal model and thus adjusting for it would eliminate part of the desired causal path. In other words, bad controls might as well be dependent variables in the model under consideration.[3] Angrist and Pischke (2008) additionally differentiate two types of bad controls a simple bad-control scenario and proxy-control scenario where the included variable partially controls for omitted factors but is partially affected by the variable of interest.[3] Pearl (1995) provides a graphical method for determining good controls using causality diagrams and the back-door criterion and front-door criterion.[4]

Examples

Simple bad control

causal diagram of education, work type and wages variables
Causal diagram showing a type of bad control. If we control for work type when performing regression from education to wages we have disrupted a causal path and such a regression coefficient does not have a causal interpretation.

A simplified example studies effect of education on wages .[3] In this gedankenexperiment two levels of education are possible: lower and higher and two types of jobs are performed: white-collar and blue-collar work. When considering the causal effect of education on wages of an individual, it might be tempting to control for the work-type , however, work type is a mediator () in the causal relationship between education and wages (see causal diagram) and thus, controlling for it precludes causal inference from the regression coefficients.

Bad proxy-control

causal diagram of education, innate ability, late ability and wages
Causal diagram showing bad proxy-control. If we control for late ability when performing regression from education to wages we have introduced a new non-causal path and thus a collider bias.

Another example of bad control is when attempting to control for innate ability when estimating effect of education on wages .[3] In this example, innate ability (thought of as for example IQ at pre-school age) is a variable influencing wages , but its value is unavailable to researchers at the time of estimation. Instead they choose before-work IQ test scores , or late ability, as a proxy variable to estimate innate ability and perform regression from education to wages adjusting for late ability. Unfortunately, late ability (in this thought experiment) is causally determined by education and innate ability and, by controlling for it, researchers introduced collider bias into their model by opening a back-door path previously not present in their model. On the other hand, if both links and are strong, one can expect strong (non-causal) correlation between and and thus large omitted-variable bias if is not controlled for. This issue, however, is separate from the causality problem.

References

  1. Cinelli C, Forney A, Pearl J (2020). "A crash course in good and bad controls" (PDF). Sociological Methods & Research. SAGE Publications Sage CA: Los Angeles.
  2. Angrist JD, Pischke JS (2014). Mastering ’metrics: The path from cause to effect. Princeton University Press. ISBN 9780691152844.
  3. Angrist JD, Pischke JS (2008). Mostly Harmless Econometrics: An Empiricist's Companion. ISBN 0691120358.
  4. Pearl J (1995). "Causal diagrams for empirical research". Biometrika. 82 (4): 669–688. doi:10.1093/biomet/82.4.669. ISSN 0006-3444.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.