Causal Diagrams and Controls
Causal Diagrams and Controls
A control set is a causal claim
Suppose family resources affect both scholarship receipt and degree completion :
The backdoor path creates confounding. Conditioning on a well-measured pre-treatment may block it. The diagram does not prove that all common causes were measured.
Three variables that look like controls
Confounder
A pre-treatment common cause can belong in an adjustment set.
Mediator
If mentoring hours are caused by the scholarship, controlling for removes part of the total effect and may introduce further bias. It answers a different direct-effect question under stronger assumptions.
Collider
If survey response is affected by the scholarship and unobserved motivation , analysing responders only opens a non-causal association between and .
HarborMart-style “more controls” logic fails here
For Pathways, consider:
| Variable | Timing | Default role | Audit question |
|---|---|---|---|
| prior exam score | before offer | possible confounder or precision covariate | did it affect assignment and outcome? |
| application essay rating | before offer but assessor-dependent | possible confounder/proxy | was it measured before assignment and consistently? |
| advising attendance | after offer | mediator | is the target total or direct effect? |
| first-year GPA | after offer | mediator and selection variable | does conditioning discard treatment pathways? |
| completion-record availability | after treatment/outcome process | selection/collider risk | did treatment affect observation? |
“Pre-treatment” is necessary for a standard confounder, but not sufficient. A pre-treatment variable can be an instrument, proxy or collider of earlier causes.
Adjustment cannot create overlap
Under conditional exchangeability and positivity,
If every high-scoring applicant receives the scholarship and no low-scoring applicant does, outcome regression outside overlap depends on functional-form extrapolation. A rich control set can make the absence of comparison units harder to see.
Design before data-driven control selection
Use this order:
- define the total or direct effect;
- draw treatment, outcome, timing and plausible common causes;
- exclude descendants of treatment from a total-effect adjustment set;
- identify the smallest defensible sets and measurement limitations;
- inspect overlap and sensitivity to unmeasured causes;
- use prediction tools only within this causal design.
LASSO can select variables that predict while omitting weak outcome predictors that strongly affect , or include post-treatment variables. Algorithmic selection is not a substitute for a timing and causal audit.
DAGs clarify assumptions; they do not certify them
Two researchers can draw different graphs because institutional knowledge differs. Make contested arrows explicit, derive alternative adjustment sets and test whether the conclusion depends on those choices.
A missing arrow is an assumption. It should be defended in prose, not hidden by a clean diagram.
Quick check
An offer increases advising attendance, and advising raises completion. Should advising be controlled when estimating the total effect of the offer?