Binary Choice
Binary Choice
Start with the probability contrast
Let mean degree completion. The policy question may be
an average risk difference. A logit coefficient is a change in log-odds, not this quantity.
Three models, three conveniences
| Model | Conditional mean | Main advantage | Main caution |
|---|---|---|---|
| linear probability | coefficients are probability-point changes | predictions can leave ; heteroskedastic errors | |
| logit | valid probabilities; odds interpretation | effects depend on and baseline risk | |
| probit | latent-normal formulation | scale is not directly substantive |
For causal work, all three still require a credible treatment-assignment argument. Robust standard errors address heteroskedasticity in an LPM; they do not repair confounding.
Odds are not risks
Suppose completion rises from 0.20 to 0.30:
- risk difference: ;
- risk ratio: ;
- odds ratio: .
“A 71% increase” would misdescribe the risk. State the scale.
Convert nonlinear coefficients into quantities people can read
For a logit model and continuous ,
If , the derivative is 0.20 at but only 0.072 at . A single coefficient does not imply a constant probability change.
For a binary scholarship offer, prefer a discrete change:
This averages the same treatment contrast over the observed covariate distribution.
From a log-odds coefficient to risk changes
The odds ratio is constant, while the probability change is not.
Interactions are contrasts of predictions
In a nonlinear model, the coefficient on is generally not the interaction effect on probability. Compute four predictions:
Report uncertainty for this contrast, preferably through the model’s delta method or resampling scheme aligned with the design.
Fit is not only discrimination
| Diagnostic | Question |
|---|---|
| calibration plot | do predicted 0.30 risks occur about 30% of the time? |
| Brier/log loss | are probabilistic predictions accurate? |
| ROC/AUC | can the model rank cases? |
| time or site validation | does performance survive the intended deployment setting? |
AUC can be high while probabilities are poorly calibrated. For a causal effect, neither calibration nor AUC proves exchangeability.
Quick check
The estimated odds ratio is 1.5 in both a low-risk and high-risk group. Are the risk differences equal?