Module 4 — Choice and Limited Outcomes

Binary Choice

Interpret linear probability, logit and probit models through risks, marginal effects and policy contrasts

Binary Choice

Start with the probability contrast

Let Y=1Y=1 mean degree completion. The policy question may be

E[Y(1)Y(0)]=P(Y(1)=1)P(Y(0)=1),E[Y(1)-Y(0)]=P(Y(1)=1)-P(Y(0)=1),

an average risk difference. A logit coefficient is a change in log-odds, not this quantity.

Three models, three conveniences

ModelConditional meanMain advantageMain caution
linear probabilityXβX'\betacoefficients are probability-point changespredictions can leave [0,1][0,1]; heteroskedastic errors
logitΛ(Xβ)\Lambda(X'\beta)valid probabilities; odds interpretationeffects depend on XX and baseline risk
probitΦ(Xβ)\Phi(X'\beta)latent-normal formulationscale is not directly substantive

For causal work, all three still require a credible treatment-assignment argument. Robust standard errors address heteroskedasticity in an LPM; they do not repair confounding.

Odds are not risks

Suppose completion rises from 0.20 to 0.30:

  • risk difference: 0.300.20=0.100.30-0.20=0.10;
  • risk ratio: 0.30/0.20=1.500.30/0.20=1.50;
  • odds ratio: (0.30/0.70)/(0.20/0.80)=1.71(0.30/0.70)/(0.20/0.80)=1.71.

“A 71% increase” would misdescribe the risk. State the scale.

Convert nonlinear coefficients into quantities people can read

For a logit model pi=Λ(Xiβ)p_i=\Lambda(X_i'\beta) and continuous xkx_k,

pixik=βkpi(1pi).\frac{\partial p_i}{\partial x_{ik}}=\beta_k p_i(1-p_i).

If βk=0.8\beta_k=0.8, the derivative is 0.20 at p=0.5p=0.5 but only 0.072 at p=0.10p=0.10. A single coefficient does not imply a constant probability change.

For a binary scholarship offer, prefer a discrete change:

AME^=1ni[p^(D=1,Xi)p^(D=0,Xi)].\widehat{AME}=\frac{1}{n}\sum_i \left[\hat p(D=1,X_i)-\hat p(D=0,X_i)\right].

This averages the same treatment contrast over the observed covariate distribution.

Py

From a log-odds coefficient to risk changes

Idle

The odds ratio e0.8=2.23e^{0.8}=2.23 is constant, while the probability change is not.

Interactions are contrasts of predictions

In a nonlinear model, the coefficient on D×GD\times G is generally not the interaction effect on probability. Compute four predictions:

[p(1,1)p(0,1)][p(1,0)p(0,0)].[p(1,1)-p(0,1)]-[p(1,0)-p(0,0)].

Report uncertainty for this contrast, preferably through the model’s delta method or resampling scheme aligned with the design.

Fit is not only discrimination

DiagnosticQuestion
calibration plotdo predicted 0.30 risks occur about 30% of the time?
Brier/log lossare probabilistic predictions accurate?
ROC/AUCcan the model rank cases?
time or site validationdoes performance survive the intended deployment setting?

AUC can be high while probabilities are poorly calibrated. For a causal effect, neither calibration nor AUC proves exchangeability.

Quick check

The estimated odds ratio is 1.5 in both a low-risk and high-risk group. Are the risk differences equal?

Answer
No. The same odds ratio implies different probability changes at different baseline risks. Compute group-specific counterfactual predictions and average the relevant contrasts.

Next: Multinomial Choice

Copyright © 2026