Module 5 — Systems, Seasonality, and Cointegration
Module 5 — Systems, Seasonality, and Cointegration
Core question
What changes when variables forecast one another, seasonal positions have their own dynamics, or non-stationary levels remain tied by a stable long-run relation?
Learning outcomes
You will be able to:
- formulate and check the stability of a VAR;
- solve a stationary VAR covariance with a Kronecker-product equation;
- distinguish Granger predictability from causal effect;
- compute and qualify an impulse response;
- choose among seasonal indicators, seasonal differencing, and SARIMA terms;
- recognise cointegration and interpret an error-correction model;
- explain why forecasts across products or time aggregates must be reconciled.
1. VAR: every variable can use every lag
For a -variable VAR(),
A VAR(1) is stationary when every eigenvalue of has modulus below one. For VAR(), use the equivalent companion matrix.
Parameter growth is the first constraint
With an intercept, a VAR has regression coefficients. For and , that is 105 coefficients before the 15 distinct innovation-covariance terms. A rich system estimated from 80 quarters is not automatically informative; shrinkage, fewer variables/lags, or theory-based restrictions may be necessary.
Stacked regression form
For VAR(1), collect rows in and rows in . Then
Equation-by-equation OLS and multivariate least squares give the same coefficient estimates when every equation has the same regressors. The innovation covariance still matters for joint inference.
2. A two-variable shock calculation
Let demeaned electricity demand and price follow
Starting from a one-unit shock to the first innovation, , propagation is :
| first response | second response | |
|---|---|---|
| 0 | 1.000 | 0.000 |
| 1 | 0.600 | 0.100 |
| 2 | 0.380 | 0.110 |
| 3 | 0.250 | 0.093 |
| 4 | 0.169 | 0.072 |
Propagation of one identified shock
The first variable reacts immediately; the second receives a delayed spillover.
If contemporaneous innovations are correlated, “a shock to variable 1 while variable 2 is unchanged” is not identified by the reduced-form covariance alone. Cholesky ordering, long-run restrictions, sign restrictions, external instruments, or a structural model add different assumptions and may produce different paths.
3. Stationary covariance is a Lyapunov equation
For VAR(1),
the unconditional covariance satisfies
Using ,
Solve and verify a stationary VAR(1) covariance
The eigenvalues check stability, the covariance eigenvalues check validity, and the residual norm checks the Lyapunov equation. These are separate claims.
4. Granger predictability is deliberately modest
Granger-causes when lags of improve forecasts of after conditioning on the included history. Operationally, compare
with
and test .
| Result | Supported claim | Not supported without more design |
|---|---|---|
| reject restrictions | has incremental lagged predictive content in this specification | intervention on changes |
| fail to reject | sample does not show incremental linear content | is irrelevant in all horizons/regimes |
Omitted common causes, measurement timing, anticipation, aggregation, and regime changes can all alter the result.
5. Seasonality is not one phenomenon
For monthly data, . Choose the smallest assumption that matches the mechanism:
| Mechanism | Model device | Interpretation |
|---|---|---|
| stable January effect | 11 month indicators | deterministic seasonal mean |
| smoothly changing recurring pattern | Fourier sine/cosine terms | parsimonious deterministic cycle |
| seasonal shocks accumulate | seasonal stochastic trend | |
| dependence remains at seasonal lags | seasonal AR/MA terms | shocks propagate across years |
A multiplicative SARIMA model is written
Reading the notation
SARIMA means:
- one ordinary difference and one annual seasonal difference;
- one non-seasonal AR and MA term;
- one seasonal MA term linking shocks 12 months apart.
It does not mean the order is appropriate. Compare it with seasonal naive and inspect whether double differencing created strong negative autocorrelation.
6. Cointegration preserves a long-run relation
Suppose is a random walk and
where is stationary. Both levels are non-stationary, but
is stationary. The pair is cointegrated. Differencing both series independently would hide the equilibrium error .
A two-variable error-correction equation may be
If and the previous equilibrium error is 10, the correction contributes to the next change in . The sign tells how deviations are repaired; cointegration alone does not tell which variable adjusts or identify a causal mechanism.
7. Hierarchical forecasts must add up
Campus demand may be forecast for buildings, faculties, and the whole university; monthly forecasts must also aggregate to quarters and years. Independently fitted forecasts are usually incoherent:
Reconciliation projects or conditions base forecasts so aggregation constraints hold. Recent work on mixed-type probabilistic reconciliation extends this idea when a hierarchy combines counts and continuous quantities. Coherence is a logical requirement; accuracy gains remain empirical and must be backtested at every level.
8. Model-choice map
| Data question | First model | Add only if needed |
|---|---|---|
| one stationary series | ARMA | nonlinear/volatility structure |
| one seasonal series | seasonal naive + regression/SARIMA | multiple seasonalities or state space |
| several stationary series | VAR | structural identification or shrinkage |
| non-stationary levels with stable spread | VECM | breaks or time-varying relation |
| many aggregation levels | local models + reconciliation | joint probabilistic hierarchy |
Practice
- Multiply the worked VAR matrix by to verify the horizon-3 response.
- For , count VAR regression coefficients with intercepts.
- Give a predictive but non-causal explanation for why temperature lags improve electricity-demand forecasts.
- Explain why seasonal indicators and seasonal differencing encode different counterfactuals.
- If and , what is the error-correction contribution to ?
- For the R example, substitute the printed into and verify one matrix entry by hand.
Answers
- and .
- , before 36 innovation-covariance parameters.
- Temperature may proxy a common seasonal/calendar process; predictive timing alone does not identify an intervention effect.
- Indicators assume repeating mean levels; seasonal differencing assumes shocks can accumulate across the same season.
- , moving upward toward the relation.
- Any entry should agree up to printed rounding; the executable residual uses full precision.
Takeaway
Multivariate and seasonal models are block-matrix extensions of the univariate theory, but identification becomes harder as dimension grows. The 2024/25 VARMA review is a graduate bridge from these classical equations to current identification and estimation research. Continue to Spectral Analysis to study covariance by frequency rather than lag.
Module 4 — Estimation, Likelihood, and Inference
Derive AR estimators from regression and moment equations, evaluate exact Gaussian likelihoods with covariance matrices, and interpret uncertainty.
Module 6 — Spectral Analysis, Cycles, and Filters
Translate autocovariance into frequency, estimate spectra, diagnose cycles, and avoid aliasing and filtering leakage.