STOP 26 / 31Make uncertainty useful.
Layout
STOP 26 · In practice

Make uncertainty useful.

EXPLORE~7 min
Back to route map
  • Northstar doesn’t just want an estimate for next month.
  • Its inventory team needs to know the plausible upside and downside, especially over the Black Friday period.
Sources of uncertainty in Northstar's sales forecast. Illustrative Northstar examples, not measured business results.
SourceWhat it meansNorthstar example
Future randomness

Outcomes fluctuate even when the model and its parameters are correct.

Northstar's individual buyer decisions can make actual daily sales differ from the conditional mean.

Estimated parameters

Trend and seasonal effects are learned with uncertainty, not known perfectly.

A short Northstar history may not pin down next year's holiday lift precisely.

Model or structural uncertainty

Omitted mechanisms and future business changes may not be captured by a model's default intervals.

Northstar may face a new competitor, changing assortment, or different customer behavior after the model was fitted.

FIG 26.1

The further ahead, the wider the range

WHAT THIS SHOWS

Each dot is one independent simulated forecast case. Green shading is the stated prediction interval; red dots missed it. Change the nominal level or the assumed uncertainty, then count actual coverage.

The question it answers: Does Northstar's stated interval cover unseen outcomes as often as it claims?

7090110130120 independent cases · ordered by increasing forecast horizon
Nominal coverage80%
Observed coverage80.8%
Outside the interval23 / 120
Reference checkConsistent in this sample
Fine print & method

The generator supplies independent normal errors with known, horizon-dependent variance. An uncertainty multiplier of 100% uses that known variance; other values deliberately misstate it. Actual finite-sample coverage need not equal the nominal percentage. The displayed reference uses a rough two-standard-error binomial comparison, not proof of calibration. This is not one correlated future sales path or a fitted production interval. Wider is not automatically better; assess both coverage and sharpness across honest backtests.

CHECK YOURSELF · CHOOSE AN ANSWER

Can you add each day’s 80% lower and upper limits to obtain an 80% monthly interval?

Your learning note

Private · just for you