How do we predict the future state of a system that moves between categories at fixed rates?
Use transition matrices and an initial state vector to predict future states and to find the long-term steady state of a system.
How to set up a transition matrix from movement percentages, apply it to an initial state to predict future states, and find the long-term steady state of a system.
Reviewed by: AI editorial process; not yet individually human-reviewed
Have a quick question? Jump to the Q&A page
Jump to a section
What this dot point is asking
You must build a transition matrix from movement data, predict the state after one or more steps, and find or interpret the long-term steady state.
Setting up a transition matrix
A system moves objects (customers, animals, voters) between a fixed set of categories at constant rates each period. The transition matrix records these rates. Using the convention , the entry in row , column is the proportion moving from category into category . Each column therefore sums to 1, since everything currently in a category must go somewhere.
Predicting future states
To advance one week, multiply the current state by . Repeat, or use to jump ahead.
The long-term steady state
As grows, the state vector usually settles to a fixed steady state that satisfies and stops changing from week to week. You can find it by computing high powers until the numbers stabilise, or by solving with the constraint that the categories add to the total.
Interpreting the result in context
The steady state predicts the eventual market share regardless of where shoppers started, provided the transition rates stay constant. Examiners reward a sentence interpreting the numbers, for example "store B eventually holds about two-thirds of the market."