How do we predict the future state of a system that moves between categories at fixed rates?
Use transition matrices and an initial state vector to predict future states and to find the long-term steady state of a system.
How to set up a transition matrix from movement percentages, apply it to an initial state to predict future states, and find the long-term steady state of a system.
Reviewed by: AI editorial process; not yet individually human-reviewed
Have a quick question? Jump to the Q&A page
Jump to a section
What this dot point is asking
You must build a transition matrix from movement data, predict the state after one or more steps, and find or interpret the long-term steady state.
Setting up a transition matrix
A system moves objects (customers, animals, voters) between a fixed set of categories at constant rates each period. The transition matrix records these rates. Using the convention , the entry in row , column is the proportion moving from category into category . Each column therefore sums to 1, since everything currently in a category must go somewhere.
Predicting future states
To advance one week, multiply the current state by . Repeat, or use to jump ahead.
The long-term steady state
As grows, the state vector usually settles to a fixed steady state that satisfies and stops changing from week to week. You can find it by computing high powers until the numbers stabilise, or by solving with the constraint that the categories add to the total.
Why a steady state exists
The reason the system settles is that the transition matrix gently pulls the state toward a balance point. Whenever more leave a category than join it, that category shrinks; whenever more join than leave, it grows. The steady state is precisely where these flows balance for every category at once, so . For a regular transition matrix - one where some power has all positive entries - this balance point is unique and is reached from any starting distribution, which is why the long-run market share does not depend on where the shoppers began. This is the key insight examiners want you to articulate when interpreting a steady state.
Interpreting the result in context
The steady state predicts the eventual market share regardless of where shoppers started, provided the transition rates stay constant. Examiners reward a sentence interpreting the numbers, for example "store B eventually holds about two-thirds of the market."
Exam-style practice questions
Practice questions written in the style of SACE Board exam questions on this dot point, with worked answer explainers. The year tag is the paper they imitate, not the source.
SACE 20235 marksCalculator-assumed. Each week 80% of shoppers at store A return to A and 20% switch to B; 90% at B return to B and 10% switch to A. Initially 1000 shop at A and 1000 at B. (a) Write the transition matrix (order A then B). (b) Find the distribution after one week. (c) Find the long-term steady-state distribution of the 2000 shoppers.Show worked answer β
(a) Columns describe where shoppers start: , each column summing to 1. (1 mark)
(b) : 900 at A, 1100 at B. (2 marks)
(c) Steady state with and . The first row gives , so , i.e. . Then , so and . (2 marks)
Marks: one for with valid columns, two for the one-week product, two for solving the steady state.
SACE 20223 marksCalculator-assumed. A transition matrix is with initial state . Find the state after two steps, .Show worked answer β
First step: . [1 mark]
Second step: . [2 marks]
The total stays 1000 at each step, confirming no loss.
