Transition matrices (SACE Stage 2 General Mathematics)
“Use transition matrices and an initial state vector to predict future states and to find the long-term steady state of a system.”
A transition matrix stores the proportions moving between categories each step. Multiply it by the current state to get the next state: . After many steps the state usually settles to a steady state that stops changing.
Jump to a section
What this dot point is asking
You must build a transition matrix from movement data, predict the state after one or more steps, and find or interpret the long-term steady state.
Setting up a transition matrix
A system moves objects (customers, animals, voters) between a fixed set of categories at constant rates each period. The transition matrix records these rates. Using the convention , the entry in row , column is the proportion moving from category into category . Each column therefore sums to 1, since everything currently in a category must go somewhere.
The state vector is a column listing the amount in each category after steps. The transition matrix holds the step-to-step proportions, with columns summing to 1. The recurrence is , and after steps .
Two competing supermarkets
Each week 80% of shoppers at store A return to A and 20% switch to B; 90% at B return to B and 10% switch to A. Set up the transition matrix with order A then B.
Column A describes shoppers starting at A: 0.8 stay at A, 0.2 go to B. Column B describes shoppers starting at B: 0.1 go to A, 0.9 stay at B.
Each column sums to 1, as it must.
Predicting future states
To advance one week, multiply the current state by . Repeat, or use to jump ahead.
One week ahead
Suppose 1000 shoppers start at A and 1000 at B, so . Find next week's distribution.
After one week 900 shop at A and 1100 at B. The column totals still add to 2000, confirming no shoppers are lost.
The long-term steady state
As grows, the state vector usually settles to a fixed steady state that satisfies and stops changing from week to week. You can find it by computing high powers until the numbers stabilise, or by solving with the constraint that the categories add to the total.
The steady state satisfies : applying the transition matrix leaves it unchanged. The total population stays constant, so for a population of split into two categories you solve together with the two parts adding to .
Long-run split of shoppers
Find the steady-state split of the 2000 shoppers. Let the steady state be with .
From , the first row gives , so , that is . Substituting into :
So in the long run about 667 shop at A and about 1333 at B, and this split no longer changes week to week.
Why a steady state exists
The reason the system settles is that the transition matrix gently pulls the state toward a balance point. Whenever more leave a category than join it, that category shrinks; whenever more join than leave, it grows. The steady state is precisely where these flows balance for every category at once, so . For a regular transition matrix - one where some power has all positive entries - this balance point is unique and is reached from any starting distribution, which is why the long-run market share does not depend on where the shoppers began. This is the key insight examiners want you to articulate when interpreting a steady state.
Interpreting the result in context
The steady state predicts the eventual market share regardless of where shoppers started, provided the transition rates stay constant. Examiners reward a sentence interpreting the numbers, for example "store B eventually holds about two-thirds of the market."
After writing , add each column. If any column does not sum to 1 you have made an error, because everything in a category must move somewhere. This quick check catches most setup mistakes before you compute.
Do not mix up rows and columns when building under the convention. With this convention the columns (not the rows) must sum to 1, and the entry in row , column is the proportion moving from into . Putting the "stay" and "leave" percentages in the wrong cells gives the wrong predictions.
Exam-style questions
Questions in the style of SACE Board exam questions on this dot point, each with a worked answer. They are written by ExamExplained unless tagged "Past paper"; the year shows the paper a question is modelled on.
Practice5 marksCalculator-assumed. Each week 80% of shoppers at store A return to A and 20% switch to B; 90% at B return to B and 10% switch to A. Initially 1000 shop at A and 1000 at B. (a) Write the transition matrix (order A then B). (b) Find the distribution after one week. (c) Find the long-term steady-state distribution of the 2000 shoppers.Show worked answer →
(a) Columns describe where shoppers start: , each column summing to 1. (1 mark)
(b) : 900 at A, 1100 at B. (2 marks)
(c) Steady state with and . The first row gives , so , i.e. . Then , so and . (2 marks)
Marks: one for with valid columns, two for the one-week product, two for solving the steady state.
Practice3 marksCalculator-assumed. A transition matrix is with initial state . Find the state after two steps, .Show worked answer →
First step: . [1 mark]
Second step: . [2 marks]
The total stays 1000 at each step, confirming no loss.