Sample means and sampling distributions (SACE Stage 2 Mathematical Methods)
“The sampling distribution of the sample mean is approximately normal, centred on the population mean, with a standard deviation that shrinks as the sample size grows.”
If you take many samples of size and record each sample mean , those means form a sampling distribution. It is centred on the population mean () with standard deviation (the standard error) , and by the Central Limit Theorem it is approximately normal for large .
Jump to a section
What this dot point is asking
A single sample gives one estimate of the population mean, but if you took another sample you would get a slightly different . The sampling distribution of the sample mean describes how these sample means vary from sample to sample.
The sampling distribution of the sample mean is the probability distribution of the values of obtained from all possible samples of a fixed size drawn from the population.
Mean and standard error
The sampling distribution has a smaller spread than the population, because averaging cancels out extreme individual values.
The quantity is called the standard error of the mean.
The standard error shrinks as grows, but only with - to halve the spread you must take four times as many observations.
A population has and . This example finds the mean and standard error of the sampling distribution of for samples of size .
Step 1: state the mean of the sampling distribution
The mean of the sampling distribution of always equals the population mean, regardless of sample size. Averaging does not introduce any systematic shift, so:
Step 2: compute the standard error
The standard error measures how much sample means vary from sample to sample. It equals the population standard deviation divided by the square root of the sample size, so larger samples produce less variable means:
Final answer: the sampling distribution has mean and standard error , far tighter than the population spread of .
The Central Limit Theorem
For a sufficiently large sample size (a common rule of thumb is ), the sampling distribution of is approximately normal, regardless of the shape of the original population. If the population is itself normal, is exactly normal for any .
This is what makes statistical inference possible: even with a skewed population, you can use normal-distribution methods on the sample mean.
Using the same population (, , , giving ), this example finds the probability that a sample mean exceeds .
Step 1: standardise using the standard error, not
When working with a sample mean rather than a single observation, the denominator of the z-score formula is the standard error , not the population standard deviation . Using alone would treat the sample mean as if it were one individual value and drastically overstate the spread:
Step 2: find the tail probability
The event is a right-tail area. Calculators return left-tail areas by default, so we subtract from :
Final answer: there is approximately a chance that a sample of observations has a mean exceeding .
Sums versus means
SACE questions phrase the same idea two ways: the sample mean and the sample sum . For the sum, the mean is and the standard deviation is , because both the means and the variances of independent observations add. For the mean, dividing the sum by gives mean and standard deviation . Notice the contrast: the spread of a sum grows with while the spread of a mean shrinks with . Reading whether the question is about a total or an average decides which result you use.
Why averaging reduces spread
It is worth understanding why the standard error shrinks. In any sample, some observations land above the population mean and some below; when you average them, the high and low values partly cancel. The larger the sample, the more complete this cancellation, so sample means cluster ever more tightly around . The rather than in the denominator reflects that this cancellation is partial - randomness does not vanish, it just averages down at the rate of the square root of the sample size, which is the law of diminishing returns behind every sample-size calculation.
Common errors
When standardising a sample mean, you must divide by the standard error , not the population standard deviation . Using alone treats as if it were a single observation and badly overstates the spread. The in the denominator is the whole point - it is why sample means are more reliable than individual values.
Read the question carefully: for one individual uses , but for a sample mean uses . Underline whether the quantity is a single observation or an average before you standardise.
Why it matters
The sampling distribution is the conceptual core of Topic 6. The standard error and the Central Limit Theorem are exactly what allow you to build confidence intervals for a population mean in the next dot points, and they explain why larger samples give more precise estimates.
Exam-style questions
Questions in the style of SACE Board exam questions on this dot point, each with a worked answer. They are written by ExamExplained unless tagged "Past paper"; the year shows the paper a question is modelled on.
SACE 2023-style2 marksCalculator-assumed. Daily milk production per cow has mean litres and standard deviation litres. Let be the total daily production of a random sample of 90 cows. Show that has mean litres and standard deviation litres (to four significant figures).Show worked answer →
For a sum of independent observations, the means add and the variances add (so the standard deviation is multiplied by ).
Mean of litres.
Standard deviation of litres.
Marks: one for the mean, one for the standard deviation using (not ). Only variances add directly, so the standard deviation scales with .
SACE 2022-style2 marksCalculator-assumed. The number of shares of a meme has mean and standard deviation . Let be the sum of the shares of a random sample of 75 memes. Show that has mean shares and standard deviation shares.Show worked answer →
For the sum of independent variables, multiply the mean by and the standard deviation by .
Mean of shares.
Standard deviation of shares.
Marks: one for the mean, one for the standard deviation using . By the Central Limit Theorem is also approximately normal.
SACE 2021-style3 marksCalculator-assumed. A population has mean and standard deviation . A random sample of size is taken. (a) State the mean and standard error of . (b) Find .Show worked answer →
(a) and . (1 mark)
(b) Standardise the sample mean using the standard error: . Then . (2 marks)
Marks reward using the standard error , not , when standardising a sample mean.