How do residuals tell us whether a straight line was the right model?
Calculate residuals, construct and interpret a residual plot, and use it to judge whether a linear model is appropriate.
How to calculate a residual as observed minus predicted, build a residual plot, and read it to decide whether a straight line fits or whether the data needs transforming.
Reviewed by: AI editorial process; not yet individually human-reviewed
Have a quick question? Jump to the Q&A page
Jump to a section
What this dot point is asking
You must calculate residuals, construct and read a residual plot, and use it to judge whether a linear model fits.
What a residual is
After fitting the least-squares line, each data point has a predicted value from the line and an observed (actual) value. The difference is the residual.
A positive residual means the point lies above the line (the model underpredicted); a negative residual means it lies below (the model overpredicted). The least-squares line is built so the residuals sum to zero.
The residual plot
A residual plot graphs the residual on the vertical axis against the explanatory variable on the horizontal axis, with a reference line at zero. It magnifies any pattern the line failed to capture.
What the shapes mean:
- No pattern (random scatter): linear model is appropriate.
- Curved pattern (U or arch): the true relationship is non-linear; transform the data.
- Fan shape (spread grows or shrinks): the scatter is not constant; the linear model may be unreliable for predictions.
Using the residual plot in the investigation
The residual plot is the diagnostic step after fitting a line. A high correlation coefficient is not enough on its own: a curved data set can still give a large . The residual plot is the more reliable check, because a curve hidden in a high- scatterplot shows up clearly as a pattern in the residuals. When you see a pattern, return to the transformation step and straighten the data before re-fitting.
Properties of residuals
Two facts about least-squares residuals are worth knowing. First, the residuals always sum to zero, because the line is positioned so the positive and negative gaps balance; this is a quick check on a completed residual table. Second, the least-squares line passes through the mean point , so the residual at the mean is zero. These properties follow from how the line is fitted to minimise the sum of squared residuals.
A worked residual-plot reading
Suppose a line is fitted to data and the residuals, read left to right across the explanatory variable, run . Plotted against , these rise from negative to positive and back to negative, an arch (curved) pattern rather than random scatter. That arch is the signal that the true relationship curves and the straight line systematically under- then over-predicts, so a transformation (such as squaring or a logarithm) is needed before a line is appropriate. A genuinely random set of residuals would show no such run of signs.
Exam-style practice questions
Practice questions written in the style of SCSA exam questions on this dot point, with worked answer explainers. The year tag is the paper they imitate, not the source.
WACE 20225 marksA least-squares line is fitted to data. At the observed value is . (a) Calculate the predicted value and the residual. (b) State what the sign of the residual tells you. (c) Explain what a clear curved pattern in the residual plot would indicate.Show worked answer →
A residual is the observed value minus the predicted value.
(a) Predicted . Residual . (3 marks)
(b) The positive residual means the observed point lies above the line, so the model underpredicted at . (1 mark)
(c) A clear curved pattern in the residual plot indicates the linear model is not appropriate; the relationship is non-linear and the data should be transformed before fitting a line. (1 mark)
Markers reward observed-minus-predicted, the above-the-line meaning of a positive residual, and reading a curved residual plot as non-linearity.
WACE 20244 marksExplain what a residual plot is and describe what its appearance should look like if a straight line is an appropriate model for the data.Show worked answer →
A residual plot graphs the residuals against the explanatory variable.
A residual plot has the explanatory variable on the horizontal axis and the residual (observed minus predicted) on the vertical axis, with a horizontal line at zero. (2 marks)
If the linear model is appropriate, the residuals are scattered randomly above and below zero with no pattern, roughly evenly spread. A pattern such as a curve or a fan shape signals that a straight line is not appropriate. (2 marks)
Markers reward the axes of the plot and "random scatter about zero" as the signal of a good linear fit.
