Skip to main content

Statistical investigation and survey design for HSC Maths Standard 2: questionnaire design, ethics and privacy, sampling methods and whether a sample is representative (Year 11 Data analysis, 2024 syllabus)

Syllabus dot point

“Pose a question for a targeted audience, develop a survey using questionnaire design principles, examine privacy, ethics and bias, and justify whether a sample is representative of the population by considering the sampling method”

10 min read

Quick answer

A statistical investigation poses a question for a target population, uses a sampling method that gives everyone a fair chance, and asks clear, neutral questions with non-overlapping choices. Check privacy and ethics, and the response rate. Random, systematic and stratified samples tend to be representative, but convenience and self-selected samples are not. Part of Year 11 Data analysis in the 2024 Mathematics Standard syllabus.

Jump to a section
  1. What this dot point is asking
  2. The answer
  3. Practice questions

What this dot point is asking

In the Mathematics Standard 11-12 Syllabus (2024), first examined in the 2027 HSC, the Year 11 focus area Data analysis begins with the statistical investigation process. NESA asks you to identify an issue and pose a question to a targeted audience, develop a survey using "questionnaire design principles of clear language, unambiguous questions and consideration of number of choices", examine issues of privacy, ethics and responsiveness, and justify whether a sample is representative of the population by considering the sampling method. The Year 11 course is assumed knowledge in the Year 12 HSC. Our page on data collection and sampling covers the sampling methods themselves. This page adds the survey design and ethics, and the calculation work.

Note

A survey is only as good as the people you ask and the way you ask them. Ask the wrong people and your answer describes them, not the population. Ask the question in a way that nudges, and you will get the answer you hoped for rather than the truth. Good statisticians plan both parts before they collect a single response.

The answer

Key fact

Plan the investigation. Pose a clear question, identify the target population, choose a sampling method that gives everyone a fair chance, design neutral questions, collect the data, then analyse and report with the limits stated.

A sample is representative when its make-up reflects the population. Random, systematic and stratified samples support that. Convenience and self-selected samples usually do not.

Questionnaire design principles

  • Clear language. Use plain words that every respondent understands.
  • One idea per question. "How satisfied are you with the price and quality?" asks two things.
  • Neutral wording. Avoid leading words such as "Don't you agree" or "obviously".
  • Sensible response choices. Options must not overlap and should cover every answer ("0 to 5, 6 to 10, 11 or more", not "0 to 5, 5 to 10").
  • A manageable number of choices. Too many options confuse respondents.

Privacy, ethics and responsiveness

  • Collect only the information you need. Names and addresses are rarely needed.
  • Tell respondents why you are collecting the data and keep answers anonymous or confidential.
  • Take care with sensitive topics, and make the survey accessible to diverse groups of people (language, disability, age).
  • Think about response rate: number of repliesnumber surveyed\frac{\text{number of replies}}{\text{number surveyed}}. A low rate raises the chance that the non-responders differ from responders, so the sample may not represent the population.

Calculations that go with sampling

  • Systematic interval: populationsample size\frac{\text{population}}{\text{sample size}}. With 840840 people and a sample of 3535, the interval is 2424.
  • Stratified sample: each group's share of the sample equals its share of the population. For 6060 from 600600 students in groups of 240240, 200200 and 160160, take 2424, 2020 and 1616.
  • Scaling to a population: multiplying a sample percentage by the population only makes sense if the sample is representative.
Worked examples

Stratified sample sizes

A sample of 6060 from 600600 students is a fraction of 110\frac{1}{10}, so 240240, 200200 and 160160 students give 2424, 2020 and 1616 in the sample.

Marker's note: check that the group sizes add to the sample size.

Self-selected poll

31503150 of 45004500 online votes support a project (70%70\%). Scaling to 60 00060\,000 residents gives 42 00042\,000, but only listeners who chose to vote are in the sample, so the figure is not a reliable estimate for all residents.

Marker's note: say "self-selected" and explain what it does to the sample.

A leading question

"Don't you agree that students who stay up late are lazy?" is leading and double-barrelled. A fair version asks for bedtime with non-overlapping options.

Marker's note: both the fault and the fix are needed.

Common traps
Calling a large sample a good sample
45004500 self-selected votes can be worse than 150150 randomly chosen people. How the sample is chosen matters more than how big it is.
Overlapping response choices
"5 to 10" and "10 to 15" both include 1010.
Confusing the sample with the population
The target population is everyone the question is about, not the people you managed to reach.
Treating a sample percentage as exact
A sample estimate has error, even from a good sample.
Exam technique

In a "justify whether the sample is representative" question, name the sampling method, say who is included and who is left out, and then give a verdict. For a "rewrite the question" task, change the wording, split double-barrelled questions and list clear, non-overlapping choices.

Practice questions

Original practice questions graded from foundation to exam level, each with a full worked solution. Try them before revealing the solution.

foundation2 marks
A school has 600600 students: 240240 in Year 10, 200200 in Year 11 and 160160 in Year 12. A stratified sample of 6060 students is taken, with each year group represented in proportion to its size. How many students are chosen from each year?
Show worked solution →
Sampling fraction
60600=110\frac{60}{600} = \frac{1}{10}.
Each stratum
Year 10: 240×110=24240 \times \frac{1}{10} = 24. Year 11: 200×110=20200 \times \frac{1}{10} = 20. Year 12: 160×110=16160 \times \frac{1}{10} = 16.
Check
24+20+16=6024 + 20 + 16 = 60.

Marker's note: one mark for the sampling fraction (or the proportion method) and one for all three correct numbers.

foundation2 marks
A systematic sample of 3535 is to be taken from a population of 840840 people listed in a database. Find the interval and describe how the sample is chosen.
Show worked solution →

Interval. 84035=24\frac{840}{35} = 24, so every 2424th person is chosen.

Method. Pick a random starting number from 11 to 2424, then choose every 2424th person after it (for example, starting at 77: persons 7,31,55,…7, 31, 55, \ldots).

Marker's note: one mark for the interval 2424 and one for a random start followed by every 2424th.

core3 marks
A survey was sent to 12001200 households. 312312 households replied, and 25%25\% of replies were "very satisfied". (a) Find the response rate. (b) Find how many households were "very satisfied". (c) Explain why a low response rate can make the results unrepresentative.
Show worked solution →
(a) Response rate
3121200=0.26=26%\frac{312}{1200} = 0.26 = 26\%.
(b) Very satisfied
25%×312=0.25×312=7825\% \times 312 = 0.25 \times 312 = 78 households.
(c) Bias
People who feel strongly are more likely to reply, so the 74%74\% who did not reply may hold different views, and the sample may not represent the population.

Marker's note: one mark per part. For (c), link the low response rate to the people who did not reply, not just to the small number.

core3 marks
A radio station asks listeners to vote online: 45004500 votes are cast and 31503150 say they support a new stadium. (a) What percentage support it? (b) The council has 60 00060\,000 residents. A reporter says "42 00042\,000 residents support the stadium". Explain why this is not justified.
Show worked solution →

(a) Percentage. 31504500=0.70=70%\frac{3150}{4500} = 0.70 = 70\%.

(b) Not justified. 70%×60 000=42 00070\% \times 60\,000 = 42\,000 is the reporter's calculation, but the vote is a self-selected sample: only listeners who chose to vote are included, they may feel strongly about the issue, and non-listeners are missing. The sample is probably not representative of all residents, so the result should not be scaled to the whole population.

Marker's note: one mark for 70%70\%, one for naming self-selection, one for linking it to a lack of representativeness.

exam4 marks
A student writes this question for a survey about sleep: "Don't you agree that students who stay up late are lazy? (Yes / No)". (a) Identify two faults in the question. (b) Rewrite it as a better question with clear response choices. (c) The survey asks for each student's name and address. Give one privacy or ethical concern.
Show worked solution →
(a) Faults
(i) It is a leading question: the wording "Don't you agree" and "lazy" pushes the respondent towards "Yes". (ii) It asks about two ideas at once (staying up late and laziness) and the choices Yes/No cannot capture degrees of opinion or the facts.
(b) Better question
"On a school night, what time do you usually go to sleep? (Before 9 pm / 9 pm to 10 pm / 10 pm to 11 pm / After 11 pm)". The wording is neutral, has one idea and gives clear, non-overlapping options.
(c) Concern
Collecting names and addresses identifies the respondents, so answers are not anonymous. Students may not answer honestly and their personal information could be misused if it is not stored securely, so only collect the information the investigation needs.

Marker's note: one mark each for two faults, one for a neutral rewritten question with distinct options, one for the privacy concern.

exam4 marks
A council wants to know how residents travel to work. It plans to survey people standing outside the town railway station between 77 am and 99 am on a Monday. (a) Name the target population. (b) Identify the sampling method and one source of bias. (c) Suggest a better method and state how it would be carried out for a sample of 150150 residents listed on the electoral roll of 60006000 people.
Show worked solution →
(a) Target population
All residents of the town who travel to work.
(b) Method and bias
This is a convenience sample: people at the station at peak time. It over-represents train commuters and leaves out drivers, cyclists, and people who work from home or at other hours.
(c) Better method
Use a random (or systematic) sample from the electoral roll. For a systematic sample of 150150 from 60006000, the interval is 6000150=40\frac{6000}{150} = 40, so choose a random start from 11 to 4040 and then every 4040th person. Contact each by a method that gives everyone an equal chance to respond.

Marker's note: one mark for the population, one for method and bias, one for a better method, one for the interval 4040.

Practise this

Sources & how we know this

ExamExplained