Statistical investigation and survey design for HSC Maths Standard 2: questionnaire design, ethics and privacy, sampling methods and whether a sample is representative (Year 11 Data analysis, 2024 syllabus)
“Pose a question for a targeted audience, develop a survey using questionnaire design principles, examine privacy, ethics and bias, and justify whether a sample is representative of the population by considering the sampling method”
A statistical investigation poses a question for a target population, uses a sampling method that gives everyone a fair chance, and asks clear, neutral questions with non-overlapping choices. Check privacy and ethics, and the response rate. Random, systematic and stratified samples tend to be representative, but convenience and self-selected samples are not. Part of Year 11 Data analysis in the 2024 Mathematics Standard syllabus.
Jump to a section
What this dot point is asking
In the Mathematics Standard 11-12 Syllabus (2024), first examined in the 2027 HSC, the Year 11 focus area Data analysis begins with the statistical investigation process. NESA asks you to identify an issue and pose a question to a targeted audience, develop a survey using "questionnaire design principles of clear language, unambiguous questions and consideration of number of choices", examine issues of privacy, ethics and responsiveness, and justify whether a sample is representative of the population by considering the sampling method. The Year 11 course is assumed knowledge in the Year 12 HSC. Our page on data collection and sampling covers the sampling methods themselves. This page adds the survey design and ethics, and the calculation work.
A survey is only as good as the people you ask and the way you ask them. Ask the wrong people and your answer describes them, not the population. Ask the question in a way that nudges, and you will get the answer you hoped for rather than the truth. Good statisticians plan both parts before they collect a single response.
The answer
Plan the investigation. Pose a clear question, identify the target population, choose a sampling method that gives everyone a fair chance, design neutral questions, collect the data, then analyse and report with the limits stated.
A sample is representative when its make-up reflects the population. Random, systematic and stratified samples support that. Convenience and self-selected samples usually do not.
Questionnaire design principles
- Clear language. Use plain words that every respondent understands.
- One idea per question. "How satisfied are you with the price and quality?" asks two things.
- Neutral wording. Avoid leading words such as "Don't you agree" or "obviously".
- Sensible response choices. Options must not overlap and should cover every answer ("0 to 5, 6 to 10, 11 or more", not "0 to 5, 5 to 10").
- A manageable number of choices. Too many options confuse respondents.
Privacy, ethics and responsiveness
- Collect only the information you need. Names and addresses are rarely needed.
- Tell respondents why you are collecting the data and keep answers anonymous or confidential.
- Take care with sensitive topics, and make the survey accessible to diverse groups of people (language, disability, age).
- Think about response rate: . A low rate raises the chance that the non-responders differ from responders, so the sample may not represent the population.
Calculations that go with sampling
- Systematic interval: . With people and a sample of , the interval is .
- Stratified sample: each group's share of the sample equals its share of the population. For from students in groups of , and , take , and .
- Scaling to a population: multiplying a sample percentage by the population only makes sense if the sample is representative.
Stratified sample sizes
A sample of from students is a fraction of , so , and students give , and in the sample.
Marker's note: check that the group sizes add to the sample size.
Self-selected poll
of online votes support a project (). Scaling to residents gives , but only listeners who chose to vote are in the sample, so the figure is not a reliable estimate for all residents.
Marker's note: say "self-selected" and explain what it does to the sample.
A leading question
"Don't you agree that students who stay up late are lazy?" is leading and double-barrelled. A fair version asks for bedtime with non-overlapping options.
Marker's note: both the fault and the fix are needed.
- Calling a large sample a good sample
- self-selected votes can be worse than randomly chosen people. How the sample is chosen matters more than how big it is.
- Overlapping response choices
- "5 to 10" and "10 to 15" both include .
- Confusing the sample with the population
- The target population is everyone the question is about, not the people you managed to reach.
- Treating a sample percentage as exact
- A sample estimate has error, even from a good sample.
In a "justify whether the sample is representative" question, name the sampling method, say who is included and who is left out, and then give a verdict. For a "rewrite the question" task, change the wording, split double-barrelled questions and list clear, non-overlapping choices.
Practice questions
Original practice questions graded from foundation to exam level, each with a full worked solution. Try them before revealing the solution.
foundation2 marksA school has students: in Year 10, in Year 11 and in Year 12. A stratified sample of students is taken, with each year group represented in proportion to its size. How many students are chosen from each year?
Show worked solution →
- Sampling fraction
- .
- Each stratum
- Year 10: . Year 11: . Year 12: .
- Check
- .
Marker's note: one mark for the sampling fraction (or the proportion method) and one for all three correct numbers.
foundation2 marksA systematic sample of is to be taken from a population of people listed in a database. Find the interval and describe how the sample is chosen.
Show worked solution →
Interval. , so every th person is chosen.
Method. Pick a random starting number from to , then choose every th person after it (for example, starting at : persons ).
Marker's note: one mark for the interval and one for a random start followed by every th.
core3 marksA survey was sent to households. households replied, and of replies were "very satisfied". (a) Find the response rate. (b) Find how many households were "very satisfied". (c) Explain why a low response rate can make the results unrepresentative.
Show worked solution →
- (a) Response rate
- .
- (b) Very satisfied
- households.
- (c) Bias
- People who feel strongly are more likely to reply, so the who did not reply may hold different views, and the sample may not represent the population.
Marker's note: one mark per part. For (c), link the low response rate to the people who did not reply, not just to the small number.
core3 marksA radio station asks listeners to vote online: votes are cast and say they support a new stadium. (a) What percentage support it? (b) The council has residents. A reporter says " residents support the stadium". Explain why this is not justified.
Show worked solution →
(a) Percentage. .
(b) Not justified. is the reporter's calculation, but the vote is a self-selected sample: only listeners who chose to vote are included, they may feel strongly about the issue, and non-listeners are missing. The sample is probably not representative of all residents, so the result should not be scaled to the whole population.
Marker's note: one mark for , one for naming self-selection, one for linking it to a lack of representativeness.
exam4 marksA student writes this question for a survey about sleep: "Don't you agree that students who stay up late are lazy? (Yes / No)". (a) Identify two faults in the question. (b) Rewrite it as a better question with clear response choices. (c) The survey asks for each student's name and address. Give one privacy or ethical concern.
Show worked solution →
- (a) Faults
- (i) It is a leading question: the wording "Don't you agree" and "lazy" pushes the respondent towards "Yes". (ii) It asks about two ideas at once (staying up late and laziness) and the choices Yes/No cannot capture degrees of opinion or the facts.
- (b) Better question
- "On a school night, what time do you usually go to sleep? (Before 9 pm / 9 pm to 10 pm / 10 pm to 11 pm / After 11 pm)". The wording is neutral, has one idea and gives clear, non-overlapping options.
- (c) Concern
- Collecting names and addresses identifies the respondents, so answers are not anonymous. Students may not answer honestly and their personal information could be misused if it is not stored securely, so only collect the information the investigation needs.
Marker's note: one mark each for two faults, one for a neutral rewritten question with distinct options, one for the privacy concern.
exam4 marksA council wants to know how residents travel to work. It plans to survey people standing outside the town railway station between am and am on a Monday. (a) Name the target population. (b) Identify the sampling method and one source of bias. (c) Suggest a better method and state how it would be carried out for a sample of residents listed on the electoral roll of people.
Show worked solution →
- (a) Target population
- All residents of the town who travel to work.
- (b) Method and bias
- This is a convenience sample: people at the station at peak time. It over-represents train commuters and leaves out drivers, cyclists, and people who work from home or at other hours.
- (c) Better method
- Use a random (or systematic) sample from the electoral roll. For a systematic sample of from , the interval is , so choose a random start from to and then every th person. Contact each by a method that gives everyone an equal chance to respond.
Marker's note: one mark for the population, one for method and bias, one for a better method, one for the interval .