Reliability and validity of health information: WACE Year 12 Health Studies Unit 4
“Evaluate the reliability and validity of health information and data, including the credibility of sources and the quality of methods”
Before acting on health information or data, you must judge its quality. Reliability is whether the information or method is consistent and would give the same result if repeated. Validity is whether it actually measures or shows what it claims to. Evaluating a source also means checking who produced it, why, when, and how the data were gathered, looking for bias, conflict of interest, sample problems and currency. WACE wants you to apply these tests to a specific source or dataset and reach a justified judgement.
What this dot point is asking
WACE expects you to evaluate, not just define. A strong answer applies reliability and validity to the actual source in the stimulus, checks the credibility markers, identifies a weakness, and states how much trust the information deserves. Marks reward applied judgement with reasons, not a textbook definition.
Reliability and validity
Reliability is consistency. A reliable method or measure produces similar results when repeated under the same conditions, by different people or at different times. If a survey gives wildly different results each time it is run with no real change in the population, it is unreliable.
Validity is accuracy of meaning. A valid method actually measures what it sets out to measure. A questionnaire that claims to measure physical activity but only asks about gym membership is not valid, because many active people never visit a gym.
The two are distinct and you need both. Information can be reliable but not valid (consistently measuring the wrong thing) or valid but unreliable (measuring the right thing inconsistently). Only information that is both can be trusted to support a decision.
Reliability is the consistency of a measure or method: whether repeating it gives similar results. Validity is whether the measure or method actually captures what it claims to. Both are required for trustworthy evidence, because a measure can be consistent yet wrong, or accurate in aim yet erratic in practice.
Judging the credibility of a source
Beyond the data itself, the source matters. Useful questions include who produced the information and what expertise they have, why it was produced and whether there is a commercial or political interest that could bias it, when it was published and whether it is current, and whether the claims are supported by evidence or reviewed by others. A government health body or peer-reviewed study generally carries more weight than an advertisement, a personal blog or a brand promoting its own product, because the latter have a motive to persuade rather than inform.
Information can be consistent yet measure the wrong thing (reliable but not valid) or measure the right thing erratically (valid but not reliable). Only information that is both can support a confident decision. Treat the two as separate tests and apply each to the source, rather than using reliable loosely to mean trustworthy in general.
Common weaknesses to look for
Several specific weaknesses reduce trust. Bias is any influence that skews the information toward a particular conclusion, including funding by a party that benefits. Sampling problems, such as a small, unrepresentative or self-selected sample, mean the findings may not generalise to the wider population. Currency matters because health knowledge changes, so out-of-date information may have been superseded. Confusing correlation with causation, or overstating a result beyond what the data support, are common errors in how findings are reported. Strong evaluation names the specific weakness rather than vaguely calling a source unreliable.
From evaluation to action
The purpose of this skill is safer decisions. Information that passes the tests of reliability, validity and credible sourcing can support a confident health decision or recommendation. Information that fails should be treated with caution or set aside, and a critical consumer seeks a better source rather than acting on weak evidence. This is the appraisal element of critical health literacy applied in practice, and it underpins the inquiry process and consumer health.
How this maps to the exam
Expect a stimulus presenting a source, study or dataset, sometimes with a flaw built in. You may be asked to evaluate its reliability, validity or credibility. Apply the tests to that specific source, name the weakness, and state how much the information should be trusted and why.
These questions usually plant a flaw. Apply the two tests separately, name the weakness, then state how much trust the source earns.
Apply validity first
Ask whether the source measures what it claims. For a study funded by the seller, the conflict of interest threatens validity because the design and reporting may be skewed toward a favourable result. State this as a validity problem.
Apply reliability next
Ask whether the method would give consistent, repeatable results. A small, self-selected sample is unlikely to, and cannot represent the wider population, so reliability and generalisability are weak. Keep this separate from validity.
Name the specific weaknesses
List them precisely: funding bias, small sample, self-selection, no peer review. Naming the weakness beats calling the source vaguely "unreliable".
State a justified level of trust
Conclude with a verdict tied to the evidence: the source deserves little trust on its own, so a consumer should seek independent, peer-reviewed studies with larger random samples before acting. The applied two-test judgement is the full-mark response.
Students frequently swap the two terms or use reliability to mean trustworthy in general. Keep them precise: reliability is consistency on repetition, validity is measuring the right thing. The marks come from applying each correctly to the source and explaining the consequence for trusting it.
Exam-style questions
Questions in the style of SCSA exam questions on this dot point, each with a worked answer. They are written by ExamExplained unless tagged "Past paper"; the year shows the paper a question is modelled on.
WACE 2022-style6 marksA health claim is based on a study funded by the company selling the product, using 30 self-selected participants. Evaluate the reliability and validity of this evidence and state how much it should be trusted.Show worked answer →
A 6 mark response needs both tests applied, the weaknesses named, and a justified verdict.
- Validity
- Company funding creates a conflict of interest that can bias the design and reporting toward a favourable result, threatening whether the study truly measures the product's effect.
- Reliability
- A small (30), self-selected sample is unlikely to give consistent results if repeated and is not representative, so reliability and generalisability are weak.
- Name the weaknesses
- Funding bias, small unrepresentative sample, self-selection.
- Verdict
- The evidence deserves little trust on its own; a consumer should seek independent, peer-reviewed studies with larger random samples before acting.
Markers reward validity and reliability applied separately, the specific weaknesses named, and a justified level of trust.
WACE 2023-style4 marksDistinguish between reliability and validity, using a health measurement example for each.Show worked answer →
A 4 mark response needs both definitions with a fitting example.
Reliability (consistency). A method that gives similar results when repeated. Example: a blood-pressure monitor that reads the same value on repeated checks of the same person.
Validity (accuracy of meaning). A method that measures what it claims. Example: a questionnaire claiming to measure physical activity but only asking about gym membership is not valid, since many active people never use a gym.
Markers reward both definitions kept distinct and an example showing each.