HSC Investigating Science Module 7 Fact or Fallacy: deep-dive 2026 guide
Module 7 rewards applying frameworks to named cases: distinguish science from pseudoscience using falsifiability and the other criteria, separate correlation from causation using confounders, reverse causation, chance and the Bradford Hill criteria, rank evidence with the hierarchy from meta-analyses down to anecdote, and evaluate a media claim by interrogating its study type, sample, effect size, replication and funding.
Jump to a section
How Module 7 fits into HSC Investigating Science
Module 7, Fact or Fallacy, is where the methodology of Module 5 becomes a tool for judgement. Instead of designing investigations, you evaluate claims: is this scientific or pseudoscientific, is this correlation actually causation, is this evidence strong or weak, is this reasoning sound or fallacious. It is the module that most directly feeds the longer extended-response items in Section II, where you are typically given a claim or scenario and asked to evaluate the science and the evidence.
The examiner reward pattern is consistent: criteria applied to specific named examples beat rote definitions every time. A student who writes "homeopathy is unfalsifiable because defenders attribute every failed trial to a non-individualised remedy, and dilutions of 10 to the power 60 leave no molecules of the original substance" outscores one who lists the eight features of pseudoscience without ever touching a real case. This guide builds the frameworks and pairs each with the named cases markers expect.
Distinguishing science from pseudoscience
Science is a process for producing knowledge through evidence and self-correction. Pseudoscience borrows the language and trappings of science without its substance.
Characteristics of a scientific claim:
- Falsifiable. A possible observation could prove it wrong.
- Empirical. Supported by observation or experiment.
- Peer reviewed. Scrutinised by independent experts before publication.
- Replicable. Independent researchers can repeat the method and obtain similar results.
- Provisional and self-correcting. Revised when new evidence emerges.
- Mechanistic. Offers a plausible cause linked to wider scientific knowledge.
- Quantitative. Makes specific, measurable predictions.
Characteristics of a pseudoscientific claim:
- Unfalsifiable. No conceivable observation could disprove it; contrary evidence is explained away.
- Anecdotal. Relies on testimonials rather than controlled studies.
- Not peer reviewed. Self-published and marketed directly.
- Not replicable. Methods are vague or proprietary.
- Resistant to revision. Defended even against overwhelming contrary evidence.
- No plausible mechanism. None proposed, or one inconsistent with established science.
- Vague. Qualitative claims like "balances energy" that are hard to test.
- Appeals to authority or tradition. Justified by celebrity or ancient wisdom rather than evidence.
Falsifiability is Karl Popper's criterion (from The Logic of Scientific Discovery, 1934) that a claim is scientific only if some possible observation or experiment could prove it wrong. A claim no result could ever disprove is empirically empty.
The demarcation problem
The boundary between science and pseudoscience is debated by philosophers of science. Karl Popper (1934) proposed falsifiability as the criterion. Thomas Kuhn (1962) emphasised paradigms and normal-science problem-solving. Imre Lakatos (in the 1970s) distinguished progressive research programmes from degenerating ones. For HSC purposes, the Popperian falsifiability criterion plus the characteristics above is sufficient, but the strongest answers acknowledge that some claims sit at the boundary.
Boundary cases reward nuance. Acupuncture shows modest evidence for some pain conditions in controlled trials but weak or absent evidence for many other claimed indications, so it is partly evidence-based and partly marketed pseudoscientifically. Some supplement claims (correcting vitamin D deficiency) are evidence-based while others (anti-ageing) are not. The criteria let you reason about a claim piece by piece rather than labelling whole fields.
Science can be wrong. The difference is that science is a self-correcting process: peer review and replication expose and overturn errors. Pseudoscience may occasionally state something true, but lacks the systematic process that makes its successes reliable. The distinction is methodological, not about who happens to be right today.
Claim: "Hydroxychloroquine cures COVID-19."
In early 2020 hydroxychloroquine was promoted as a COVID-19 treatment on the basis of an in vitro study and small uncontrolled case series.
- Falsifiable? Yes, large randomised trials could test it.
- Tested? Yes. The UK RECOVERY trial (over 11,000 participants), the WHO SOLIDARITY trial and Australia's ASCOT trial all enrolled hospitalised patients.
- Result? Multiple large randomised controlled trials found no benefit and possible harm.
- Self-correction? The drug was removed from COVID-19 treatment guidelines globally.
This is science working as intended: a claim built on weak evidence was tested rigorously, found unsupported, and the consensus updated. The claim would only have become pseudoscientific if its proponents had refused to accept the trial results, as some did.
Correlation versus causation
A correlation is a statistical association; as one variable changes the other tends to change in a related way, measured by the correlation coefficient r from minus 1 to plus 1. Causation is a directed relationship where changing one variable produces a change in the other.
The asymmetry is the key fact: all causation produces correlation, but not all correlation indicates causation. Three reasons a correlation can exist without causation:
- Confounding. A third variable causes both. Ice cream sales and drowning deaths both rise in summer because hot weather drives both. Eating ice cream does not cause drowning.
- Reverse causation. The supposed effect is actually the cause. A correlation between cannabis use and depression might reflect people with depression self-medicating, rather than cannabis causing depression.
- Chance. Random fluctuations produce associations in large datasets. Test 100 random hypotheses at p less than 0.05 and on average five will appear "significant" by chance alone.
The post hoc fallacy ("after this, therefore because of this") treats a temporal sequence as proof of causation. Temporal sequence is necessary for causation but not sufficient. An MMR vaccination given just before the typical age of an autism diagnosis is a temporal coincidence, not evidence of cause.
The Bradford Hill criteria
In 1965 the epidemiologist Sir Austin Bradford Hill proposed considerations for inferring causation from observational evidence, used when randomised trials are unethical or impossible. They are a set of considerations to weigh, not a checklist:
- Strength of association. Strong associations are less easily explained by confounders.
- Consistency. Reproduced across populations, places and times.
- Specificity. The cause is linked to a specific outcome.
- Temporal sequence. The exposure precedes the outcome.
- Biological gradient (dose-response). More exposure produces more outcome.
- Plausibility. A mechanism consistent with current knowledge exists.
- Coherence. The relationship fits known facts about the disease.
- Experimental evidence. Where possible, intervention reduces the outcome.
- Analogy. Similar cause-effect relationships exist elsewhere.
In the 1950s observational studies (Doll and Hill in the UK) found smokers had far higher lung cancer rates than non-smokers. Tobacco companies argued this was only correlation. Applying the Bradford Hill criteria settled the question:
- Strength. Smokers had over ten times the risk.
- Consistency. Replicated in dozens of studies across many countries.
- Temporal sequence. Smoking preceded cancer onset by decades.
- Dose-response. Pack-years strongly predicted risk.
- Plausibility. Tobacco smoke contains over 60 carcinogens that damage DNA.
- Experimental. Animals exposed to tar developed tumours.
With all the criteria satisfied, the medical consensus shifted to causation by the late 1960s, leading to Australia's National Tobacco Strategy and the world-first plain-packaging legislation. This shows how causation can be established from observational data when a randomised trial (deliberately making people smoke) would be unethical.
The hierarchy of evidence
Not all evidence is equal. The hierarchy ranks study designs by how reliably they establish cause and effect, from strongest to weakest:
- Systematic reviews and meta-analyses. Statistically combine all studies on a question. Cochrane reviews and NHMRC guidelines are the gold standard; they can detect small effects and quantify uncertainty.
- Randomised controlled trials (RCTs). Random assignment, ideally double-blinded, balances confounders across groups so outcome differences can be attributed to the treatment.
- Cohort studies. Groups followed over time; can detect associations but not establish causation alone. The 45 and Up Study (260,000 NSW participants) is an Australian example.
- Case-control studies. Compare people with and without a condition, retrospectively; cheap but vulnerable to recall bias.
- Cross-sectional studies. A snapshot at one time; cannot establish temporal sequence.
- Case reports and case series. A single patient or small group; hypothesis-generating only.
- Expert opinion and anecdote. Lowest; useful for context but not evidence of an effect.
Higher designs rule out more threats: meta-analyses and RCTs best control confounders, reverse causation and chance; case reports control none.
Evaluating a media claim
When a headline says "X causes Y", run a quick checklist: What study is cited, one study or a meta-analysis? What design, an RCT or a case report? What sample size? How large is the effect (effect size matters as much as statistical significance)? Has it been replicated? Who funded it? Most single observational studies overstate effects, which is why meta-analyses are needed to correct them.
Headline: "Drinking coffee reduces heart-disease risk, new study finds."
- Study type. A single observational study sits low on the hierarchy. It can show a correlation but cannot establish causation.
- Confounders. Coffee drinkers differ from non-drinkers in age, occupation, exercise and diet. Without statistical adjustment, the association may reflect lifestyle rather than coffee.
- Reverse causation. People with existing heart problems may have cut down on coffee on medical advice, creating an apparent protective effect.
- Publication bias. A single positive study may have been selected from many showing no effect.
- Judgement. The headline is not warranted. A fair framing is "coffee consumption is associated with lower heart-disease risk in this cohort, but causation requires randomised trials or consistent observational evidence with a mechanism." Multiple cohorts plus a meta-analysis would be needed for a stronger claim.
Logical fallacies and cognitive bias
Faulty reasoning lets weak claims survive. Common fallacies to name in answers: post hoc ergo propter hoc (treating sequence as cause), appeal to authority (a claim is true because a famous person said so), appeal to nature (natural therefore safe), straw man (attacking a distorted version of an argument), and false dichotomy (presenting only two options). Cognitive biases include confirmation bias (seeking evidence that supports a prior belief) and the placebo effect plus regression to the mean, which together explain why people genuinely feel better after an ineffective remedy.
Check your knowledge
A mix of definitional, applied and evaluative questions covering this topic. Answer all under exam conditions, then check against the solutions block.
- Explain the concept of falsifiability and why it is important for distinguishing science from pseudoscience. Include one example of an unfalsifiable claim. (4 marks)
- Using one named scientific example and one named pseudoscientific example, distinguish between scientific and pseudoscientific claims. (6 marks)
- Distinguish correlation from causation. Give one example of a correlation that is not causal and identify the confounder. (4 marks)
- State four of the Bradford Hill criteria and explain how each supported the conclusion that smoking causes lung cancer. (5 marks)
- Rank these designs from strongest to weakest evidence and justify the ranking: case report, cohort study, randomised controlled trial, systematic review. (4 marks)
- A magazine reports that "eating chocolate prevents heart disease, according to a new study." Outline three questions you would ask before accepting the claim. (3 marks)
- A claim notes that some children are diagnosed with autism within months of an MMR vaccination, concluding the vaccine causes autism. (a) Identify the logical fallacy. (b) Give the correct interpretation. (c) State one type of study that has refuted the claim. (4 marks)
- A friend says a magnetic bracelet relieves their joint pain. (a) Give two reasons the claim fails scientific criteria. (b) Give one explanation for why the friend genuinely feels relief. (3 marks)
- Q1
- Falsifiability, argued by Karl Popper in 1934, is the principle that a claim is scientific only if there is some possible observation or experiment that could prove it wrong. It matters because science advances by attempting to disprove hypotheses; a claim that survives serious attempts at disproof becomes more credible, while a claim no result could disprove cannot be tested and is empirically empty. Example of an unfalsifiable claim: "consciousness influences quantum events", because every result can be interpreted as showing or not showing the influence, so no experiment could rule it out.
- Q2
- Scientific example, vaccination: the MMR efficacy claim is falsifiable (an outbreak in vaccinated populations would disprove it), peer reviewed (thousands of studies), replicable (clinical trials worldwide), quantitative (efficacy with confidence intervals), mechanistic (triggers immune memory) and provisional (schedules update as variants emerge). Pseudoscientific example, homeopathy: it is practically unfalsifiable (defenders blame non-individualised remedies for failures), has no plausible mechanism (dilutions of 10 to the power 60 leave no molecules of the original substance), shows no consistent peer-reviewed positive effect in meta-analyses, and does not update its theory in response to evidence. Comparison: vaccination satisfies every criterion of science; homeopathy fails each one.
- Q3
- A correlation is a statistical association between two variables; causation is a directed relationship where changing one variable produces a change in the other. All causation produces correlation, but not all correlation indicates causation. Example: ice cream sales correlate with drowning deaths because both rise in summer; the confounder is hot weather, which independently increases ice cream consumption and swimming. Eating ice cream does not cause drowning.
- Q4
- Any four. Strength: smokers had over ten times the lung cancer risk, too large to be explained away by confounders. Consistency: the association was replicated in dozens of studies across many countries. Temporal sequence: smoking preceded cancer onset by decades. Dose-response (biological gradient): more pack-years produced higher risk. Plausibility: tobacco smoke contains over 60 carcinogens that damage DNA. Experimental: animals exposed to tar developed tumours. Each criterion independently strengthens the inference, and together they established causation despite the absence of a randomised human trial.
- Q5
- From strongest to weakest: systematic review, randomised controlled trial, cohort study, case report. The systematic review combines and quality-weights all relevant studies, best controlling confounders, reverse causation and chance. The RCT uses randomisation to balance confounders so outcome differences are attributable to the treatment. The cohort study follows groups over time and can show association but cannot fully control confounders. The case report describes a single patient and is hypothesis-generating only, controlling none of the threats to validity.
- Q6
- Any three: What was the study design, observational or randomised controlled trial? What was the sample size and was it representative? How large is the effect, and is it clinically meaningful or only statistically significant? Has the result been independently replicated? Who funded the study, and is there a conflict of interest?
- Q7
- (a) Post hoc ergo propter hoc (after this, therefore because of this). (b) Autism is typically diagnosed at around the same age that MMR is routinely given, so the two coincide in time without one causing the other; temporal coincidence is not causation. (c) Large cohort or population studies have refuted the claim, such as a study of over 500,000 Danish children, with subsequent meta-analyses covering more than a million children showing no link.
- Q8
- (a) Any two: there is no plausible mechanism by which a static magnetic field would relieve joint pain, and controlled trials show no effect beyond placebo; the claim rests on anecdote and is not replicated. (b) Genuine relief is explained by the placebo effect, by regression to the mean (pain that was unusually bad naturally returns toward average), and by the natural fluctuation of arthritis pain over time.