Evaluation and criteria to evaluate success: HSC Design and Technology Designing and Producing
“Evaluate a design solution against the criteria to evaluate success, using ongoing and final evaluation methods to judge fitness for purpose and inform improvement”
Evaluation judges a design solution against the criteria to evaluate success, which are measurable benchmarks written from the brief. Ongoing evaluation runs throughout the process, feeding back into idea development and production, while final evaluation assesses the completed solution for fitness for purpose. Methods include testing, user trials, expert feedback and comparison to the criteria.
Jump to a section
What this dot point is asking
NESA wants you to evaluate a design solution against the criteria to evaluate success, using both ongoing and final evaluation to judge fitness for purpose and to drive improvement. Evaluation is the analytical engine of the design process and a heavily weighted part of the Major Design Project folio.
The answer
Criteria to evaluate success
Evaluation only works if you have something to measure against. The criteria to evaluate success are derived from the design brief and written early, before designing begins. Good criteria are:
- Specific and measurable, so a judgement can be made objectively where possible.
- Comprehensive, covering function, aesthetics, ergonomics, safety, cost, durability, sustainability and any user-specific requirements.
- User-focused, reflecting the needs of the intended user, not just the designer's preferences.
For example, a criterion such as the product must support a load of at least 100 kilograms without permanent deformation is measurable and testable, whereas the product should be strong is not.
Ongoing evaluation
Ongoing (formative) evaluation happens continuously throughout the design process. At every stage you ask whether the current decision, sketch, prototype or production step still meets the criteria. This is what makes the design process iterative: a prototype that fails an ongoing evaluation sends you back to develop a better solution. Ongoing evaluation is documented in the portfolio through annotated tests, feedback and revised decisions.
Final evaluation
Final (summative) evaluation assesses the completed solution against the original criteria to determine fitness for purpose, whether the product, system or environment actually meets the identified need. It also reflects on the design process itself: what worked, what would be done differently, and what the limitations are. A strong final evaluation reaches a clear, evidence-based judgement rather than a vague claim of success.
Methods of evaluation
A range of methods provides the evidence for a judgement:
- Testing, applying loads, measuring performance, checking dimensions and tolerances against specifications.
- User trials, observing real users interacting with the solution and gathering structured feedback.
- Expert appraisal, seeking the opinion of teachers, clients or industry specialists.
- Comparison to existing solutions, benchmarking against competitor products.
- Surveys and questionnaires, gathering quantitative and qualitative user responses.
Triangulating several methods produces a more convincing evaluation than relying on a single test.
Fitness for purpose
The central question of all evaluation is fitness for purpose: does the solution do the job it was designed to do, for the intended user, within the constraints of the brief? Fitness for purpose ties together function, safety, usability and quality, and is judged directly against the criteria to evaluate success.
Feeding evaluation back into design
Evaluation is valuable only when it informs action. Ongoing evaluation should visibly change the design in the portfolio, showing improvement driven by evidence. Final evaluation should identify realistic improvements and future directions. This closes the loop of the iterative design process and demonstrates the reflective practice NESA rewards.
How it is examined and assessed
Evaluation appears in both the written paper and the Major Design Project. In the folio, markers look for measurable criteria, documented testing, and judgements that reference the criteria with evidence. In the written paper you may be asked to explain how a designer would evaluate a solution or why ongoing evaluation matters. Generic, unsupported claims of success score poorly.
Fitness for purpose, whether a solution does the job it was designed to do for the intended user within the brief, is the unifying question of all evaluation and is judged directly against the criteria to evaluate success.
- Unmeasurable criteria
- Statements such as the product should look good cannot be tested. Make criteria specific and measurable.
- Evaluating only at the end
- Ongoing evaluation is required and must show in the folio as testing that changed the design.
- Stating success without evidence
- A judgement must be supported by test results, user feedback or comparison to the criteria.
- Ignoring limitations
- A credible final evaluation acknowledges weaknesses and proposes realistic improvements.
Exam-style questions
Questions in the style of NESA exam questions on this dot point, each with a worked answer. They are written by ExamExplained unless tagged "Past paper"; the year shows the paper a question is modelled on.
2023 HSC-style1 markWhat is the primary purpose of ongoing evaluation? A. To set goals B. To explore ideas C. To establish consumer needs D. To solve design issues as they ariseShow worked answer →
The correct answer is D, to solve design issues as they arise.
Ongoing evaluation is the continuous checking of a solution against the criteria to evaluate success at every stage of the design process, not just a final judgement at the end. Its core purpose is to detect problems as they emerge and resolve them before they become costly, then feed the result back into the next stage. This is what makes evaluation iterative.
A (setting goals) and C (establishing consumer needs) belong to the briefing and research stages, while B (exploring ideas) is idea generation. None of these is the purpose of evaluation itself.
2022 HSC-style1 markA designer is planning to release a line of ergonomic wheelchairs for children. What is the best way to evaluate the useability of this wheelchair? A. Invest in innovative material development B. Test the product in a range of environments C. Consider surveys from the specific target market D. Compare the design with competitive manufacturersShow worked answer →
The correct answer is C, consider surveys from the specific target market.
Useability is judged by how well the intended users can actually operate the product, so the most direct evaluation method is gathering feedback from the specific target market, here children who use the wheelchair, against the criteria to evaluate success.
B (testing in a range of environments) evaluates durability and performance rather than useability for the user. A (material development) is a design decision, not an evaluation method, and D (comparing with competitors) is benchmarking that does not test how well this product meets its own users' needs.