An exploration into the criteria used in assessing design activities with adaptive comparative judgment in technology education
Bibliographic Data
| ID | 21530764 |
|---|---|
| Authors | Jeffrey Buckley (0000-0002-8292-5642, Athlone Institute of Technology, corresponding author), Donal Canty (0000-0003-4819-0424, University of Limerick), Niall Seery (0000-0003-4199-4753, Athlone Institute of Technology) |
| Year | 2022 |
| Volume | 41 |
| Issue | 2 |
| Pages | 313-331 |
| Publication date | 2022-04-03 |
| Open Access | No |
| Type | ARTICLE |
| Venue | Irish Educational Studies (JOURNAL) |
| Journal identifiers | ISSN: 0332-3315 • E-ISSN: 1747-4965 |
| Publisher | Informa UK Limited (PUBLISHER • GB) |
| DOI | 10.1080/03323315.2020.1814838 |
| OpenAlex | W3086450829 |
| Language | EN |
| Citations received | 2 |
| References cited | 16 |
The use of design assignments for teaching, learning, and assessment is considered a signature of technology education. However, there are difficulties in the valid and reliable assessment of features of quality within designerly outputs. In light of recent educational reforms in Ireland, which see the introduction of classroom-based assessments centring on design in the technology subjects, it is paramount that the implementation of design assessment is critically considered. An exploratory study was conducted with a first year cohort of initial technology teacher education students (N = 126) which involved them completing a design assignment and subsequent assessment process through the use of adaptive comparative judgement (ACJ). In considering the use of ACJ as a potential tool for design assessment at post-primary level, data analysis focused on criteria used for assessment. Results indicate that quantitative variables, i.e. the amount of work done, can significantly predict performance (R2 = .333, p < .001), however qualitative findings suggest that quantity may simply align with quality. Further results illustrate a significant yet practically meaningless bias may exist in the judgement of work through ACJ (φ = .082, p < .01) and that there was need to use varying criteria in the assessment of design outputs
Adaptive design · Biology · Management science · Mathematics education · Competency Development and Evaluation · Computer Science · Engineering · Engineering Education and Curriculum Development · Psychology · Student Assessment and Feedback
| Citations per year | 0.5 |
|---|---|
| Citation span | 2022 - 2026 (5) |
| Highly cited | No |