ENHANCED ASSESSMENT AND LEARNING THROUGH ADAPTIVE COMPARATIVE JUDGEMENT

ENHANCED ASSESSMENT AND LEARNING THROUGH ADAPTIVE COMPARATIVE JUDGEMENT

T. Topping, M. Murphy, S. Saunders (2023).  ENHANCED ASSESSMENT AND LEARNING THROUGH ADAPTIVE COMPARATIVE JUDGEMENT. 379-389.

The School of Engineering, University of Liverpool is trialling the use of Adaptive Comparative Judgement (ACJ) as tool to allow students to engage in a peer learning and assessment process. By examining three case studies, this paper describes how ACJ has been used in undergraduate engineering modules to enhance the assessment process for learning. The first case study in this paper describes how ACJ was used as an approach to provide feed-forward in a conceptual engineering design activity. It explores how ACJ has been used to facilitate a more structured approach to reviewing and contextualising examples of previously submitted work, in order to help students properly understand assignment expectations; and to provide some form of feed-forward. The second case study describes how ACJ is being used to facilitate peer assessment with the aim of increasing learner benefit. It was used to facilitate and inform peer discussion in an engineering ethics topic; and to help students reflect on their own attitudes and learning. The third explores how ACJ can be used to inform the final grade of a summative assessment and how the outcomes of completing an ACJ activity compare between students and teachers. The paper presents student perceptions and the authors experiences of using ACJ and discusses how such activities have been structured. Although the overall findings indicate that ACJ can be of benefit to teaching, more work is needed to optimise its deployment.

Authors (New): 
Tony Topping
Matt Murphy
Samuel Saunders
Pages: 
379-389
Affiliations: 
University of Liverpool, United Kingdom
Keywords: 
Formative Assessment
peer assessment
Peer learning
Adaptive Comparative Judgement
CDIO Standard 11
Year: 
2023
Reference: 
Bartholomew, S.R., Mentzer, N., Jones, M. et al. (2022) Learning by evaluating (LbE) through adaptive comparative judgment, Int J Technol Des Educ 32, 1191–1205. : 
Bartholomew, S. R., Yoshikawa, E. (2018). A systematic review of research around Adaptive Comparative Judgment (ACJ) in K-16 education. 2018 CTETE Monograph Series. : 
Biggs, J., & C. Tang. (2011). Teaching for Quality Learning at University, Fourth Edition, The Society for Research in Higher Education. Berkshire: Open University Press: 
Boud, D., Cohen, R., & Sampson, J (2001). Peer Learning in Higher Education: Learning from and with Each Other (1st ed.). Routledge: 
Canty, D. (2012). The impact of holistic assessment using adaptive comparative judgment of student learning, PhD Thesis, University of Limerick, Ireland.: 
Florian, L., & Pratt, L. (2015). Embedding equality and diversity in the curriculum: an education practitioner’s guide. York: Higher Education Academy.: 
Hansson, J., Kolmskog, P., Odemark, Y. & Högfeldt, A. (2011). Peer Learning With Small Means: A Case Study Of Implementing Peer Learning In A Laboratory Exercise. Proceedings of the 7th International CDIO Conference, DTU, Denmark: 
Hermon, P. & McCartan, C. (2011). Peer Rating for Feedback in Group Projects, Proceedings of the 7th International CDIO Conference, DTU, Denmark : 
Jonsson, J., Täck, E., Hulthén, E. & Eriksson, A. (2022). PEER REVIEW IN A PRODUCT DEVELOPMENT COURSE – IMPLEMENTATION AND RECEPTION, Proceedings of the 18th International CDIO Conference, Reykjavik University, Iceland: 
Kimbell, R. (2018). Constructs of quality and the power of holism. Paper presented at the PATT35, Athlone Institute of Technology, Athlone, Ireland.: 
Kimbell, R. (2022) Examining the reliability of Adaptive Comparative Judgement (ACJ) as an assessment tool in educational settings. Int J Technol Des Educ 32, 1515–1529. : 
Pollitt, A. (2004). Let’s stop marking exams. Available at: http://www.cambridgeassessment.org.uk/images/109719-let-s-stop-marking-exams.pdf. (Accessed 10th January 2023) : 
Pollitt, A. (2012). The method of adaptive comparative judgement. Assessment in Education: Principles, Policy & Practice, 19(3), 281–300.: 
Poot, R., Gielen, K., Brincker, L., Filius, R. & Wiegant, F. (2020) Deep Learning through Peer Feedback in Higher Education; a Manual for Teachers, Utrecht University, Available at: https://cat-database.sites.uu.nl/wp-content/uploads/sites/778/2020/10/18012-B2-Deep-Learning-through-Peer-feedback-final-sept2020.pdf (Accessed 10th January 2023) : 
Seery, N., Canty, D. (2017). Assessment and Learning: The Proximal and Distal Effects of Comparative Judgment. In: de Vries, M. (eds) Handbook of Technology Education. Springer International Handbooks of Education. Springer, Cham : 
Tanner, D., Canty, D. & Power, J. (2019) Combined Strategies to Promote Active Learning and Retention, Proceedings of the 15th International CDIO Conference, Aarhus University, Denmark : 
Thurstone, L. L. (1927). A law of comparative judgment. Psychological Review, 34, 273–286.: 
Topping K. (1998) Peer assessment between students in colleges and universities, Review of Educational Research, 68 (3), pp. 249 – 276, DOI 10.3102/00346543068003249 : 
Topping K.,J. (2009) Peer assessment, Theory into Practice, 48 (1), pp. 20 – 27, DOI 10.1080/00405840802577569 : 
Go to top
randomness