Blind versus visible checkbox grading: Does not seeing the grades when assessing mathematics enhance inter-rater reliability? - Archive ouverte HAL
Communication Dans Un Congrès Année : 2023

Blind versus visible checkbox grading: Does not seeing the grades when assessing mathematics enhance inter-rater reliability?

Résumé

Assessing handwritten mathematics questions with multiple assessors is a daunting task regarding grading reliability. One of the primary sources of assessor variability arises when the grade resulting from the correction scheme does not align with their holistic appreciation of the student's answer. In this study, we developed a 'checkbox grading' approach that could possibly circumvent this variability source. In our approach, exam designers preset atomic feedback items with partial grades; next, assessors should tick the items relevant to a student's answer, allowing 'blind grading' when the underlying grades are not shown to the assessors. The study was executed in cooperation with the Flemish Exam Commission with 10 assessors and 30 students during a mathematics exam. This paper answers the question 'Does blind checkbox grading enhance inter-rater reliability?' In order to do so, we compared 'blind grading' with 'visible grading' and concluded that blind grading enhances the inter-rater reliability when the grading scheme is stringent.
Fichier principal
Vignette du fichier
TWG21-Moons-600.pdf (666.2 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04413554 , version 1 (23-01-2024)

Identifiants

  • HAL Id : hal-04413554 , version 1

Citer

Filip Moons, Ellen Vandervieren. Blind versus visible checkbox grading: Does not seeing the grades when assessing mathematics enhance inter-rater reliability?. Thirteenth Congress of the European Society for Research in Mathematics Education (CERME13), Alfréd Rényi Institute of Mathematics; Eötvös Loránd University of Budapest, Jul 2023, Budapest, Hungary. ⟨hal-04413554⟩

Collections

TICE CERME13
45 Consultations
44 Téléchargements

Partager

More