- 15-19/06/2026
Validation of a multiple-choice physics test using classical test theory: toward a more up-to-date international item database
Andrea Fusari, Matteo Bozzi, Roberto Virzi, Marco Costigliolo, Maurizio Zani
PCE, The Paris Conference on Education (Paris – France)
——————–
Abstract:
This study examines the psychometric properties of a multiple-choice physics questionnaire using the framework of Classical Test Theory (CTT), with the aim of validating individual items and contributing to the development of a reliable item bank for research and assessment. The instrument was designed to investigate students’ conceptual understanding of fundamental physics topics and to identify common misconceptions or conceptual errors that may persist after formal instruction.
The questionnaire is being developed within the T.I.M.E. project by Politecnico di Milano in collaboration with Doshisha University, Bauman Moscow State Technical University, and the University of Trento. The dataset includes responses from approximately 1,400 university students enrolled in engineering and science programs. This internationally diverse sample includes students from Italian, Japanese, and Russian institutions, enabling the analysis of response patterns across different educational contexts and exploring how prior schooling systems influence the persistence of physics misconceptions.
Item analysis was conducted using standard CTT indicators, including item difficulty, discrimination indices, and distractor functioning. Particular attention was devoted to distractor performance to identify functional alternatives that capture specific incorrect reasoning patterns. Results indicate that ten of the twelve analyzed items include effective distractors and are well-constructed, while two items exhibit weak distractors that may require revision. These results represent a first step toward the construction of an updated international physics item bank, which could support both formative and summative assessment and enable comparative studies of physics learning across different educational systems.
Attività
Finanziamenti