Department
Physics
Document Type
Article
Publication Date
5-2006
Abstract
We present a simple technique for evaluating multiple-choice questions and their answers beyond the usual measures of difficulty and the effectiveness of distractors. The technique involves the construction and qualitative consideration of item response curves and is based on item response theory from the field of education measurement. To demonstrate the technique, we apply item response curve analysis to three questions from the Force Concept Inventory. Item response curve analysis allows us to characterize qualitatively whether these questions are efficient, where efficient is defined in terms of the construction, performance, and discrimination of a question and its answer choices. This technique can be used to develop future multiple-choice examination questions and a better understanding of results from existing diagnostic instruments.
Journal Title
American Journal of Physics
Journal ISSN
0002-9505
Volume
74
First Page
449
Digital Object Identifier (DOI)
10.1119/1.2174053
Included in
Curriculum and Instruction Commons, Educational Assessment, Evaluation, and Research Commons, Science and Mathematics Education Commons