Abstract—This publication proposes an objective examination format for assessing students' ability to solve problems in Analogue Electronics. It suggests that a problem asking more than one question can take the form of a Problem-Based Multiple-Response (PBMR) item. Depending on the inter-relationship between the questions addressed in the stem, this paper identifies four types of items and suggests a scoring rule for each one of them. Issues related to the time slot given per item are also discussed. Examination results show that both the facility (F.I) and the discrimination (D.I) indices improve, and much guesswork is discarded whenever the scoring of an item considers the inter-relationship between the questions addressed in the stem. PBMR items addressing two or more fully inter-related questions are more suitable for testing the students' ability to solve problems when an objective examination is desirable. Such problem items give a more realistic picture of the student's actual knowledge.
 

Index Terms—objective test, electronics, problem-solving, guessing, reliability, discrimination index

Cite: Panos Photopoulos and Dimos Triantis, "Problem-Solving Multiple-Response Tests: Guessing is not a Favourable Strategy," International Journal of Learning and Teaching, Vol. 8, No. 1, pp. 64-70, March 2022. doi: 10.18178/ijlt.8.1.64-70

Copyright © 2022 by the authors. This is an open access article distributed under the Creative Commons Attribution License (CC BY-NC-ND 4.0), which permits use, distribution and reproduction in any medium, provided that the article is properly cited, the use is non-commercial and no modifications or adaptations are made.