Documente Academic
Documente Profesional
Documente Cultură
I. Objectives
At the end of the lesson the students should be able to:
1. evaluate existing multiple-choice items by using commonly-accepted criteria to identify
specific flaws in the items
2. improve poorly-written multiple-choice items by correcting the flaws they contain
3. construct well-written multiple-choice items that measure given objectives, and
4. show teamwork and cooperation through participating in a group activity.
II. Contents
Topic Preparing a Better Multiple- Choice Test Items
References Ebel, R. L., & Frisbie, D. A. (1986). Essentials of educational measurement (4th ed.).
Englewood Cliffs, NJ: Prentice-Hall.
Zimmerman, B. B., Sudweeks, R. R., Shelley, M.F., & Wood, B. (1990). How to prepare
better tests: guidelines for university faculty. Provo, UT: Brigham Young University
Testing Services.
http://www.duq.edu/about/centers-and-institutes/center-for-teaching-
excellence/teaching-and-learning/multiple-choice-exam-construction
III. Procedure
A. Routinary Activities
Teacher’s Activity Student’s Activity
Good Morning Class...
Good Morning Sir!
Before we start let us seek first the guidance of our Almighty
God...”
(One Student will lead the Prayer)
(Checking of Attendance)
(Students will tell who’s absent for the day)
So how’s your day? Is it good so far?
It was great Sir!
That’s good to know. Last meeting we have discussed table of
specifications So, are you ready for our new topic today?
Yes Sir!
Okay that’s good, so let’s begin this with a group activity!
Yes Sir!
B. Motivation
Before I will discuss our topic for today, let us have an activity. I
will divide you into 4 groups.
1
(The teacher will discuss the mechanics and facilitate the said
activity.)
C. Presentation of the Lesson
How did you find the activity?
It is nice Sir!
You have listed a number of comments regarding how the
questions were constructed. If you are the students taking
those questions as the items in your examination do you think
you will get the answer right? Why?
No Sir, the questions are confusing and funny.
Questions are defective that the correct answer is
obvious, debatable, obscure, or missing altogether.
Very good! You know class sometimes exams are not difficult,
or perhaps students fail examination because they did not
review. Sometimes it is the fault of the test writer. What do
you think is our lesson for today?
Preparing a Better Multiple- Choice Test Items
Very nice, it seems we are ready to discuss this lesson. Well-
written multiple-choice test questions do not confuse students,
and yield scores that are more appropriate to use in
determining the extent to which students have achieved
educational objectives. As future teachers, you must acquire
the competency of authentic and purposeful assessment
D. Lesson Proper
(Teacher prepares the Powerpoint presentation of this lesson)
Anatomy of a Multiple-Choice Item
A standard multiple-choice test item consists of two basic
parts: a problem (stem) and a list of suggested solutions
(alternatives). The stem may be in the form of either a
question or an incomplete statement, and the list of
alternatives contains one correct or best alternative (answer)
and a number of incorrect or inferior alternatives (distractors).
2
constructing multiple-choice items. Before that tap the person
to your right and tell “Are you still ok?” Tap back the person
who just tapped you and respond “Yes, Im ok and ready to
learn.”
(Student follows the icebreaker of the teacher)
Guidelines for Constructing Multiple-Choice Items
These guidelines are specifically designed for the single-answer
and best-answer varieties of multiple-choice items.
3
stem has been reworded to include the words
common to all of the alternatives.
Very well said. Excess material in the stem that is not essential
to answering the problem increases the reading burden and
adds to student confusion over what he or she is being asked to
do. Look at this another example.
1. Suppose you are a mathematics professor who wants to
determine whether or not your teaching of the unit on
probability has had a significant effect on your students.
You decide to analyze their scores from a test they took
before the instruction and their scores from another
exam taken after the instruction. Which of the following
t-tests is appropriate to use in this situation?
*a. Dependent samples.
b. Heterogeneous samples.
c. Homogeneous samples.
d. Independent samples.
My dear students please bear in your minds that “do not make
an essay-long stem”. The stem of the first example is
excessively long for the problem it is presenting. The stem of
the second example has been reworded to exclude most of the
irrelevant material, and is less than half as long. Isn’t it?
Yes Sir!
4. State the stem in positive form (in general)
Negatively-worded items are those in which the student is
instructed to identify the exception, the incorrect answer, or
the least correct answer. Such items are frequently used,
because they are relatively easy to construct. The teacher
writing the item need only come up with one distractor, rather
than the two to four required for a positively-worded item.
4
understand it clearly.
Thank you very much for that good answer. How can we then
improve this question, anyone? Alternatives must be reworded or paraphrased to
make it clearer and concise.
Better Example
1. How long does an annual plant generally live?
*a. Only one year.
b. Only two years.
c. Several years.
Better Example
1. Region 2 is widely known for its?
*a. Corn
b. Banana
c. Durian
d. Kiwi
5
Very well said. If the student misses the item, it does not tell
the teacher in which of the four areas the student is weak. In
the better example, all of the alternatives refer to state
agriculture, so if the student misses the item, it tells the
teacher that the student has a weakness in that area. Now let
us proceed to the 8th guideline. This is the guideline loved by
students.
Why do you think that even if the student doesn’t know the
correct answer he/she can guess the correct answer?
Sir, the word “an” in the stem of the poor example
above serves as a clue to the correct answer,
“adjective,” because the other alternatives begin with
consonants.
Yes, I can’t agree more to that. The flaw has been corrected in
the better example by placing the appropriate article, “an” or
“a,” in each alternative.
Better Example
6
4. You have just spent ten minutes trying to teach one of
your new employees how to change a typewriter ribbon.
The employee is still having a great deal of difficulty
changing the ribbon, even though you have always
found it simple to do. At this point, you should: a. Ask an
experienced employee working nearby to change the
ribbon in the future.
b. Mention that you never found this difficult, and ask
what he or she finds difficult about it.
*c. Review each of the steps you have already
explained, and determine whether the employee
understands them.
d. Tell the employee that you will continue teaching him
or her later because you are becoming irritable.
Why can a student guess the right answer in the poor example?
The answer in the poor example above stands out
because it does not include the identical wording
underlined in each of the distractors.
No Sir, we will violate guideline number 3.
Very good, so can we just correct it by adding the phrase “tell
the employee” in alternative C?”
Yes, that is correct. The answer is less obvious in the better
example because the distractors have been reworded to be
more parallel with the answer.
7
the alert student.
Poor Example
1. To avoid infection after receiving a puncture wound to
the hand, you should:
a. Always go to the immunization center to receive a
tetanus shot.
b. Be treated with an antibiotic only if the wound is
painful.
*c. Ensure that no foreign object has been left in the
wound.
d. Never wipe the wound with alcohol unless it is still
bleeding.
Better Example
1. To avoid infection after receiving a puncture wound to
the hand, you should always:
a. Go to the immunization center to receive a tetanus
shot.
b. Be treated with an antibiotic if the wound is painful.
*c. Ensure that no foreign object has been left in the
wound.
d. Wipe the wound with alcohol unless it is still bleeding.
Well done! The clue has been removed from by replacing the
answer with another valid answer that does not include the
keyword.
8
increase the student’s chance of guessing the correct answer.
Poor Example
1. Which of the following artists is known for painting the
ceiling of the Sistine Chapel?
a. Vice Ganda.
b. Flintstone.
*c. Michelangelo.
d. Santa Claus
To correct this, we have something like this…
Better Example
1. Which of the following artists is known for painting the
ceiling of the Sistine Chapel?
a. Botticelli.
b. da Vinci.
*c. Michelangelo.
d. Raphael.
Okay let us see from what you have given, to create plausible
distractors you should use common student misconceptions.
Also, you can develop your own distractors, using words that
“ring a bell” or that “sound official.”
Yes you are right. When more than one of the alternatives can
be successfully defended as being the answer, responding to an
item becomes a frustrating game of determining what the
teacher had in mind when he or she wrote the item. Such
ambiguity is particularly a problem with items of the
bestanswer variety, where more than one alternative may be
correct, but only one alternative should be clearly best. Take a
look at this example.
Poor Example
1. China should adopt a foreign policy based on:
a. A strong army and control of the North American
continent.
b. Achieving the best interest of all nations.
c. Isolation from international affairs.
*d. Naval supremacy and undisputed control of the
9
South East Asia sea lanes
As you can see in this example class, all answers can be a
correct answer because we have a problem with the stem.
Here is the improve version of it.
Better Example
1. According to Xi Jinping, China should adopt a
foreign policy based on:
a. A strong army and control of the North American
continent.
b. Achieving the best interest of all nations.
c. Isolation from international affairs.
*d. Naval supremacy and undisputed control of the
South East Asia sea lanes
11. Present the answer in each of the alternative positions Yes, Sir
approximately an equal number of times, in a random
order.
During examinations do you look for a pattern in the answer
sheet?
As a future teacher you should not create a pattern because Yes Sir!
once the pattern was disclosed to the students, you are already
defeating the purpose of the assessment. Many teachers have
a tendency to avoid placing the answer in the first or last
alternative positions, preferring instead to “bury the answer in
the middle.” This tendency, however, is not unknown to
certain students, who generally select one of the alternatives in
the middle if they are unsure of the answer. Also, if there is a
noticeable pattern to the positions of the answers from item to
item, alert students will take notice and make their selections
accordingly. In either case, the unprepared but clever student
increases his or her chance of obtaining a higher score. So how
are we going to address this problem?
10
e. Heating steam from 100°C
to 200°C
With the suggestions I have given you? How do you correct our
example?
11
If the vocabulary is somewhat difficult, the item will likely
measure reading ability in addition to the achievement of the
objective for which the item was written. As a result, poor
readers who have achieved the objective may receive scores
indicating that they have not. Avoid highfalutin words. How do
you call a very difficult test?
“Nosebleed”, Sir
Lastly, one of the most neglected guideline sometimes.
E. Values Integration
You know class; it is upsetting in the part of the teacher if the
students fail their exams. Sometimes even though how great
you are in instructional delivery, if you can’t prepare a good
assessment tool the whole teaching learning process is futile.
Isn’t it?
Yes Sir.
The 15 guidelines that I have given you should be memorized
by heart because this will guide you in your future career. May I
ask you what is the most difficult exam you ever had
undertaken?
(Answer may vary)
You know what is the most difficult exam class for me?
No, Sir. What is it?
Life is the most difficult exam. Many people fail because they
try to copy others. Not realizing that everyone has a different
test paper. Do you believe in that?
Yes Sir!
If life is an exam what type do you think it is?
(Answer may vary)
F. Generalization
What did you learn?
We learned the parts of a multiple-choice item and the
guidelines in better preparing it.
Okay class let us recall the fifteen (15) guidelines we have just
tackled. (Ask a student to give one)
(Students will answer in no specific order)
12
What type of test item will I use if the attainment of the
educational objective can be measured by having the student
select his or her response from a list of several alternative
responses.
Multiple-choice
Very good class!
G. Application
Since you already understand our lesson for today, let us have
a game entitled “The Choice”. (The teacher will discuss the
mechanics of the game)
IV. Evaluation
Direction: Identify the guideline/s violated by the following items. Reconstruct/revise each item to be a
better test exam item. The correct answer is indicated by asterisk (*). (2 points each)
1. Philippines is
a. a member of ASEAN
b. located at the Pacific Ring of Fire*
c. the Pearl of the Orient
d. worth dying for
2. Which of the following is the best explanation of why technical advances in farm equipment led
to an increase in urbanization?
a. Fewer people were needed to run the farms.*
b. Fewer people were qualified to operate the equipment.
c. More people could live in the city and commute to the farm.
d. More people went to work at the equipment manufacturing plant.
4. A nurse is assessing a client who has pneumonia. Which of these assessment findings indicates
that the client does NOT need to be suctioned?
a. Diminished breath sounds.
b. Absence of adventitious breath sounds.*
c. Inability to cough up sputum.
d. Wheezing following bronchodilator therapy.
6. The kidneys:
a. are located in a position that is retroperitoneal.
13
b. are surrounded by a renal capsule.
c. are protected by the 9th and 10th ribs of the rib cage.
d. are a) and b) only.
e. are all of the above
7. Which of the following provides the best indication that somatosensory pathways are affected
by Gilda’s multiple sclerosis?
a. Gilda has fuzzy vision.*
b. Gilda has strange sensations in her arms.
c. Gilda is having trouble performing the cognitive skills required in her job.
d. Gilda has become increasingly clumsy.
8. Which one of the following did NOT contribute to the eighteenth century Industrial Revolution
in Britain?
a. rapid technological change in the textile industry
b. enclosure and consolidation of agricultural lands
c. introduction of gold as a convenient medium of exchange *
d. increased trade with other nations
9. For interactionists, which of the following is generally identified as the cause of deviance?
a) Subcultures b) Individual c) Society d) Biology
10. What causes ice to transform from solid state to liquid state?
a. Change in temperature
b. Chemical Change
c. Change in chemical composition
d. Change in heat levels
V. Assignment
Direction: Read some articles about Super Typhoon Lawin. Prepare five (5) multiple-choice items
following the given guidelines. Print your output in a letter size bond paper. (15 points)
14