Documente Academic
Documente Profesional
Documente Cultură
Catherine Li
Roxanne Ménard
Melissa Zhu
McGill University
TEST CREATION – ALL SUMMER IN A DAY 2
Table of Contents
Introduction..........................................................................................................................3
Analysis.............................................................................................................................19
Validity...........................................................................................................................19
Authenticity...................................................................................................................20
Reliability......................................................................................................................20
Reflection...........................................................................................................................21
Group process................................................................................................................21
References..........................................................................................................................23
TEST CREATION – ALL SUMMER IN A DAY 3
Introduction
The class taking this test is in their third year of high school (high school cycle two ESL
students). They are avid English readers and enjoy relatable and adventurous stories. Before the
test, students were asked to familiarize themselves with the different works of Ray Bradbury, as
they are about to begin a unit titled “Utopia and Dystopia”, with the novel Fahrenheit 451 as a
main point of focus. They will have read All Summer in a Day prior to this test. This assessment
will serve a double purpose in this case: firstly, it will be a C2 evaluation (Reinvests
understanding of texts), and secondly, it will be used to analyse Bradbury’s distinctive writing
style. In this C2 evaluation, students will be asked to answer each question by referring back to
the text (as it is an open-book exam) and recall upon previous knowledge, such as character traits
and literary devices. They will have one hour to complete this evaluation. During this time, they
are expected to read the text, and complete the following evaluation. When correcting, the
teacher will focus on “Evidence of understanding of texts through the response process” from the
TOTAL: /44
Name: ____________________________
Group: ______________
Read the short story All Summer in a Day by Ray Bradbury from beginning until
TRUE OR FALSE
Read the following statements. If you find them to be true, CIRCLE T. If you find
them to be false, CIRCLE F. If the answer was not provided in the text, CIRCLE
NM. Each question is worth 2 POINTS. You may not have partial marks.
Example:
/6
TEST CREATION – ALL SUMMER IN A DAY 5
Read all the sentences. Use the words in the Word Bank to complete the sentences.
You do not need to use all the words in the Word Bank. You may not use the same
word from the Word Bank twice. Each blank space is worth 2 POINTS. You may
WORD BANK
Ray Bradbury is a famous sci-fi author. He wrote classics such as Fahrenheit 451
and 1984. He also wrote short stories, like All Summer in a Day. In this story, the
children live on a different planet, where the nature looks very different. There are
_____________ plants everywhere. These plants have different colours than those
because there is no light in them. Since there is no fresh air circulating in the
/10
TEST CREATION – ALL SUMMER IN A DAY 6
question. Each question is worth 2 POINTS. You may not get partial marks.
1. Which of the follow statements are true to nine-year-old children who have
spent all their lives on Venus?
a. They children are always cruel to girls who are pale
b. The children have never heard a bird sing
c. The children grow up with no real memory of the sun
d. The children have never experienced heavy rain
3. Why do the children move slowly and hesitate to open up the closet door to
let Margot out at the end of the story?
a. They know the will get in trouble for what they did
b. They are worried that Margot may not be where they left her
c. They do not want to see her pale face again
d. They know they have done a cruel thing to her
TEST CREATION – ALL SUMMER IN A DAY 7
/6
MATCHING QUESTIONS
1. Character Identification
The two columns below are a list of the characters from the story and
characteristics. Read the left columns carefully and select the appropriate
characteristic from the right column. WRITE the corresponding LETTER of the
response in the blank provided in the left column. ONE point will be earned for
/4
2. Figurative Language
The two columns below are a list of literary devices and passages from the story.
Read the left columns carefully and select the appropriate passage from the right
column. WRITE the corresponding LETTER of the response in the blank provided
in the left column. ONE point will be earned for each correct response.
/4
TEST CREATION – ALL SUMMER IN A DAY 9
3. Vocabulary
The two columns below are a list of vocabulary words and definitions. Read the
left columns carefully and select the appropriate definition from the right column.
WRITE the corresponding LETTER of the response in the blank provided in the
left column. ONE point will be earned for each correct response.
/7
TEST CREATION – ALL SUMMER IN A DAY 10
SHORT-ANSWERS QUESTIONS
worth 1 POINT while Question 2 and 3 are worth 3 POINTS EACH. You may get
partial marks.
__________________________________________________________________
__________________________________________________________________
__________________________________________________________________
2. Why is Margot different from the other children in her class in terms of her
__________________________________________________________________
__________________________________________________________________
__________________________________________________________________
3. Would you be Margot's friend? Justify your answer with elements from the
text. /3
__________________________________________________________________
__________________________________________________________________
__________________________________________________________________
/7
TEST CREATION – ALL SUMMER IN A DAY 11
TOTAL: /44
Name: ____________________________
Group: ______________
Read the short story All Summer in a Day by Ray Bradbury from beginning until the end. Then,
TRUE OR FALSE
Read the following statements. If you find them to be true, CIRCLE T. If you find them to be
false, CIRCLE F. If the answer was not provided in the text, CIRCLE NM. Each question is
Example:
T / F / NM 1. Margot got to see the important event at the end of the story. /2
/6
Knowledge statement: The students will demonstrate their understanding of the story’s basic
facts. One question concerns plot, the second one setting, and the last one, characterisation.
Rational/Weighting: Each question is worth two points because it is quite easy to answer:
TEST CREATION – ALL SUMMER IN A DAY 12
students will be able to find the answers directly from the text, after a careful reading. This
section is made easier to answer purposefully, as the matching questions are more difficult. This
Read all the sentences. Use the words in the Word Bank to complete the sentences. You do not
need to use all the words in the Word Bank. You may not use the same word from the Word Bank
twice. Each blank space is worth 2 POINTS. You may not get partial marks.
WORD BANK
Ray Bradbury is a famous sci-fi author. He wrote classics such as Fahrenheit 451 and 1984. He
also wrote short stories, like All Summer in a Day. In this story, the children live on a different
planet, where the nature looks very different. There are __gigantic___ plants everywhere. These
plants have different colours than those on earth, they are ____black/grey____ and
____black/grey____. Since it rains a lot, children use underground tunnels to travel. The tunnels
are ___bleak____ because there is no light in them. Since there is no fresh air circulating in the
/10
Rational/Weighting: Each fill in the blank is worth two points. In general, this section is pretty
easy to complete. There are two interchangeable answers, and the last two fill-in-the-blanks have
clues to help the students pick out the right answer. We have been working on adjectives in class
Answer each of the following multiple-choice questions by CIRCLING the letter corresponding
to the correct answer. There is ONE correct answer to each question. Each question is worth 2
1. Which of the follow statements are true to nine-year-old children who have spent all their
lives on Venus?
a) They children are always cruel to girls who are pale
b) The children have never heard a bird sing
c) The children grow up with no real memory of the sun
d) The children have never experienced heavy rain
3. Why do the children move slowly and hesitate to open up the closet door to let Margot
out at the end of the story?
a) They know the will get in trouble for what they did
b) They are worried that Margot may not be where they left her
c) They do not want to see her pale face again
TEST CREATION – ALL SUMMER IN A DAY 14
/6
Knowledge statement: The students will demonstrate their understanding of the short story as
well as the main ideas the author wants to convey through this short story.
Rational/Weighting: Each multiple-choice question is worth two points with no partial marks
given. Two out of the three questions are rather straightforward, and the students will be able to
find the answers directly in the text. The 3rd question requires the students to have understood
what the author is trying to convey with the final passage of the text.
MATCHING QUESTIONS
1. Character Identification
The two columns below are a list of the characters from the story and characteristics. Read the
left columns carefully and select the appropriate characteristic from the right column. WRITE
the corresponding LETTER of the response in the blank provided in the left column. ONE point
E. Follower
TEST CREATION – ALL SUMMER IN A DAY 15
/4
2. Figurative Language
The two columns below are a list of literary devices and passages from the story. Read the left
columns carefully and select the appropriate passage from the right column. WRITE the
corresponding LETTER of the response in the blank provided in the left column. ONE point will
_D__ 1. Simile A. “... she knew they were dreaming and remembering
gold or a yellow crayon or a coin large enough to buy
the world with.”
_C__ 2. Metaphor B. “But then then always awoke to the tatting drum…”
_E__ 3. Personification C. “... and if she spoke at all, her voice would be a
ghost.”
/4
TEST CREATION – ALL SUMMER IN A DAY 16
3. Vocabulary
The two columns below are a list of vocabulary words and definitions. Read the left columns
carefully and select the appropriate definition from the right column. WRITE the corresponding
LETTER of the response in the blank provided in the left column. ONE point will be earned for
/7
Knowledge statement: The students will demonstrate their understanding of the characters in the
story, as well as the literary devices and vocabulary words found in this short story.
Rational/Weighting: One point will be earned for each correct response which will add up to a
TEST CREATION – ALL SUMMER IN A DAY 17
total of 15 points for the matching questions. This section covers material that the students have
been working on such as literary devices. The matching questions about character identification
tests the students’ understanding of the text. The students should be able to match the correct
definitions to the new vocabulary with the use context and past knowledge.
SHORT-ANSWERS QUESTIONS
Answer the following questions with 1 TO 3 SENTENCES ONLY. Question 1 is worth 1 POINT
while Question 2 and 3 are worth 3 POINTS EACH. You may get partial marks.
The children are excited to see the sun because they can only see it once every seven years for
two hours.
3. Why is Margot different from the other children in her class in terms of her past
experience? (2 reasons)
/3
Margot lived on Earth in the past. She has seen and experienced the sun.
4. Would you be Margot's friend? Justify your answer with elements from the text.
/3
/7
Knowledge statement: The students will demonstrate their understanding of key elements related
Rational/Weighting: Question 1 is worth 1 point because it requires the students to answer it with
only one key element from the text. On the other hand, Question 2 and 3 are worth 3 points each
because students need to use more than one piece of information to answer them. Students may
receive partial marks depending on their answer. For example, for Question 3, students may
receive partial marks if they answered the question, but their explanation is not well justified
Analysis
Validity
The areas of learning being assessed are the students’ ability to understand and to reinvest
their understanding of texts by answering different types of questions. They will also be tested on
material covered in class prior to the test such as character identification and literary devices.
This assessment can be considered valid as the content of the test accurately measures what is
intended to be measured and provides us teachers with valuable and appropriate information
about our specific purpose. The bulk of this assessment measures the students’ reading
comprehension. We made sure that the questions included in the test would address the students’
ability to comprehend the passages of the story rather than their ability to find the answer
through other test-taking strategies. We made sure that some questions didn’t give out the answer
or hinted to other questions. We decided to make this an open-book test with the purpose to
assess the students’ reading and comprehension ability rather than their ability to memorize a
whole story. The questions are not overly long and are appropriate to the students’ reading level.
The students will have had the chance to read the text before, and will be given one whole hour,
which is ample time, to complete the test. This way, there will be no misinterpretation of the
students’ knowledge due to time constraints and anxiety levels. By asking students to describe
their response process, we could have gathered more information about how students arrived at
certain answers, or about how they approached specific questions or problems. However, doing
so would involve more of the students’ writing ability, which is not our purpose with this
assessment. Hence, we decided to make up for this by eliminating any ambiguous questions. The
short answer questions are straightforward and are questions that can be answered with no more
than 3 sentences.
TEST CREATION – ALL SUMMER IN A DAY 21
Authenticity
This assessment is considered authentic because students are asked to demonstrate their
understanding by answering questions correctly through the application of both their knowledge
of different elements from the text and grammar notions learned in class instead of recalling
information from memorization. Students are also developing their comprehension skills, which
could be used in other contexts. On top of showing evidence of their knowledge, they construct
new meaning by using information from the text to answer questions on the theme of bullying.
This helps them to develop their social awareness of real-life issues. These questions are
meaningful because they are required to take a stance in regard to this social issue, and to
effectively support and justify their opinion with any available information and their repertoire of
knowledge. In addition, having several types of questions reflects the reality of the world in
Reliability
This assessment has a high level of reliability since it contains a substantial number of
questions - at least three questions for each type. The more items an assessment has, the more
reliable it is for teachers to use it to assess the understanding of learners. By using different types
of questions, this test can also minimize the chances of students’ weaknesses in test taking of a
certain type of question. Also, the phrasings of these questions are simple and adapted to the
level of high school ESL learners so they can demonstrate their understanding effectively
without being affected by other factors such as the use of complex lexicon. Their level of
proficiency should not inhibit them from showing what they learned. Furthermore, instructions
are formulated as clearly as possible to ensure that students truly understand what and how they
need to answer the questions, so the results are reliable to reflect their knowledge and skills.
TEST CREATION – ALL SUMMER IN A DAY 22
TEST CREATION – ALL SUMMER IN A DAY 23
Reflection
Group process
The process of creating this test was straightforward and cooperative. Upon receiving the
instructions, we chose our text, discussed about our target students including their background
and level, and read the story together. We then proceeded to identifying our main objectives. This
is an assessment created to test reading comprehension, hence we wanted the students to focus
on identifying the main idea of passages, understanding the vocabulary in context, making
inferences and understanding the author’s purpose. Once that was clear, we came up with
possible questions and “knowledges” we wanted to test our students on. We then separated the
task and created our questions on a shared Google Document; that way we would be able to give
each other feedback on the different types of questions created. Each one of us completed the
Knowledge statement and the Rational of our respective parts. The Analysis and the reflection
were done together. The clear instructions and expectations for this assignment provided us with
a good understanding of what to do from start to end. With good cooperation, we were able to
While working on this assignment, we realized that making a test might seem like a
simple task, but it is, in fact, quite difficult to do. For instance, it was hard to construct the fill in
the blank text without revealing answers to other questions on the test (extraneous clues). Both
the multiple-choice questions and the matching questions revealed themselves as challenging.
When doing the multiple-choice section, we needed to ensure that we were not creating
subsuming response options, which is when “the intended answer and a very good distractor
could both be correct.” (Coombe, Folse and Hubley, 2007, p.22). In other words, we wanted the
TEST CREATION – ALL SUMMER IN A DAY 24
students to know the facts very well so they wouldn’t get distracted, while making the test a little
difficult. Matching questions, on the other hand, were exigent due to their creation process.
Indeed, thinking of elements of the story that could be used in this format for an evaluation as
structured as this assessment was quite difficult. Once again, we always double-checked for
extraneous clues which would help students answer other questions in the test. The last
perplexing issue during the creation of this assessment came about while writing the short
answer questions. It was hard to formulate questions in a way that would lead to the knowledge
we wanted the students to demonstrate. For example, our original question was “Why is Margot
different?”. However, we were scared that the students would focus too much on Margot’s
appearance, and not about her coming from Earth. Thus, we had to change the question to “Why
is Margot different from the other children in her class in terms of her past experience?” to
ensure that students understood Margot’s origin. Lastly, as Coombe, Folse and Hubley
From this assignment, we will remember that the first step in creating an assessment is to
establish a list of “knowledges” that we want students to demonstrate. We must as well ensure
that the text contains enough “knowledges” to be tested so that the questions are created to assess
big ideas and not small details. Then, in the next step of creating the test questions, we must
formulate each question based on one knowledge only and make sure that each question has a
clear purpose to be in the test. Also, it is important to write clear instructions and questions while
taking into consideration the level of proficiency of the students taking the test. In general, we
learned that an assessment is useful when the test creators are creating it while evaluating the
authenticity. Therefore, at the end of the creation process, we retained that it is necessary to
References
Coombe, Christine, Keith Folse & Nancy Hubley (2007). A Practical Guide to Assessing
English Language Learners. Ann Arbour: The University of Michigan Press. pp. 16-37.