Activities for assessment of reading

Activities for assessment of reading
CSWE 1 (2008) Module K LO 1 Demonstrate understanding of a written recount
Activity 1.1: Selecting and adapting the text
Materials needed:



CSWE curriculum
A text –‘ Moving House’ is provided below, or you can use one of your own
Checklist for selecting authentic texts.
Text for Activity 1.1: Moving House
Last weekend my friend Maria and her husband, Nick moved house from a little apartment in
the city to a 3 bedroom brick house in the suburbs. The initial task was to pack their stuff.
Then they got a removalist and a truck to move the boxes and furniture. At the new house
Maria and Nick decided where to put the furniture and unpacked the boxes. They put the food
and plates in the kitchen cupboards and made sure the fridge and freezer were turned on.
After unpacking they were exhausted, so they boiled up the kettle and had a cup of tea. They
were both tired but they were happy. Nick was happy to have an extensive garden in which to
grow vegetables. Maria contemplated making new friends. Someone knocked on the door
while Maria and Nick were drinking tea. It was their neighbours. The neighbours gave them
flowers and a cake to welcome them to the neighbourhood. Maria invited the neighbours in
for a drink. Both Maria and Nick were happy with their first day in the new house.
Activity:
1. Check the criteria (see the CSWE curriculum);
2. Check the length (eg for CSWE I: “approximately 100 words or more”). This text is
181 words long, so it needs to be shortened;
3. Check the density of language;
4. Check the difficulty of the vocabulary (removalist? exhausted? extensive? boiled up?
contemplated? neighbourhood?);
5. Check the discourse structure eg The initial task = first;
6. Check the contextualisation.
Modify the text according to the criteria and the level of the students.
Something to think about:
Make it a good model for the corresponding learning outcome, ie C1 K2 Write a recount.
© NEAS Ltd 2014
1
Suggested final text for CSWE I:
Last weekend Maria and her husband Nick moved house. First they packed their things. Then
they got a truck to move the boxes. At the new house Maria and Nick unpacked the boxes. They
put the food and plates in the kitchen cupboards. After unpacking, they sat and had a cup of tea.
They were both tired but happy. They liked the house because it had a big garden. When Maria
and Nick were drinking tea their new neighbours knocked on the door. They gave Maria and Nick
some beautiful flowers and a chocolate cake. Both Maria and Nick were happy with their first day
in the new house.
(109 words)
Activity 1.2: Developing questions for the learning outcome
Materials needed:



CSWE curriculum
A suitable text – ie the one you have just worked on
Question types overview handout (available on the ATB website page).
Activity:
1. Check the criteria: CSWE I K1 Demonstrate understanding of a written recount
1.1
1.2
1.3
Demonstrate understanding of topic/participant/s
Demonstrate understanding of sequence of events
Demonstrate understanding of details of events
2. Consider different types of question
Use Questions types overview handout
Relevant issues:





Provide a variety of questions, but not so many as to be confusing – 3 is a good
number;
Ensure that the students are familiar with the type of question and understand what
they are supposed to do;
Ensure that students know what is expected of them (eg short answers rather than
complete sentences);
Start with some easy questions as a lead-in;
Ensure that questions follow the text ie the answer to Q1 comes before the answer
to Q2, and summary questions come at the end.
NB a reading task does not want questions that require a lot of writing.
Suggested question types:
 Multiple choice
 Gap fill
 Short answer questions/sentence completion
 Ordering/sequencing
© NEAS Ltd 2014
2
Activity 1.3: Develop a multiple choice question (MCQ) for criterion 1.1: Demonstrate
understanding of topic/participant/s
NB the issues associated with MCQs:




Do not involve much writing
Can involve minimal reading, BUT
Not easy to write: should have 4 alternatives, including 3 distracters which should be
plausible but incorrect
Dichotomous items (True/False; Yes/No) should be avoided as guessing has a 50%
chance of being correct.
Suggested answer:
1. Tick (  ) the correct answer
The story is about:
last Monday
next weekend
moving house

drinking tea
Activity 1.4: Develop a sequencing question for criterion 1.2: Demonstrate
understanding of sequence of events
Issues relating to sequence of events (CSWE 1 and CSWE 2)




If the criteria of the curriculum require a question on sequence (which CSWE 1 and
CSWE 2 do) it is essential that the recount or story includes sufficient events for the
development of an appropriate assessment. Events may have to be written in specifically.
Location of questions should be at, or towards the end. Questions generally follow the
text, ie the answer to Q1 should be in the text before the answer to Q2. A sequencing
question is a summary of all the events in the text, and therefore should come last (or
nearly last).
Number of events: tasks for a learning outcome should be comparable, so check how
many items other tasks have used (about 5 or six is a good number for these levels).
A sequence is a unit, and each item should not be marked individually, ie the learner
either gets it all correct, or not. For this reason, especially at this level, it is helpful to give
the starting item. If the learner does not get the first item correct it is impossible to
achieve the correct sequence, although this could become a question on its own eg what
was the first thing that Tom did?
© NEAS Ltd 2014
3
Text for activity
Last weekend Maria and her husband Nick moved house. First they packed their things. Then they
got a truck to move the boxes. At the new house Maria and Nick unpacked the boxes. They put the
food and plates in the kitchen cupboards. After unpacking, they sat and had a cup of tea. They were
both tired but happy. They liked the house because it had a big garden. When Maria and Nick were
drinking tea their new neighbours knocked on the door. They gave Maria and Nick some beautiful
flowers and a chocolate cake. Both Maria and Nick were happy with their first day in the new house.
Activity:




List the events
Decide how many to include in the question
Decide which items to include (or which to
leave out)
Decide how much of each event to include eg
o Maria and Nick sat and had a cup
of tea,or
o They sat and had a cup of tea, or
o Maria and Nick had a cup of tea
Suggested answer:
1. First they packed their things.
2. Then they got a truck to move the
boxes.
3. Maria and Nick unpacked the boxes.
4. They put the food and plates in the
kitchen cupboards.
5. They sat and had a cup of tea.
6. Their new neighbours knocked on the
door.
7. They gave Maria and Nick some
beautiful flowers and a chocolate cake.
Number these sentences in the order they happen in the story.
The first one has been done for you.
The neighbours gave Maria and Nick some flowers
Someone knocked on the door.
They moved the boxes in a truck.
Maria and Nick packed their things.
1
They put the food in the kitchen cupboards.
Pages 8 & 9 of this document outline the question items and answers of this assessment
task.
© NEAS Ltd 2014
4
Activity 2: CSWE 3 K1 Demonstrate understanding of a biography/autobiography
‘Sister Emily’s Story’
SISTER EMILY’S STORY
by Clarissa Summers
Aunt Emily is over eighty now and very frail. Most people call my aunt ‘Sister Emily’, for she is a nun.
One day she told me how this had come about.
‘During World War II, I lived in Melbourne with my mother and two young sisters, my father having
died some years earlier. We did not have much money but we were happy. I was very close to my
mother, who always wanted me to be a nun. I had other ideas, however – I wanted marriage and
children!
‘Although my life was full and I had lots of friends, I was not really satisfied. I had started doing some
voluntary welfare work with the Church – visiting families in need of help – but I felt I should do
something more with my life.
‘For my twenty-fourth birthday, some friends arranged a party. It was here I met Peter, a handsome
Canadian air force officer on leave before returning to Canada. We liked each other immediately.
Peter met my family and they liked him too and during the next six weeks we saw each other a lot.
When Peter’s leave was coming to an end, he asked Mother’s permission to ask me to marry him –
that was the custom in those days.
‘Mother said, “Yes,” but after he’d gone she said to me, “If you go to live in Canada, Emily, you’ll
never see me again.” Her words were like a knife to my heart. My mother was the most important
person in the world to me. In those days people didn’t travel like they do now and we were quite poor,
so I knew what she’d said was true. Peter understood how upset I was, “Well, we’ll have a twelve
month’s break,” he said. “Take the twelve months and feel free.” The next day, he left for Canada.
‘Because this twelve month period was to be a complete break, we didn’t write to each other. Then
one day Mother told me she’d heard from someone that Peter had got married. When she said this, I
nearly fainted. For many weeks I didn’t feel like eating and or doing anything.
‘Eventually, I resumed my welfare work with the poor families. More strongly than ever, I felt I must
make something of my life and so I began to think about becoming a nun.
‘I didn’t say anything to Mother. Instead, I went to our local church and had a long talk with the priest.
He encouraged me to take the idea seriously and to think hard and pray about it. When I was sure, I
told Mother of my decision. She was delighted. Then I entered a convent for the six month
preparation time before becoming a nun.
‘At the end of the twelve months, Peter returned from Canada. He came straight to our house and
knocked on the door. Mother invited him in. “Where’s Emily?” He asked. Mother explained that I
had entered a convent and was now a nun. When Peter heard this he was very, very upset. In fact,
he hadn’t got married at all – what Mother had told me was not correct. She asked him if he wanted
to see me but he replied, “No. I’ll remember Emily as I knew her.”
A tear ran down Emily’s cheek. ‘When you go into a convent,’ she went on, ‘you are free to leave at
any time if that’s what you want. But I never knew Peter had come back. Mother didn’t tell me until
many, many years later.’
‘Aunt,’ I said slowly. ‘Did you even ask your mother who told her that Peter had got married?’
Aunt Emily shook her head. ‘I didn’t need to,’ she said sadly.
This is an alternative text to assess, modify and develop questions items for a CSWE III
learning outcome, cf Activity 1.1.
Activity 3: Spot the problems! (piloting)
© NEAS Ltd 2014
5
It is essential to pilot a test. Even the best and most experienced test designers cannot
anticipate everything, so it is vital to get feedback from other teachers/work colleagues who
are familiar with the students, the level of skill, and the issues involved in testing. It is also
essential to see how the test works with students. Note, the test should not be used to
assess students, rather, students at or above the level of the test (eg students who have
recently moved up a level) should first do the test and then be given the opportunity to
comment on it.
Example and activity: CSWE I G1 Beginner reading and writing skills for descriptions.
This test was designed, developed and piloted. Nevertheless, five problems were later
discovered.
Materials needed:



CSWE curriculum
The Task Set “Jane” (available on the ATB website page).
Feedback is below.
Activity:
1. Workshop participants find the problems.
2. Get feedback, and discuss.
3. Show problems not identified.
Feedback from a service provider
“I would like to suggest that you raise some issues with a test that is in the task bank already.
It is Cert I G1 – read a description – and it is called Jane.
It starts by saying that Jane is 13 years old and has a sister and two brothers. Question 4 is
“How many children are there in Jane’s family? And the answer is supposed to be 4.
The difficulty is that Jane is counted as one of the children. However Jane is 13. Many of
them learn in their picture dictionaries that children are from age 4 to 12 and teenagers are
from 13 to 19. So they will not be sure if Jane should be counted as a child.
In addition it is a kind of trick question because it is easy to not notice that Jane is one of the
children as she is the centre of the story and you tend to count her brothers and sisters and not
her.
In addition, I would like to have permission to substitute a Canberra suburb for the place
name “Wulagi” which is familiar to very few students in Australia. Also I want to substitute
Belconnen Stadium instead of Marrara Stadium. Otherwise our students will be looking up
Wulagi and Marrara in their dictionaries and getting confused whereas the people for whom
this test was designed would find those place names very familiar.
One of my Muslim students assumed that Jane was a boy. I thought it was his poor reading.
However then I realised that the fact that Jane plays football would have confused him. It is
© NEAS Ltd 2014
6
probably unfair to use a test as an opportunity to break down gender stereotypes, especially as
some students would not have these stereotypes and for others they would be very entrenched
in their thinking.
For our adult students it would be better to have a version of this test in which Jane is an adult
– perhaps 36 years old- and she has four children. Then it is very clear who the children are
and also the family is being described in the terms that our students usually describe their
families i.e. with themselves as parent and the children as a result of their marriage”.
My friend Jane
My friend Jane is 13 years old. Her birthday is in
April. She lives in Wulagi with her mother, sister
and two brothers.
Jane is a small girl and is only about 150
centimetres tall. She has short, curly black hair,
big brown eyes, olive skin and glasses.
Jane plays football every Saturday morning at
Marrara Stadium. Jane also loves to ride her
bicycle.
She is a happy person with a big smile.
The problems
 Jane’s age
 Place names
 Including her in the number of children
 Girls play football?
 Learners are adults
 Vocabulary: olive?
Moving House – question items
© NEAS Ltd 2014
7
1. Tick (  ) the correct answer
The story is about:
last Monday
next weekend
moving house
drinking tea
2. Number these sentences in the order they happen in the story.
The first one has been done for you.
The neighbours came in for a drink.
Someone knocked on the door.
They packed their things.
Maria and Nick moved house.
1
They put the food in the kitchen cupboards.
Answer these questions in a few words.
3. When did they move house?
_________________________________________________
________
4. What is the name of Maria’s husband?
_________________________________________________
________
5. What did they put in the kitchen cupboards?
_____________________________________
_______
6. Why was Nick happy?
_____________________________________
_______
7. What did their neighbours give them?
_________________________________________________
________
Moving House – answers
Answer key
In order to achieve the learning outcome learners must:
© NEAS Ltd 2014
8
1.1
1.2
1.3
identify the topic/participants(s);
demonstrate understanding of sequence of events, and
demonstrate understanding of details of events.
Note that sentences need not be grammatically correct or in sentence form but errors must
not interfere with meaning.
1. Moving house (1.1)
2. (1.2)
The neighbours came in for a drink.
5
Someone knocked on the door.
4
They packed their things.
1
Maria and Nick moved house.
2
They put the food in the kitchen cupboards. 3
3. Last weekend (1.3)
4. Nick (1.1)
5. Food and plates (1.3) (either or both answers for a correct response)
6. To have a big garden and/or grow vegetables (1.3)
7. Flowers and a cake (1.3) (either or both answers for a correct response)
© NEAS Ltd 2014
9