Umpiring assessors` manual

Guide to
Match Observation
* * *
2010
ECB ACO
© 2010 ECB ACO
Guide to Match Observation
Page 2
ECB ACO
Guide to Match Observation
Contents
Page
Contents
3
Aims and objectives of the guide
4
Attributes of an effective match observer / assessor
5
1.
Planning & Preparation
6
2.
Observation
7
3.
Recording
8
4.
Analysing and Evaluation
9
5.
Learning points
11
6.
Gathering additional evidence
11
Example questions
12
The Review
13
7.
Competences & criteria
Pre-match Planning and Preparation
14
Techniques & Fieldcraft
15
Man and Match Management
16
Teamwork
17
Appendix A
Performance criteria in 4 key areas:




Planning and Preparation
Technique & Fieldcraft
Match and Man Management
Teamwork
Appendix B









L2 T0 Level 2 Application sheet
L2 T1 Umpires Match Record
L2 T2 Match Planner
L2 T3 Self-evaluation
L2 T4 Observer evaluation
L2 T5 Scorer Feedback sheet (optional)
L2 T6 Captains/Coaches/Managers Feedback sheet (optional)
L2 T7 Observers Match Record
Supervising the Toss – best practice guide
© 2010 ECB ACO
Page 3
ECB ACO
Guide to Match Observation
The aim of this guide is to:
 support the training and deployment of match observers
 provide an outline of the ECB ACO process for match observation
 provide an outline of the criteria used for performance assessment
 provide assistance to gathering evidence of performance
 provide assistance to the analysis of relevant performance
 provide additional support material to gather further evidence
 provide assistance to the match observer for feedback
It will also assist the Match Observer by
 supporting the training accreditation of match observers
 enabling you to generate evidence towards your Accreditation as an
ECBACO Assessor
 providing the Match Observer with an opportunity to work, learn and
share with others
 encouraging the Match Observer to reflect on their own performance
both as an Official and as an ECB ACO Match Observer
Remember:
The purpose of match observation is improve the overall standard of
officiating. The aim is to agree those performance elements that the individual
wishes to maintain and those he or she wants to improve upon.
Match Observers will support this as a critical friend by
 creating a positive and safe environment for discussion
 focusing on the performance of the umpire at the relevant level
 observing and recording evidence of the umpires performance
 asking probing questions to gather additional evidence
 assessing this evidence against the expected criteria
 providing feedback on the performance and any gaps
 promoting a climate for self-reflection
 identifying the action plan for future performance
© 2010 ECB ACO
Page 4
ECB ACO
Guide to Match Observation
Attributes of an EFFECTIVE Match Assessor
Demonstrate positive body language, interested, smiling, nodding, etc.
Settles the umpire and creates a positive learning environment
Has a practical, working Knowledge
 of the Laws of Cricket
 of the Assessment process
 of the evaluation criteria at the relevant level
Has the necessary range of Skills
 Interpersonal – able to build rapport
 Communication skills
 Negotiation skills
 Questioning skills
 Listening skills
 Observation skills
 Analysis and evaluation skills
Demonstrates these personal Qualities
 Trustworthy
 Organised and logical, systematic
 Fair
 Objective
 Reliable
 Consistent approach (not good cop – bad cop!)
 Approachable
 Supportive
 Demonstrates empathy with the umpire
© 2010 ECB ACO
Page 5
ECB ACO
Guide to Match Observation
1. Planning and preparation
Planning your briefing
 Consider your approach for the briefing
 What is the purpose and benefit for them and you
 Consider what you want to say and how you want to say it
 Make it two-way, ask questions to establish facts and info
 Agree a mutually convenient time and place for the briefing
Conducting the pre-observation discussion
 Build the supportive relationship - establish rapport
 Establish through discussion what they already do well
 Discuss their expectations of the observation outcome
 Discuss the observation, your role and your expectations
 Agree and Confirm the next 3 or 4 appointments/venues
 Agree up to 3 key areas of development to focus on
 Agree where, when and how you will observe
 Confirm which part(s) of the match will you be observing (ideally this is
a minimum of 20 overs through to a full match)
 Agree where, when and how the review will be conducted
Preparation for observation
As you would expect of the umpire
 Plan your route and timetable
 Gather the equipment you need, clipboard paper, pen, etc.
 Be familiar with this guide, the evaluation sheets, the criteria
 Know what can reasonably be achieved through observation,
questions, listening
 Be available for the pre-match meeting with colleague, the captains, if
applicable
 Agree how you will introduce yourself to others on the day
© 2010 ECB ACO
Page 6
ECB ACO
Guide to Match Observation
Observation
The purpose of the observation is to:
 see and hear what the umpire does well in the performance of the role
and responsibilities as an official before, during and after a match
 assist the umpire to understand how they compare against the
benchmark criteria in key areas of their performance
 provide independent evidence for their performance review of those
things that could assist the umpire to improve their performance
Match Observers should:
 Arrive as planned and agreed
 Introduce yourself as an ECB ACO match observer (not an assessor)
 Observe the Umpire’s performance and practice unobtrusively yet from
different points of the boundary or as an on-field colleague
 Observe the Umpires body language, general demeanour
 Listen to, and observe, their communication with their colleague, the
scorer(s), captain and any players
 compare and contrast what they saw or heard with your expectations
(focus on positives)
 identify what matches and mis-matches there are in terms of
performance (skills and knowledge requirements plus application =
performance)
Key observation points

Think about your - position, comfort, view, writing notes etc.

agree if you are to observe the pre-match discussion with their
colleague and / or the pre-match meeting with the captains.

Once the match starts remain unobtrusive e.g. do not wander around
the boundary with a clipboard making notes as this is distracting.

Agree, in advance, the key performance criteria to focus on

Be clear what that looks and feels like at this standard

Catch the Umpire doing the right things– e.g. effective Signalling

Doing things right – Signalling well and in correct sequence
© 2010 ECB ACO
Page 7
ECB ACO
Guide to Match Observation
Recording
The purpose of making notes is to:
 have an accurate written record of the umpire’s performance as an
official before, during and after a match
 prompt the match observer and the umpire to reflect back on specific
situations without relying on either individual’s memory
 provide independent evidence of their performance for inclusion in the
portfolio
Match Observers should:
 use the observer evaluation form, (L2 T4), as both a planning tool and
a checklist for observing the umpire and recording notes
 record only what you actually see and hear
 suspend your judgement until your notes and the observation have
provided sufficient evidence that reflects the agreed performance
areas.
 note the umpires body language, general demeanour and their
communication with their colleague, the scorer(s), captain and any
players throughout the period under observation
Record your notes – be prepared to challenge and to be challenged on what
you have recorded.
During the review use phrases like
what I saw was….
What I heard was….
© 2010 ECB ACO
Page 8
ECB ACO
Guide to Match Observation
Analysis and Evaluation
The purpose of analysis and evaluation is to:
 allocate your observations and notes to each of the performance areas
for grading against the benchmark criteria
 compare and contrast the umpire’s performance as an official before,
during and after a match against the against the agreed criteria
 determine the performance highs and any performance gaps to build
an development action plan for future matches
Match Observers should:
 use the observer evaluation form, (L2 T4), as both a planning tool and
a checklist to allocate the relevant notes to the appropriate area(s)
 compare the notes with the benchmark criteria
 analyse the recorded performance in each of the key areas on that day
and in that match
 evaluate the recorded performance and apply the relevant grading of
(A – D) against each key area
In preparation for the review
Focus on the positives
 Confirm in which areas the umpire is to be graded A or B on the basis
of what you have seen and heard and why
Review the negatives
 Confirm in which areas the umpire is to be graded C or D on the basis
of what you have seen and heard and why
© 2010 ECB ACO
Page 9
ECB ACO
Guide to Match Observation
Learning points
Using the A – B gradings
Identify what the umpire did well and should be encouraged to continue doing
Using the C – D gradings
Identify what they did that was not acceptable and that you would like them to
improve i.e what you would like them to better
You may like to use the following phrase or something similar
 What I would like you to do is…
Note: this phrase enables us to convert negative feedback into positive actions
e.g. your pre-signalling was not visible to the scorers
converts to
what I would like you to do in future is to exaggerate your pre-signals so that
they are visible to the scorers at all times.
In preparation for the review
Consider your evaluation and the main Learning points for use in the review ideally pick a few (3-5) important key points to assist the umpire’s future
performance and focus on these.
Too many points and the value may be diluted or lost!
© 2010 ECB ACO
Page 10
ECB ACO
Guide to Match Observation
Gathering further evidence
You may wish to include any relevant comments or conversational feedback
from the scorer, the manager, captain or coach that you have heard or
overheard during the match.
If you have agreed to record their comments for feedback these would be
valid too.
On-field colleague feedback can be complementary and useful to add to the
off-field evidence.
If you choose to gather further evidence through questions
 Plan to ask clear, unambiguous questions - knowing why you are
asking the question - avoid apparently random, arbitrary questions
 Use HOW and WHAT type questions to encourage specific reflection –
(see examples below)
 Sequence questions in a logical order
 Use follow-on questions where appropriate
 Ask one question at a time – like signalling – wait for the answer!
 Avoid interrupting
 Use silence, resist the temptation to rephrase or amplify original
question too soon - allow people time to respond
 Actively listen - respond to answers with warmth, enthusiasm and as
constructively as possible
 Only build on their answers and add value, if appropriate. Say nothing
if they have made the point
© 2010 ECB ACO
Page 11
ECB ACO
Guide to Match Observation
Example Questions
Practice varying your What, How and Why questions using
T
Tell me about…
E
Explain…
D
Describe …
P
Precisely …
I
In detail …
E
Exactly …
e.g.
Tell me about your preparation for today’s match
Explain what happened (when the batsman/fielder …?
Describe in your own words what happened next …
Precisely what did you hear the bowler say?
Describe in detail – how you will deal with that differently next time
What exactly did you agree with your colleague about foul language?
What did YOU enjoy most about this match today?
Focus in … what was it about ….. that made it enjoyable?
Why was that?
If you were starting that match again –
What, if anything, would you do same again? (supplementary - Why?)
What, if anything, would you do differently?
(supplementary – Why?)
How would you deal with that situation next time, if it happened again?
What was it about your preparation/planning that helped today?
Talk me through your planning/preparation for today?
What are you most pleased with?
What didn’t go se well?
What did you learn from that situation?
© 2010 ECB ACO
Page 12
ECB ACO
Guide to Match Observation
The REVIEW
REMEMBER:
It is their review of their performance on the day and your war stories are
likely to be distracting and unproductive!
If appropriate, and agreed by all parties the umpire colleague may also be
directly involved in the review meeting for the benefit of both officials.
If this option is exercised the match observer must control the discussion and
ensure that the review does not become 2 on to 1.
REVIEW
The purpose of the review is to:
 provide the umpire with feedback on their performance against the
agreed areas compared to the benchmark criteria
 re-engage them with their goals for that specific match
 encourage them to reflect on their performance before, during and after
the match against the against the agreed criteria
 assist them to determine an action plan that will guide them to improve
Match Observers should:
 start with a very short introduction where you enthuse about one or two
things they did well – 30 seconds max!
 lead by asking the umpire for their overview of the match and areas of
their performance that went well. Obtain their initial reaction and input.
 re-engage the Umpire e.g. remind me what your goals were today?
 use the observer evaluation form, (L2 T4), as both a planning tool and
a checklist to guide the review with the umpire
 conduct the review in an agreed timeframe
 avoid times of high emotion
 encourage two-way discussion – 80 / 20 rule
 be objective and not judgemental during the review
 focus on the performance not the performer
 base the feedback on evidence - what you saw and heard them do
 agree a detailed actionable development plan that can be measured SMART objectives
 summarise the key points – Focus on the agreed criteria
 confirm and share the decisions you have already made
© 2010 ECB ACO
Page 13
ECB ACO
Guide to Match Observation
Umpires Match Observers
Competences and criteria
Pre-match planning and preparation
Before the day





Confirmed appointment, colleague and competition
Know and Understand the competition rules and regulations
Know, Understand and can explain the ECB directives
Prepare and check clothing and equipment (including spares)
Planned the route and alternatives to the correct ground
Before the match




Be punctual and have a watch
Meet and Greet, colleague, club officials, groundsman, etc.
Displaying confidence – body language, deportment
Smart, clean, professional image for the competition, weather etc.
Before the Pre-match meeting with the Captains (and with colleague)





Check the pitch, markings, and surrounding areas of the ground
Position, movement and safety of sight screens, boundary
Ensure wickets, balls, bats, etc. comply with regulations
Familiar with first aid procedures and emergencies
Any issues passed to those responsible
Also
 Agree with colleague: levels of tolerance, series of signals, zero tolerance for No balls
and Wide ball criteria to ensure consistency
Supervising the Toss – Pre-match meeting with Captains
 Take control of the balls, (and spares)
 Politely yet assertively remind Captains of the Spirit of Cricket and of their
responsibility for the behaviour of their players
 Exchange team sheets of nominated players
 Check for completeness, e.g. signatures and young players
 Advise on restrictions/conditions for young players, if relevant.
 Confirm hours of play, master clock and backup timepiece
 Agree intervals, meal and drinks breaks with officials/captains
 Confirm and Agree any local rules
 Confirm over rates, use of covers, movement of sight screens
 Confirm action for interruptions for Weather and light, if relevant
 Allocation of Scorer(s)
Before play commences









Confirm with the Scorers agreements in respect of:
Position of Scorer(s)
Competition rules, regulations and ECB directives, if relevant
Any young players
Hours of play, Master clock, and backup timepiece
Intervals, meals and drinks breaks
Confirm any local rules
Confirm over rates
Confirm action for interruptions for Weather and light, if relevant
© 2010 ECB ACO
Page 14
ECB ACO
Guide to Match Observation
Techniques & Fieldcraft
Start of Play
 Exude confidence and Authority without arrogance
 Appropriate body language and tone of voice/ language
 Checking all participants are ready to commence
 Remain alert and concentrate throughout
 Never switch off between overs
 Loud, clear calls, and verbal decisions
 Positioning – best and safe
 Maps the ‘protected area’
 Posture and observation when moving position
 Positioning not Policing
 Demonstrates knowledge of the laws and local competition rules
 Regular and frequent eye contact with colleague
 Observation of the field, eye contact with colleague






Clarity and accuracy of signals, pre-signals, multiple signals
Timing of signals and responds to acknowledgement of the Scorer
Technically correct signals - No eccentric signals
4th / 5th ball signals, communication with colleague
Respect for Captains, Players, and the Officials
Be seen to be monitoring weather conditions
Remember:
It is not your job to score.
© 2010 ECB ACO
Page 15
ECB ACO
Guide to Match Observation
Match management and Man-management
During the match
 Positioning best and safe at all times. Moves quickly and unobtrusively
 Look interested. Demonstrate awareness and concentration throughout
 Builds rapport with captains and players throughout the match
 Punctual and accurate time management of the match as described in
the Laws, rules or regulations e.g. Start, Re-start and Finish on time
 Confirming all delays and rescheduled starts with both captains
 Call “Time” and “Play” at either end of interval or break
 Calls loudly and Signals clearly for all players to hear and/or see
 Advise captains or relevant people of any positioning changes
 Manages other personnel – e.g. groundsmen, caterers, etc.
 Respect for captains wishes or views, (as appropriate)
 Diffuses situations using a sense of humour or empathy
 Regular/irregular control and inspection of the ball
 Applies the Laws, rules, regulations, directives, accurately and fairly
without fear or favour. Adopts a consistent approach throughout
 Advises and applies ECB directives eg, fast bowling, helmets, etc.
 Commands respect through ‘Delivery of Decisions’
 Not influenced by pressure situations by captains or players
 Deals with practical incidents on the day, explains decisions, if relevant
 Positioned to view situations on which may be called to make decisions
 Positioned to assist colleague with decisions
 Striker’s end - safe distance yet close enough to hear and see without
interfering
 At end of each over ensures overt observation of players and the pitch
 Maintains a ‘watching brief’ on Ground, Weather and Light conditions
 Consults with colleague on issues of Ground, Weather and Light
 Consults with colleague, if relevant and as appropriate
After the match
 Is approachable by Captains to explain any match situations – yet not
to debate decisions
 Is available to provide feedback on incidents, issues from the match
 Is available to explain any disciplinary reports that are required in a
concise, objective and an accurate manner
© 2010 ECB ACO
Page 16
ECB ACO
Guide to Match Observation
Teamwork: Colleagues and Scorers
Before the day
 Contact colleague, build rapport, discuss the match, local customs
 Confirm the competition rules and regulations, ECB directives,
 Plan the route, travel arrangements, timings and agree dress code
Before the match
 Meet and Greet colleague
 Become familiar with club first aid procedures and emergencies
 Conduct pre-match duties, e.g. check the pitch, pitch and boundary
markings, the playing area and surrounding areas
 Ensure wickets, balls, bats, etc. comply with regulations
 Note the position, movement and safety of sight screens, boundary
 Ensure that any issues are passed to those responsible
Before the Pre-match meeting with the Captains (and with colleague)
 Agree with colleague: levels of tolerance, series of signals, zero
tolerance for No balls and criteria for Wide ball to ensure consistency
 Take control of the balls, (and spares)
Supervising the Toss – Pre-match meeting with Captains
 Share responsibility for discussion points with Captains
 Politely yet assertively remind Captains of the Spirit of Cricket and of
their responsibility for the behaviour of their players
 Exchange team sheets of nominated players
 Check for completeness, e.g. signatures and young players
 Advise on restrictions/conditions for young players, if relevant.
 Confirm hours of play, master clock and backup timepiece
 Agree intervals, meal and drinks breaks with officials/captains
 Confirm and Agree any local rules
 Confirm over rates, use of covers, movement of sight screens
 Confirm action for interruptions for Weather and light, if relevant
 Confirm Allocation of Scorer(s)
Before play commences
 Share local knowledge with colleague and the Scorer(s)
 Confirm with the Scorers agreements in respect of:
 Position of Scorer(s)
 Competition rules, regulations and ECB directives, if relevant
 Any young players
 Hours of play, Master clock, and backup timepiece
 Intervals, meals and drinks breaks
 Confirm any local rules
 Confirm over rates
 Confirm action for interruptions for Weather and light, if relevant
© 2010 ECB ACO
Page 17
ECB ACO
Guide to Match Observation
During the match
 Best and Safe positioning of self and colleague
 Conduct all match routines and own duties in a professional manner
 Maintain Effective communication with colleague at all times
 Maintain regular eye contact with colleague
 Consult, with colleague as appropriate
 Clear and concise pre-arranged signals for colleague e.g. 4th or 5th ball,
over waist height, bat/pad etc.
 Ensure colleague has heard and seen the call/signal(s)
 Assist colleague with decisions where relevant and appropriate to
deliver correct decisions e.g. difficult catches, boundaries, crossed, etc.
 Monitor players and the pitch at the end of each and every over
 Discuss any position changes
 Monitor match conditions and take all decisions relating to Ground,
Weather and Light or other suspensions of play jointly with colleague

 Inform colleague and Scorer(s) of Actions, Cautions, Warnings etc.
 Be proactive with colleague, acting as a team, in any disputes






Clear, unambiguous signals and pre-signals to the Scorer(s)
Await and respond to Scorer(s) acknowledgements
Check/clarify any dismissals as required
Kept Scorers informed of all delays and scheduled re-starts
Confirm the correctness of the score/result with the Scorer(s)
Thank Scorer(s) for their contribution to the match
© 2010 ECB ACO
Page 18