DI Score Room
Appraiser Training 2017
Score room CM’s Name Here
Score Room Masters
Useful email addresses
Cell Phone Numbers
Important Websites
 Destination Imagination
http://www.destinationimagination.org/
 Your Region Destination Imagination
http://capital.texasdi.org
 Score Site
http://discoring.texasdi.org
 DI Appraiser Basics
http://www.diuniversity.org
Overview of the Training
2017 Challenges
Score Room Mission
Paperwork Flow
Scoring Considerations
Individual Jobs for Score Room
Handling Problems
Final Thoughts
2017 Challenges
Example Challenges
& Colors
•
•
•
•
•
•
•
•
•
A: Show & Tech (Tech)
B: Top Secret (Secret)
C: Vanished! (Vanish)
D: 3-Peat (Peat)
E: In It Together (Together)
PO: Ready, Willing & Fable (Fable)
IC
Score room
Save the Day
Orange/Salmon
Yellow
Blue
Pink/Red
Green
Grey
Purple
Black
White
We like to color code everything for easy sorting. Consult
your RD/AD for their choice of colors!
General Procedures
 When? Report to Score Room by 9:00
 Leave time for Breakfast and Sign in before this
 We’ll be working until about 5:30 (we hope!)
 Access to the room is limited
 Not a place for visiting or hanging out
 All paperwork is logged in and out of the room
 Refer anything unusual to the room leaders
 This allows everyone else to continue processing the
“normal” scores, keeping the flow going
 Add to the bottom, take from the top
 This keeps paperwork flowing in time order
Primary Mission
 The primary Mission of a DI Score Room is to
provide the announcer at the conclusion of a
tournament with an accurate list of place finishes for
the teams that competed at that tournament.
 Help keep the tournament running smoothly
 Get everyone home at a reasonable hour
 Goal: All scores Complete 1 hr before the award
ceremony
 Accuracy
 Efficiency
 Timeliness
Score Room Mission
Accuracy is foremost.
Procedures result in all scoring operations
being done twice by independent people.
These two people must agree on the
resulting computation.
If in doubt ask your CM or send back to
appraiser to correct
Never erase a score
Initial ALL changes
Score Room Mission
• Efficiency is secondary to Accuracy.
Efficiency is defined as
computing the final scores by
the time that the Tournament
Director expects them to be
done.
Typically final scores are
available about an hour or less
after the last team performance.
Score Room Mission
• Timeliness
 Process paperwork ASAP
 Don’t Hold on to Packets!
 Process Packets in order (first in
first out)
 Process and move on to the
next step, then file!
 Have everything completed
well before the scheduled
awards ceremony
Individual Responsibilities
 Appraiser – Site, not score room personnel
 Appraisal Team Organizer- Site
 Score checkers
 Computer operators
 Score runner
 Gate keeper
 Paperwork Manager
 Score Room Challenge Masters
Paperwork Flow - Central
Appraisers
Appraisers
Appraisers
Appraisers
Appraisers
Challenge
Sites
Head Appraiser
Appraisal Team
Organizer
Team Manager
Runner
Logs all
Time(s) In
Time(s) Out
Gate Keeper
Results TM, HA
Score Room
Checker (optional)
Final Score
storage area
Data Entry 1
Data Entry 2
Paper Work Manager
File Manager
Central Score Room Sample Layout
Score Room
Gate Keeper
Check In
Check and Backup
Printer / Copier
Backup
Data Entry 1
Data Entry 2
Checker
(optional)
Tournament
Master
Data Entry 1
Data Entry 2
Final Score
Data Entry 1
Data Entry 2
storage area
Scoring Guidelines
 Objective - Non-averaged
scores
 0, 5, 10, 15
 all appraisers must agree
 Subjective - Averaged scores
 USS Appraiser ranges 1-30
 will vary between appraisers
 Rounding – Score program
does this for us
 2 digits to right of decimal
.666 > .67 and .333 > .33
 Zero Score
 if element is not present
 all appraisers scoring that
element must agree it was not
there
 Deductions




all appraisers must agree
% of the points earned
reason(s) must be noted
Deduction Worksheet with
highlighted entry
Appraiser
 Complete the Appraiser Score
Sheet
 Must complete all assigned items
and no more!
 Must be legible
 Must agree on all deductions, zero
scores or non averaged scores (0,
5, 10, 15)
Appraisal Team Organizer
 Collect Appraiser forms, envelope and all
paperwork from the team.
 Check for legibility and any missing items
 Place all paperwork in envelope, give to
runner to deliver to checker & Computer
Operator
 Receive Head Appraiser and Team copies
from computer operator - log times in for
Head Appraiser.
 Log times when team has received their copy
Making up the Score Packet
 Team label on the upper left corner of envelope
 Please put the papers in this order
Label
 Deductions worksheet if there is a Deduction
 Weigh-in (Check In) sheet (Challenge E Only)
 Appraisers sheets
 In Order (Alpha or Numeric)
 Prep area sheet
 Everything else last
 Small Envelope with Award Certificates
 Team manager Copy of scores also goes in when
complete
 Stickies on the special stickies sheet stay at the
appraisal site to give back to Team manager with team
scores
 ONLY positive comments! Trash inappropriate ones…
Status Dots
Score Checkers
 Check incoming score sheets for completeness &
legibility
 Check Weight held calculation (Challenge E)
 Write initials next to calculation
 Check order of paperwork
 Deduction Work sheet
 Weigh-in Sheet (Challenge E)
 Appraiser sheets (in order)
 Prep Area sheet
 extra material last
 Pass to Computer Operators.
Score Checker
 Ensure Legibility
 Common Errors
Subjective vs Objective
Objective all must agree
Range
Deductions
Checking Scores
Never have two team’s paperwork out in
your work area at once!
If your Head Appraiser needs you to look at
something, put the current team’s paper away!
After checking, please put the score sheets
in the order that they appear on the printed
Appraiser Assignment sheet form before
sending to score room.
Score Runners
 Very Important Job!
 Introduce yourself to Head Appraiser,
Appraisal Team Organizer and Gate
Keeper
 Pick up completed score packets from
competition sites
 Team challenges
 Instant challenges
 Deliver score packets to score room
check-in
 Make scheduled runs
Computer Operators - Central
 Will use provided Computers & Printers
 Computer Proficiency very helpful!
 Importance of accuracy in typing numbers
 1st Entry Operators
Enter scores from appraiser sheets
Place all remaining paperwork in team envelope
and pass to 2nd entry computer operator
 2nd Entry Operators
Re-enter scores from appraiser sheets
Check is automatically done when saved
 Occasionally enter bad data to verify check
Print 1 Team, 1 Head Appraiser and 1 Score
Room Copy
 Score Room Copy into envelope
 Team and HA copies get returned to site in folder
 Can download program and be familiar with it
http://discoring.texasdi.org/
Gate Keeper / Check In
Accept all incoming packets
Using Check In Computers and Program
 Log in and out times on IC/TC
 Log out paperwork leaving score room for
questions
Do not let unauthorized individuals in
score room
Paperwork Manager
 Pick up incoming folders from gatekeeper
and transfer to the correct computer operator
 Pick up completed folders from Computer
Operators
 Deliver HA and Team score printouts to
return folder
 File folders in appropriate boxes by challenge
and update checklist
 If scores are pulled after filing, hand walk the
returned envelope to computer operators and
identify actions needed
Score Room Challenge Master
 Knowledge of
 the challenges
 scoring program
 how calculations are done
 all score room jobs
 Recruit and train
 appraisal team organizers
 score room personnel
There to help with any questions or
issues
How to Handle Issues
 Talk with your score room leader
 Mark team with an Issue in the program
 Enter explanation in Modify Team dialog box
 Use “yellow sticky” to describe issue
 Put all paperwork in the package in order
 Put on a red sticker
 Log team red in the Check-In program
 Return to team challenge room for
correction
Processing Issues (cont.)
When a red sticker packet comes back in
Log it in at Check-In
Goes to head of the queue for the first
computer
It is an older packet than those we’re
processing
Could be from
A change we requested
A change the Head Appraiser is requesting
Partially cover red sticker with green sticker
Sticker Management
Good packet after 1st entry – put a green sticker
on packet
Bad packet during 1st entry – put a red sticker
on packet – return for problem resolution
MJA
Good packet after 2nd entry and check –
initial green sticker – Send to File
Bad packet during 2nd entry – add red sticker
– return for problem resolution
Problem resolved and re-run through 1st entry –
add a green sticker
MJA
Good packet after 2nd entry and check –
initial green sticker – Send to file
Practice
Some people will not be doing data entry
Everyone should be familiar with the
scoring program
In case of illness, etc.
Help during breaks
If you haven’t used it before, please
download it and practice
http://discoring.texasdi.org
Scoring Goals
Ensure that every team gets the full credit they
deserve for their challenge solution
And only the credit they deserve
Turn scores around promptly
Allows team managers to review them
Maintain the confidentiality of the scores
Never leave your paperwork unattended
Let everyone get home at a reasonable hour
Have fun in the process
QUESTIONS!
 Ask and we’ll see if we can answer.
Computer Entry Demo
Note: Screenshots are of last year’s challenges but procedure
is the same for 2016
Tournament Summary Window


Scoreboard for
the tournament

number of teams

number whose
scores are
incomplete

when they should
finish

when the scores
were printed
Drill down to a
challenge level
Drilling Down to Enter Scores

List of teams in a
challenge level

performance
time

status

being
scored?

TC done?

IC Done?
Entering Scores


Data entry of all
appraisers’ scores
Computer verifies
ranges



Verifies appraiser
agreement for objective
scores
Computer calculates it
all
Computer scales the
final results and prints
them
Error Checking
Entering Item-Specific Deductions
• Click on the square checkbox to the
left of the item’s title
• Fill in the deduction value and the
reason
• Note that deductions can be a percent
of the awarded score (not the max
score!)
Click on “OK” to close the deduction dialog box
Entering “Other” Deductions
 Deductions are not normally editable as a
safety measure.
 To enable:
Right click in the score area
Select “Modify Deductions”
Or, “Alt-D” for you keyboard types
 All deductions MUST have a reason
Entered in the second computer
All Challenge Level Window
a VERY useful tool!
Use with Quick Search!
Issues Form (Modify Team dialog)
… for your time.
… for your generosity.
… for your service.
… for all you do.