Robofest 2007
Explanation of Judging Rules
CJ Chung, Associate Prof. of Computer Science
Lawrence Technological University
Revised on March 14
Robofest
1
Agenda
1. Introduction to Robofest
Judging
2. Exhibition Judging Guidelines
3. Game Judging Guidelines
Robofest
2
Robofest Judging Philosophy
• Simple
• Fair
• Maximize Students’ learning
Robofest
3
Judge Types and Roles
Game Judges
Chief Game Judge
25%
Robofest
Exhibition Judges
Chief Exhibition Judge
Qualify to
Worlds
4
Exhibition
Judging
Robofest
5
2007 Exhibition Competition
• Exhibition team member must
introduce her/his role (5 sec x number
of team members)
• Introduction of Robots (10 sec)
• They will have 4 minutes for the robot
presentation and demonstration
• After the demo, they will also answer
a question; they have 45 seconds
including discussion time to answer.
Robofest
6
Exhibition Judging
Exhibition Judges & Chief Exhibition Judge
PR
teamID Total
_____ ____
_____ ____
…
comments
________
________
…
PR
teamID Total
_____ ____
_____ ____
…
comments
________
________
k
k: number of judges
teamID
_____
_____
_____
Judge’s Awards &
Qualification
Robofest
Avg. comments
____ ________
____ ________
____ ________
Chief Exhibition
Judge using
Excel
7
Roles of Exhibition Judges
• Before the Opening Ceremony - visit each
team table to be familiar with the exhibitions
• During the official presentation
 Watch the demos carefully and score them
 Score presentation and answer a question
• Anytime before the game 2nd round
 Visit team tables to interview with teams
 Inspect program code and robot(s)
 Meeting with Chief Exhibition Judge
Robofest
8
Responsibilities of
Chief Exhibition Judge
• Anytime before the Game 2nd round




Meeting with Exhibition Judges
Collect forms and sheets
Check the forms
Calculate average score for each team using Excel
• Before the award ceremony: decide award
winners as well as qualified teams to
advance
• After the event, submit all the forms, sheets,
hard copies to scorekeeper
Robofest
9
Exhibition Competition
Comprehensive Score is based on:
• Public Demonstration Performance (reliability) •
•
•
•
•
•
•
Robofest
30%
Originality (creativity) - 20%
Team Public Presentation and Answer of
Question - 20%
Source Code Inspection - 10%
Complexity and Number of Functions - 5%
Usefulness / Practicality - 5%
Entrepreneur ideas and mindset – 5%
New Technologies Used and Other Factors - 5%
10
Game:
Miner Rescue
Challenge
Robofest
11
Robofest 2007 Game Judging
• Simpler!
 No robot inspection
 No code inspection
 No program hardcopy submission
• But, introducing Unknown Problem (UP)
• No final matches
• Overall score is based on
 Oral Presentation (OP) – 10%
 Unknown Problem (UP) - 20%
 Performance Score (PS) – 70%
Robofest
12
Miner Rescue Challenge
The brightness of the competition area is unknown
Robofest
13
2007 Game Rules - General
• The successful rescue of a miner occurs
•
•
•
•
Robofest
when the ball touches or passes over the
center black line on the base station with the
robot (no throwing allowed)
2 minutes per game are given
2 chances (rounds) are given for each team
Only 2 players are allowed in the official
playing field
2 robots are required and both must
participate in rescuing miners (if not, no 5
points!)
14
First Round Game Procedures
• UP will be unveiled right after opening ceremony
• Your team has solved the UP, and is ready for
•
•
•
•
•
•
Robofest
the game, come to the staging area with 2 bots
Each team member must introduce her/his
name, and role (5 sec. x # members)
Introduce their Robots (10 seconds)
MC will ask a question (selected at random);
answer it within 45 sec including discussion time
MC will assign a competition track
Test of the unknown problem by Judges
Robots will be inspected by Judges
15
How to start the robot
• Staring orientation can be any direction
• Robots can start at the same time and
in any order, multiple times.
• All ground contact points must start on
the base station,10x24 board.
 This means that the robots can hang over the
board as long as all the wheels are touching
the board, for example.
Robofest
16
Setup # 1 ball - “Recommendations”
for Qualifying Competitions
• can be placed in the middle of the straight
line as shown in the figure
Robofest
17
Setup # 2 ball - “Recommendations”
for Qualifying Competitions
a
b
Robofest
Host organizer can choose an option:
• Option 1: place at random in an imaginary circle with 10”
diameter in the center of the mine field (see above a)
• Option 2: almost in the center (fixed, see above b)
18
Setup # 3 ball - “Recommendations”
for Qualifying Competitions
1
2
Can be placed (this rule is for fairness)
• Round 1: left (or right) side corner
• Round 2: right (or left) side corner
Robofest
The gap is
between ¼ - ½
inches.
(0.6 - 1.25cm)
19
Setup # 4 ball - “Recommendations”
for Qualifying Competitions
Placed somewhere inside the tunnel not on the
black line. (Chief Judge will decide)
 Junior division - not touching the wall
 Senior division – touching one wall (see above example)
Robofest
20
Scores: Junior & Senior Division
, and all 4 miners were saved using both robots!
Robofest
21
What is the ramp?
Robofest
22
The Bot is returning home without the
ball… When can I pick it up?
• Answer: When any part of the robot
touches the black line on the base station
• In order not to lose the 5 points
Robofest
23
In Case of Any Failure (when a
robot goes crazy…)
• If a robot is touched outside the base
station, the robot must be restarted.
• If a ball was moved by the (crazy) robot,
judges must reset the ball closed to
original location, after two robots are
back to the base station.
• If any piece of the robot is left on the
field or taken apart during the play, it
must be retrieved by the player and
the “5” points cannot be earned.
Robofest
24
Robot Specifications:
• No size limitation as long as it stays alone
on the base board.
• You may use any part & material
• Only one robot controller (computer) for
each robot.
Robofest
25
Tunnel Setup – “recommendation”
for Qualifying Competitions
• Tunnel will be located on
the left-side straight line,
• Exact location will be
almost same as the
figure 1 in the official rule
• the opening/orientation of
the tunnel will be same
as the figure 4 in the
official rule document
Robofest
26
Tunnel Setup – “recommendation”
for Qualifying Competitions - Cntd
• Note that the tunnel is taped on the board
completely. It should not move during play.
• A judge may need to hold down the mine
structure if a robot is too powerful.
Robofest
27
Unknown Problem (UP) Details
• Each team will be given a sheet with the
•
•
•
•
Robofest
description for the UP.
One of the game robots should be used to
solve the problem.
You will not need to make any mechanical
changes to robot, assuming you are using a
light sensor facing down and a touch on your
robot.
the UP will require a LCD to display at least 3
digits.
The score and the rank of this UP will be used
for tie-breaker.
28
Flash Extra Points for Unknown
Problem (UP):
The purpose is to encourage teams to try
early!
• The team that solves the problem first time
will get 3 extra UP points
• The team that solves the problem 2nd time
will get 2 extra UP points
• The team that solves the problem 3rd time
will get 1 extra UP points
Robofest
29
What if your team cannot solve UP?
• Try to get partial points
• Just line up! - Do not forget to bring the
following forms:
 Scoring Sheet with official team label (can be
found in the team envelope)
 Unknown Problem Sheet given
Robofest
30
Miner Rescue – Junior vs. Senior
Division
• Everything will be the same, except the
following:
 Senior Division UP will be harder
 The No. 4 ball for Senior Division will be
placed at more difficult location. The ball is
touching a wall.
Robofest
31
Judging and Prizes:
• Everyone is the winner: All students will
receive medals and framed certificates.
• 25% of the total number of teams at each
qualifying site will win large trophies.
 Overall Performance Awards
 Programming Awards
 Presentation Awards
 (Special) Judges Awards: Innovative
solutions, best platform (if needed), etc.
• The tie breaker is the result and rank of the
unknown problem
• A team will win only one award trophy
Robofest
32
How Game Judging is Scored:
Game Judges
PR
OP
teamID
…
Score
teamID
Score
_____ _____
_____ _____
_____
_____
_____ _____
_____
_____
_____ _____
Round 1
…
UP
UP
teamID
…
PS
PS
teamID
Score
Score
Score
Score
teamID
n
m
Round 2
…
PS
PS
teamID
teamID
teamID
n
Score
Score
n
Score Keeper
Chief (Spreadsheet)
Judge
Robofest
n: number of teams
m: number of official tracks
33
Typical scenario to play a game
• Emcee will check timer, judges, teams are
ready
• Give the start signal
• Then Judges place balls.
 All the playing fields must have balls at almost
same locations.
 Suggested locations were mentioned in the
previous slide
Robofest
34
Game Oral Presentation (OP)
Judging Criteria (10% of the overall score)
•
•
•
•
Team introduction (10%)
Robot introduction (10%)
Answer a question (70%)
Presentation delivery (10%)






Robofest
Eye contact
Loud enough
Clear
Spoke extemporaneously
Time used effectively
Etc.
35
Roles of Game Judges
• Before the Opening Ceremony
 Check the tracks before opening ceremony
 Be familiar with all the game rules and rule
updates
• During the game
 Score team presentations.
 Maintain official tracks (Especially the base
station and ramp boards must be checked)
 Check rule violations
 Reset Balls
 Score games – submit the sheet to Chief Judge
Robofest
36
Responsibilities of
Chief Game Judge
• Decide the exact location of the No. 4 ball and
•
•
•
•
•
•
•
Robofest
inform that to Judges.
Collect Game Scoring Sheets
Check Game Scoring Sheets
Deliver to Score Keeper
Check the Excel file entered by Score Keeper
Decide anything not specified in the rule
Make final decision, if any judging dispute
occurs
Work with Scorekeeper to decide Award
Winners and Qualifying teams
37
Rule Updates
• www.robofest.net homepage
 Updates
 Clarifications
 FAQs
Robofest
38
Robofest
Little Robots, Big Missions
Questions
?
Robofest
39
Robofest
Little Robots, Big Missions
Thank
You
Robofest
40
Robofest 2007 WarmUp
“Motivating young Minds to Master the Machine.”
Robofest
March 10, 2007 (revised on March 14)
Lawrence Technological University
41
Warm-Up Schedule
8:00 a.m.
Setup begins
9:00 a.m.
Arrival and Check-in of Judges, Volunteers, Coaches and
Teams
9:10 a.m.
All Teams should be checked in
9:15 a.m.
Judge Training (Judging forms will be distributed and
explained)
 Exhibition Judging – Lori Birman and AJ Ureel
 Game Judging – CJ Chung and Joe Long
9:30 a.m.
Opening Welcome – Bill Drummond, National Anthem,
Introduction of Site Host Organizers and Judges – Lori
Birman, and Explanation of Judging Rules – CJ Chung
10:00 a.m. Unveiling of Unknown Problem
10:15 a.m. Demonstration of Exhibitions
Game Judge Training 2 – Joe Long
10:30 a.m. First Round
11:30 p.m. Second Round
Robofest
12:10 p.m. Closing & Thank You
42