2012
Judging Guidelines for
Exhibition & RoboFashion Dance
Go to
www.robofest.net and click on
[Robofest 2012] button.
This PowerPoint file and related
materials will be available under
“Judging” section.
Updated Feb 20, 2012
This presentation is for all volunteers, coaches,
mentors, site hosts, and team members
Judging Philosophy
• Maximize Students’ STEM learning
• Objective and Fair
• Simple and efficient – Judges do not
have enough time before the closing
ceremony for long discussion
Judge Types and Roles
Chief Judge
About 20%
of
teams
Judges
Qualify for Regional
and World
Championships
3
Exhibition Judging (RFD
judging also uses similar concept)
An example of science related autonomous robotics project
Sr. Division First Place 2007: Farmington Harrison High School, Michigan
GPS guided robotic boat monitoring and measuring ecological data
Exhibition Competition Category
• Complete freedom to show off any type of
creative autonomous robotics project
• Must employ sensors
• Human to Robot, Robot to Robot interaction
strongly encouraged (see next slides)
• Math and Science components – No. 1 criteria
(25%)
• Sharing online video (such as YouTube or
SchoolTube) is highly recommended
5
Possible Interactions Allowed for
RFD and Exhibition (Not for Game)
• Human <-> Robot
• Robot <-> Robot(s)
• Student programmed Host Computer <->
Robot(s)
• Student programmed devices such as smart
phones or another controller operated by
human player <-> Robot(s). But note that
sensors must be used.
• RC (or Joystick) is not allowed. May be used only to start.
6
Examples of
Human <-> Robot Interactions
•
•
•
•
•
•
Claps/Knocks – Sound Sensor
Flash Light – Light Sensor
Color Cards – Color Sensor
Waving Hands – Sonar Sensor
Gesture – On-board camera
…
Examples of
Robot <-> Robot Interactions
•
•
•
•
•
•
IR communication (For example, Lego RCX)
Touch sensors
Light/Color sensor; special color jersey
RFID
Bluetooth or ZigBee
On-board camera – Robot gesture / visible
signal
• ...
8
Exhibition Competition
• Teams are supposed to demonstrate the
project whenever they have visitors
• Silent Judges may visit team tables
individually, as if they are spectators
• Official presentation when a group of Judges
visits the team table: Teams will have
maximum 4 minutes for their team
introduction, robot presentation, and
demonstration
• Michigan Regional and World Championship will have People’s
Choice award, decided by spectators
If a team is continuing a prior
year’s project…
• They must inform judges that this is a
“continued” project
• They must add new feature(s), or significantly
improve or change a feature
Roles of Exhibition Judges (1)
• Before the competition date:
– Visit team web pages
– Watch team videos, if any are submitted
• Before the Opening Ceremony: Visit each
team table to be familiar with the
exhibitions
Roles of Exhibition Judges (2)
• Score the official presentation & demo
• Any time up to one hour before the closing:
– Visit team tables to interview teams
– Read their posters
– Ask for re-demonstrations, if needed
– Inspect program code and robot(s)
– Select top 50% teams and submit ranks of them
to the Chief Judge using the score sheet
– Submit comments on ALL teams to the Chief
Judge using the Judging worksheet
Exhibition Competition Team Score is
based on:
Application of math and science concepts
Originality (creativity and imagination; innovation)
Wow! factor & public demo performance (reliability)
Presentation methods and student attitude for
spectators; Information on the team poster;
Information on the web such as team video
Source code and robot inspection
Complexity, size, and number of functions
Usefulness / Practicality
Entrepreneurial ideas and mindset, others
25%
20%
20%
10%
10%
5%
5%
5%
Possible Problems of this
suggested Judging method and
How to solve the problem
• When a Judge is not a technical expert of a
field, for example, program code inspection
• Ask other Judges about their opinions before
you make final selections and ranking them
Responsibilities of
Chief Exhibition Judge
• One hour before the closing
– Meet with all Exhibition Judges
– Collect score sheets with ranks & comments
– Calculate total rank for each team using Excel with
help from Scorekeeper
– Write comments for each team using Excel or paper
• During the closing ceremony
– Briefly talk about strength and weakness of each
team
– Announce award winners as well as qualified teams
to advance
• After the event, submit all the comments, sheets, and
the Excel file to the scorekeeper
Exhibition Judging Worksheet
• A sample worksheet can be found on the web:
– http://www.robofest.net/2012/ExhJudgeForm.pdf
– http://www.robofest.net/2012/ExhJudgeForm.xls
• Note that Robofest will *not* post these
worksheets from Judges
• Only final Excel file from Chief Judge and Chief
Judge’s comments will be posted
An example: 5 Sr. Exhibition teams,
3 Judges, and a chief Judge
team ID Judge1 Judge2 Judge3
Total
A
1
2
1
4
B
5
5
5
15
C
2
1
5
D
5
5
2
3
13
E
3
3
5
11
Award Advance
1st
place
yes
yes
• Chief Judge will decide if there is a tie.
• No. of teams to advance will be given
Example of Judges’ Comments –
Should be read before announcing
winners
Judges' Comments
Team ID Strength
A
Excellent Science project
B
…
C
Very creative
D
E
Practical project
Suggestions to improve
Eye contact during the demo
…
Need more reliability
Employ math/science concepts
http://www.robofest.net/2012/ChiefJudgeCommentForm.doc
http://www.robofest.net/2012/ChiefJudgeCommentForm.pdf
RoboFashion &
Dance Judging
Team SWATT, Kosciuszko Middle School, Hamtramck, MI
Synchronization by Bluetooth communication
RoboFashion & Dance Show
• Two+ robots are recommended
• Human to Robot, Robot to Robot interaction /
communication strongly encouraged (See
previous slides)
• Stage
– Two 6ft plastic (folding leg) tables should be used
– Team decides orientation
– Team will have freedom to design their landmarks
by themselves
– Bring the tables to the competition site! (or let us
know if you need tables)
20
Note on Interactions
• Human to robot, Robot to robot interaction /
communication / synchronization is
important.
• Human players just dancing to the music with
robots is *NOT* human to robot interaction
RoboFashion Judging Criteria
• Team Intro and Presentation delivery (10%)
• Wow! factor and Demo reliability (15%)
• Artistic Choreography, Performance, whole
stage usage (15%)
• Creativity and Innovation (10%)
• Applying math & science concepts (15%)
• Robot <-> Robot Interactions & synchronization
and Human <-> Robot Interactions (15%)
• Code inspection (10%)
• Robot mechanical design (10%)
Fashion & Dance Judging
Worksheet
• A sample worksheet sheet can be found on
the web:
– http://www.robofest.net/2011/Fashion11JudgeForm.pdf
– http://www.robofest.net/2011/Fashion11JudgeForm.xls
• Note that Robofest will *not* post these
worksheets from Judges
• Only final Excel file from Chief Judge will be
posted
Roles of Chief Judge and Judges
• Basically each Judge selects best “n” teams
and give their ranks to the Chief judge
• Chief Judge calculate total ranks
• Please refer to Exhibition Judging guidelines
Little Robots,
www.robofest.net
Rule Updates
Clarifications
FAQs
Warm Up Video
Big Missions
Questions?
Contact:
Dr. Chris Cartwright,
Robofest Program Manager,
[email protected]
Dr. CJ Chung,
Robofest Director,
[email protected]