A modern approach to the Turing
Test
Alex Gutowski
CS534 AI Showcase
April 23rd, 2013
Remember the Turing Test?
Turing Test:
• A test created by Alan Turing in his 1950 paper
"Computing Machinery and Intelligence,“
• Loebner Prize, a competition for practical
application of the Turing Test
▫ Chatterbot
▫ Some Chatterbots are actually successful
• Competition Extensions/Variations on the TT:
▫
▫
▫
▫
Hutter Prize
Reverse Turing test and CAPTCHA
Minimum Intelligent Signal Test
Total Turing Test
Angry Birds
The Angry Birds AI Challenge
• Goal: To “build an intelligent Angry Birds
playing agent that can play new levels better
than the best human players”
▫ A modern twist to the Turing Test
• Intended Use: Have a way to mimic human
game play so that there is a ranking of how
difficult a level is without actually “playing” it
Components:
• A basic game playing software, (written in Java,
and playable in Google Chrome)
▫ A computer vision component: used to
identify objects and locations
▫ A trajectory component: used to calculate
trajectories of shots
▫ A game playing interface: executes game
actions
Example level through the eyes of the
computer vision component:
What AI ideas are required:
•
•
•
•
•
Computer vision
Knowledge representation and reasoning
Heuristic search
Machine learning
Applied planning
2012 Competition
• The top 3 AI agents:
▫ Naive Agent: 526, 590
▫ Birdbrain: 501,200
▫ ABC-IS-course-UNICAL: 492,980
• The top 3 Humans:
▫ Dengji Zhao: 556,510
▫ Human 2: 545,870
▫ Human 3: 503,450
• *Note: This was the score for 10 levels of play
and 1 hour of game play time
Results
• Agent Weaknesses:
▫ Could not succeed with birds that required a “tap”
of the screen to cause a 2nd action
▫ Some agents got stuck and could not solve the
level at all
▫ Different approaches showed different results
(hitting pigs directly vs. hitting objects into pigs)
 The agent was not able to make this decision on its
own
Conclusion:
• Competition is hosted during the International
Joint Conference on Artificial Intelligence
(IJCAI) National Conference on August 6-8,
2013 in Beijing China
• Still not to late to register for 2013’s competition
(Ends June 30th)
• Takes the standard Turing Test and adds a
modern twist
Works Cited:
• http://en.wikipedia.org/wiki/Turing_test
• http://blogs.wsj.com/techeurope/2013/04/05/angry-birds-used-as-a-testof-artificial-intelligence/
• http://aibirds.org/
• http://ijcai13.org/program/angry_birds_ai_co
mpetition