Lab Book
Beti Lula John
Speech Recognition Robot
Problem and Mission
Civilization’s Great Steps Forward:
1) Fire
2) The Wheel
3) The Printing Press
4) The Steam Engine
5) The Transistor
6) Google
7) ???
www.build-it-yourself.com
Speech Recognition Robot
Problem and Mission
Robots Will Rule!!!
However to make this next
great leap forward, we need to
make the interface between
humans and machines more
natural.
www.build-it-yourself.com
Speech Recognition Robot
Project Plan
Goal:
Design, build and present a speech
recognition robot that is worthy of media
attention.
1) It must work.
2) It must be engaging.
Deliverables:
1) Power Point Lab book
2) Working robot
3) Presentation
www.build-it-yourself.com
Speech Recognition Robot
Project Plan
Tasks:
1) Research
2) Identify problem
3) Specify solution functionality
4) Build
5) Test and modify
6) Manage and document
7) Market and present
www.build-it-yourself.com
Speech Recognition Robot
Teamwork
Assign specific tasks to focused specialists:
Marketing
-Market Demand
- Competition
- Sales Pitch
- Project Mgm’t
- Present
Engineering
- Technologies
- Inputs / Outputs
- Specifications
- Build
- Test & Refine
www.build-it-yourself.com
Programming
- Technologies
- Inputs / Outputs
- Specifications
- Program
- Test & Refine
Speech Recognition Robot
Performance
Name 1
Attendance
Professionalism
Teamwork
Initiative
Results
Total
5
5
4
3
5
22
Name 2
Name 3
3
3
1
1
3
11
2
2
1
1
2
8
Attendance - Are you present?
Professionalism - Are you respectful of your lab and your teammates?
Teamwork - Did you help your teammates or participate in discussions?
Initiative - Did you do something more than was expected?
Results - Did you get a result?
Yes = 1
No = 0
www.build-it-yourself.com
Speech Recognition Robot
Project Management – 4 Phases
1) Discovery
Research applications
Research technology
2) Design
Specify a talking robot
3) Development
Build a talking robot
4) Deployment
Document project
Present project
www.build-it-yourself.com
Speech Recognition Robot
Speech Recognition Applications
Document useful applications
of speech recognition robots.
1) Aviation
2) Healthcare
3) Administration
4) Personal computers
5) Production
6) ???
www.build-it-yourself.com
Speech Recognition Robot
Robots … What are they good for?
Document what robots do better than humans.
Document what humans do better than robots.
www.build-it-yourself.com
Speech Recognition Robot
Problem and Mission
Document a problem that could be solved by a speech
recognition robot.
Document the mission. (What must our speech recognition
robot do to solve the problem?)
www.build-it-yourself.com
Speech Recognition Robot
Problem Solving Techniques
1)
2)
3)
4)
5)
Identify the problem and focus.
Build on the ideas of others.
Break the solution into simple parts.
Work with teammates.
Document.
www.build-it-yourself.com
Speech Recognition Robot
Measures of Success
1) Does it work 9 times out of 10?
2) Is it unique?
3) Will it attract media attention?
www.build-it-yourself.com
Speech Recognition Robot
Program Primitives
1)
2)
3)
4)
5)
Series vs. Parallel
Iteration
Conditional
Variables
Messaging
www.build-it-yourself.com
Speech Recognition Robot
Strategies for recognizing speech
What are 3 attributes of speech that can be detected
and interpreted?
www.build-it-yourself.com
Speech Recognition Robot
Program Flow Chart to Detect Syllables
start
Start
Wait for
syllable
Wait
Display
1 syllable
No
2nd syllable
detected
?
Yes
www.build-it-yourself.com
Display
2 syllables
Speech Recognition Robot
Program Flow Chart to Detect Syllables
Wait for
syllable
start
Start
No
Volume
high
?
Yes
No
Volume
low
?
Yes
End
www.build-it-yourself.com
Speech Recognition Robot
Tasks
Marketing:
1) Develop an elevator pitch for your robot. Research what an elevator pitch is.
2) Design a one page advertisement for your robot.
3) Design signs that explain how your robot works.
4) Build expressive eyes, mouth, arms, and body.
5) Write and record the script you want your robot to lead
(man - machine interaction)
Engineering:
1) Build the structure.
2) Build a gear train that drives two shafts.
3) Build a mechanism that makes eyes, mouth and arms move.
Programming:
1) Write a program to execute the script or man - machine interaction.
Document everything in your lab books.
www.build-it-yourself.com
Speech Recognition Robot
Robot / Human Script
When visitor is detected, say:
Greetings! My name is ...
Welcome to Colegio Las Hayas.
While you are waiting, would you like to ...
Please answer, "Si" or "Huh, Huh" to my question.
If "Si" then say:
If "Huh, Huh" then say:
www.build-it-yourself.com
Speech Recognition Robot
Structure and components
Engineering:
This structure is
good for mounting
motion modules
and sensors at
different levels.
The vertical shaft
could make arms
move left and
right.
www.build-it-yourself.com
Robot Structure:
Click on ‘Build-It-Blocks’
Select ‘Presenting Ideas’
Select ‘LEGO Tall Structure
Gear Train:
Click on ‘Build-It-Blocks’
Select ‘Spin, Rotate, Twirl’
Select ‘Power Top Gear Train Mini”
www.build-it-yourself.com
Speech Recognition Robot
Structure and components
Engineering:
The ‘Open ‘n Close’
module can drive
many parts to move.
www.build-it-yourself.com
Robot Structure:
Click on ‘Build-It-Blocks’
Select ‘Shake, Dance, Flap’
Select ‘Open ‘n Close’
www.build-it-yourself.com
Speech Recognition Robot
Structure and components
Engineering:
The arms and the
mouth move.
www.build-it-yourself.com
Speech Recognition Robot
Robots Made from Premium Quality Junk
www.build-it-yourself.com
Speech Recognition Robot
Speech
Recognition
Program
www.build-it-yourself.com
Speech Recognition Robot
Speech
Recognition
Program
www.build-it-yourself.com
Speech Recognition Robot
Speech
Recognition
Program
www.build-it-yourself.com
Speech Recognition Robot
Speech
Recognition
Program
Programming team:
www.build-it-yourself.com
Speech Recognition Robot
Robot Promo
Marketing team:
What can you say and show that will make
customers want to buy your robot?
1) Write and perform a song that your robot will sing.
2) Write and design an advertisement.
3) Design a Web page or a Facebook page for your robot.
www.build-it-yourself.com
Speech Recognition Robot
References
Example of project web site
http://www.build-it-yourself.com/support/support-workshops/wkshp-archive/wkshp-glts-2002/index.
Introduction to talking robots at Tokyo University
http://www.youtube.com/watch?v=Li4w9DPPNYI&NR=1&feature=fvwp
Demo of MIT Kismet language vs expression
http://www.youtube.com/watch?v=dKZczUDGp_I
Demo of how engaging a talking robot can be.
http://www.youtube.com/watch?v=HuqL74C6KI8&feature=related
www.build-it-yourself.com
Speech Recognition Robot
Project Summary
What you should know:
• The problem and mission
• 3 deliverables
• 3 measures of success
• 4 project management phases
• 3 reasons for modular construction
• 5 problem solving techniques
• 5 program primitives
• Effective use of Power Point, Google, Excel and
collaboration tools
Reference Slides Follow
www.build-it-yourself.com
Speech Recognition Robot
Presentation Outline
Project Presentation
1) Introduce team members and explain the parts of the project that were most
interesting to you.
2) State the problem and mission (PPT Lab Book)
3) Describe the 4 phases of project planning and who did what. (PPT Lab Book)
- Discovery
- Design
- Development
- Deployment
4) Present your research (PPT Lab Book)
5) Present your robot.
6) Grade your work on 5 measures of performance.
Questions
1) Why is modular construction valuable?
2) Why is teamwork important?
3) What do humans do well and what to robots do well?
4) What are 5 computer programming structures?
5) Describe how your program works?
www.build-it-yourself.com
Speech Recognition Robot
Teamwork
The importance of teamwork in solving complex problems.
How many people are on the World of Warcraft team?
How many people to develop an animated feature film?
www.build-it-yourself.com
Speech Recognition Robot
Teamwork
The importance of teamwork in solving complex problems.
How many people are on the World of Warcraft team?
60 developers / 400 employees when launched in 2001. 5000
employees in 2009.
How many people to develop an animated feature film?
75 artists using hand made frames. 27 animators made Toy
Story using computer tools.
www.build-it-yourself.com
Speech Recognition Robot
Teamwork
The importance of teamwork in solving complex problems.
How many people worked for NASA when we landed on the
moon?
www.build-it-yourself.com
Speech Recognition Robot
Teamwork
The importance of teamwork in solving complex problems.
How many people worked for NASA when we landed on the
moon?
36,000 NASA employees when man landed on the moon
www.build-it-yourself.com
Lab Book
Beti Lula John
Can’t read from a distance. Image does not relate to content
Speech Recognition Robot
Lab Book
Beti
Lula
John
Average, boring, not engaging
Lab Book
Beti Lula John
Direct, engaging