Final Year Project (2001 – 2002)
Voice Interactive Game
(SM4)
Project Supervisor:
Dr. Siu Man Hung
Group Members:
Chow Po Suen
99100439
Lo Wing Chi
99278470
Yu Siu Man
99229405
eg_cpsaa
eg_lwc
eg_ysm
In this project, we intend on implementing a voice interactive game,
“Magic Spell”. In the game, the player needs to say some English phrases
or words when prompted to do so. In order to kill enemies within the
game, players must pronounce the phrases correctly.
To implement the game, we have to obtain the speech of the user from the
microphone, process the signals, develop our own recognizer, and build
the interface for the whole game. In addition, for the two-player mode,
we should be able to establish a connection between two computers and
maintain the communication between them.
The purpose of uses this voice interactive game is to provide a more
interesting way for people to practice oral English. In Hong Kong,
students are not motivated to practice English. We hope that this game
will encourage people to improve their spoken English.
6LJQDO
5HFRJQL]HU
3URFHVVRU
*DPH &RQWUROOHU
Result
Recognition Function
MFCC
file
Read
MFCC
Phrases
Viterbi
The recognizer works with the MFCC file as input. It reads the MFCC
and then runs the Viterbi algorithm to obtain a phrase in our network as
the recognition result.
c
a
t
d
o
g
start
end
p
e
n
f
i
s
h
The recognizer finds the most similar phrase as the output. For example,
in the network above, if we input “car”, the recognizer will output “cat”.
Therefore, a phrase with very general characteristic is added in our
network to use for rejecting totally wrong input.
MFCC
MFCC
MFC
Record the
waveform
Chop out the
silence at the
front and the end
Convert the
waveform to MFCC
At the beginning of each stage, some monsters will
appear. There is a phrase in front of the monster.
When the phrase becomes red, the monster will
attack the player within a second. If the player
pronounces the phrase correctly, the monster dies.
Otherwise, the player is attacked.
In every stage, there is a
mini-game at the end of the
stage. In one of the
mini-games, the player has to
memorize the pattern of the
cards when they are shown.
Then after all the cards are
closed, the boss will show
the player a card. The player
has to find out the card with
the same picture and speak
the word on that card.