International Journal of Research in Computer and Communication technology, IJRCCT, ISSN 2278-5841, Vol 2, Issue 1,
January 2013.
Design and Development of Gesture Controlled MP3 Player Using ARM7 and
Image Processing Technique
Kurma Soujanya
Mr. M. Firdouse Ali Khan
M.Tech(Embedded systems)
Senior Assistant Professor
Aurora’s Technological and Research Institute Aurora’s Technological and Research Institute
Parvathapur,Uppal
Parvathapur,Uppal
Hyderabad,
Hyderabad,
Andhrapradesh,500039
Andhrapradesh,500039
[email protected]
[email protected]
Abstract- The aim of the project we are controlling the
MP3 Player by Gesture. A Gesture image is taken from
Camera and image will be processing in MATLAB and
using the human hand movement the image is recognized
and depending on this left or right or up or down of these
signals send to controller. The MP3 player is interfaced to
the ARM7 controller using some relay drivers which can
drive the MP3 player to play, pause, forward, rewind
sound up and down etc operations.
Keywords-MP3; gestures control; matching
algorithm; ARM7controller
1. INTRODUCTION
The six signals are processing in ARM; those
signals are (play, stop, forward, rewind, volume up and
down). The MP3 player is interfaced to the relay drives
and ARM controller. Relays are acts as a switching
button, like open and closes of electric circuit. Totally
five relays are performed, first input is given to pc the
relay button will be on and the MP3 player will be play
to the first signal. The MP3 player will be play some
audio signals only and the functions are observed on
LCD.
Power supply is needed from +5v to +12v to the
ARM controller using transformer, bridge rectifier, filters
and regulators.
Nowadays, most MP3 players are controlled by
buttons on their bodies. While in this project, we do a
new design, through embedding a three-axis
accelerometer in the MP3 device, which can make MP3
player controlled by certain gestures performed in the air,
instead of traditional way of control mentioned above.
2. WORKING MECHANISM
In this concept the mp3 player controlled using by
gesture. An input image is taken from camera and image
will be processing in mat lab (pc).In mat lab comparing
the two images of both input and database images. After
compare the images the result given to the pc (mat lab).
Rs232 it communicates the signals from mat lab to
ARM7 controller
.
www.ijrcct.org
Fig1: block diagram
[email protected]
Page 32
International Journal of Research in Computer and Communication technology, IJRCCT, ISSN 2278-5841, Vol 2, Issue 1,
January 2013.
3. DESIGN OF GESTURE
CONTROLLER
Fig 2: design of gesture controller
The MP3 (music) player controlled by
using gesture. An input image is taken from
camera and image will be processing in mat lab.
In mat lab compare the both input and database
images, after comparing the images result will be
given to ARM7 controller with the help of RS232
cable. The MP3 player is interfaced to the ARM
controller and relay drives, the relays are acts as a
electric switching button, and a input first image
is recognized with ARM7 controller, the relay
will be automatically on and MP3 player is play.
The MP3 player played some audio signals only,
and the functions are display to the LCD.
3(a) EDGE DETECTION
ALGORITHM:
the camera is available then using the video input
function, we capture a video and a snap of it is taken as
input to our system.
Once we are ready with the input image, we need
this to processes in two steps:
 To eliminate the color deviation for input and
data base image
 To match them based on edge features
For color we calculate the histograms for both the
input and the database images, and these histograms are
interpolated on a 3d space with sum threshold
parameters, and then the interpolated values of these will
be compared in order to get the sorted output from the
database wherein this output is taken as reference in the
next step.
In the next step we go for edge extraction for both
input and database images, and this is done first by
converting the image into grayscale, and then binary zing
it using the gray threshold value being calculated. Now
these edge extracted images will be compared and the
comparison values are noted.
Now in order to get the required form of output to
give it to embedded system we go for conditional loop
where in we check with the comparison value at each
step and then determine the output condition based on
the very least value...
So this completes the flow of working. This process
will be going on for infinite loop until user wants to exit
from it.
Fig3: edge detection algorithm
The input to the system can be given from
camera or from pc, this first checks for the
availability of camera using the try function. If
www.ijrcct.org
[email protected]
3(b) IMAGE PROCESING:
Page 33
International Journal of Research in Computer and Communication technology, IJRCCT, ISSN 2278-5841, Vol 2, Issue
1, January 2013.
A gesture input images are taken from
camera and images will be processing in mat lab.
In mat lab comparing the both input and data base
images and It perform the totally six images, they
are play, stop, forward, rewind, volume up &
down.
Play & stop
forward
rewind
Fig5:ARM7 (LPC2148)
Volume up
volume down
Fig4: gesture input images
4. WORKING PROCESS IN
EMBEDDED SYSTEM:
Embedded system is a combination of
software and hardware components.
The LPC2148 incorporate a 32 kB to 512 kB Flash
memory system, respectively. This memory may be used
for both code and data storage. General purpose I/O
registers are relocated the ARM local bus, and this pins
are applied to the Driving LEDs, or other indicators and
Controlling off-chip devices. UART contains data
transfer between the Receiver and Transmitter.
Hardware Requirements:

ARM7 NSK electronics.
A. ARM7(LPC 2148):

Speed 60MHZ.

ARM7 64 I/O Pins.
ARM (LPC2148) is a 32-bit, and it’s
(Reduced Instruction Set Computer) architecture.
On-chip Static RAM (SRAM) may be used for
code and/or data storage. SRAM may be accessed
as 8-bits, 16-bits, and 32-bits. ARM7 Local Bus
for interface to on-chip memory controllers, the
AMBA Advanced High performance Bus (AHB)
for interface to the interrupt controller, and APB
for connection to the on-chip peripheral
functions.
B. LCD :
Fig6: liquid crystal display
LCD consisting of totally 16 pins. First 8-pins
are data pins (D0-D7), it is used for storing data which is
to be displayed on LCD. Remaining pins are connected
to the registers (En1, En2, R/W, VCC, VSS, RS and
VEE) to the ARM controller.
www.ijrcct.org
[email protected]
Page 34
International Journal of Research in Computer and Communication technology, IJRCCT, ISSN 2278-5841, Vol 2, Issue
1, January 2013.
(a) 16*2 alphanumeric position of LCD.
(b) Power supply is needed from 5v.
C. RELAYS:
Fig9: power supply
To operate this hardware circuit 12V dc. Power
supply is needed in order to get the 12v dc from 220v ac
we connect transformer, bridge rectifier, filter, regulator
to arm controller.
F. RS232 CABLE:
Fig7: relay driver
Relay is an electrical switch that opens
and closes under the control of another electrical
circuit. Input given from 12v, and output 220v.
Fig10:RS232 cable
ON - common + normally opened.
OFF - common + normally closed.
Max232 (voltage level shifter) is used to change the
voltage level of pc TTL (TRANSISTOR TO TRANSISTOR
LOGIC) to CMOS (CIRCUIT METAL OXIDE
SEMICONDUCTOR) of ARM processor.
D. MP3 PLAYER:

SOFTWARE REQUIERMENTS:
Fig8:mp3 player
It is interfaced to the relay drivers and
ARM controller. Performed the six input signals
are like stop or play, forward, rewind, volume up
and down to the mp3 player. The total
performance display on the LCD.
E. POWER SUPPLY:
www.ijrcct.org
Serial communication with equalization speed of
9600 baud rate is used.
[email protected]
A. MAT LAB:
Mat lab is a soft ware which is installed in
computer. in that software we built programming with all
instructions with the base of programming only the total
kit will be work. In Mat lab we are using image
processing toolbar for detecting the gesture image using
edge detection algorithm.
Page 35
International Journal of Research in Computer and Communication technology, IJRCCT, ISSN 2278-5841, Vol 2, Issue
1, January 2013.
Fig11: MAT LAB screen shot
Pc requirements:
Mat lab 7.5 version will be performed.
Hard disk 5 GB free space
RAM 2GB
Processor 32bit
Fig13: screen shot of flash magic
B. KEIL SOFTWARE:
It is used for code compiling return and
for creating hex file for ARM processor. Run the
programming used to keil software
Fig12: screen shot of keil
Fig- flow chart or guesture control.
5. CONCLUSION:
C. FLASH MAGIC:
It is used for burning the hex file into the
controller.
www.ijrcct.org
[email protected]
In mat lab the signals taken from the PC (image
processing) and using edge detection algorithm will
be processed by the controller with the help of serial
communication (RS232 cable).
Page 36
International Journal of Research in Computer and Communication technology, IJRCCT, ISSN 2278-5841, Vol 2, Issue
1, January 2013.
In embedded kit using some relay
drives control the mp3 player to play or stop,
forward and backward volume up and down
functions are controlled by gesture
6. REFERENCE:
[1] R.C. Gonzalez, R.E. Woods, Digital Image Processing,
Addison Wesley Publishing Company, Inc New York, 1992.
[2] P. Qiu, Image Processing and Jump Regression
Analysis, Wiley, New York, 2005.
[3] J. Besag, Spatial interaction and the statistical analysis of
lattice systems (with discussions), Journal of the Royal
Statistical Society (Series B) 36 (1974) 192-236.
[4] J. Be sag, on the statistical analysis of dirty pictures
(with discussion), Journal of the Royal Statistical Society
(Series B) 48 (1986) 259–302.
[5] J.A. Fessler, H. Erdogan, W.B. Wu, Exact distribution of
edge- preserving MAP estimators for linear signal models
with Gaussian measurement noise, IEEE Transactions on
Image Processing 9 (2000) 1049–1055.
[6] Wen Zheng
He Jia-yang
Zhao Zhi=peng. AVR
Singlechip Developing from Primary to Master [M].Peking
electricity Publishing company, 2009(Chinese).
[7] Lin Rui, Han Yong-quan .Hi-Q Programming Guide—
C++/C Language[M].Peking china electronic industry
Publishing company 2007(Chinese).
[8] Liu Lan-xiang Zhang Qiu-sheng. ATmega128
Singlechip
Applying
and
Developing
Examples
[M].Peking mechanical industry Publishing
company, 2006 (Chinese).
www.ijrcct.org
[email protected]
Page 37