,QWHUQDWLRQDO-RXUQDORI,QQRYDWLRQVLQ(QJLQHHULQJDQG7HFKQRORJ\,-,(7
6HQWLPHQW$QDO\VLVRI7ZLWWHU'DWDFRQWDLQLQJ
(PRWLFRQV$6XUYH\
-D\DQWKL7
Assistant Professor, Department of Computer Applications
Mohandas College of Engineering and Technology, Trivandrum, Kerala
6UHHMD.
Assistant Professor, Department of Computer Applications
Mohandas College of Engineering and Technology, Trivandrum, Kerala
$EVWUDFW6HQWLPHQW$QDO\VLV6$DOVRFDOOHGRSLQLRQPLQLQJDVWKHQDPHVXJJHVWVLVWKHILHOGRIVWXG\ZKLFKDQDO\]HV
SHRSOH¶V RSLQLRQV VHQWLPHQWV HYDOXDWLRQV DSSUDLVDOV DWWULEXWHV DQG HPRWLRQV WRZDUGV HOHPHQWV VXFK DV SURGXFWV
VHUYLFHVRUJDQL]DWLRQVLQGLYLGXDOVLVVXHVHYHQWVWRSLFVDQGWKHLUDWWULEXWHVWKURXJKWZLWWHU0LFUREORJJLQJWZLWWHULV
XVHGE\SHRSOHWRWDONDERXWWKHLUGDLO\FKRUHVDQGWRVKDUHLQIRUPDWLRQLWLVDQRQOLQHVRFLDOQHWZRUNLQJ0LFUREORJJLQJ
VHUYLFHHQDEOHVXVHUVWRVHQGDQGUHDGWZHHWVZKLFKDUHWH[WPHVVDJHVOLPLWHGWRFKDUDFWHUV,QWKLVVXUYH\SDSHU
ZHSURSRVHDPRGHOWKDWFDQLGHQWLI\WKHSXEOLFRSLQLRQZLWKWKHLUHPRWLRQV7KHPDLQWDUJHWRIWKLVVXUYH\LVWRJLYH6$
WHFKQLTXHVXVHGIRUHPRWLFRQVDQGWKHUHODWHGILHOGVZLWKEULHIGHWDLOV7KHPDLQFRQWULEXWLRQVRIWKLVSDSHULQFOXGHWKH
LOOXVWUDWLRQRIWKHUHFHQWWUHQGRIUHVHDUFKLQWKHVHQWLPHQWDQDO\VLVDQGLWVUHODWHGDUHDV
.H\ZRUGV6HQWLPHQW$QDO\VLV0LFUREORJJLQJ(PRWLFRQ/H[LFRQEDVHGFODVVLILHU1DwYHEDVHGFODVVLILHU6XSSRUW9HFWRU
0DFKLQH
,,1752'8&7,21
6HQWLPHQW DQDO\VLV RU RSLQLRQ PLQLQJ UHIHUV WR WKH W\SH RI QDWXUDO ODQJXDJH SURFHVVLQJ XVHG WR XQGHUVWDQG WKH
PRRGVRSLQLRQVDQGVHQWLPHQWVRIWKHSXEOLFUHJDUGLQJDSDUWLFXODUSURGXFWRUDPRYLHRUDQHYHQW7KHDYDLODELOLW\
RIODUJHDPRXQWVRIGDWDDQGWKHKXPDQWHQGHQF\WRDOZD\VIDFWRUZKDWRWKHUSHRSOHWKLQNKDVEHHQLQIOXHQWLDOLQD
GHFLVLRQPDNLQJSURFHVV7KLVXQLTXHIHDWXUHSOD\VDYLWDOUROHLQGHFLGLQJRQPDWWHUVWKDWKDYHILQDQFLDOPHGLFDO
VRFLDORURWKHULPSOLFDWLRQV6HHNLQJVHFRQGRUWKLUGRUPDQ\PRUHRSLQLRQVKDYHIXHOOHGWKHLQWHUHVWRIUHVHDUFKHUV
LQWKHILHOGRIVHQWLPHQWPLQLQJ:LWKPXOWLSOHUHYLHZVDYDLODEOHIRUDVLQJOHSURGXFWDQGWKHHQRUPRXVJURZWKLQ
WKH QXPEHU RI LQWHUQHW XVHUV LW KDV EHFRPH LQGLVSHQVDEOH WR GHYHORS D V\VWHP WKDW FROOHFWV EXLOGV DQDO\]HV DQG
FODVVLILHVWKHFRPPHQWVRUDUHYLHZSRVWHGRQOLQH7KHUHDUHLQVWDQFHVZKHUHSHRSOHDUHELDVHGLQWKHLURSLQLRQVDQG
DXWRPDWLFDOO\WKDWKDVDQLPSDFWRQWKHFRQWHQWWKH\FRQWULEXWHWRWKHIRUXPDVUHYLHZRUEORJSRVWVRUWZHHWV$VWKH
QXPEHURIVXFKSHRSOHFRQWULEXWLQJFRQWHQWVXUJHVLWKDVEHFRPHDKXJHFKDOOHQJHWRFODVVLI\DQGRUJDQL]HWKHUHDO
SUREOHPVDQGSURVSHFWVRIWKHSURGXFWZKLFKPDNHVWKHXVHUWRGRXEWWKHUHOLDELOLW\RIWKHFRQWHQW
0LFUREORJJLQJLVDZHEVHUYLFHWKDWDOORZVWKHVXEVFULEHUWREURDGFDVWVKRUWPHVVDJHVWRRWKHUVXEVFULEHUVRIWKH
VHUYLFH7KHVWULFWFKDUDFWHUOLPLWLPSRVHGE\7ZLWWHULVDFXUVH:HDUHIRUFHGWRDEEUHYLDWHZRUGVFRQFHSWV
DQG VHQWHQFHV 3UROLILF XVH LV PDGH RI DFURQ\PV FUHDWLYH FRQWUDFWLRQV DQG WKH VW\OLVWLF XVH RI SXQFWXDWLRQ LV
FRPPRQ3URPLQHQWLQ7ZHHWVLVWKHFRSLRXVXVHRIHPRWLFRQV
(PRWLFRQVDUH$6&,,DUW7KH\DUHVRPHWLPHVFDOOHG³6PLOH\V´7KH\DUHIRUPHGWKURXJKWKHFUHDWLYHXVHRIOHWWHUV
QXPEHUVDQGSXQFWXDWLRQV\PEROV0RVWRIWHQWKRXJKQRWDOZD\VWKH\DWWHPSWWRUHSUHVHQWIDFLDOIHDWXUHV$VWKHLU
QDPH LPSOLHV HPRWLFRQV DUH JO\SKV GHVLJQHG WR DGG HPRWLRQDO IODYRU WR SODLQ WH[W PHVVDJHV -XVW DV VLPSOH
SXQFWXDWLRQFDQFRQYH\VXUSULVHRUSRVHDTXHVWLRQ"HPRWLFRQVFDQFRQYH\KDSSLQHVVDQGMR\VDGQHVV
ODXJKWHU'RUFKHHNLQHVV
9ROXPH,VVXH$SULO
,661±
,QWHUQDWLRQDO-RXUQDORI,QQRYDWLRQVLQ(QJLQHHULQJDQG7HFKQRORJ\,-,(7
7KHUH DUH PDQ\ HPRWLFRQV SUHVHQW LQ WZHHWV 7KHVH HPRWLFRQV FDQ EH DQDO\]HG WR IRUP WKH VHQWLPHQW RI D JLYHQ
WZHHW $ JLYHQ HPRWLFRQV FDQ EH FODVVLILHG LQ D WKUHH ZD\ DV SRVLWLYH QHJDWLYH DQG QHXWUDO 7KLV DORQJ ZLWK WKH
ZRUGVZLOOGHWHUPLQHWKHRYHUDOOVHQWLPHQWVRIDVHQWHQFHWZHHW
6HQWLPHQW$QDO\VLVLGHQWLILHVWKHVHQWLPHQWH[SUHVVHGLQDWH[WWKHQDQDO\]HVLW7KHWDUJHWRI6$LVWRILQGRSLQLRQV
LGHQWLI\WKHVHQWLPHQWVWKH\H[SUHVVDQGWKHQFODVVLI\WKHLUSRODULW\DVVKRZQLQ)LJXUH>@
)LJXUH6HQWLPHQWDO$QDO\VLV3URFHVV
,,'$7$'(6&5,37,21
6LQFH WKH RSLQLRQV FRQWULEXWHG E\ SHRSOH DQG FRPSDQLHV DUH WR EH HYDOXDWHG ZH FRQVLGHU WKH GDWD IURP EORJV
UHYLHZVLWHVZHEGLVFRXUVHDQGQHZVDUWLFOHV
Review: 7KHUHDUHPDQ\XVHUJHQHUDWHGUHYLHZVDYDLODEOHRQWKHLQWHUQHWWKDWDLGVDFXVWRPHULQEX\LQJDSURGXFW(
FRPPHUFH VLWHV VXFK DV ZZZDPD]RQLQ ZZZIOLSNDUWFRP DQG ZZZUHYLHZFHQWUH KDV PLOOLRQV RI FXVWRPHU
UHYLHZV IRU SURGXFWV ZKHUHDV ZZZUHGLIIFRPPRYLHVUHYLHZV ZZZLQGLDJOLW] FRP DQG
ZZZURWWHQWRPDWRHVFRPKDVUHYLHZVIRUPRYLHVDQGZZZ\HOSFRPZZZEXUUSFRPKDVUHVWDXUDQWUHYLHZV>@
Web Discourse:$EORJLVDSHUVRQDOZHEVLWHRUZHESDJHRQZKLFKDQLQGLYLGXDOUHFRUGVRSLQLRQVOLQNVWRRWKHU
VLWHV HWF RQ D UHJXODU EDVLV 7KH\ DUH WKH IDVWHVW JURZLQJ VHFWLRQV RI WKH HPHUJLQJ FRPPXQLFDWLRQ V\VWHPV 7KH
VLPSOH DQG QRQRQVHQVH VW\OH RI ZULWLQJ D SRVW DQG XSORDGLQJ LW RQ WKH ZHE KDV PDGH WKH EORJJLQJ ZRUOG DQ
LQGLVSHQVDEOHVRXUFHRIGDWDLQWKHFDVHRIVHQWLPHQW PLQLQJ>@7KHPLFUREORJJLQJVLWH7ZLWWHULVDOVRIORRGHG
ZLWK RSLQLRQV WKDW DUH GHFLVLYH LQ GHWHUPLQLQJ WKH HOHFWLRQ UHVXOWV HYHQ >@7KHVH RSLQLRQV FDQ DOVR EH XVHG IRU
FODVVLI\LQJ VHQWLPHQWV >@ 3HRSOH UHFRUG WKH GDLO\ HYHQWV LQ WKHLU OLYHV DQG H[SUHVV WKHLU RSLQLRQV IHHOLQJV DQG
HPRWLRQVLQDQRQOLQHMRXUQDORUEORJRURQ7ZLWWHU>@
News Articles: 7KHZHEVLWHVOLNHZZZWKHVXQFRXNZZZFQQFRPDQGZZZWKHKLQGXFRPKDVQHZVDUWLFOHVWKDW
DOORZXVHUVRUUHDGHUVWRFRPPHQW7KLVKHOSVLQUHFRUGLQJWKHRSLQLRQVRIWKHSHRSOHLQLVVXHVWKDWDUHRIFXUUHQW
UHOHYDQFHDQGLPSRUWDQFH
2XWRIWKH7ZHHWVWKDWFRQWDLQHGHPRWLFRQVWKHWRSVPLOH\VDFFRXQWHGIRURIDOORFFXUUHQFHV
7KH\DUHOLVWHGEHORZ
9ROXPH,VVXH$SULO
,661±
,QWHUQDWLRQDO-RXUQDORI,QQRYDWLRQVLQ(QJLQHHULQJDQG7HFKQRORJ\,-,(7
7DEOH7KHWRSHPRWLFRQVLQWZLWWHU>@
61R (PRWLFR
Q
8VDJH
3HUFHQW
0HDQLQJ
Happy face
'
Laugh
Sad face
Wink
Happy face
(with nose)
3
Tongue out
Happy face
Happy face
(mirror)
Wink (with
nose)
Uneasy,
undecided,
skeptical,
annoyed?
;'
Big grin
'
Laugh
R
Shock,
Yawn
@
Happy face
'
Grin
(mirror)
'
Wink and
grin
@
Happy face
Unhappy
Uneasy,
undecided,
skeptical,
annoyed?
Unhappy
,,,&/$66,),&$7,210(7+2'6
9ROXPH,VVXH$SULO
,661±
,QWHUQDWLRQDO-RXUQDORI,QQRYDWLRQVLQ(QJLQHHULQJDQG7HFKQRORJ\,-,(7
,Q WKLV VHFWLRQ ZH UHYLHZ IXQGDPHQWDO DVSHFWV RI WKUHH FODVVLILFDWLRQ PHWKRGV 7KH\ DUH OH[LFRQ EDVHG PHWKRG
ZKLFKFRPHVXQGHUXQVXSHUYLVHGOHDUQLQJ1DwYH%D\HVPHWKRGDQG6XSSRUW9HFWRU0DFKLQHVZKLFKFRPHXQGHU
VXSHUYLVHGOHDUQLQJPHWKRGV
$VXSHUYLVHGOHDUQLQJDOJRULWKPDQDO\]HVWKHWUDLQLQJGDWDDQGSURGXFHVDQLQIHUUHGIXQFWLRQZKLFKFDQEHXVHGIRU
PDSSLQJ QHZ H[DPSOHV ,W LV GRPDLQ VSHFLILF ZKHUHDV XQVXSHUYLVHG OHDUQLQJLV WKHPDFKLQH OHDUQLQJWDVN RI
LQIHUULQJDIXQFWLRQWRGHVFULEHKLGGHQVWUXFWXUHIURPXQODEHOHGGDWD
A. LEXICON-BASED CLASSIFICATION
7KHOH[LFRQEDVHGDSSURDFKLVEDVHGRQWKHDVVXPSWLRQWKDWWKHFRQWH[WXDOVHQWLPHQWRULHQWDWLRQLVWKHVXPRIWKH
VHQWLPHQWRULHQWDWLRQRIHDFKZRUGRUSKUDVH
7KHFODVVLILHULVEDVHGRQHVWLPDWLQJWKHLQWHQVLW\RIQHJDWLYHDQGSRVLWLYHHPRWLRQLQWH[WWKDWLVWKHRXWSXWRIWKH
FODVVLILHULVRQHRI^í`
6HQWLPHQW$QDO\VLVRQ7ZLWWHUGDWDLVQRWFRQ¿QHGWRUDZWH[W$QDO\]LQJ(PRWLFRQVKDYHEHHQDQLQWHUHVWLQJVWXG\
*RHWDOXVHGHPRWLFRQVWRFODVVLI\WKHWZHHWVDVSRVLWLYHRUQHJDWLYHDQGWUDLQVWDQGDUGFODVVL¿HUVVXFKDV
1DLYH%D\HVDQG6XSSRUW9HFWRU0DFKLQHV+DVKWDJPD\KDYHVRPHVHQWLPHQWLQLW'DYLGRYHWDO>@XVHG
KDVKWDJV DQG HPRWLFRQV DV VHQWLPHQW ODEHOV IRU FODVVL¿FDWLRQ WR DOORZ GLYHUVH VHQWLPHQW W\SHV IRU WKH WZHHW
1HJDWLRQ DQG LQWHQVL¿HU SOD\ DQ LPSRUWDQW UROH LQ 6HQWLPHQW $QDO\VLV 1HJDWLRQ ZRUG FDQ UHYHUVH WKH SRODULW\
ZKHUHDVLQWHQVL¿HULQFUHDVHVVHQWLPHQWVWUHQJWK7DERDGDHWDO>@VWXGLHGUROHRIWKHLQWHQVL¿HUDQGQHJDWLRQLQ
WKHOH[LFRQEDVHG6HQWLPHQW$QDO\VLV:LHJDQGHWDO>@VXUYH\WKHUROHRIQHJDWLRQLQ6HQWLPHQW$QDO\VLV
Preprocessing
7KHREMHFWLYHRIWKHSUHSURFHVVLQJVWHSLVWRQRUPDOL]HWKHWH[WLQWRDQDSSURSULDWHIRUPWRH[WUDFWWKHVHQWLPHQWV
7KHSUHSURFHVVLQJVWHSVXVHGDUH
POS Tagging: 326 7DJJHU JLYHV SDUW RI VSHHFK WDJ DVVRFLDWHG ZLWK ZRUGV 326 WDJJLQJ LV GRQH XVLQJ 1DWXUDO
/DQJXDJH7RRO.LW1/7.
Stemming: 6WHPPHU JLYHV WKH VWHP ZRUG 1RQ VWHP ZRUGV DUH VWHPPHG DQG UHSODFHG ZLWK VWHP ZRUGV )RU
H[DPSOHZRUGVOLNH¶ORYHG¶¶ORYHV¶¶ORYLQJ¶¶ORYH¶DUHUHSODFHGZLWK¶ORY¶7KLVZRXOGDLGWKHHQJLQHWRGRWKH
ZRUGPDWFKIURPWKHWH[WWRWKHOH[LFRQ6WHPPLQJLVGRQHXVLQJ1DWXUDO/DQJXDJH7RRO.LW1/7.
Exaggerated word shortening: :RUGVZKLFKKDYHVDPHOHWWHUPRUHWKDQWZRWLPHVDQGQRWSUHVHQWLQWKHOH[LFRQDUH
UHGXFHGWRWKHZRUGZLWKWKHUHSHDWLQJOHWWHURFFXUULQJMXVWRQFH)RUH[DPSOHWKHH[DJJHUDWHGZRUG1222222
LVUHGXFHGWR12
Emoticon detection: (PRWLFRQ KDV VRPH VHQWLPHQW DVVRFLDWHG ZLWK LW 7ZLWWHU 1/3 LV XVHG WR H[WUDFW HPRWLFRQV
DORQJZLWKWKHVHQWLPHQWVLQWKH7ZLWWHUGDWD>@
Hashtag detection: 7KHKDVKWDJLVDWRSLFRUDNH\ZRUGWKDWLVPDUNHGZLWKDWZHHW+DVKWDJLVDSKUDVHVWDUWLQJZLWK
ZLWKQRVSDFHEHWZHHQWKHP+DVKWDJVDUHLGHQWLILHGDQGVHQWLPHQWVDUHH[WUDFWHGIURPWKHP
Stop Words: $OOWKHVWRSZRUGVOLNHDDQWKHLVHWFDQGGLVFRXUVHFRQQHFWLYHVDUHGLVFDUGHG
7KHZRUNIORZPRGHOLVVKRZQLQ)LJXUH
9ROXPH,VVXH$SULO
,661±
,QWHUQDWLRQDO-RXUQDORI,QQRYDWLRQVLQ(QJLQHHULQJDQG7HFKQRORJ\,-,(7
Tweets
Segmentation
Emoticon
Detection
Emoticon
Database
PreͲprocessing
FeatureSelection
Emoticonbased
Sentiment
Textbased
Sentiment
Sentiment
AnalysisScore
)LJXUH:RUNIORZRIPRGHO
EMOTICONS AND SENTIMENT [4]
,QRUGHUWRH[SORLWHPRWLFRQVLQDXWRPDWHGVHQWLPHQWDQDO\VLVZHILUVWQHHGWRDQDO\]HKRZHPRWLFRQVDUHW\SLFDOO\
UHODWHGWRWKHVHQWLPHQWRIWKHWH[WWKH\RFFXULQ,QVLJKWVLQWRZKDWSDUWVRIDWH[WDUHDIIHFWHGE\HPRWLFRQVLQZKLFK
ZD\DUHFUXFLDOIRUDGYDQFLQJWKHVWDWHRIWKHDUWRIVHQWLPHQWDQDO\VLVE\KDUYHVWLQJLQIRUPDWLRQIURPHPRWLFRQV
Emoticons as Cues for Sentiment
(PRWLFRQVFDQJHQHUDOO\EHXVHGLQWKUHHZD\V)LUVWHPRWLFRQVFDQEHXVHGWRH[SUHVVVHQWLPHQWZKHQVHQWLPHQWLV
QRWFRQYH\HGE\DQ\FOHDUSRVLWLYHRUQHJDWLYHZRUGVLQDWH[WVHJPHQWWKXVUHQGHULQJWKHHPRWLFRQVWREHFDUU\LQJ
WKH RQO\ VHQWLPHQW LQ WKH VHQWHQFH LQ VXFK FDVHV 6HFRQG HPRWLFRQV FDQ VWUHVV VHQWLPHQW E\ LQWHQVLI\LQJ WKH
VHQWLPHQWDOUHDG\FRQYH\HGE\VHQWLPHQWFDUU\LQJZRUGV7KLUGHPRWLFRQVFDQEHXVHGWRGLVDPELJXDWHVHQWLPHQW
IRU LQVWDQFH LQ FDVHV ZKHUH WKH VHQWLPHQW DVVRFLDWHG ZLWK VHQWLPHQWFDUU\LQJ ZRUGV QHHGV WR EH QHJDWHG 6RPH
H[DPSOHVFDQEHIRXQGLQ7DEOH7DEOHFOHDUO\VKRZVWKDWWKHVHQWLPHQWDVVRFLDWHGZLWKDVHQWHQFHFDQGLIIHU
ZKHQXVLQJGLIIHUHQWHPRWLFRQVLHWKHKDSS\HPRWLFRQ³'´DQGWKH³B³HPRWLFRQLQGLFDWLQJH[WUHPHERUHGRP
RUGLVDJUHHPHQWLUUHVSHFWLYHRIWKHSRVLWLRQRIWKHHPRWLFRQV7KHVHQWLPHQWFDUULHGE\DQHPRWLFRQLVLQGHSHQGHQW
IURPLWVHPEHGGLQJWH[WUHQGHULQJZRUGVHQVHGLVDPELJXDWLRQWHFKQLTXHV>@QRWXVHIXOIRUHPRWLFRQV$VVXFK
WKHVHQWLPHQWRIHPRWLFRQVDSSHDUVWREHGRPLQDWLQJWKHVHQWLPHQWFDUULHGE\YHUEDOFXHVLQVHQWHQFHVLIDQ\
7DEOH7\SLFDOH[DPSOHVRIKRZHPRWLFRQVFDQEHXVHGWRFRQYH\VHQWLPHQWV
9ROXPH,VVXH$SULO
6HQWHQFH +RZ
6HQWLPHQW
,ORYHP\MRE'
7KHVRQJZDVEDG'
',JRWDSURPRWLRQ
B,ORYHP\MRE
7KHVRQJZDVEDGB
,JRWDSURPRWLRQB
3RVLWLYH
3RVLWLYH
3RVLWLYH
1HJDWLYH
1HJDWLYH
1HJDWLYH
,QWHQVLILFDWLRQ
1HJDWLRQ
2QO\VHQWLPHQW
1HJDWLRQ
,QWHQVLILFDWLRQ
2QO\VHQWLPHQW
,661±
,QWHUQDWLRQDO-RXUQDORI,QQRYDWLRQVLQ(QJLQHHULQJDQG7HFKQRORJ\,-,(7
3UDEX3DODQLVDP\HWDO>@SUHVHQWHGDOH[LFRQEDVHGPHWKRGIRU6HQWLPHQW$QDO\VLVZLWKUHDOWLPH7ZLWWHUGDWD
7KH\KDYHSURYLGHGSUDFWLFDODSSURDFKHVWRLGHQWLI\LQJDQGH[WUDFWLQJVHQWLPHQWVIURPHPRWLFRQVDQGKDVKWDJV,Q
WKHLUPHWKRGWKHQRQJUDPPDWLFDOZRUGVFRQYHUWHGWRJUDPPDWLFDOZRUGVDQGQRUPDOL]HQRQURRWWRURRWZRUGVWR
H[WUDFW VHQWLPHQWV7KH\ KDYH FRQGXFWHG H[SHULPHQWV XVLQJ VXEMHFWLYH H[SUHVVLRQV DUH PDUNHG IURP WKH
WZHHWV7KH\JRWDQ)VFRUHRIRQWKHWHVWGDWDVHW
B. NAIVE BAYES CLASSIFICATION
1DLYH %D\HV LV D SUREDELOLVWLF OHDUQLQJ PHWKRG WKDW DVVXPHV WHUPV RFFXU LQGHSHQGHQWO\ ,Q RUGHU WR LQFRUSRUDWH
XQODEHOHGGDWDWKHIRXQGDWLRQ1DwYH%D\HVZDVEXLOG7KHWDVNRIOHDUQLQJRIDJHQHUDWLYHPRGHOLVWRHVWLPDWHWKH
SDUDPHWHUV XVLQJ ODEHOHG WUDLQLQJ GDWD RQO\ 7KH HVWLPDWHG SDUDPHWHUV DUH XVHG E\ WKH DOJRULWKP WR FODVVLI\ QHZ
GRFXPHQWV E\ FDOFXODWLQJ ZKLFK FODVV WKH JHQHUDWHG WKH JLYHQ GRFXPHQW EHORQJV WR >@ 7KH QDLYH %D\HVLDQ
FODVVLILHUZRUNVDVIROORZV&RQVLGHUDWUDLQLQJVHWRIVDPSOHVHDFKZLWKWKHFODVVODEHOV77KHUHDUHNFODVVHV
&&&N(YHU\VDPSOHFRQVLVWVRIDQQGLPHQVLRQDOYHFWRU; ^[[[Q`UHSUHVHQWLQJQPHDVXUHG
YDOXHVRIWKHQDWWULEXWHV$$$QUHVSHFWLYHO\7KHFODVVLILHUZLOOFODVVLI\WKHJLYHQVDPSOH;VXFKWKDWLW
EHORQJVWRWKHFODVVKDYLQJWKHKLJKHVWSRVWHULRUSUREDELOLW\7KDWLV;LVSUHGLFWHGWREHORQJWRWKHFODVV&LLIDQG
RQO\3&L_;!3&M_;IRU”M”PML7KXVZHILQGWKHFODVVWKDWPD[LPL]HV3&L_;7KHPD[LPL]HGYDOXHRI
3&L_;IRUFODVV&LLVFDOOHGWKHPD[LPXPSRVWHULRUK\SRWKHVLV
%\ %D\HV 7KHRUHP 3 $_% 7KH VLPSOLFLW\ RI WKH QDwYH ED\HV WKHRUHP LV YHU\ XVHIXO ZKHQ LW FRPHV WR
GRFXPHQWFODVVLILFDWLRQ7KHPDLQLGHDLVWRHVWLPDWHWKHSUREDELOLWLHVRIFDWHJRULHVJLYHQDWHVWGRFXPHQWE\XVLQJ
WKH MRLQW SUREDELOLWLHV RI ZRUGV DQG FDWHJRULHV 7KH VLPSOLFLW\ RI WKH 1DwYH %D\HV DOJRULWKP PDNHV WKLV SURFHVV
HIILFLHQW+DQKRRQ.KDQJ(WDO>@KDVSURSRVHGDQLPSURYHGYHUVLRQRIWKH1DwYH%D\HVDOJRULWKPDQGDXQLJUDPV
ELJUDPVZDVXVHGDVWKHIHDWXUHWKHJDSEHWZHHQWKHSRVLWLYHDFFXUDF\DQGWKHQHJDWLYHDFFXUDF\ZDVQDUURZHGWR
FRPSDUHG WR ZKHQ WKH RULJLQDO 1DwYH %D\HV ZDV XVHG DQG WKDW WKH JDS ZDV DEOH WR EH QDUURZHG
FRPSDUHGWRZKHQ690ZDVXVHG
3DEOR*DPDOOR0DUFRV*DUFLD>@SUHVHQWHG1DwYH%D\HVVWUDWHJ\ZKHQWKHFODVVLILHUVDUHLPSOHPHQWHGZLWKWKH
%LQDU\VWUDWHJ\ZKHQWKH\XVHDSRODULW\OH[LFRQDQGZKHQPXOWLZRUGVDUHFRQVLGHUHGDVIHDWXUHV7KHWZRV\VWHPV
VXEPLWWHGWR6HPHYDOFRPSHWLWLRQZHUHWKRVHREWDLQHGWKHEHVWVFRUHV&21675%,1/(;0:DQG81&21675
%,1/(;0: ,Q WKH 7ZHHWV WHVW FRUSXV WKH FRQVWUDLQHG V\VWHP UHDFKHG )VFRUH ZKLOH WKH
XQFRQVWUDLQHGYHUVLRQDFKLHYHG
C. SUPPORT VECTOR MACHINES (SVM)
6XSSRUW 9HFWRU PDFKLQH LV 9HFWRU VSDFH EDVHG PDFKLQHOHDUQLQJ PHWKRG DLPLQJ WR ILQG D GHFLVLRQ ERXQGDU\
EHWZHHQWZRFODVVHVWKDWLVPD[LPDOO\IDUIURPDQ\SRLQWLQWKHWUDLQLQJGDWDSRVVLEO\GLVFRXQWLQJVRPHSRLQWVDV
RXWOLHUV RU QRLVH $SDUW IURP SHUIRUPLQJ OLQHDU FODVVLILFDWLRQ 690V FDQ HIILFLHQWO\ SHUIRUP D QRQOLQHDU
FODVVLILFDWLRQ XVLQJ ZKDW LV FDOOHG WKH NHUQHO WULFN LPSOLFLWO\ PDSSLQJ WKHLU LQSXWV LQWR KLJKGLPHQVLRQDO IHDWXUH
VSDFHV7KLVGLVFULPLQDWLYHFODVVLILHULVFRQVLGHUHGWKHEHVWWH[WFODVVLILFDWLRQPHWKRG>@05XVKGL6DOHK(WDO
>@KDVDSSOLHGWKHQHZUHVHDUFKDUHDE\XVLQJ6XSSRUW9HFWRU0DFKLQHV690IRUWHVWLQJGLIIHUHQWGRPDLQVRI
GDWDVHWVDQGXVLQJVHYHUDOZHLJKWLQJVFKHPHV7KH\KDYHDFFRPSOLVKHGH[SHULPHQWVZLWKGLIIHUHQWIHDWXUHVRQWKUHH
FRUSRUD7ZRRIWKHPKDYHDOUHDG\EHHQXVHGLQVHYHUDOZRUNV7KH6,1$,&RUSXVKDVEHHQEXLOWIURP$PD]RQFRP
VSHFLILFDOO\LQRUGHUWRSURYHWKHIHDVLELOLW\RIWKH690IRUGLIIHUHQWGRPDLQV>@
3UHUQD &KLNHUVDO >@ WUDLQHG D 6XSSRUW 9HFWRU 0DFKLQH 690 RQ WZHHWV DOORZHG WR EH XVHG IRU WUDLQLQJ
SXUSRVHV7KH\JRWDQ)VFRUHRIIRUDOOIHDWXUHV
,9&21&/86,21
'DWDLQVRFLDOPHGLDSDUWLFXODUO\LQPLFUREORJJLQJDUHVKRUWUHDOWLPHDQGYHU\LQIRUPDO7KLVSRVHVDFKDOOHQJHWR
WKHVHQWLPHQWDQDO\VLVRIWKHVHGDWD,QWKLVSDSHUZHWULHGWRUHYLHZWKHSUHVHQFHRIHPRWLFRQVLQWKHPLFUREORJJLQJ
9ROXPH,VVXH$SULO
,661±
,QWHUQDWLRQDO-RXUQDORI,QQRYDWLRQVLQ(QJLQHHULQJDQG7HFKQRORJ\,-,(7
VLWHWZLWWHUDQGWKHGLIIHUHQWWHFKQLTXHVIRUFODVVLI\LQJWKHVHHPRWLFRQVLQRUGHUWRSUHGLFWWKHVHQWLPHQWRIWKHJLYHQ
WZHHW'LIIHUHQWFODVVLILFDWLRQWHFKQLTXHVDUHDQDO\]HGLQWKLVSDSHUYL]OH[LFRQEDVHG1DwYH%D\HVDQG690
7KHUH DUH PDQ\ SRWHQWLDO IXWXUH H[WHQVLRQV RI WKLVZRUN ,W LV LQWHUHVWLQJ WR LQYHVWLJDWH WKH FRQWULEXWLRQVRIRWKHU
HPRWLRQ LQGLFDWLRQ LQIRUPDWLRQ DYDLODEOH LQ RWKHU VRFLDO PHGLD ,W LV DOVR LQWHUHVWLQJ WR VWXG\ RWKHU PHWKRGV WR
PHDVXUHWKHVHQWLPHQWVRULHQWDWLRQRIWKHVRFLDOPHGLDSRVWV
5()(5(1&(6
>@ $SRRUY $JDUZDO %R\L;LH ,OLD 9RYVKD 2ZHQ 5DPERZ 5HEHFFD 3DVVRQQHDX 6HQWLPHQW $QDO\VLV RI 7ZLWWHU 'DWD 'HSDUWPHQW RI
&RPSXWHU6FLHQFH&ROXPELD8QLYHUVLW\1HZ<RUN1<86$
>@ :DODD0HGKDW $KPHG +DVVDQ +RGD .RUDVK\ 6HQWLPHQW $QDO\VLV $OJRULWKPV DQG $SSOLFDWLRQV $ 6XUYH\ $LQ 6KDPV (QJLQHHULQJ
-RXUQDO9ROXPH,VVXH'HFHPEHU3DJHV
>@ www.datagenetics.com/blog/october52012/index.html
>@ $OH[DQGHU+RJHQERRP'DQLHOOD%DO)ODYLXV)UDVLQFDU0DOLVVD%DO([SORLWLQJ(PRWLFRQVLQ6HQWLPHQW$QDO\VLV
>@ :DJKRGH 3RRQDP % 3URI 0D\XUD .LQLNDU 0,7 $FDGHP\ RI (QJLQHHULQJ 7ZLWWHU 6HQWLPHQW $QDO\VLV ZLWK (PRWLFRQV ,QWHUQDWLRQDO
-RXUQDORI(QJLQHHULQJDQG&RPSXWHU6FLHQFH$SULO
>@ 5R\GHQ/HZLV6WHYHQ:DUH.D\KDQ0RKDUUHUL6HQWLPHQWDQDO\VLVXVLQJHPRWLFRQV
>@ 0*RYLQGDUDMDQ5RPLQD0$6XUYH\RI&ODVVLILFDWLRQ0HWKRGVDQG$SSOLFDWLRQVIRU6HQWLPHQW$QDO\VLV
>@ %R3DQJDQG/LOOLDQ/HH2SLQLRQ0LQLQJDQG6HQWLPHQW$QDO\VLV
>@ $KPHG$EEDVL6WHSKHQ)UDQFH=KX=KDQJDQG+VLQFKXQ&KHQ³6HOHFWLQJ$WWULEXWHVIRU6HQWLPHQW&ODVVLILFDWLRQ8VLQJ)HDWXUH5HODWLRQ
1HWZRUNV´,(((7UDQVDFWLRQVRQ.QRZOHGJHDQG'DWD(QJLQHHULQJ9RO1RSS
>@ 5REHUW 3 6FKXPDNHU <XOHL =KDQJ &KXQ1HQJ +XDQJ +VLQFKXQ &KHQ´ (YDOXDWLQJ VHQWLPHQW LQ ILQDQFLDO QHZV DUWLFOHV´ 'HFLVLRQ
6XSSRUW6\VWHPV±
>@ 0 5XVKGL 6DOHK 07 0DUWtQ9DOGLYLD $ 0RQWHMR5iH] /$ 8UHxD/ySH]´([SHULPHQWV ZLWK 690 WR FODVVLI\ RSLQLRQV LQ GLIIHUHQW
GRPDLQV´([SHUW6\VWHPVZLWK$SSOLFDWLRQV±
>@ ,QWURGXFWLRQ WR ,QIRUPDWLRQ 5HWULHYDO E\ +LQULFK6FKXW]H FRXUVH DQG FKDSWHU RI WKH ERRN >056@ DOO DYDLODEOH DW
ZZZLQIRUPDWLRQUHWULHYDORUJ
>@ 6LQJK DQG 9LYHN .XPDU ³$ FOXVWHULQJ DQG RSLQLRQ PLQLQJ DSSURDFK WR VRFLRSROLWLFDO DQDO\VLV RI WKH EORJRVSKHUH´ &RPSXWDWLRQDO
,QWHOOLJHQFHDQG&RPSXWLQJ5HVHDUFK,&&,&,(((,QWHUQDWLRQDO&RQIHUHQFH
>@ 0HOYLOOH :RMFLHFK*U\F ³6HQWLPHQW $QDO\VLV RI %ORJV E\ &RPELQLQJ /H[LFDO .QRZOHGJH ZLWK 7H[W &ODVVLILFDWLRQ´ .''ெ -XQH ±
-XO\3DULV)UDQFH&RS\ULJKW$&0
>@ ;LD+X-LOLDQJ7DQJ+XML*DRDQG+XDQ/LX8QVXSHUYLVHGVHQWLPHQWDQDO\VLVZLWKHPRWLRQDOVLJQDOV
>@ 3UDEX3DODQLVDP\9LQHHW<DGDYDQG+DUVKD(OFKXUL6HUHQGLR6LPSOHDQG3UDFWLFDOOH[LFRQEDVHGDSSURDFKWR6HQWLPHQW$QDO\VLV
>@ 3DEOR*DPDOOR0DUFRV*DUFLD&LWLXV$1DLYH%D\HV6WUDWHJ\IRU6HQWLPHQW$QDO\VLVRQ(QJOLVK7ZHHWV
>@ 3UHUQD &KLNHUVDO 6RXMDQ\D 3RULD DQG (ULN &DPEULD 6H178 6HQWLPHQW $QDO\VLV RI 7ZHHWV E\ &RPELQLQJ D 5XOHEDVHG &ODVVLILHU ZLWK
6XSHUYLVHG/HDUQLQJ
>@ 0LFKDHO :LHJDQG $OH[DQGUD %DODKXU %HQMDPLQ 5RWK 'LHWULFK .ODNRZ $QGU HV 0RQWR\R $ VXUYH\ RQ WKH UROH RI QHJDWLRQ LQ
VHQWLPHQW DQDO\VLV 3URFHHGLQJV RI WKH ZRUNVKRS RQ QHJDWLRQ DQG VSHFXODWLRQ LQ QDWXUDO ODQJXDJH SURFHVVLQJ ± $VVRFLDWLRQ IRU
&RPSXWDWLRQDO/LQJXLVWLFV
>@ 0DLWH 7DERDGD -XOLDQ %URRNH0LODQ 7R¿ORVNL .LPEHUO\ 9ROO DQG 0DQIUHG 6WHGH /H[LFRQEDVHG PHWKRGV IRU VHQWLPHQW DQDO\VLV
&RPSXWDWLRQDOOLQJXLVWLFVYROXPHQXPEHU±0,73UHVV
>@ 'PLWU\'DYLGRY2UHQ7VXUDQG$UL5DSSRSRUW(QKDQFHGVHQWLPHQWOHDUQLQJXVLQJWZLWWHUKDVKWDJVDQGVPLOH\V3URFHHGLQJVRIWKH
UG,QWHUQDWLRQDO&RQIHUHQFHRQ&RPSXWDWLRQDO/LQJXLVWLFV±$VVRFLDWLRQIRU&RPSXWDWLRQDO/LQJXLVWLFV
>@ +DQKRRQ.DQJ6HRQJ-RRQ<RR'RQJLO+DQ´6HQWLOH[LFRQDQGLPSURYHG1DwYH%D\HVDOJRULWKPVIRUVHQWLPHQWDQDO\VLVRIUHVWDXUDQW
UHYLHZV´([SHUW6\VWHPVZLWK$SSOLFDWLRQV±
>@ 5XL;LD&KHQJTLQJ=RQJ6KRXVKDQ/L³(QVHPEOHRIIHDWXUHVHWVDQGFODVVLILFDWLRQDOJRULWKPVIRUVHQWLPHQWFODVVLILFDWLRQ´,QIRUPDWLRQ
6FLHQFHV±
>@ 0 5XVKGL 6DOHK 07 0DUWtQ9DOGLYLD $ 0RQWHMR5iH]/$ 8UHxD/ySH]´ ([SHULPHQWV ZLWK 690 WR FODVVLI\ RSLQLRQV LQ GLIIHUHQW
GRPDLQV´([SHUW6\VWHPVZLWK$SSOLFDWLRQV±
9ROXPH,VVXH$SULO
,661±