ISSN 1648-8776
-$81Ǐ-Ǐ02.6/,1,1.Ǐ'$5%$,15
5(6($5&+2):25'6($5&+$/*25,7+06%$6('215(/$7,21$/'$7$%$6(
2OHNVLM9RONRY6LPRQD5DPDQDXVNDLWơ
âLDXOLDLXQLYHUVLW\)DFXOW\RI7HFKQRORJ\
,QWURGXFWLRQ
:RUG JDPHV DUH D VLPSOH DQG IXQ ZD\ WR VSHQG
WLPH ,W KHOSV WR LPSURYH D SHUVRQ¶V YRFDEXODU\ H[SDQG
HUXGLWLRQ WUDLQ PHPRU\ DQG LQWHOOLJHQFH DQG GHYHORS
ORJLF DQG DVVRFLDWLYH WKLQNLQJ 7KHUH H[LVWV GLIIHUHQW
W\SHVRIZRUGJDPHVZKLFKUHTXLUHGLIIHUHQWJDPHORJLF
DQG GLIIHUHQW ZRUG¿QGLQJ DOJRULWKPV 7KH RSWLPL]DWLRQ
RI ZRUG VHDUFK DOJRULWKPV LV UHTXLUHG WR GHVLJQ D IXOO\
IXQFWLRQLQJDQGHI¿FLHQWV\VWHP
7KHDLPRIWKLVZRUNLVWRUHVHDUFKWKHHI¿FLHQF\RI
GLIIHUHQWNLQGVRIZRUGVHDUFKDOJRULWKPVXVLQJDQ64/
EDVHG UHODWLRQDO GDWDEDVH 5HVXOWV RI WKLV UHVHDUFK FRXOG
SURYLGHYDOXDEOHLQIRUPDWLRQIRUWKHGHVLJQRIDQHI¿FLHQW
KHOSLQJ V\VWHP IRU VROYLQJ ZRUG JDPHV 6WULQJ 6HDUFK
$OJRULWKPV
7R ¿QG D VXLWDEOH ZRUGIRUZRUG JDPH UHTXLUHV
UHYLHZRIGLFWLRQDU\DQGWR¿QGRQH7KLVUHTXLUHVFHUWDLQ
UHVRXUFHV WR FRPSDUH DOO ZRUGV IURP WKH GLFWLRQDU\ WR
WKH ZRUG VHDUFK SDWWHUQ7KHUH DUH GLIIHUHQW DOJRULWKPV
IRU VWULQJ PDWFKLQJ SUREOHP $V 5 5LYHVW >@ VWDWHV
WRVHDUFKIRUDSDWWHUQRIOHQJWKPLQDWH[WRIOHQJWKn
ZKHUH n > PWKHVHDUFKWLPHLVQLQWKHZRUVWFDVH
IRU¿[HGP0RUHRYHULQWKHZRUVWFDVHDWOHDVWnP
FKDUDFWHUPXVWEHLQVSHFWHG+RZHYHUWKHFRPSOH[LW\
RI VWULQJ VHDUFK FDQ YDU\ GHSHQGLQJ RQ WKH DOJRULWKP
XVHG
7KH PRVW NQRZQ XQRSWLPL]HG VWULQJ VHDUFK
DOJRULWKP LV QDLYH RU EUXWH IRUFH DOJRULWKP ,W WULHV WR
PDWFK DQ\ VXEVWULQJ RI OHQJWK P LQ WKH WH[W ZLWK WKH
SDWWHUQ >@ WKHUHIRUH nPGLIIHUHQW FRPELQDWLRQ RI
RQH ZRUG PXVW EH FKHFNHG WR ¿QG DOO SDWWHUQ PDWFKHV
7KLV DOJRULWKP PDWFKHV DOO SDWWHUQ OHWWHUV IRU DOO ZRUG
FRPELQDWLRQV 0HDQZKLOH .QXWK 0RUULV DQG 3UDWW¶V
DOJRULWKP >@ RSWLPL]HV LW DQG GRHV QRW H[DPLQH DOO
WKH SDWWHUQV 7KLV DOJRULWKP FRPSDULQJ WZR VWULQJV
FRPSDUHV LW XQWLO WKH ¿UVW XQPDWFKHG OHWWHUV WKHUHIRUH
WKHFRPSOH[LW\RIWKLVDOJRULWKPLVDOLWWOHELWVPDOOHUDQG
WKHVHDUFKWLPHLVPRUHGHSHQGDEOHRQWKHVHDUFKSDWWHUQ
DQGFRPSDUDEOHVWULQJ
7R UHGXFH WKH FRPSOH[LW\ RI WKH VHDUFK DOJRULWKP
%R\HUDQG0RRUH>@SURSRVHGWRVHDUFKWKHSDWWHUQIURP
ULJKWWROHIW,IQRPLVPDWFKRFFXUVWKHQWKHSDWWHUQKDV
EHHQIRXQG2WKHUZLVHWKHSDWWHUQPDWFKLQJLVPRYHGWR
WKHOHIWE\DQDPRXQWRIOHWWHUVZKLFKLVFDOFXODWHGXVLQJ
KHXULVWLF DOJRULWKP DGMXVWLQJ WR WKH GLIIHUHQFH RI WKH
PDWFKLQJSDWWHUQ
7KH FRPSOH[LW\ UHVHDUFK RI WKHVH VWULQJ VHDUFK
DOJRULWKPVGHSHQGRQWKHOHQJWKRIWKHSDWWHUQZDVFDUULHG
RXWE\5LFDUGR$%DH]D<DWHV>@VHH)LJ,WVKRZHG
WKHGHFUHDVHRIWKH%R\HUDQG0RRUHDOJRULWKPFRPSDUHG
WRWKHQDLYHDQG.QXWK0RUULV3UDWWDOJRULWKP+RZHYHU
DOO WKHVH FODVVLF DOJRULWKPV ZHUH SURSRVHG LQ PHDQZKLOHQHZLQIRUPDWLRQWHFKQRORJLHVDOORZGLIIHUHQW
VROXWLRQVWRWKHSUREOHP
138
:RUG6HDUFKLQ64/%DVHG5HODWLRQDO
'DWDEDVHV
5HODWLRQDO GDWDEDVH PRGHO LV DQ RUJDQL]DWLRQ RI
GDWD LQWR FROOHFWLRQV RI WZRGLPHQVLRQDO WDEOHV FDOOHG
³UHODWLRQV´ >@ 7KLV W\SH RI GDWDEDVH PDQDJHPHQW
V\VWHPVDWSUHVHQWLVWKHPRVWFRPPRQLQGLIIHUHQWNLQGV
RILQIRUPDWLRQV\VWHPV>@7KHSRSXODULW\RIUHODWLRQDO
GDWDEDVHPDQDJHPHQWV\VWHPVLVLQFUHDVHGE\VXSSRUWRI
64/ZKLFKDOORZHGFOHDUV\QWD[WRJHWUHTXLUHGGDWDIURP
UHODWLRQDOGDWDEDVHV
7KH 6WUXFWXUHG 4XHU\ /DQJXDJH 64/ LV D
VWDQGDUGL]HG ODQJXDJH XVHG WR UHWULHYH DQG XSGDWH GDWD
VWRUHG LQ UHODWLRQDO WDEOHV RU GDWDEDVHV >@ 64/ KDV
GLIIHUHQW W\SH RI TXHULHV DQG SDUDPHWHUV +RZHYHU IRU
VWULQJVHDUFKDOJRULWKPVWKH/,.(FODXVHLVXVXDOO\XVHG
,WKDVWZRZLOGFDUGVWKHSHUFHQWVLJQUHSUHVHQWV]HUR
RQHRUPXOWLSOHFKDUDFWHUVWKHXQGHUVFRUHBUHSUHVHQWV
DVLQJOHQXPEHURUFKDUDFWHU>@
7KH V\PEROV FDQ EH XVHG LQ FRPELQDWLRQV WR
FRPSRVHDGHVLUHGSDWWHUQRIVHDUFKVWULQJ
)LJ&RPSDULVRQRIFRPSOH[LW\RIVWULQJVHDUFK
DOJRULWKPV>@
3RVVLEOH'DWDEDVH'HVLJQVIRU:RUG6HDUFK
%DVHGRQ/HWWHU3DWWHUQV
7KHPRVWLPSRUWDQWHOHPHQWRIZRUGVHDUFKV\VWHPV
LV WKH GHVLJQ RI D V\VWHP GDWDEDVH WKH GDWDEDVH KDV WR
VWRUH WKH ZRUG GLFWLRQDU\ ZKLFK XVXDOO\ VWRUHV D ODUJH
QXPEHURIGDWDDZRUGVHDUFKV\VWHPXVXDOO\VHDUFKHV
IRU PDWFKLQJ ZRUGV DFFRUGLQJ WR D NQRZQ SDWWHUQ
WKHUHIRUHPDQ\FRQQHFWLRQVWRWKHGDWDEDVHFDQEHXVHG
7(&+12/2*,-2602.6/$,,1)250$7,.$
+RZHYHUWRVSHFLI\WKHUDQJHRIZRUOGOHWWHUVZRXOGQRW
EHSRVVLEOHZLWKWKH¿UVWGDWDEDVHGHVLJQ
7R GHVLJQ D V\VWHP ZLWK D ZLGH YDULHW\ RI VWULQJ
VHDUFK DOJRULWKPV D VFUDEEOHW\SH VHDUFK KDV WR EH
VXSSRUWHG7KLVW\SHRIVHDUFKXVXDOO\KDVQRSDWWHUQEXW
MXVWDOLVWRISRVVLEOHOHWWHUVZKLFKKDYHWREHXVHGWRJHW
DZRUG7RGRWKLVZLWKWKHSUHYLRXVO\GHVFULEHGGDWDEDVH
GHVLJQ ZRXOG EH GLI¿FXOW DOO SRVVLEOH FRPELQDWLRQV RI
NQRZQ OHWWHUV KDYH WR EH JHQHUDWHG D ODUJH QXPEHU RI
SRVVLEOHOHWWHUFRPELQDWLRQVFDQEHJHQHUDWHGIRUORQJVHW
RIOHWWHUVDQG64/LVQRWFDSDEOHRIJHQHUDWLQJDOOSRVVLEOH
ZRUGFRPELQDWLRQVIURPDNQRZQVHWRIOHWWHUVHWF
7R VROYH WKLV SUREOHP D QHZ LPSURYHPHQW WR WKH
GDWDEDVH GHVLJQ KDV WR EH PDGH ± WKH GDWDEDVH VKRXOG
GHVFULEH DOO ZRUGV E\ VSOLWWLQJ WKHP LQWR OHWWHUV DQG
DVVRFLDWLQJWKHPWRWKHFRUUHVSRQGLQJZRUGVHH)LJ
7KH VLPSOHVW GHVLJQ RI D ZRUG VHDUFK GDWDEDVH LV
UHSUHVHQWHGLQ)LJ
GLFWLRQDU\
GLFWLRQDU\BLG
GLFWLRQDU\BWLWOH
ZRUG
GLFWLRQDU\BLG
ZRUG
)LJ'DWDEDVHGHVLJQ1R
7KLVDUFKLWHFWXUHLV YHU\ VLPSOH DQGDOORZV KDYLQJ
GLIIHUHQWGLFWLRQDULHVLQWKHVDPHV\VWHP8VLQJWKLVNLQG
RIGDWDEDVHGHVLJQWZRW\SHVRI64/TXHULHVFDQEHXVHG
WRJHWPDWFKLQJZRUGVIURPWKHGDWDEDVH
x 7RVHOHFWDOOPDWFKLQJZRUGVIURPWKHGDWDEDVH
DFFRUGLQJWRSURYLGHGSDWWHUQ37516(/(&7ZRUGZRUG
)520ZRUG:+(5(ZRUGZRUG/,.(µ3751¶
x 7R VHOHFW DOO PDWFKLQJ ZRUGV IURP D VSHFL¿F
GLFWLRQDU\ ',&7 LQ WKH GDWDEDVH DFFRUGLQJ WR SURYLGHG
SDWWHUQ 3751 6(/(&7 ZRUGZRUG )520 ZRUG
:+(5( ZRUGGLFWLRQDU\BLG ',&7 $1' ZRUGZRUG
LIKE ‘3751¶
7KHSDWWHUQFDQEHFRPSRVHGRIDQ\V\PEROVIURP
WKH DOSKDEHW DQG SHUFHQW VLJQ DV ZHOO DV XQGHUVFRUH
BZLOGFDUGVWRUHSUHVHQWDQ\XQLPSRUWDQWSDUWVRIWKH
ZRUG +RZHYHU WKLV DUFKLWHFWXUH GRHV QRW DOORZ IRU D
VHDUFKDFFRUGLQJWRWKHOHQJWKRIWKHZRUG7KHUHIRUHWKLV
GDWDEDVHGHVLJQFDQEHLPSURYHGE\DGGLQJDQDGGLWLRQDO
¿HOGWRWKHWDEOHZRUGVHH)LJ
GLFWLRQDU\
GLFWLRQDU\BLG
GLFWLRQDU\BWLWOH
GLFWLRQDU\
GLFWLRQDU\BLG
GLFWLRQDU\BWLWOH
ZRUG
GLFWLRQDU\BLG
ZRUGBLG
ZRUG
QXPEHUBRIBOHWWHUV
OHWWHU
ZRUGBLG
OHWWHU
)LJ'DWDEDVHGHVLJQ1R
7KLVDUFKLWHFWXUHZRXOGDOORZIRU¿QGLQJDOOZRUGV
IRUDVFUDEEOHW\SHZRUGVHDUFK
x 7RVHOHFWDOOPDWFKLQJZRUGVIURPDVSHFL¿FGLFWLRQDU\
',&7 LQ WKH GDWDEDVH DFFRUGLQJ WR D SURYLGHG VHW RI
OHWWHUV^/, /«/1`ZKHUHDWOHDVW0OHWWHUVRIWKH
VHWZRXOGEHXVHG6(/(&7ZRUGZRUG)520OHWWHU
ZRUG :+(5( ZRUGZRUGBLG OHWWHUZRUGBLG $1'
OHWWHUOHWWHU µ/¶ 25 OHWWHUOHWWHU µ/¶ 25 « 25
OHWWHUOHWWHU µ/1¶$1' ZRUGGLFWLRQDU\BLG ',&7
JURXS E\ OHWWHUZRUGBLG +$9,1* FRXQWOHWWHUZRUGB
LG!0.
7KLV GDWDEDVH GHVLJQ ZRXOG SURYLGH DOO WKH
IXQFWLRQDOLW\ WKH V\VWHP QHHGV +RZHYHU LW FDQ EH
H[WHQGHG WR VHDUFK IRU ZRUGV E\ SDWWHUQ XVLQJ WKH WDEOH
OHWWHU LQVWHDG RI WKH ZRUG 7KLV UHTXLUHV DGGLQJ WKH
SRVLWLRQRIOHWWHULQWKHZRUGRQO\VHH)LJ
ZRUG
GLFWLRQDU\BLG
ZRUG
QXPEHUBRIBOHWWHUV
)LJ'DWDEDVHGHVLJQ1R
7KLV GDWDEDVH GHVLJQ LPSURYHPHQW DOORZV IRU WZR
DGGLWLRQDOTXHULHVWRVSHFLI\WKHVHDUFK
x 7R VHOHFW DOO PDWFKLQJ ZRUGV IURP WKH VSHFL¿F GLFWL
RQDU\ ',&7 LQ WKH GDWDEDVH DFFRUGLQJ WR D SURYLGHG
SDWWHUQ3751ZKHUHWKHOHQJWKRIWKHZRUGLVH[DFWO\
1 6(/(&7 ZRUGZRUG )520 ZRUG :+(5( ZRUG
GLFWLRQDU\BLG ',&7$1'ZRUGZRUG/,.(µ3751¶
$1'ZRUGQXPEHUBRIBOHWWHUV 1.
x 7R VHOHFW DOO PDWFKLQJ ZRUGV IURP WKH VSHFL¿F GLFWL
RQDU\ ',&7 LQ WKH GDWDEDVH DFFRUGLQJ WR D SURYLGHG
SDWWHUQ 3751 ZKHUH WKH OHQJWK RI WKH ZRUG LV PRUH
WKDQ1DQGOHVVWKDQ16(/(&7ZRUGZRUG)520
ZRUG:+(5(ZRUGGLFWLRQDU\BLG ',&7$1'ZRUG
ZRUG /,.( µ3751¶$1' ZRUGQXPEHUBRIBOHWWHUV !
1$1'ZRUGQXPEHUBRIBOHWWHUV1).
7KHUHFDQEHGLIIHUHQWFRPELQDWLRQVRIZRUGOHQJWK
OLPLWDWLRQVKRZHYHUWKHVHWZRDUHWKHPRVWO\XVHG
7KH 64/ TXHU\ WR JHW DOO ZRUGV ZLWK H[DFW OHQJWK
FDQ DOVR EH UHDOL]HG ZLWK ¿UVW GDWDEDVH GHVLJQ )RU WKLV
SXUSRVHWKHHXQGHUVFRUHBZLOGFDUGVKRXOGEHXVHGWR
LGHQWLI\DOOXQNQRZQOHWWHUVDQGWKHLUSRVLWLRQLQWKHZRUG
GLFWLRQDU\
GLFWLRQDU\BLG
GLFWLRQDU\BWLWOH
ZRUG
GLFWLRQDU\BLG
ZRUGBLG
ZRUG
QXPEHUBRIBOHWWHUV
OHWWHU
ZRUGBLG
OHWWHU
SRVLWLRQ
)LJ'DWDEDVHGHVLJQ1R
7KHSRVLWLRQRIDOHWWHULQDZRUGDOORZVXVWRVHDUFK
E\VSHFLI\LQJZKLFKOHWWHULQWKHVHWDQGWKHOHWWHUVKRXOG
EHSODFHGLQWKHZRUG7KHUHIRUHWKHTXHU\IRUVHDUFKLQJD
ZRUGRIVSHFL¿FOHQJWKFDQEHFKDQJHGWRLW
x 7RVHOHFWDOOPDWFKLQJZRUGVIURPDVSHFL¿FGLFWLRQD
U\ ',&7 LQ WKH GDWDEDVH DFFRUGLQJ WR D SURYLGHG VHW
RI OHWWHUV ^/, / « /1` WKH OHQJWK RI WKH ZRUG LV
H[DFWO\ 0 6(/(&7 ZRUGZRUG )520 OHWWHU ZRUG
:+(5( ZRUGQXPEHUBRIBOHWWHUV 0 $1' ZRUG
139
ISSN 1648-8776
-$81Ǐ-Ǐ02.6/,1,1.Ǐ'$5%$,15
1. 6(/(&7 ZRUGZRUG )520 ZRUG :+(5( ZRUG
ZRUG/,.(µD¶
2. 6(/(&7 ZRUGZRUG )520 ZRUG :+(5( ZRUG
ZRUG/,.(µDB¶
3. 6(/(&7ZRUGZRUG)520ZRUG:+(5(ZRUGGLF
WLRQDU\BLG $1'ZRUGZRUG/,.(µD¶
4. 6(/(&7ZRUGZRUG)520ZRUG:+(5(ZRUGGLF
WLRQDU\BLG $1'ZRUGZRUG/,.(µDB¶
5HVXOWVREWDLQHGIURPWKHWHVWDUHSUHVHQWHGLQWDEOH
$VWKHUHVXOWVRIWKLVWHVWVKRZHGWKHH[HFXWLRQWLPH
LV GHSHQGDEOH RQ WKH QXPEHU RI ZRUGV LQ WKH GDWDEDVH
+RZHYHU WKH W\SH RI 64/ TXHU\ GRHV QRW KDYH D JUHDW
LQÀXHQFH RQ VSHHG DV RQO\ RQH GLFWLRQDU\ H[LVWV LQ WKH
GDWDEDVHEXWRQO\WKHQXPEHURIIRXQGHOHPHQWVGLIIHUV
EHFDXVHRIWKHFRQGLWLRQVZKLFKZHUHXVHG
ZRUGBLG OHWWHUZRUGBLG$1'OHWWHUOHWWHU µ/¶DQG
OHWWHUSRVLWLRQ 25 OHWWHUOHWWHU µ/¶ $1' OHWWHU
SRVLWLRQ 25«25OHWWHUOHWWHU µ/1¶$1'OHWWHU
SRVLWLRQ 1$1' ZRUGGLFWLRQDU\BLG ',&7 JURXS
E\OHWWHUZRUGBLG+$9,1*FRXQWOHWWHUZRUGBLG!1.
+RZHYHULWLVXQNQRZQLIWKLVTXHU\ZRXOGEHPRUH
HI¿FLHQWWKDQLQWKHSUHYLRXVDUFKLWHFWXUH
5HVHDUFKRI5HODWLRQDO'DWDEDVH%DVHG:RUG
6HDUFK$OJRULWKPV
7R GH¿QH WKH EHVW GDWDEDVH DUFKLWHFWXUH IURP WKH
SURSRVHG RQHV D UHVHDUFK RI LWV HI¿FLHQF\ KDV WR EH
FDUULHG RXW )RU WKLV SXUSRVH IRXU GLIIHUHQW GDWDEDVH
DUFKLWHFWXUHV GHVFULEHG HDUOLHU LQ WKLV SDSHU ZLOO EH
FUHDWHGLQWKH64/LWHGDWDEDVHPDQDJHPHQWV\VWHP7R
H[DPLQH WKH HI¿FLHQF\ RI WKHVH GDWDEDVH DUFKLWHFWXUHV
H[SHULPHQWV ZLWK GLIIHUHQW QXPEHU RI ZRUGV LQ WKH
GDWDEDVH KDYH WR EH GRQH 7KHUHIRUH H[SHULPHQWV ZLOO
EH H[HFXWHG ZLWK DQG ZRUGV LQ WKH
GDWDEDVH $FFRUGLQJ WR WKH GDWDEDVH DUFKLWHFWXUH DOO
SURYLGHG 64/ TXHULHV VKRXOG EH WHVWHG XVLQJ GLIIHUHQW
SDWWHUQVRUVHWVRIOHWWHUV
7KHSXUSRVHRIWKHUHVHDUFKZRXOGEHWRHYDOXDWHWKH
TXHU\H[HFXWLRQWLPHWRREWDLQDVXJJHVWHGOLVWRIZRUGV
DFFRUGLQJ WR WKH FKRVHQ GDWDEDVH DUFKLWHFWXUH DQG WKH
QXPEHURIZRUGVLQWKHGDWDEDVHDQGVHDUFKSDWWHUQRUVHW
RIOHWWHUV
7HVWLQJ ZLOO EH GRQH ZLWK ZRUGV IURP WKH (QJOLVK
GLFWLRQDU\ :LWK HDFK GHVLJQ RI WKH GDWDEDVH WZR W\SHV
RIUHTXHVWVFRPSOH[DQGVLPSOHZLOOEHSHUIRUPHGWKH
DYHUDJHTXHU\WLPHZLOOEHFRPSDUHGZLWKRWKHUGHVLJQV
RIGDWDEDVHV
5HVHDUFKRI'DWDEDVH'HVLJQ1R
7KHVHFRQGGDWDEDVHGHVLJQLVWHVWHGDVZHOODVWKH
¿UVWRQHKRZHYHUDOLPLWDWLRQWRWKHZRUGVL]HLQXVHG
1. 6(/(&7 ZRUGZRUG )520 ZRUG :+(5( ZRUG
ZRUG/,.(µD¶$1'ZRUGQXPEHUBRIBOHWWHUV 2. 6(/(&7 ZRUGZRUG )520 ZRUG :+(5( ZRUG
ZRUG /,.( µDB¶ $1' ZRUGQXPEHUBRIBOHWWHUV !
$1'ZRUGQXPEHUBRIBOHWWHUV
3. 6(/(&7 ZRUGZRUG )520 ZRUG :+(5( ZRUG
GLFWLRQDU\BLG $1' ZRUGZRUG /,.( µD¶$1'
ZRUGQXPEHUBRIBOHWWHUV 4. 6(/(&7 ZRUGZRUG )520 ZRUG :+(5( ZRUG
GLFWLRQDU\BLG $1'ZRUGZRUG/,.(µDB¶$1'
ZRUGQXPEHUBRIBOHWWHUV!$1'ZRUGQXPEHUBRIB
OHWWHUV
7KH UHVXOW RI WKH VHFRQG GDWDEDVH GHVLJQV WHVWLQJ
LV SURYLGHG LQ WDEOH ZKHUH FDQ EH QRWLFHG VLPLODU
WHQGHQFLHV +RZHYHU FRPSDULQJ UHVXOWV RI WKH ¿UVW DQG
VHFRQG UHVHDUFK ZH FDQ QRWLFH WKH GHFUHHV RI WKH TXHU\
H[HFXWLRQ WLPH ,W VKRZV WKDW ZRUG OHQJWK VWRUDJH FDQ
RSWLPL]HWKH64/TXHU\H[HFXWLRQWLPHIRUDZRUGVHDUFK
ZKHQWKHGHVLUHGOHQJWKRIWKHZRUGLVNQRZQ
5HVHDUFKRI'DWDEDVH'HVLJQ1R
7RWHVWWKHSHUIRUPDQFHRIWKH¿UVWGDWDEDVHGHVLJQ
64/TXHULHVZHUHXVHGWRJHWDOOWKHZRUGVZKLFKVWDUW
ZLWKOHWWHUµD¶DQGGLIIHULQFRQGLWLRQV
7DEOH5HVXOWVRIWHVWLQJZLWKWKH¿UVWGDWDEDVHGHVLJQ
6LWHRIWKH
GLFWLRQDU\
4XHU\H[HFXWLRQWLPHPV
1XPEHURIUHWXUQHGURZVE\TXHU\
¶VWTXHU\
¶QGTXHU\
¶UGTXHU\
¶WKTXHU\
¶VWTXHU\
¶QGTXHU\
¶UGTXHU\
¶WKTXHU\
ZRUGV
1
1
1
1
10
9
10
9
ZRUGV
2
2
2
2
100
99
100
99
ZRUGV
6
6
6
6
408
407
408
407
ZRUGV
8
8
8
8
408
407
408
407
7DEOH5HVXOWVRIWHVWLQJZLWKWKHVHFRQGGDWDEDVHGHVLJQ
6LWHRIWKH
GLFWLRQDU\
4XHU\H[HFXWLRQWLPHPV
¶VWTXHU\
¶QGTXHU\
¶UGTXHU\
1XPEHURIUHWXUQHGURZVE\TXHU\
¶WKTXHU\
¶VWTXHU\
¶QGTXHU\
¶UGTXHU\
¶WKTXHU\
ZRUGV
1
1
1
1
3
5
3
5
ZRUGV
1
1
1
1
11
38
11
38
ZRUGV
1
3
1
3
51
186
51
186
ZRUGV
5
6
5
6
51
186
51
186
140
7(&+12/2*,-2602.6/$,,1)250$7,.$
2. 6(/(&7 ZRUGZRUG )520 ZRUG :+(5( ZRUG
GLFWLRQDU\BLG $1'ZRUGZRUG/,.(µDB¶$1'
ZRUGQXPEHUBRIBOHWWHUV!$1'ZRUGQXPEHUBRIB
OHWWHUV
3. 6(/(&7 ZRUGZRUG )520 OHWWHU ZRUG :+(5(
ZRUGQXPEHUBRIBOHWWHUV $1'ZRUGZRUGBLG OH
WWHUZRUGBLG$1'OHWWHUOHWWHU µD¶DQGOHWWHUSRVLWL
RQ 25 OHWWHUOHWWHU µE¶$1' OHWWHUSRVLWLRQ $1'ZRUGGLFWLRQDU\BLG JURXSE\OHWWHUZRUGBLG
+$9,1*FRXQWOHWWHUZRUGBLG!
4. 6(/(&7 ZRUGZRUG )520 OHWWHU ZRUG :+(5(
ZRUGQXPEHUBRIBOHWWHUV $1'ZRUGZRUGBLG OH
WWHUZRUGBLG $1' OHWWHUOHWWHU µD¶ DQG OHWWHUSRVL
WLRQ 25OHWWHUOHWWHU µE¶$1'OHWWHUSRVLWLRQ 25 OHWWHUOHWWHU µL¶ $1' OHWWHUSRVLWLRQ $1'
ZRUGGLFWLRQDU\BLG JURXS E\ OHWWHUZRUGBLG +$
9,1*FRXQWOHWWHUZRUGBLG!
7KLVGDWDEDVHGHVLJQDOORZVXVWRVHDUFKIRUZRUGVE\
DYHU\VSHFL¿FOHWWHUSDWWHUQDVFDQEHVHHQIURPWKHWHVWHG
TXHULHV 0HDQZKLOH WKH H[HFXWLRQ WLPH RI WKHVH TXHULHV
VHH WDEOH LV QRWLFHDEO\ ELJJHU 7KLV OHDGV WR WKH IDFW
WKDWWKLVNLQGRIVHDUFKFDQEHXVHIXOLQFHUWDLQVLWXDWLRQV
KRZHYHULWVKRXOGQRWEHXVHGIRUDVLPSOHZRUGVHDUFKDV
LWFDQGHFUHDVHWKHSHUIRUPDQFHRIWKHV\VWHP
5HVHDUFKRI'DWDEDVH'HVLJQ1R
7KHWKLUGGHVLJQKDVPRUHGLIIHUHQFHVLQFRPSDULVRQ
WRWKH¿UVWRQHDVLWKDVDQDGGLWLRQDOWDEOHWRVWRUHOHWWHUV
RI WKH ZRUGV 7KHUHIRUH PRUH FRPSOH[ 64/ TXHULHV WR
MRLQ PXOWLSOH WDEOHV KDYH WR EH XVHG KRZHYHU VLPLODU
TXHULHVWRWKH¿UVWDQGVHFRQGGHVLJQVKRXOGZRUNHLWKHU
1. 6(/(&7 ZRUGZRUG )520 ZRUG :+(5( ZRUG
GLFWLRQDU\BLG $1' ZRUGZRUG /,.( µD¶$1'
ZRUGQXPEHUBRIBOHWWHUV 2. 6(/(&7 ZRUGZRUG )520 ZRUG :+(5( ZRUGGLFWL
RQDU\BLG $1'ZRUGZRUG/,.(µDB¶$1'ZRUG
QXPEHUBRIBOHWWHUV!$1'ZRUGQXPEHUBRIBOHWWHUV
3. 6(/(&7 ZRUGZRUG )520 OHWWHU ZRUG :+(5(
ZRUGZRUGBLG OHWWHUZRUGBLG$1'OHWWHUOHWWHU µD¶
25OHWWHUOHWWHU µE¶$1'ZRUGGLFWLRQDU\BLG JUR
XSE\OHWWHUZRUGBLG+$9,1*FRXQWOHWWHUZRUGBLG!
4. 6(/(&7 ZRUGZRUG )520 OHWWHU ZRUG :+(5(
ZRUGZRUGBLG OHWWHUZRUGBLG$1'OHWWHUOHWWHU µD¶
25OHWWHUOHWWHU µE¶25OHWWHUOHWWHU µU¶$1'ZRUG
GLFWLRQDU\BLG JURXS E\ OHWWHUZRUGBLG +$9,1*
FRXQWOHWWHUZRUGBLG!
$V UHVXOWV RI WKLV WHVW VKRZ VHH WDEOH WKH
H[HFXWLRQ WLPH RI FRPSOH[ TXHULHV LV ELJJHU FRPSDULQJ
WR TXHULHV ZKLFK GR QRW XVH WKH WDEOH µOHWWHU¶ $QRWKHU
LQWHUHVWLQJ WKLQJ ZKLFK ZDV QRWLFHG E\ FRPSDULQJ WKH
3UG DQG WK TXHULHV LV WKH H[HFXWLRQ WLPH ZKHQ WKHUH DUH
ZRUGVLQWKHGDWDEDVH±WKHWKTXHU\LVIDVWHUZKHQ
WKHUHDUHXSWRZRUGVZKLOHWKHUGTXHU\LVIDVWHU
ZKHQWKHQXPEHURIZRUGVLQWKHGDWDEDVHLV7KLV
OHDGVWRIDFWWKDWWKHVSHHGRIWKHVHTXHULHVLVGHSHQGHQWRQ
WKHZRUGLQWKHGDWDEDVH
6XPPDU\RIWKH5HVHDUFK
$VFDQEHVHHQIURPUHVHDUFKWKHWLPHWRSHUIRUP
VLPSOH TXHULHV GRHV QRW GHSHQG RQ WKH VWUXFWXUH RI WKH
GDWDEDVHEXWRQO\RQKRZPXFKGDWDWKHUHLVLQVLGH7KH
DVFHQW RI WLPH WR SHUIRUP PRUH FRPSOH[ TXHULHV FDQ EH
VHHQ ZLWK ZRUGV ZKLFK JHQHUDOO\JLYHV PRUHWKDQ
URZVLQWKHGDWDEDVH
7KH DYHUDJH SHUIRUPDQFH RI DQ\ RI WKH UHTXHVWV
GHSHQGLQJRQWKHGHVLJQFDQEHVHHQLQWKHFKDUWEHORZ
7KHVHFRQGW\SHJLYHVWKHEHVWSHUIRUPDQFHEHFDXVH
LWLVSRVVLEOHWRPRUHDFFXUDWHO\GHVFULEHWKHUHTXHVWEXW
WKHVHIHDWXUHVDUHQRWHQRXJK7KHIRXUWKW\SHUHTXLUHVWRR
PXFK WLPH WR SURFHVV WKHLU IXOO RSSRUWXQLWLHV 7KH PRVW
5HVHDUFKRI'DWDEDVH'HVLJQ1R
)RUWKHH[SHULPHQWZLWKWKHIRXUWKGDWDEDVHGHVLJQ
GLIIHUHQWW\SHVRI64/TXHULHVZHUHWHVWHGDVZHOO
1. 6(/(&7 ZRUGZRUG )520 ZRUG :+(5( ZRUG
GLFWLRQDU\BLG $1' ZRUGZRUG /,.( µD¶$1'
ZRUGQXPEHUBRIBOHWWHUV 7DEOH5HVXOWVRIWHVWLQJZLWKWKLUGGDWDEDVHGHVLJQ
6LWHRIWKHGLFWLRQDU\
4XHU\H[HFXWLRQWLPHPV
1XPEHURIUHWXUQHGURZVE\TXHU\
¶VWTXHU\
¶QGTXHU\
¶UGTXHU\
¶WKTXHU\
¶VWTXHU\
¶QGTXHU\
¶UGTXHU\
¶WKTXHU\
ZRUGV
1
1
1
1
3
5
9
2
ZRUGV
1
1
2
1
11
38
55
6
ZRUGV
2
2
8
6
51
186
354
52
ZRUGV
4
5
22
26
51
186
660
111
7DEOH5HVXOWVRIWHVWLQJZLWKWKHIRXUWKGDWDEDVHGHVLJQ
6LWHRIWKHGLFWLRQDU\
4XHU\H[HFXWLRQWLPHPV
1XPEHURIUHWXUQHGURZVE\TXHU\
¶VWTXHU\
¶QGTXHU\
¶UGTXHU\
¶WKTXHU\
¶VWTXHU\
¶QGTXHU\
¶UGTXHU\
¶WKTXHU\
ZRUGV
1
1
1
1
3
5
3
1
ZRUGV
1
1
4
5
11
38
4
1
ZRUGV
1
2
42
65
51
186
4
1
ZRUGV
5
6
350
520
51
186
4
1
141
ISSN 1648-8776
-$81Ǐ-Ǐ02.6/,1,1.Ǐ'$5%$,15
3. $OOSURSRVHGGDWDEDVHGHVLJQVDOORZIRUZRUGVHDUFKLQ
WKHGDWDEDVHDQGWKHUHVXOWVRIWHVWHG64/TXHULHVJLYH
VXLWDEOHUHVXOWVDOOZRUGVZKLFKPHHWWKHSDWWHUQRIVHWRI
OHWWHUVDUHIRXQG7KHUHIRUHWKHPDLQFKRLFHRIGDWDEDVH
GHVLJQVKRXOGEHGRQHDFFRUGLQJWRWKHTXHU\H[HFXWLRQ
WLPHWRJHWDFHUWDLQVHWRIZRUGVIURPWKHGDWDEDVH
4. 7KH VWRUDJH RI OHWWHUV LQ GLIIHUHQW WDEOHV IRU DOO WKH
ZRUGVLQWKHGLFWLRQDU\JLYHVDQRSSRUWXQLW\WRVHDUFK
IRU ZRUGV ZKLFK KDYH D VHW RI OHWWHUV +RZHYHU WKLV
GDWDEDVHGHVLJQLVVSDFHFRQVXPLQJDVDOOZRUGVKDYH
PRUHVSDFHLQWKHGDWDEDVHDQGWKHH[HFXWLRQWLPHLV
ELJJHUFRPSDULQJWRGDWDEDVHGHVLJQVZLWKRXWDVHSD
UDWHWDEOH IRU OHWWHUVVWRUDJH7KHUHIRUHWKLV GDWDEDVH
GHVLJQVKRXOGEHXVHGMXVWIRUVSHFL¿FSUREOHPVROYLQJ
WRHQVXUHJRRGV\VWHPSHUIRUPDQFH
)LJ&RPSDULVRQRIH[HFXWLRQWLPHLQSURSRVHGGDWD
EDVHGHVLJQV
5HIHUHQFHV
EDODQFHGUHVXOWLVSURYLGHGE\WKHWKLUGW\SHEHFDXVHRI
TXLWHH[DFWTXHULHVWKDWGRQRWUHTXLUHWRRPXFKWLPHWR
SHUIRUP
1R UHODWLRQVKLS EHWZHHQ TXHU\ H[HFXWLRQ WLPH
DQG QXPEHU RI UHWXUQHG UHVXOWV ZDV QRWLFHG 7KH TXHU\
H[HFXWLRQ WLPH LV PRUH GHSHQGHQW RQ WKH QXPEHU RI
UHFRUGVZKLFKPXVWEHH[DPLQHG7KHUHIRUHDQHIIHFWLYH
ZD\ WR UHGXFH WKH ZRUG VHDUFK H[HFXWLRQ WLPH LV ZRUG
OHQJWKOLPLWDWLRQZKLFKUHGXFHVWKHQXPEHURIH[DPLQHG
UHFRUGVLQWKHGDWDEDVHDVZHOODVTXHU\H[HFXWLRQWLPH
&RQFOXVLRQV
1. 7KHVWULQJVHDUFKDOJRULWKPFDQYDU\LQLWVFRPSOH[LW\
DQGUHTXLUHWH[WDQDO\VLVZKLOH64/EDVHGUDWLRQDOGD
WDEDVHDOORZVIRUDZRUGVHDUFKDFFRUGLQJWRDNQRZQ
SDWWHUQRIVHWRIOHWWHUVPRUHHDVLO\
2. 7RGHVLJQFHUWDLQIXQFWLRQDOLW\IRUZRUGVHDUFKDOJR
ULWKPVOLPLWDWLRQVFDQEHXVHGGHSHQGLQJRQGDWDEDVH
VWUXFWXUH7KHUHIRUHWKHGHVLJQRIGDWDEDVHVFKHPDLV
YHU\LPSRUWDQWWRHQVXUHDOOWKHIXQFWLRQDOLW\DQGSHU
IRUPDQFHRIWKHV\VWHP
1. 5 5LYHVW 2Q WKH ZRUVWFDVH EHKDYLRU RI VWULQJ
VHDUFKLQJDOJRULWKPV6,$0-RQ&RPSXWLQJ
5. 5 %DH]D<DWHV ,PSURYHG VWULQJ VHDUFKLQJ
6RIWZDUH3UDFWLFHDQG([SHULHQFH
6. '(.QXWK-0RUULVDQG93UDWW)DVWSDWWHUQPD
WFKLQJLQVWULQJV6,$0-RQ&RPSXWLQJ
7. 5%R\HUDQG60RRUH$IDVWVWULQJVHDUFKLQJ
DOJRULWKP&$&0
8. 5LFDUGR$%DH]D<DWHV6WULQJ6HDUFKLQJ$OJR
ULWKPV5HYLVLWHG3URFHHGLQJVRIWKH:RUNVKRSRQ$O
JRULWKPVDQG'DWD6WUXFWXUHVS$XJXVW
9. -HIIUH\'8OOPDQKWWSLQIRODEVWDQIRUGHGXaXOOPDQ
IRFVFKSGI!
10. 2NXQLV50DNDUHYLþLXV03RSXOLDULDXVLRVGXRPHQǐ
ED]LǐYDOG\PRVLVWHPRV
11. 3DOLXOLV(%DURQLHQơ5'XRPHQǐED]LǐYDOG\
PR VLVWHPǐ DQDOL]ơ -DXQǐMǐ PRNVOLQLQNǐ GDUEDL 1U
3²
12. $Q LQWURGXFWLRQ WR WKH 64/ SURFHGXUH KWWSZZZ
DWVXFODHGXVWDWVDVOLEUDU\QHVXJEWSGI!
13. 64/±/,.(&ODXVHKWWSZZZWXWRULDOVSRLQWFRP
VTOSGIVTOOLNHFODXVHSGI!
5(6($5&+2):25'6($5&+$/*25,7+06%$6('215(/$7,21$/'$7$%$6(
2OHNVLM9RONRY6LPRQD5DPDQDXVNDLWơ
6XPPDU\
:RUGJDPHVDUHDVLPSOHDQGIXQZD\WRVSHQGWLPH,WKHOSVWRLPSURYHDSHUVRQ¶VYRFDEXODU\H[SDQGHUXGLWLRQWUDLQ
PHPRU\DQGLQWHOOLJHQFHDQGGHYHORSORJLFDQGDVVRFLDWLYHWKLQNLQJ7KHUHH[LVWGLIIHUHQWW\SHVRIZRUGJDPHVDQGGLIIHUHQW
W\SHVRIZRUGJDPHVUHTXLUHDGLIIHUHQWJDPHORJLFDQGGLIIHUHQWZRUG¿QGLQJDOJRULWKPV7KHRSWLPL]DWLRQRIZRUGVHDUFK
DOJRULWKPVLVUHTXLUHGWRGHVLJQDIXOO\IXQFWLRQLQJDQGHI¿FLHQWV\VWHP7KHDLPRIWKLVZRUNLVWRUHVHDUFKWKHHI¿FLHQF\RI
GLIIHUHQWNLQGVRIZRUGVHDUFKDOJRULWKPVXVLQJ64/EDVHGUHODWLRQDOGDWDEDVH
,QWKLVZRUNFODVVLFVWULQJVHDUFKDOJRULWKPVDUHDQDO\]HGDQGDGLIIHUHQWDUFKLWHFWXUHRIUHODWLRQDOGDWDEDVHVWUXFWXUHZDV
SURSRVHGWRGHVLJQDIXQFWLRQDODQGHI¿FLHQWZRUGVHDUFKV\VWHP$QHI¿FLHQF\DQDO\VLVRISURSRVHGGDWDEDVHGHVLJQVZDVDOVR
DQDO\]HGWRREWDLQPHWULFVWRGH¿QHZKLFKDUFKLWHFWXUHZRXOGEHWKHPRVWVXLWDEOHIRUWKGHVLJQRIZRUGVHDUFKV\VWHP
.H\ZRUGV64/ZRUGVHDUFKGDWDEDVH
142
7(&+12/2*,-2602.6/$,,1)250$7,.$
5(/,$&,1Ơ6'820(1Ǐ%$=Ơ66758.7Nj5$3$5(07Ǐä2'ä,Ǐ3$,(â.26$/*25,70Ǐ7<5,0$6
2OHNVLM9RONRY6LPRQD5DPDQDXVNDLWơ
6DQWUDXND
äDLGLPDLåRGåLDLV\UDSDSUDVWDVLUOLQNVPDVODLNRSUDOHLGLPREnjGDVNXULVSDGHGDDVPHQLPVSOơVWLVDYRåRG\QąJHULQWL
HUXGLFLMąODYLQWLDWPLQWƳLUPąVW\PąY\VW\WLORJLQƳPąVW\PąâLXRPHWXHJ]LVWXRMDGDXJVNLUWLQJǐåDLGLPǐåRGåLDLVNXULHUHLND
ODXMDLUVNLUWLQJRåDLGLPRDOJRULWPRWLQNDPRåRGåLRUDGLPRDOJRULWPR7RGơONXULDQWLQIRUPDFLQHVVLVWHPDVSDGHGDQþLDVVXUDVWL
LHãNRPąåRGƳSDJDOåLQRPXVNULWHULMXV\UDODEDLVYDUEXWLQNDPDLSDULQNWLDURSWLPL]XRWLåRGåLǐSDLHãNRVDOJRULWPąâLRGDUER
WLNVODV±LãWLUWLåRGåLǐSDLHãNRVDOJRULWPǐQDXGRMDQþLǐ64/SDUHPWDVUHOLDFLQHVGXRPHQǐED]HVQDãXPą
'DUEH DSåYHOJLDPL NODVLNLQLDL WHNVWR SDLHãNRV DOJRULWPDL LU DQDOL]XRMDPRV VNLUWLQJRV UHOLDFLQLǐ GXRPHQǐ ED]Lǐ DUFKL
WHNWnjURVOHLGåLDQþLRVDSUDã\WLWXULPąåRGåLǐåRG\QąLUDWOLNWLåRGåLǐDWUDQNąQDXGRMDQWVNLUWLQJRWLSRSDLHãNą'DUEHWLULDPDV
SDVLnjO\WǐGXRPHQǐED]ơVVFKHPǐQDãXPDVVLHNLDQWƳYHUWLQWLWLQNDPLDXVLąGXRPHQǐED]ơVDUFKLWHNWnjUąåRGåLǐSDLHãNRVVLVWHPDL
NXULRMHJDOLEnjWLY\NGRPLVNLUWLQJRWLSRåRGåLǐSDLHãNRVDOJRULWPDLUHDOL]XRWL
3UDVPLQLDLåRGåLDL64/åRGåLǐSDLHãNDGXRPHQǐED]ơ
ƲWHLNWD
143