IBM `s Statistical Question Answering System Abraham Ittycheriah

"!#%$&'()*,+-.
0/
1243658795;:<>==@?BA674CD3FEG587H4IJ583F=FELKNM93O5;K4P;HBQRCETSVU;ELK4W-XY7[Z.H91]\B^_5;E`=a58=FK95;b9583Oc[74E
degfhe i_jlknm4oDp H
q(j 3Ocr= j ^KsCELW;7r=6tH4u qoDvxw;y;p
z 5;2{CDE|H }~3658K4PD:NH ^@P7[Z.H 5;\4^_5;E`=O3€8]^_58=Ot j K e ET29: e A j :
aELA6795;3O\nU e IJ58:‚: j K4C
ƒ CDbB= e(j }…„‡†TCˆA‰=F3OEGA58†.„‡K4W;ELK4CDC3OETK4W{HBaZB=FWxC36tŠK4EL‹;CD3OtFET=@?;H
d ELtOA58=O5l^Œ5l?;Hru0U vxp;pxw8
:5;: : j K4ClAD58ELb e 3OZB=OW;C36t e Cˆ\BZ
Ž-…D‘’”“4•;‘
QRCn\BCˆtFA3FEL2YC,=F79Cn< i I—–r=65”=FEGt=FEGA58†˜]Z4Cˆt@=OE j K™1K9tF^_C3OETK4WJ} j 3hša0„_›‡S y t?Bt=FCD:œELK™\BC=O5;ET†Œ58K9\† j[j cž5”=
tFC‹xC3658†…C k 58:‚b4†LCDtŸ58K{\ CD3F3 j 36t e šŒ74Ct?Bt=FC:EGt¡58Kž58b9b4†TEGA58=FE j K j }¢:5 k EL:£Z9:CKr=F3 j b[?JA†G5;tOtFE`¤{AD5”=OE j KJ} j 3
¥ Z4Cˆt@=OE j KY¦”5;K9t^_C3§=@?[bYC‡b43OCD\4ELA=FE j K58K{\¡K958:‚Cˆ\ŸCKr=FET=@?]:5;3Fc[ELK4W e QRC¢\4CDtOA3OET2YC j Z43tF?[t=FCD:¨} j 3ELKB} j 3F:5”=OE j K
3OC=O3FELC‹”58†{^74EGA67ETK=O74C¤{3Ot=¢t=FCbn\BEL\-\ j AZ4:‚CKr=‡3OC=O3FELC‹”5;†4}~3 j :&5¡† j AD58†9CDK9A?BA† j b{Cˆ\BEL59Hr5;K9\‚ELK=F74CtCˆA j K9\
t=FCDbJb{CD3} j 3F:‚Cˆ\©58K©C k b95;K9tFE j K j }ª=F74C ¥ Z4C3O?n^ j 36\4t5;K9\N¤9K95;†T†L?\BEL\Jb95;tOtF5;W;C¡3OC=O3FELC‹”58†.}~3 j :«=O74C£ša„Œ›
A j †L†TCˆA‰=FE j K e Q¬C¡^EL†L†58†Gt j \BEGtOAZ9tOtŒ=F79C58K9tF^¢CD3tCD†TCˆA‰=OE j K5;†TW j 3OE`=O74:^74EGA67©\BC=OC3O:‚ETK4Cˆt_=F74C£2{Cˆt@=0tFCKr=FCDK9AC
WxET‹xCKR2 j =F7¬=F74C ¥ Z4Cˆt@=OE j KR5;K9\¬=F74C j AAZ43F3OCK{AC j }5nb9743O5xtC 2YC† j K4WxETK4WN= j =O74C,58K{t^_C3¡A†G5;tOtŸ\BCDtFEL3FCˆ\ 2[?
=O74C ¥ Z9CDt=FE j K e aCˆtZ4†T=OtŒ58=¢=O74C m;w8v 2[?x=OC5;K9\ w;v 2[?r=FC†TCD‹;CD†Lt¢} j 3_=O74C j ‹xC3658†L†{tF?Bt@=OC:5;t_^_C†L†5;t_3FCˆtZ9†`=6t j K
Cˆ5;A67tZ42§A j :‚b j K4CKr=583OCŸb43FCˆtCDKr=FCD\ e
­
®¢¯°x±[²%³
´µ²°[¶§·9¸¹±4¸@º‡»
–[?Bt=FC:t0=F7958=]bYC3F} j 3O: ¥ Z4Cˆt@=OE j K 58K{t^_C3OETK9W,58ZB= j :5”=FS
EGA58†L†L?-2[?nA j :‚b4ZB=OC3795l‹xCŸ2{CDCKJ583 j Z9K9\,} j 30t j :‚CŸ=FEL:‚C
5;t\BCˆtFA3FEL2{Cˆ\©2[?½¼|¾3OCCK C=¡58† e H oDyx¿;ÀxÁeŸf K4†L?3FCˆACDKx=O†T?
=F7 j Z4Wx7795l‹;CtF?Bt@=OC:tª2YCCKn\BC‹xC† j bYCD\ = j 7958K9\4†TC7[Z4WxC
\458=O582{5;tFCDt(5;K9\,5tF†TELW;7r=O†T? 3FEGA674CD3‡tC= j } ¥ Z9CDt=FE j K9t e šŒ79C
=@?[b{Cˆt j } ¥ Z4Cˆt@=OE j K9tŒ=O795”=]AD58K©2YC£\BCˆ58†T=0^E`=O7©= j \45l?N583OC
3OCDt=F3OELA=FCD\]= j 2{C¢t7 j 3=…58K9tF^¢CD3§}Â5;A=295;tFCD\ ¥ Z4Cˆt@=OE j K9t e <VK
ša„Œ›‡S p H{5K[Z4:h2{CD3 j }‡tFET=FCDt0b9583F=FEGAELb958=FCD\ELK©=O74C¤936t=
¥ Z4CDt=FE j K4S>5;K9t^_C3OELK4W©C‹”58†LZ958=FE j K¼Âà jrj 3F79CCDt 58K{\™šŒEGAC;H
oDyxy;yrÁ 5;K9\]=F74C‡2{Cˆt@=t?Bt=FC:tEG\BCDKx=OE`¤{CD\} j Z93.:5” j 3.tFZ42BS
A j :‚b j K4CKr=OtDÄ
5”=0=F74C \45”=658295xtC j }‡\ j AZ4:‚CKr=6t058K{\ j ZB=Ob4ZB=Ot0=F79C£2YCDt=
\ j AZ9: CDKr=Ot j 3 b{5;tOtF5;W;CDt‚5;K4K j =65”=OCD\È^E`=O7È=O74C©K95;: Cˆ\
CKr=OE`=OETCˆt e šŒ74C-¤{K958†t=O58WxCnEGth= j tFC†LCDA‰= =F79CNC k 5;A‰=58K4S
tF^¢CD3DHWxET‹xCKJ=O74CELKB} j 3O:5”=FE j KR582 j ZB=Ÿ=O74C58K9tF^¢CD3¡A†G5;tOt
58K{\™=O74C= j bµtFA j 3OETK4WRb95xtFtO58WxCDt e IJETK4EL:‚ETPDETK9W½‹l5;3FE j Z{t
\BEGt@=658K9AC]:‚C=F3OELADt_5;b4b4†LETCˆ\ j ‹xC3_b474365;tFCDt j 3_^ETK{\ j ^t j }
=FC k =,3FCˆtZ4†T=Ot‚ELKÇ=F74C©2YCDt=ntOA j 3FELK4WžtCˆA‰=FE j KÈ=F7{5”=,795xt5
b474365;tFC 2{CD† j K4W;ELK4WN= j 58K{t^_C3ŸA†G5;tOt e šŒ74EGt=F74CDK¬3OCb93FCS
tFCKr=Ot_=O74C¡2{Cˆt@=0tOA j 3FELK4W‚58K9tF^_C3 e
Å ˜]Z4Cˆt@=OE j KY¦”10K9tF^¢CD3Œš¢?[b{C£›¢†G5;tOtET¤{AD5”=FE j K
Å ˜]Z4CD3F?-C k b958K{tE j KY¦”<VKB} j 3O:5”=OE j K-aC=O3FELC‹”5;†
question
Answer
Type Prediction
Information
Retrieval
Query
expansion
Å u]58:‚CD\„(Kr=OE`=@?-I 583OcrELK4W
Å 10K9t^_C30–BC†LCDA‰=OE j K
Answer
Selection
Ranked
Answers
TREC
f 4Z 3ntF?Bt@=OC:Æ5836A674ET=FCDA=FZ43OC©} j 3,=F79ELtN?;Cˆ583,^Œ5;t-24Z4EL†`=
583 j Z9K9\Ç=F74CˆtC } j Z43n:5” j 3nA j :‚b j K4CDKr=OtN5;t-tF7 j ^KµELK
M…ETW e%oxe sCD3FCxH9=O74C ¥ Z4Cˆt@=OE j K©ELt]ELK4b4ZB=Ÿ58K9\JA†L5xtFtFET¤9CD\©5xt
5;tFc[ETK9WJ} j 3‚58KÇ58K9tF^_C3 ^7 j tFCnAD5”=FCDW j 3F?RELt j K4C j }=F79C
K95;: Cˆ\RCKr=FET=@?¬A†L5xtFtFCDt= j 2{C-\4CDtOA3OET2YCD\R2YC† j ^ e 10\9\BE`S
=FE j K{58†L†T?xH”=F74C ¥ Z4Cˆt@=OE j KhEGt…b43FCˆtCDKr=FCD\£= j =F79CETKB} j 3F:58=FE j K
3OC=F3OELC‹”58†(¼Â<@a Á CK9W;ELK4C} j 3 ¥ Z4CD3F?,C k b958K9tFE j K58K9\N\ j AZBS
:‚CKr=3OC=F3OELC‹”58† e šŒ79ELtŸCDK4W;ELK4C;HW;EL‹;CK¬=F79C ¥ Z4CD3F?xH.† jrj cBt
DOC
Database
Raw
Named
Text
Entity
Marked
Text
o
M…ELW;Z43OC o ć˜]Z4CDt=FE j K1K{t^_C3OETK9W‚103OA679E`=OCDA‰=OZ43OC
IJ5 k EL:£Z4: CDKx=O3 j b[?Æ: j \BCD†T†LELK4WÉEGtÊ\BCDtOA3OEL2{Cˆ\ËELK
¼ ƒ C†L†G5 d ELC=O3O5ÌC=Ç5;† e H oDyxyxwBÍRi C3OW;C3™C=Ç5;† e H oDyxy;¿xÁe
I©C=F7 j \4t j }‡}~CD5”=OZ43OChtFC†LCDA‰=OE j K EGt}~Z93=O74C3¡\BCˆtFA3FEL2{Cˆ\JELK
¼ i CD3FWxC3Ÿ58K9\ d 3OETKr=FPxH oDyxy;pxÁe Q¬C‚^EL†T†K j =\BELtOAZ{tFt]=F79C
:5”=O74C:5”=OELAD58†…\BC=658EL†Lt j }=F79Ch58†LW j 3FET=F79:«74CD3FCxH9ELK9t=FCD5x\
^_C]^EL†T† j K4†L?,t7 j ^Î=O74C}~CD58=FZ43OCDt¢=F7{5”=583OC0Z9tFCD\nELKntFZ9A67
5 : j \4C† e
Q¬CÏ^ET†L†RK j ^Ð\BCDtOA3OET2YCÑCˆ5;A67ÒtFZ42BSVA j : b j K9CKr=ÓELK
W;3OCD58=FCD3Œ\4C=O5;ET† e
Ô
45
base
ngr−only
pos
expcat
expcat−markqw
40
35
accuracy
30
25
20
Õµ»0°xÖR²·Ç×N¯¹¡²ÙØRÚ@Ûª°[°[¸Vܟ¶§Û%±4¸º‡»
15
<VKµ58K9tF^_C3 =@?[b{CJA†L5xtFtFE`¤YA5”=OE j K=O74C©b43 j 24†LC:ÉELt = j †L58S
2YC†05 ¥ Z4Cˆt@=OE j KÈ^ET=F7Ç=F79CJ†L5;2{CD† j }=F74C©K{58:‚CD\ÇCKr=OE`=@?
=F7{5”=(=O74C ¥ Z4Cˆt@=OE j K‚tFCCDcBt e(f Z43‡†G582YC†Gt‡5;3FCŒ=O74C0t=O5;K9\45836\
IJŠŸ›Ý¼Þ›¢79ETK9A67 j 3ˆH oˆy;y[ß8Á AD5”=OCW j 3FELCDt¢^ET=F7n=F74C¡5;\9\BE`=OE j K
j } d s0a01]–B„Ó^74EGA67 EGt5nA58=OA67¬5;†T†%} j 3¡5;K9t^_C36tK j = j }
=F79C]t=O58K{\45836\A58=FCW j 3OETCˆt e <VK-5;\4\4E`=OE j K,^¢C0795;\5a0„‡1S
– f uÒAD5”=OCW j 3F?™^74ELA67µ^Œ5;t=FELCD\Ç= j Qàs q ¥ Z4Cˆt@=OE j K9t e
d 3 j ACˆtFtFETK9W j }0a„‡1– f u5;K9\ d s]a1]–4„ÝELt£=F79CntO58:‚C
ELK j Z43Nt?Bt=FC:HELKr=FC3Ob43OC=OETK4W½ET=N5xt-\BCˆtEL3OETK4W5™A†G58Z9tFC
^74EGA67795;\N5 K j Z4Kb4793O5xtCC:h2{Cˆ\4\BCD\NELKE`= e
1á:‚5 k ET:hZ4:ËCDKx=O3 j b[?µ: j \BCD† j } =F79C½b43 j ACDtOt^_5xt
=F3658ELK4Cˆ\ j KR5A j 3Fb9Z9t j } ¥ Z9CDt=FE j K9t=O795”=795xtŸ2{CDCK½58K4S
K j Kx=65”=OCD\©^ET=F7¬=F74C‚582 j ‹;C£: CDKr=FE j K4Cˆ\ A58=FCDW j 3OELCDt e QRC
A3OCD58=FCˆ\ oDy;vxv ¥ Z4CDt=FE j K9t02[?Nb93FCˆtCDKx=OETK9W-5,7[Z4:58KJtFZ42BS
@CDA=‡5¡\ j AZ4:‚CDKx=‡tFC†LCDA=FCˆ\ 58=(3O5;K9\ j :Ì58K9\ 795l‹[ELK4WŸ3FCˆ5;\
5‚b j 3F=FE j K j }…=F74C\ j AZ4:‚CKr=DHY5 ¥ Z4CDt=FE j K^Œ5;tŒb474365;tFCD\.H
=F79CŒ5;K9tF^¢CD35;K9\£\ j AZ4:‚CKr=ªK[Z4:£2YC3ªK j =FCˆ\£ELK 5x\4\BET=FE j K e
QRC£58†Gt j Z{tCˆ\ oxvxv ¥ Z9CDt=FE j K9t}~3 j :«5‚=O3FEL‹[EL5\458=O5;295;tFC
¼Âs]58†L†T:5;3FcBtDH oDy;yxyxÁ 58K4K j =O58=FCˆ\-ELK©5 tFEL: EL†G583:58K4K9C3 e
<VKµ=F74C¬C k bYC3OET:‚CKr=6t,^_CJZ9tFCD\Î=O74CJ} j †T† j ^ETK9Wž=@?rbYCDt
j }h}~CD58=FZ43OCDt©tF7 j ^KELKâš%5;24†TC m4e „¢5;A67à}~Cˆ5”=OZ43FCR=@?[bYC
C k b95;K9\4t j K™=O74C}~CD58=FZ43OCJ582 j ‹;CNE`= e šŒ74CÎãF„ k b958K9\4CD\
sELC365836A67[?Bä-}~Cˆ5”=OZ43FCnZ9tFCDtQ j 36\4u0C=N¼|I©EL†T†LC3ˆH oDy;yxvxÁ = j
C k b95;K9\Î^ j 36\4t‚}~3 j :Æ5 ¥ Z4CDt=FE j Kµ^ j 36\ÇZ4bB= j 58K{\ÎETKBS
A†LZ9\BELK4W‚=O74C¡¤936t@=K j Z4K©A†LZ9t=FCD3 e šŒ79C©ãFIJ5;3FcN˜]Z9CDt=FE j K
Q j 36\4ä‚}~CD58=FZ43OCEG\BCKr=OE`¤9Cˆt=O74C ¥ Z4Cˆt@=OE j K©^ j 3O\9t58K9\J†L58S
2YC†Gt(=O74C:&5;t j ADAZ43OELK4WELK‚=F74C]2{CDW;ELK4K4ELK4W j }.5 ¥ Z4Cˆt@=OE j K
¼~2 ¥ ^ Á H§ELK=F74Ch: EG\4\B†LCn¼Â: ¥ ^ Áj }(5 ¥ Z4Cˆt@=OE j K j 3058=0=F79C
CK{\ j }…5 ¥ Z4Cˆt@=OE j KR¼ÂC ¥ ^ Á‰e
šŒ74C}~CD58=FZ43OCDt j }§=F74C:5 k EL:£Z9:ÑCKr=O3 j br?£: j \BCD†9^_C3OC
KBS>W;3658:t j }%^ j 36\4tŸ¼~3OC ¥ Z4EL3OCD\-= j 2{C¡5x\l5;ACKr= Á 58K{\-295;W
j }ª^ j 36\4t^74CD3FC¡b j tFET=FE j K©EGtK j =0ET:‚b j 3F=O5;Kx= e šŒ79Cb{CD3S
} j 3O:58K9AC j }ª=O74Ch5;†TW j 3OE`=O74:åEGt0tF7 j ^K©ELKJM%ELW e§mBe „¢5;A67
}~CD58=FZ43OC=@?[bYCÈ5x\4\4t = j =O74CÎ5;AAZ4365;A? j },=O74CÈtF?Bt@=OC:
58K{\£A67 j[j tFELK4W ߔvxv }~Cˆ5”=FZ93FCˆt…5xA674ELC‹;Cˆt=O74C¢2YCDt=(5;ADAZ4365;A?
¼ y9e vrwxæ Á¢j K5‚74C†G\ j ZB=0tFZ429tFC= j }=F79C\45”=65 e
1ÑbYCDAZ4†TEG583}~Cˆ5”=FZ93FC j }(=O74C 5;3OA679E`=OCDA‰=OZ43OC£EGt0=O795”=ŸEL:hS
b43 j ‹;CD: CDKr=OtELK 58K{t^_C3=@?[bYC£b43OCD\4ELA=FE j KJ\ j K j =A j 3O3FCS
†G5”=FC\4ET3OCDA=F†L?-^ET=F7©EL: b93 j ‹xC:‚CKr=OtŒELK=F79C j ‹;C3658†L†tFA j 3OC
j }ª=O74C‚t?Bt=FC: e šŒ74C£3OCD5xt j KNEGt0=F7958=b95;3O5;†T†LC†%ET:‚b43 j ‹;CS
:‚CKr=Ot£:£Z9t=£2YC,:5;\BC-ETKž=O74C,K95;: Cˆ\žCKr=FET=@? :5;3Fc[ELK4W
5;t]^_C†L†5xtŸ58K9tF^¢CD3tFC†LCDA=FE j KJELK j 36\BC30= j 3FCˆ58†LETPDC£=O74C:
ELKn=O74C j ‹;CD3O5;†T†§tF?[t=FCD: e
10
5
0
100
200
300
400
500
number of features
600
700
800
900
M…ELW;Z43OC m Ä(10K9t^_C3š¢?[b{C d 3FCˆ\BELA=FE j K d C3F} j 3O:58K9AC
ç
èx»é6º(·{³Ùۅ±4¸@º¢»åêβ±B·9¸²ë…ÛªÚ
m
šŒ74C‚b4Z43Ob j tFC j }‡=F79CETKB} j 3F:58=FE j K 3OC=O3FELC‹”5;†…: j \BZ4†LC‚ELt
= j tFCD5836A67Î=F79Cž\95”=O5;295;tFCJ= j tFC†LCDA=Nb{5;tOtF5;W;CDt j }=OC k =DH
A j Kr=O58ELK4ELK4W‚ETK4} j 3O:‚58=FE j KN3FCD†TCD‹”58Kr=¢= j =F74C ¥ Z4CD3F? e
f Z43£ELKB} j 3O:5”=OE j K½3FC=F3OETCD‹l5;†¢tFZ429tF?Bt@=OC:œZ9tCˆth5©=@^ j S
b95xtFtN58b4b93 j 5;A67 e <VK=O74C¬¤93Ot=b95;tOtH0^¢CžtCˆ5836A674CD\µ5;K
CK{A?BA† j bYCD\BEG5à\458=O5;295;tFC e šŒ74CÈ74ELW;74Cˆt@=žtFA j 3OETK4Wµb{5;tS
tO58W;Cˆt-^_C3OC¬=F74CDKÓZ9tFCD\= j A3FCˆ5”=FC¬C k b95;K9\BCD\ ¥ Z4C3OELCDtDH
58b9b4†TELCD\ ELK‚=F74C]tCˆA j K{\hb{5;tOt(tFA j 3OETK9W j }{=O74C0ša„Œ›½b{5;tS
tO58W;Cˆt e Q¬CZ9tFCD\Ç\45”=65 b93FCSÞb43 j ACˆtFtFETK9W 58K9\È3OC†LC‹”58K9AC
tOA j 3OELK4W£=OCDA674K9E ¥ Z4CˆttEL:‚ET†G583Œ= j =F74C j K4CDtŒ^_C58b9b4†TELCD\NELK
j Z93hša„Œ›Ñ1]\[SVs j A8H(– ƒ a58K{\ț_ì.<@a&b95;3=OELAETb{5”=FE j K{t
¼ÂM93O5;K4P¡58K9\a j Z4c j tH oˆy;y;prÁ H¼ÂM93O5;K4PŸC=05;† e H oDyxy;yrÁ‰e
aC†LC‹”58K{ACtFA j 3OETK4WR^Œ5;th295;tFCD\ j KÇ: j 3Fb97™Z4K4ELW;3658:
58K{\½24ELW;3658:œ}~CD58=FZ43OCDtDHC k =F365;A=FCD\½}~3 j :í=O74Cn=FC k =\45”=65
Z9tFETK9Wh5£\4CDAEGtFE j K=F3OCC295;tFCD\= j cxCK4ELPCD3DHrb95;3=FS j }îS>tFb{CDCDA67
=O5;W;WxC3J¼ÂIJC3OEL5;†L\ j H oˆy;yxvxÁ 58K9\µ5ž: j 3Fb47 j † j W;EGA5;†58K958S
†L?rPDC3 e
<VKÎ=F74C©¤{3Ot=,b95;tOtDH_^_C©Z9tFCD\µ5ž: j \BET¤{A58=FE j K j }Ÿ=F79C
f c”58b4E} j 3O:£Z4†G5µ¼Âa j 2{CD3=6t j KÎC=n5;† e H oDy;yrw;Á H¢\BCˆtFA3FEL2{Cˆ\
ELKÓ¼ÂM93O5;K4PNC=,58† e H oDy;yxyxÁ = j tOA j 3FCnb95;tOtO58W;CˆtC k =O3O5xA‰=OCD\
}~3 j :—=O74C½CK{A?BA† j bYCD\BEG5Î\ j AZ4:‚CDKx=6t e Q¬C™A j K[‹;CD3=OCD\
=F79C¢CDK9A?BA† j bYCD\4EL5]583F=FEGA†LCDt%ETKr= jŸpxmxmxßxߢj ‹;C3O†G58b4b4ELK4Wb{5;tS
tO58W;CˆtH…CD5xA67½A j Kr=658ELK4ETK9WJ58b4b43 jlk ET:58=FC†L? oˆv;v K j KBSVt@= j b
^ j 36\4t ei 5;tFCD\ j K©=F74Ch¤936t@=b95;tOt]b95;tOtF5;W;C¡3658K4c[ELK4W9HY^_C
A j K9t=F3OZ9A‰=OCD\ÇC k b95;K9\BCD\ ¥ Z4CD3FELCDt,Z9tELK4Wž=O74C † j A58†]A j K4S
=FC k =ª5;K958†L?BtEGt‡¼|셛_1 Á =OCDA674K9E ¥ Z4CŸ¼~ï]Z 5;K9\ ›¢3 j }î=ˆH oDyxy;¿xÁ H
: j \BE`¤{CD\N5;tŒ\BCDtOA3OEL2{Cˆ\-ELKR¼|M43658K4PC=5;† e H oDyxy;yxÁe <VKn=F79C
tFCDA j K9\Ÿb95xtFt…tFA j 3OETK9W9Hˆ^¢C¢Z9tCˆ\Ÿ=F79C‡C k b95;K9\BCˆ\ ¥ Z4C3OETCˆt= j
tOA j 3OC m8¿;Àrm8pxvrß b95xtFtO58WxCDt_295xtCˆ\ j K-=O74Cša„_›‡S y ˜ð¡1
A j 3Fb9Z9t e šŒ74C]b95;tOtF5;W;Cˆt^¢CD3FC0tFC†LCDA=FCˆ\ = j A j Kr=O5;ETK9CD\58b4S
b43 jlk ET:5”=OC†L? m8vxv K j KBSVt@= j bN^ j 3O\4t e
š%5;24†TC m tFZ4:‚:583OETPDCDt]=F74CELKB} j 3F:5”=OE j K¬3OC=O3FELC‹”5;†ª3FCS
tFZ4†`=6t j KJ=O74C oDx¿ \BCD‹;CD† j b4:‚CKr=0=OCDt=ŸtFC= ¥ Z9CDt=FE j K9t\BCS
tOA3OET2YCD\-2{CD† j ^ e šŒ74CŸbYC3F} j 3O:‚5;K9AC]ELtŒ:‚Cˆ5;tFZ43FCˆ\2[?=F79C
ŠK4ELW;3658:t
I j 3Ob474Cˆ\H d 583F=S f }îSV–[bYCCˆA67
i ETWx3O5;:‚t
„ k b95;K9\BCD\NsELC365836A67[?
IJ583Ocn˜]Z4Cˆt@=OE j KnQ j 36\
Qµ7{5”=?;Cˆ583\BEG\NQ j 3F†G\-Qž583<F<_t=O5;3=‰ñ
^7{5”= z Q d €
?xCD5;3 z u0u¡€
\ j z à iŒƒ €
Q j 3F†G\ z u d €
z
z
z
Qž583 u d €<< u d €t=O583F= u0u€
^7{5”= z ^b€½^795”= z ^b€ ?;CD5;3 z K4K€R^795”= z ^b€ \ j z ‹[2§\§€
^7{5”= z ^b€ ^ j 3O†L\ z K4b€ eTeLe
^7{5”= z Q d €¨?;CD5;3Ç=FEL: C b{CD3FE j \å:‚Cˆ5;tFZ43FCâ582{t@=O3O5xA‰=FE j K
?xCD5;3 z u0u¡€Ÿ\ j z à iŒƒ € eLeLe
^7{5”= 2 ¥ ^ò?xCD583Ï=OET:‚C b{CD3FE j \ó:‚CD5xtZ93FC582{t@=O3O5xA‰=FE j K
?xCD5;3 z u0u¡€Ÿ\ j z à iŒƒ € eLeLe
š…5824†LC o Ä(M4Cˆ5”=OZ43FCˆtŒZ9tFCD\nETKN=F79C58K9tF^¢CD3A†G5;tOtET¤{A58=FE j KnC k b{CD3FEL:‚CKr=Ot
b95;tOt o HBša„_›
b95;tOt m BH ša„_›
b95;tOt m [H CK9A?BA† j bYCD\BEG5
IJaa
v4e x¿xvxw
v4e xprm”
v4eôw8vxÀ4o
š…5824†LC m Ä(aC=F3OETCD‹”58†3OCDtFZ4†`=6t e
Q j 36\4t
I j 3Fb47{t
d 583F=S j }îS@–[bYCCˆA67
¾3658:‚:583M…†L5;Wxt
d 3OC‹[E j Z9tŒš…58Wrt
š…5824†LC À Ä M4Cˆ5”=FZ93FCˆt¡Z9tFCD\žELK½=F74C-K958:‚CD\žCDKr=FET=@?¬: j \BC†
} j 3b93FCˆ\BELA=FELK4W =O5;W{¼ vrÁ‰e
I©Cˆ58KaCDAETb43 j A5;†.a58K4c¬¼ÂIJaa Á ¼~à j[j 3O74CCˆt58K9\NšŒEGAC;H
oDyxy;yrÁ(j }%=O74C74ELW;74Cˆt@=3658K9crELK4W‚b95xtFtO58WxCA j Kr=O5;ETK4ELK4W =F79C
58K{t^_C3‡t=F3OELK4W58: j K9WŸ=F74C= j b‚¤9‹xCb95xtFtO58WxCDt e šŒ74C¤936t=
†LETK4C j }Y=F74C=65824†LC0tF7 j ^t…=F79C3FCˆtZ9†`= j }Y¤{3Ot=(b95;tOt(tOA j 3FELK4W
Z9tFETK9W=F74C ša„_›‡S y ˜ð¡1Ý\458=O582{5;tFC e šŒ74C£tFCDA j K9\†LETK9C
A j Kr=O58ELK9t0=F74C‚3OCDtFZ4†T= j 2B=O5;ETK4Cˆ\©^ET=F7 ¥ Z9C3OETCˆt0C k b{58K9\BCˆ\
Z9tFETK9WŸ=F74Cša„_›™\45”=658295xtC e šŒ79C†L5xt@=‡†LELK4C j }§=O74C=O5;24†LC
tF7 j ^t=O74C‡3OCDtFZ4†T=…A j 3F3OCDtFb j K9\BELK4W_= j =F74C_t?Bt=FCD:â5;b4b4†LETCˆ\
ELK j Z43 j8õ AEG58†9tFZ424:‚EGtFtFE j K.Hr^E`=O7 ¥ Z4C3OETCˆt(C k b{58K9\BCˆ\ Z9t@S
ELK4W =F74C¡CDK9A?BA† j bYCD\4EL5‚\458=O582{5;tFC e
ö
^¼~S Á ^¼~S ÁŸÿ ^¼ vxÁ¡ÿ ^¼>û Á ^¼Þû Á
:©¼~S Á :©¼îS Á¡ÿ :©¼ vrÁ¡ÿ :©¼Þû Á :©¼Þû Á
b%¼îS m;Á b¼îS oˆÁ¡ÿ b¼ vrÁÿ b¼ olÁ b¼ mxÁ
}¼~S mxÁ }¼îS oˆÁŸÿ }¼ vxÁ¡ÿ }¼ oˆÁ }¼ mxÁ
=l¼îS m;Áe =l¼îS oˆÁ =ˆ¼~S olÁŸÿ
÷Ûª³Ï²øù©»‡±4¸@±8¯åÕµ»0»0ºª±BÛ%±4¸º‡»
=F79C©: j t@=,†LELc;C†L?™b{5”=F7Ç} j 3=F74C©^7 j †LCJtCDKx=OCK9AC e šŒ79C
bYC3F} j 3O:‚5;K9AC j }=O74C©K95;: Cˆ\ÇCKr=FET=@?Ç\4C=FCˆA‰= j 3,EGt,A j : S
b95;3O5;24†TC-= j =F74CbYC3F} j 3O:58K9ACnAET=FCˆ\ELK¨¼ i_j 3F=F7[^ELA6cžC=
58† e H oDyxy;prÁ ^79CK‚=F3658ELK4ELK4W=F74C0:‚5 k ET:hZ4:ÙCDKr=F3 j b[?£58†LW j S
3OE`=O74: j K j K9†T?N58K4K j =O58=FCD\©\95”=O5 e Q¬C j :‚E`=]=F74Ch3FCˆtZ9†`=6t
74CD3FCELKJ=O74ChA j K9tFEG\BC365”=OE j K j }‡tb{5;ACxH{29ZB=K j =FC£=F7958=]ELK
=F79C5;K958†L?BtEGt j }=F74C ¥ Z9CDt=FE j K-5;K9t^_C3OELK4Wt?Bt=FCD:Ï2YC† j ^
j K9†T? £j ZB= j } ¿8 C3O3 j 3Ot‡583OC]5”=F=F3OET29ZB=FCˆ\-\BEL3FCˆA‰=O†T? = j =F79C
K95;: Cˆ\NCKr=FET=@?,:583Oc[ETK4Wh} j 3=F74C mxw8v 2r?r=OCŸtF?Bt@=OC: e
Õµ»0°xÖR²·à®Œ²Ú@²¶Y±4¸º‡»
u05;:‚CD\ÎCKr=OE`=@?Î58K4K j =O58=FE j KÎEGt-5½:583Oc[Z4b j }Ÿ=F79CJ=FC k =
^ET=F7h=F74CŒA†G5;tOt…ETKB} j 3F:58=FE j K e 10t…:‚CKr=FE j K4Cˆ\h5;2 j ‹xC;H j Z93
A†G5;tOtFCDt‚A j 3F3OCDtFb j K9\½= j =F74CJIJŠŸ›A†L5xtFtFCDt\4Z4CN= j =F79C
5l‹”58EL†L5;24EL†TET=@? j }]=O3O5;ETK4ELK4W™\95”=O5R} j 3=F79CDtFC A†G5;tOtCˆt e QRC
Z9tFCD\à=F74CR=FC k =©A j 3Ob j 3O5™5l‹l5;ET†G5829†TC }~3 j :ú=F74C½ì ƒ ›«= j
=F3658ELKn=F74C¡:5 k EL:£Z4:«CKr=F3 j b[?: j \BC† e
QµETK9\ j ^t j }_û¡¦ˆS m ^ j 3O\4tDHY: j 3Fb979tHYb95;3=FS j }îS>tFb{CDCDA67
=O5;WxtÝ5;K9\ÒüY58Wxt¨3658EGtCˆ\#2[?Òb{5”==OC3OKíWx3O5;:‚:‚5;3OtÓ} j 3
ƒ 1ªš„0H.I f u0„ q H›_10a ƒ HIJ„¢1]–BŠ]a„H d „‡a›_„‡u]šŸH
šŒ<@IJ„0H ƒ Š]a1ªšŒ< f uA†L5xtFtFCDtDHx5;† j K4WŸ^E`=O7=F79C=@^ j b93FCS
‹[E j Z9tŸ=658Wxt¡5;3FC,A3FCˆ5”=OCD\ } j 3Cˆ5;A67ž^ j 3O\ e šŒ74C,^ELK9\ j ^
} j 3]b43OCD\BEGA‰=OETK4W-=F74C£=O5;W{¼ vrÁ EGt0tF7 j ^K©ETK¬š%5;24†TC À4e „¢5;A67
t=F3OCD58:â795xt5¤ k Cˆ\‹ j AD5824Z4†G583O?Ÿ58K9\£KBSÞWx3O5;:t.}~3 j :â=O74ELt
‹ j AD5824Z4†G583O?R} j 3O:á=F74CN}~Cˆ5”=FZ93FCˆt j }0=O74C:‚5 k ET:hZ4:ýCKBS
=F3 j b[?,: j \BCD† e šŒ79CŸ=F3658ELK4ETK9W‚\95”=O5‚EGt583O3658K4WxCD\= j ETK{\BE`S
A58=FCŒ5ŸtbYCDAEL5;†[AD5”=OCW j 3F?} j 3…2YCWxETK9K4ETK9WCˆ5;A67hK958:‚CD\£CKBS
=FET=@?;H4} j 3C k 5;:‚b4†TC i CWxETK d „‡a]– f uÓ= j ¤9K9\N=O74C¡2 j Z4K9\[S
583OELCDt j }…=F74C¡K{58:‚CD\nCKr=FET=@? e
šŒ74CJt?Bt=FCD:þC k b4† j 3OCDt‚:hZ4†`=OETb9†TCJu]„&7r?[b j =O74CDtFCDt‚ELK
b95;3O5;†T†LC†58K9\ c;CDCb9t j K9†T?=O7 j tFCh^ET=F7R74ELW;7¬b43 j 295829ET†LE`=@?
58K{\Jb43 j ACCˆ\4t^ET=F7R5-2YCD5;: S>tFCD5;3OA67J5;†TW j 3OE`=O74:å= j ¤{K9\
QRC3FCˆACDET‹xCELK=F79ELt: j \BZ4†LC¡=O74C ¥ Z4CDt=FE j KHB=F74ChA†G5;tOt j }
=F79CŸ5;K9tF^¢CD3(=F7{5”=Œ=F74C ¥ Z4Cˆt@=OE j KntFCCcBt_58K9\n5£3658K9c;CD\-tC=
j }]b95;tOtF5;W;Cˆtn¼ ߔvxÁ 58K9K j =65”=FCˆ\^ET=F7È=F74CIJŠŸ› A†G5;tOtFCDt e
šŒ74C j bB=OET:58†ŒtFCKr=FCDK9AC-=F7958= 58K{t^_C36t¡=O74C ¥ Z4Cˆt@=OE j KELt
K j ^t j Z4Wx7r= e šŒ74CNša0„_›Ù†LCK4W;=F7ÈA j K9t=F3658ELKr=Ot j } m;w;v
2[?r=FC¡58K9\ w;v 2[?r=FC¡5;3FC=F79CK©58b4b9†TELCD\ j KN=F79CtCDKx=OCK9AC e
šŒ74C58†LW j 3FET=F74: Z{tCˆ\nELKN=F74EGtŒ: j \BZ4†LC¡ELt†LEGt@=OCD\N74C3OC;Ä
o;e „¢5;A67-3OC=O3FELC‹xCD\nb95;tOtO58W;CEGttb4†LET=ETKr= j tFCKr=FCDK9ACˆt e
mBe 1Î^ELK9\ j ^ÈELt} j 3F:‚Cˆ\ 5;3 j Z4K9\£CD5;A67‚tFCKr=FCDK9AC¼Â^ETKBS
\ j ^¨tELPCŸEGt À tCDKr=FCK{ACDt Á
š 74Ch} j †L† j ^ETK4WN\BEGt@=658K9ACDt583OChA j :‚b4ZB=FCˆ\Ä]I 5”=OA674S
À4e Œ
ELK4W Q j 36\4tDHþšŒ74CDtO58Z93FZ9tÉIJ5”=6A67.HþI©EGt@SVIJ58=OA67
Q j 36\4tDH ƒ ELtFb{CD3OtFE j K.H5;K9\›¢†TZ{t@=OC3¡Q j 36\4t e šŒ79CDtFC
5;3FC¡\BC¤9K4CD\N2YC† j ^ e
À
š 74C† j A58=FE j K j 3¡5829tFCK{AC j }_=F74C,\4CDtFET3OCD\¬CKr=FET=FELCDt
9e Œ
EGtK j =FCD\nELKn=O74CtOA j 3OC e
m8v9om8vxÀÑm8vxyÌmBoDvÙmBolßÌm;m8vÌmxm”Ùm;À4om;À;pÑm8rm
m”[wÝm;wxmÌm;w;ÀÌm;w8yÙm8¿8Ïm8¿;¿ÌmrߔÀÑmrß8wÝm;p;vÑm;p;¿
m8p[ßâm8y;Ùm8y[ߨÀ;v4oÓÀ;v;pÑÀ4oˆwâÀ9oDyÌÀrm;mâÀrm8yÌÀxÀ;v
À;Àx¿ÝÀ8{oÀ8rÀÝÀxw8vÑÀxw;mÌÀxwxߨÀx¿;ÀÌÀx¿8ÌÀ[ß[oÀ[ßl
Àrß8pÝÀ;prwÝÀ;yrmâÀ;y;ÀÑÀ;y;y̍9o;oµ{oˆmâ{oDÀâ[m8vݍrÀ8
rw;Àârw8Ìrw;¿ârw8p̍x¿xmݍx¿;yâBߔÀݍBߔ¿ârp;Àݍrp8
xyxvâxyrwâxy[ßâw8v8Ïw8v;¿ÙwBo;ow4olßÝw4oDpÌwxm;wÌwxm8p
w8ÀrmÝw8ÀxyÑw”r¿Ìw;w8vÙw;w8ÀÙw8¿;vÌw;¿4oÓw;¿rßâwrß8mÌwrßl
w8p9ow8pxÀÑw8pxpÌw8y8Ïw8yxwÌ¿;vxmâ¿xvxwÝ¿xv;yÝ¿9oD¿Ì¿rm8À
¿xmrߨ¿;ÀxvÌ¿;À[ߨ¿;À;pÑ¿8;Ù¿8xyÝ¿rwBo¿rw8pÝ¿x¿;vÌ¿x¿xw
¿rßBoà¿rß;mÝ¿rß8yÝ¿;pxmÌ¿;p;¿Ñ¿;y;ÀÑß8v;v$#%&%'#%)(*#%,+
„ 5;A67 j }_=F74CˆtCn\BELt=O5;K9ACˆt£5;3FC^_CELW;7r=FCˆ\H.=O74CntFCK4S
wBe ¢
=OCK9ACDtŸ3658K4cxCD\ 5;K9\ =F74C = j b w tFCKr=FCDK9AC5;3FCh=F74CDK
j ZB=Fb4Z4= e
šŒ74C\BC¤{K4E`=OE j K j }=O74C¡‹”583OE j Z9t\BEGt@=658K9ACDt5;3FC
“B‘ˆ•
{’% šŒ74CŸšM…< ƒ M™tZ4: j }.=F74CK[Z4:£2YC3
j }^ j 3O\4t¡=F7958=h:5”=6A674CD\½EG\BCDKx=OELAD58†L†T?RELK½=F74Cn: j 3FS
b479CD\tb{5;AC e ¼Þû Á
“B‘D• šŒ74C¢šM%< ƒ MNtZ4: j }[=O74C(K[Z4:£2YC3
j §} ^ j 36\4t=O795”=_:5”=OA679CD\‚Z9tFETK9W£5Ÿ=F79CDtO58Z43OZ9tª:5”=6A67
Z9tFELK4W‚Q j 3O\4u0C=0tF?[K j K[?[:t¼F¼ÂI©EL†L†TCD3DH oˆy;yxvxÁÁe ¼Þû Á
[D“%’% M tZ4: j }(=O74C‚KrZ9:hS
“B‘D• {’ % šŒ74CšM…< ƒ 2YC3 j } ¥ Z9CDt=FE j KåA j Kr=FCDKx=Ç^ j O3 \9t=O795”=µ\BEG\K j =
:5”=6A67nELKN=F74EGt5;K9t^_C3 e ¼îS Á
#%-.#%,/0#%&10#%2#3#%)4'#%)5*#(760#8(9%'#8(&(*#8(7+
#8(-.#8(7/0#(910#(:#3#(&4'#(&5*#+&60#+7%'#+,(*#+&+
#+8-;4&6,/<476&1<4762#=4,(&4>4,(&534&+&6<4,+7%>4,+,(34,+&+
4,+8-;4,+,5>4-?6>4-?%>4-(34-:+
| šŒ74CŸKrZ9:£2YC3 j }…^ j 3O\4t_ELK-=O74C¡A5;K9\BEG\45”=OC
tFCKr=FCDK9AC0=F7958= j ADAZ43_2{C=@^¢CDCK,:58=OA674ELK4W ¥ Z4Cˆt@=OE j K
^ j 36\4t e ¼~S Á
r’l
š 74C¢K[Z4:h2{CD3 j }9^ j 36\4t.ELK=O74CA5;K9\BETS
Œ
\458=FC£tFCKr=OCK9AC¡=F7958= j AAZ43O3FCˆ\N5x\l5;ACKr=F†L?NETKJ2 j =O7
=O74C ¥ Z4CDt=FE j K58K9\5;K9t^_C3AD58K9\BEG\458=FC e ¼>û Á
š…5824†LC  Ä0˜]Z4Cˆt@=OE j K©K[Z4:£2YC36t0A67 j tCDK} j 30=F74C ša„_›‡S y
\BCD‹;C† j b9: CDKr=tFC= e
…‘r’!9’…
„‡5;A67,\4ELt=O5;K9AC]795;t¢5^_CELW;7r=¢58b9b4†TELCD\-58K9\‚=O74C]A j 3O3FCS
tFb j K9\BELK4WtFELW;K‚t7 j ^Kh582 j ‹;CŒ5”==65;A674Cˆ\¡= j ET= e šŒ74CŒtFA j 3OC
} j 3ª5;K 5;K9t^_C3…EGt…=F74CtFZ4: j }4=F74C\4ELt=O5;K9ACˆt…5;K9\£=F74C_= j b
w tCDKr=FCK{ACDt5;3FC=O74CK j Z4=Fb4ZB= e
š j tCD†TCˆA‰==O74C mxw8v©j 3 w8v 2r?r=OCn58K{t^_C3£A67[Z4K9c }~3 j :
=F79CDtFCtCDKx=OCK9ACDtDHŸ=F74CÈt?Bt=FC: EL\4CKr=FET¤9CD\¨=O74C† j K4WxCDt=
:‚ELtF:5”=6A674CD\¡b9ETCˆACDt2{C=@^¢CDCK¡=O74C¢5;K9tF^¢CD358K9\¡=F74C ¥ Z9CDtS
=FE j K e <>==F74CDK 58K95;†T?[PDCD\N=F79C 5;K9t^_C3]58K9\=O74C ¥ Z4Cˆt@=OE j K
= j ¤9K9\-^74C3OC=O74CACKr=FCD3 j }=F74C:5”=6A67,^_5xt‡5;K9\Z9tFETK9W
5µtFZ42B@CDA=S>‹;CD3F2BS j 24@CDA‰=J5xtFtFZ4:‚bB=FE j K j }‚=O74CtCDKr=FCK{AC;H
ET== j[j c½=O74C ¥ Z4CDt=FE j KÎ5;t CDE`=O74C3-\4CDtFET3OETK9W =O74CJtZ92B@CDA=
j 3 j 2B@CˆA‰=0^74EGA674CD‹;C30795;\N=O74C£†LCD5xt@=:5”=6A674CDt0^E`=O7©=F79C
¥ Z4CDt=FE j K e
1K9tF^¢CD3ÙtFC†LCDA=FE j Kþ5;tÙ\ j K9Cå582 j ‹;C Z9tFCD\á: j t@=O†T?
74CDZ43FEGt=FEGA\BEGt@=658K9AC:‚C=F3OEGAtª= j tFCCDch58K,5;K9tF^¢CD3 e M4ZB=OZ43OC
^ j 3Oc]2[?Ÿ=F79C_5;ZB=F7 j 3Ot^ET†L†Bt7 j ^½7 j ^ž= j =F3OCD5”=…=F79CDtFC¢\BEGt@S
=O5;K9AC:‚C=F3OELADt(5;t…}~Cˆ5”=FZ93FCˆt(58K9\h= j \BC‹xC† j b5¡t@=65”=OELt=FEGA5;†
: j \BC†} j 358K9tF^_C3tCD†TCˆA‰=OE j K-} j 358K j bYCK©\ j :5;ETK e
"
–B?[t=FCD:
ša„Œ› y
3OCDtFZ4†`=6t
Q i
ƒ „‡Ã
C k b958K{tE j K
mxw8v 2[?x=OC
w;v 2[?r=FC
v4e rwrß
v4eôm8yxv
v4e xÀrß
v4eôm8prß
„ Ã
ƒ ‡
ša„_›
C k b958K{tE j K
v4e 9olß
v4eôm8¿;¿
š…5824†LC w ĪIJaaÓ} j 3ša„_›‡S y 58K9\-=F74CA67 j tFCK\BC‹-tFC=
´µ²ë‡²Úº(¹]³Ï²»¢±Î®Œ²±ÇÕµ»0ÛÚ@¯°r¸F°
5;\9\BCD\½CD‹;CD3F?½tFC‹;CDKr=F7 ¥ Z4Cˆt@=OE j K™tc[ELb4b4ELK4WJ=O74C j K4Cˆt£ELK
=F79Ch582 j ‹;CA†L5xtFt= j ?[ELC†G\=F79C or¿ ¥ Z4CDt=FE j K9t e 1ÑtFC= j }
58K{t^_C3_b95”=F=FCD3FK9tŒ^Œ5;tŒ\BCD‹;CD† j b{Cˆ\} j 3Œ=O74C¡tC=Z9tELK4W =F79C
@Z9\BWxC:‚CKr=6tŒ¤9†LCb93 j ‹[EG\BCD\n2[?-u<–Bš e
šŒ74CIJaaÑ} j 3=F74C‚CDKx=OET3OCt?Bt=FCD:Ê} j 3Ÿ=F79C mxw8v 2r?r=OC
tF?[t=FCD:å58K{\-=O74C w8v 2[?r=FCtF?[t=FCD:EGtt7 j ^K-ELKš…5829†TC wBe
1K95;†T?BtFELt j }.=O74CŸA j :‚b j K4CDKr=Ot_583OC0t7 j ^K,ETKNš%5;24†LC ¿4e
1KÎCD3F3 j 3‚EGt,5”=F=F3OET24Z4=FCD\È= j 5RA j :‚b j K4CDKx=ET}¡E`=,EGt‚=F79C
¤936t@=A j :‚b j K4CKr==O795”=0AD58Z9tFCD\-=F74CŸ}Â5;ET†LZ43OCŸ^ j 3Fc[ELK4Wh†LC}î=
= j 3OELW;7r=…ELK j Z43(tF?Bt@=OC:Ï5836A674E`=OCDA=FZ43OC e M%E k ETK9W]=O74EGtªC3O3 j 3
=F7 j Z4Wx7 K4CDCD\¬K j =¡A j 3F3OCDA=]=O74C£¤{K958†(5;K9t^_C3Ÿ5;tET=¡:‚5l?
ELKr‹ j cxCŸ5;KC3O3 j 3_ELKJ5tFZ429tFC ¥ Z4CKr=0tF?Bt@=OC: e 10K9t^_C3]tCS
†LCDA‰=OE j K£EGtt@=OET†L†4tCDCK£= j 2{C_=F79C_:58 j 3A58Z{tC j }9b93 j 24†TCD:t
ELK j Z43 ¥ Z4CDt=FE j K58K{t^_C3OETK9W tF?Bt@=OC: e
QRC ^Œ58Kr=OCD\= j :58ELKr=O5;ETK =F74Cša„Œ›‡S y \45”=658295xtC 5;t5
=FCˆt@=JtFC=ˆH]24Z4=ELK j 36\BC3n= j \ j t j :‚C¬b j t=S>C‹”58†LZ958=FE j K
58K{58†L?[tFEGtH[^_CA67 j tCŸ5 tZ42{tC= j }=O74C ¥ Z9CDt=FE j K9tŒ5;tŒ5 \BCS
‹;CD† j b4:‚CKr=tC=_} j 3K4C k =?;Cˆ583 e šŒ79C3OC]^_C3OC0=@^ j A†G5;tOtCˆt
j } ¥ Z4CDt=FE j K9tŒELKN=F74EGt?xCD5836t_C‹”58†LZ958=FE j K.Ä ¥ Z4CDt=FE j K{t_=F7958=
795x\ j K4†T? j K4Cb474365;tFETK9W 5;K9\ ¥ Z4Cˆt@=OE j K9t_=F7{5”=795;\n: j 3OC
=F7{58K j K4C‚b474365;tFELK4WR¼Â3FCDb474365;tFCD\ Áe QRC‚^_5;Kx=OCD\ m8v[æ«j }
¥ Z4CDt=FE j K{t j }Cˆ5;A67,A†G5;tOtªELK=F79C]\BCD‹;C† j b9: CDKr=(=FCˆt@= e šŒ79C
C k 5xA‰=]†LEGt@= j } ¥ Z4Cˆt@=OE j K9t]^¢ChZ9tCˆ\©} j 3 j Z43ša0„_›‡S y \BCS
‹;CD† j b4:‚CKr=0=OCDt=ŸtFC=Ÿ583OChtF7 j ^KJELK¬š…5824†LC {e šŒ79Ch‹”583OETS
58Kr= ¥ Z4Cˆt@=OE j K9t^_C£A67 j tCh583OC£t7 j ^KNELKJET=O5;†TEGAtDHY5;K9\^_C
› j :‚b j K4CDKr=
1K{t^_C3š¢?[b{C
<@a
u0„
1K{t^_C30–[CD†TCˆA‰=OE j K
–[?Bt=FC:
uZ4:h2{CD3 j }ª„(3O3 j 3Ot¼Â„‡3F3 j 3_365”=FC Á
m;w8v 2[?r=FC
w8v 2[?r=FC
w ¼ À4e [æ Á
ß ¼ {e p[æhÁ
oDy ¼ oˆÀræ Á
oDy ¼ oDÀræ Á
 ¼ mBegß;æ Á
w ¼ À9e BæhÁ
À;¿ ¼ m89egß;æ Á w;m ¼ ÀxwBe ¿ræ Á
¿8 ¼ xÀ9e p[æhÁ
p;À ¼ w;¿4e præ Á

š…5824†LC ¿ Ä0› j : b j K9CKr=]CD3F3 j 3365”=OC¡} j 30=F74C ša„_› y \BC‹
tFC=} j 3 xm w8v [2 ?x=OC¡t?Bt=FC:

m
˜ð¡1Ó3658K9c
o
À
w
m;y
oˆv
m
m
ˆo À
rw ß
w û
š j =O58†
o
y
m
m
m
o
ß
o
m;m
o
<@a¨3658K4c
À 
w À
o v
o v
v o
v v
m o
y w
w
m
v
w
v
o
v
o
o
¿
š j =O5;†
w û
w8À
oDÀ
¿
¿

¿8
oDx¿
m
v
x v
[ ß
o

m
˜ð¡1Ó3658K9c
o
À
w
w û
š j =O58†
o
m;v
w
¿
À
m
4m o
wrß
m
w
m
m
o
o
;o o
m;m
<@a¨3658K4c
À 
m o
o v
o o
v v
o v
 À
y w
v
v
¿
À
o
o
v
o
o
9o
[ß
o
À
š j =O5;†
w û
w
o
À4o
y
o;o
¿
¿
p;À
oDx¿
š…5824†LC ß Äa5;K4c©=F3658K{tET=FE j KR:5”=F3OE k H%<@aÏ^t£˜ð¡1H m;w;v
2[?r=FCDt
š…5824†LC p Ä©a58K9cž=F3658K9tFE`=OE j KÈ:58=F3OE k H‡<@a«^t-˜ð¡1H w;v
2[?r=FCDt
1K j =F74CD3.‹[ETCD^b j ETKr=EGt= j tCDC=F74C(C8@YCˆA‰= j }r=F74C‡tF?Bt@=OC:
K =O74C,<@a&3658K4c[ELK4W©3OCDtFZ4†`=6t e šŒ74EGtEGt£tF7 j ^Kž2{CD† j ^&ELK
j ž
M…ETWxZ43OC À4e M…ETK9\4ETK4W£=F74C m;w8v 2[?r=FCˆtª}~3 j :&5¡b95xtFtO58WxCŒ=F7958=
EGt j }=@?[b4ELAD58††LCK4W;=F7 mBe & A 2[?x=OCDt,tF7 j ^t‚t j :‚CJ\BCWx3O58S
\458=FE j K.H…24ZB=h}~Z43=O74C3¤9K9\BELK4W©=O74C w;v 2r?r=OC,58K9tF^¢CD3795xt
A j K9tFEL\BCD3O5;24†LC \BCWx3O5x\45”=OE j K e <VK¨š%5;24†TCˆt ß 58K9\ p ^_C
tF7 j ^â=F74Ch=F3658K{tET=FE j KJ:58=F3OE k } j 3]=F79Ch3658K4cn}~3 j :Ê<@aÝ= j
=F79Cž˜ð¡1ÒtF?Bt@=OC: e u j =FC©=O795”=n=F74CD3FC 5;3FC¬tELW;K4ET¤{AD58Kr=
=F3658K{tET=FE j K9t‡2{C=@^¢CDCK=O74C0<@aà3O5;K4c 5;K9\‚=O74C¡˜ð¡1à3O5;K4c§H
24ZB=-=F7958=,ETK9tFbYCDA‰=OE j K j }=F74C©¤{K958†3OCDtFZ4†T=,ETKµM…ELW;Z43OC À
tF7 j ^tŒ=F7{5”= j ‹xC3658†L†.t?Bt=FC:bYC3F} j 3O:‚5;K9AC¡EGt0tFEL: EL†G583= j
=F79ChbYC3F} j 3O:58K9AC j }(<@aÌ} j 3]=F74C m;w;v 2[?r=FC‚t?Bt=FC:5;K9\
\BCDW;365;\BCˆ\n58= w8v 2[?x=OCDt e šŒ74EGt^_C¡2{CD†TELC‹xC¡b j ETKr=Ot= j =F79C
b j tOtEL24EL†TET=@? j }ª:‚5;c[ETK4W: j 3FCEL:‚b43 j ‹;C:‚CDKx=6tŒETK¬58K9tF^¢CD3
tFC†LCDA‰=OE j Kn2[?,3OC3658K9crELK4Wh=F74C¡3OCDtFZ4†T=Ot e
=F79Cn:‚CD5;K^_C-2YC†LETCD‹;C,=O795”= :£Z9A67™: j 3FCNA5;K2{CN\ j K9C
ELK™}~ZB=OZ43OCNCD‹”58†LZ95”=OE j K9t eÎf Z43AZ43O3FCDKr= ^ j 3OcžELth= j ZB=OE`S
†LETPDC£:5 k EL:£Z4:ÊCKr=O3 j br?-}~CD58=FZ43OCDt]ETKJ=F74C 58K9tF^¢CD3]tFC†LCDAS
=FE j Khb43 j ACDtOt^79ELA67h^ET†L†[3FCDK9\BC3%=F79CŒtF?Bt@=OC:ÝA j :‚b4†TC=FCD†T?
=F3658ELK95;24†TC}~3 j :C k 58:‚b4†LCDt e
E
šŒ74C¡58Z4=F7 j 3Ot_=O7958K4cN–B58†LET:«a j Z4c j tDH A ELtF7 j 3OC d 58b4ELK4CK9E
58K{\¬š j \4\RQR5;3O\ } j 3¡:58c[ELK4WN=F74EGt¡^ j 3Oc©b j tFtFEL24†TC5;K9\
74CD†Tb4ELK4WZ9tŒ^ET=F7N=O74CEL3CK j 3O: j Z9t_C k bYC3F=FEGtC e
êβ.é6².·4²»]¶§²°
10\958: i CD3FWxC358K{\¡s0583O3O? d 3OETKr=OP eªoDyxy;p9e 1A j : b{583OELt j K
j }ªA3OE`=OC3OEL5£} j 3:5 k EL:£Z9:CKr=F3 j b[?9¦l:‚ELK4EL:£Z4:å\4ET‹xC3FS
W;CK{AC }~CD58=FZ43OCtCD†TCˆA‰=FE j K eJILKDMNPOPOPQRTS9UVWMYX[Z]\O
^_\9RTKDQ
90
80
` M)SXO8KDO8SNPOaM)S[bdcfeRTKgRNPh)ijkOZ]\MQVHRTSmlnhZpo2KDh)i&qrh)S:s
U)o:hU&OtIdKDMNPOgVPVgRTS7U H9b95;W;Cˆt y[ßu§oDv;¿ HrUxZ4K4C e
retrieved passage
250 bytes
50 bytes
10\958: ì e&i CD3FWxC3ˆH#Ã]ETK9ACKr= ƒ C†L†G5 d ELC=O3O59Hœ5;K9\
–r=FCDb474CK ƒ C†L†L5 d ETC=F365 e_oDy;yx¿4e 1¨:‚5 k ET:hZ4:CKr=O3 j br?
58b4b43 j 5xA67= j K{5”=FZ93O5;†r†G58K9W;Z95;W;C_b43 j ACDtOtELK4W e ` Mcfeo2s
Zvh)ZRM)ShiwqxRTS9U)o2RyVgZpRNgV H mxm ¼ olÁ‰e
number of queries
70
60
50
1 e§i_j 3F=F7[^EGA6cYH{U e –r=FCD3F†LETK9W9H§„ e 10W;EGA67x=OCELK.H§58K9\©a e ¾3FS
ELtF74:58K e oDy;yxp4e „ k b9† j E`=OETK4W&\BEL‹;CD3OtFCc[K j ^†LCD\BWxC
t j Z43OACDt ‹rEG5µ:5 k EL:£Z4: CDKx=O3 j b[?ÓELKÌK95;: Cˆ\ÝCKr=OE`=@?
3FCˆA j WxK4ET=FE j K e ILKDMNPOPOPQRTS9UVaMzXLZT\:O `L{ q}|Dl!~Ls ` q€5,4)
‚ R„ƒ&ZT\†…‡M)KDˆVD\MPe‰MS=ŠOKg‹nqhKU7O ` M)KpeM)KDh”e
40
30
20
10
0
1
2
3
4
position
5
u05;K9A?ț¢79ETK9A67 j 3 eàoDyxyrß[e IJZ9A‰S ß {K 58:‚CD\™CKr=FET=@?½=O5xtc
\BC¤9K9E`=OE j K eŒIdKDMNPOOPQ)RTS7U)V MYXŽj† ` sg#e
>5
M%ELW;Z93FC À Ä ƒ C‹xC† j b4:‚CKr=]–[C= d C3F} j 3O:58K9AC
B
Õµ¶F»º%ÖÈÚ@²%øHG(²³Ï²»¢±
جº‡»0¶ÚDC0°[¸@º¢»
–r=OCb474CDK ƒ CD†T†G5 d ETC=F3654HÃ0ELK9ACKr= ƒ C†L†L5 d ETC=F3654H,5;K9\
U j 74Knì%5@§C3F=@? eŒoDyxyxwBe <VK9\BZ{AELK4W }~DC 5”=OZ43OCDt j }…3O5;K9\ j :
¤9C†G\4t e ^:OPNP\9S:RNPh)ifO‘e:MKgZ ` j†s `‚ sY5&/sz%8-,- HYIJ5l? e
I e 4M 3658K4Pn58K9\– e a j Z4c j t e½oˆy;y;p9e š3OCDAS ¿ 5x\[SÞ7 j A,3FCS
=F3OETCD‹l5;† e <VK©„ e I e à j[j 3O74CDCDt58K{\ ƒhe A‚e s0583O:58K.H[Cˆ\BE`S
= j 36tDH IdKDMNPOOPQ)RTS7U)VŽMYXfZT\:O ‚ R„ƒ&ZT\’^:Oƒ&Z_fbLZKgRO8“h)i ` M)S:s
XOKDO8SNPO ”8^fb ` sD1•”e u0<–Bšµ–[bYCDAEG58† d Z424†LEGA5”=OE j K w8v;v S
m”xv9e
QRChb43OCDtFCKr=OCD\J5;2 j ‹xC j Z93]5836A674ET=FCˆA‰=FZ93FC 58K9\J5NA j :‚b j S
K4CDKx=h^ELtFC-CD‹l5;†TZ{5”=FE j K j }_=O74CntF?Bt@=OC:œETK=F74C ¥ Z4Cˆt@=OE j K
58K{t^_C3OETK9WJb43 j 24†LC: e šŒ74ELt ^Œ5;t j Z43h¤936t@=‚?;Cˆ583 j }0\BCS
‹;CD† j b4ELK4W½=F79ELttF?[t=FCD:Æ58K9\µ7{5l‹rELK4WÈb{CD3} j 3F:‚CD\µ5;2 j ‹xC
w
I e 9M 3O5;K4P;HxU e – e IJAˆ›_5;3F†LC?xH;58K9\‚– e a j Z4c j t e‡oDyxy;y9e 10\[S
7 j A58K9\ :£Z9†`=OET†LETK9W;Z95;†9ELKB} j 3O:5”=FE j K 3OC=F3OELC‹”58†458=‡ET29: e
<VK‚„ e I e à jrj 3F79CCDt5;K9\ ƒ£e A‚e s05;3F:58KH8CD\BET= j 3OtDH IdKMs
NOPOPQRTS9UVfMzX–ZT\:O ‚ O“OS?ZT\’^:Oƒ&ZfbLZKgRO8“h)i ` MSXOKDO8SNPO
”^fb ` sg#z•”e u<–Bšâ–[bYCDAEL5;† d Z429†TEGA58=FE j K w8v;v S m8rm4e
ie M e ¾3OCCDK.H;1 e A‚e Q j †T}@H[› e ›¢7 j :‚tFc[?;H;5;K9\ ì e A‚eli 5xtCS
2958†L† e oDyx¿;À9e 1K 85 ZB= j : 5”=OELA ¥ Z4CDt=FE j K&58K{t^_C3OC3 e
` M)cHe_o2ZvO8KPVnhS_Q’^_\M)o,U\2Z H{b958WxCDt m8v[ßu4mBoD¿9e
10AD5;\BCD:‚ELAÇs05;†T†L:583Oc[t e
oDyxy;y4e—A K j ^†LCD\4W;C™:5xt@=OC3 e
e
\9ZpZ˜e}™ š,š?›œ›œ›žU,KDOPhZ‘ho&ˆ&TNPMc
I C3OEL5;†L\ 9j e‡oˆy;yxv4e š…58W;WxETK9W=FC k =…^ET=F7‚50b93 j 295824EL†LELt=FEGA
ie ©
: j \BCD† e V< K IdKDMNOPOPQRTS9UV‡MYXŸZT\:OJ|D –j¡l hZpo2KDhiœqrh)S:s
U)o:hU&OŽ|&^_q H{b958WxCDt oD¿9go u§olß8m4e
¾ e ©
I EL†T†LC3 e oˆy;y;v9e Q j 3O\4K4C=ˆÄÒ1K j KBS>†TELK4C†LC k EGA5;†
\45”=658295xtC e |gS?ZvO8KgSh)ZRM)Shi£¢2M)o2KgShiMzX¤qrOƒ&RNMU,KDhe:\9‹ H
À ¼ [Á‰e
– e „ e a j 2YC3F=Ot j K.H”– e QR5;†TcxC3ˆHˆ– e U j K4CDtDHˆI e I e s058K{A j A6crS
i Cˆ58Z4†LELCZ.H45;K9\-I e ¾Ÿ58=} j 3O\ eŒoˆy;yxw4eªf c”5;b4E5”=Œ=F3OCDAS À9e
<VK ƒhe A‚e s05;3F:58KHrCˆ\BET= j 3ˆH IdKMNPOPOPQRTS7U)VnMYX¥Z]\O‡^_\9RTKDQ
^:Oƒ&ZrfbdZpKgRO“hi ` MSXOKDO8SNPOJ”^fb ` sY+•”e u0<–Bš–[bYCS
AEG58† d Z924†TEGA58=FE j K w8vxv S m;m;w4e
„(†L†LCK#I e à [j j 3O74CDCDt¨58K9\ ƒ 5l^K#I e šŒEGAC e oˆy;y;y9e
šŒ74CJ=O3FCˆA‰S p ¥ Z4CDt=FE j K5;K9tF^¢CD3FELK4W½=O3O5xA6cÈCD‹l5;†TZ{5”=FE j K e
^?ab ` sY4[IdKMNPOPOPQRTS7U)V H4b95;W;CDt {go uB¿;À4e
UxETK k Ÿ
E ï0Z¨58K9\Q ei 3OZ9ACž›¢3 j }î= eÊoˆy;y;¿9e ˜]Z9C3O?ÇC k S
b958K9tFE j K‚Z9tFETK4W£† j A5;†958K{\‚W;† j 295;†4\ j AZ4:‚CKr=¢5;K958†L?BtEGt e
<VK ILKDMNPOPOPQRTS9UV’MzX‡ZT\:O’%,5)Z]\¦aS:S?o:hi|S:Z‘OKgS_hZpRMSh)i
 ` j ‚ |)~œ|D ` M)SXO8KDO8SNPOWM)SkfOVOPh)KDN\
h)SQJ§mO8“O8i˜s
Mec!O8S:ZdRTS¨|gSXMKgc!hZpRMS©fO8ZKgRO8“hige
¿