!#"$%"&'()+*-,#.0/1#2435.0/61872:9;/. 182435<=.0/>3?@
BD
A CEE '6FGH@JI,8.03>2=9K/. L24,8M#. 1ON6*-,#2PM#M
RTSVU6WYX[Z]\_^a`cbW
Q
dYU:egfihj`lkDmnhVUpoqfibr\sWutvWYoJwxU6yqbzW|{
dVUJ}p~WVbhVUpo
s_+;s___sH
#q#p[KOz8
i HP¡£¢p#¥¤¦¡-:
¡
§;4¨©¡ª¤«¬®¯°±
²³6´c³¥nµ;¶·c__l·
#q#p[KOz8
i H¡8£¢q8¸¨O¹ºP
©
¨£¹ºP
©qz»½¼¸¾¿À
_ÁlVÂ;Ã=c ÄÅ
¶
[KO¥rO£
:
¡#ª¤«¶¬H®Æ¯Ç
ÈÉÊËPÊÌ£ÍÊÎ!ϸÐÑÌ£Ò-Ó5ÔÊËPÊÕ!ÖPÊÑ6רØÙÚKÑÊÍÌ£ÛÁÊ4ÎsÙÙÜ6ÝÍÊÕ!ÊHÖÁÑ6רØ×rÞ
ߺà¸áâãäiåâ
æ-çèé4êëìríêçHîé4ïñðòcëòzîó=çÁô4ïñòzõïñîJë6é4çHöP÷òïíêçJðøçèéôPëöÁé4ïñòõ5ë5îçHòé4çHòöÁç½ðôé4çÁèéîòzïñùùçÁéøô4ðúûë
ü ðöHêú!çHòéKðô ü ðöHêú!çÁòéKöHðììñçHöé4ïðòsé4÷ëé¸ô4çHîùðò ü î ü ï0ô4çHöÁé4ì0ýé4ðë¥íêzçÁôýþÿ½ùçÁò ü ðúëïñòé4çÁèé4êëì
íêçÁîé4ïðògëòzîó=çÁô4ïñòõùô4çHîêùzùðîçHîé4÷ëéqíêçÁîé4ïðòîJëô4ç6òëé4êzôPëì
ëò ü êòô4çHîéô4ïñöÁé4ç ü óï0é4÷lô4çHîùçHöÁé
é4ð5é4ðùïñöþæ=÷ç6íêçHîé4ïñðòlëòzîó=çÁô4ïñò
õ Ké4çHöP÷òzïíêzçHî ëîçH
ú ð ü ïñç ü ïñòsé4ð ü ëý îîýîé4çHú!î öHëò
çô4ðêzõ÷zìñý ü ï ï ü ç ü ïñòé4ðqé8ó¸ðqé8ýùçHî
é4çHö÷zòïíêçHîøðô=ïñòø£ðô4úëé4ïñðò!îçHç ïñò
õ -ó÷ïñöP÷!ìðöHëì
ï Hçé4÷çëòîó=çô=ïñò ëîé ü ðöHêzú!çHòéKöÁðìñìñçHöÁé4ïñðòzî !ëò ü "#
é4çHö÷zòïíêçHîøðô¸ô4çHë ü ïñòzõpöHðú!ùô4çH÷çHòzîïñðò
$&%'
é4÷ëéqëòzîó=çÁô6ë!îçÁô4ïñçHî½ðø¸íêzçHîé4ïñðòzî½ô4çHìëé4ç ü é4ðëõï çHò ü ðöÁêú!çHòé(
þ :ì0é4÷ðêzõ÷cé4÷zçHîçé#ó=ð
é#ýzùçÁî¸ðø[é4çHöP÷òïíêçÁî¸ëò ü îýzîé4çÁú!î=ëô4ç ü ï )içÁô4çHò*é ï0éïñî ü çHîï0ôP+ë zìç:é4ðöÁð
ú zïñòçé4÷çHú ø£ðôçHòë ìñïñòõ
ú!ðô4ç=ë ü ëòöHç ü øðô4ú!î
ðø ¥þæ=÷ïñîùëùçÁô ü ïñîöHêîîçHîëò5ëùùô4ðëöP÷6é4÷ëé
îêöHöHçÁîîø£êìñì0ýçHò÷ëòöÁç ü
ëòçÁèïñîé4ïñò,
õ cîýzîé4çÁúDóï0é4÷ $&%öëùë ïñìñïñé4ïñçHîHþ-æ=÷ïñîpçHòz÷ëòöHçHú!çÁòé½ïñîpïú!ùðôéPëò
é çÁöëêzîç!ë ü
ëòzöHç ü +.iëî½çÁèçHú!ùìñï /ç ü ý_é4÷0
ç 1$&234&353176½æ ùzô4ðõôPë8
ú ïñîJú!ð ïñòõ!é4ðóëô ü î +
îýîé4çHú!îié4÷ëé-ïñòöÁðô4ùðôPëé4ç¸îçHúëòé4ïö;ëò ü ùzôPëõúëé4ïñ9ö òðóìñç ü õçKçÁò+ë zìñïòzõ ü ïëìñðõê:ç ëîç ü +6þ
;¸çÁöëêzîç6é4ð ü ëH<
ý =
î $&%Yîýîé4çHú!îïñ>ò ðì ç½ë5î÷ðôéJîçô4ïçÁî:ðø;íêçHîé4ïñðòzîïñòsöHðòé4çè*é é4÷çý!ô4çHùzô4çHîçÁòé
ëô4ê ü ïñú!çHòéPëôýø£ðô4ú ðø;ïñòé4çÁôPëöÁé4ï ç +¿ó÷zïöP÷löHðòîé4ï0é4êzé4çHîqëùðîîï ìñçøðêò ü ëé4ïðòlø£ðô½ú!ðô4ç
ë ü ëòöÁç ü øðô4ú!îðø ü ïëìñðõê:ç ëîç ü +6þ
?:@BADC>EGFC>H+IKJ#L[ÿ½ùçHò 2qðúëïñòé4çÁèé4êëìríêçÁîé4ïð
ò #ëòzîó=çÁô4ïñòzõ ô4çHë ü ïñòzõöHðú!ùô4çH÷çÁòîïñðòrþ
!#"$%
&('*) âã+ ,.-Kåâ0/1+ )
243527689;:<>=#?>@ACB
DFEHGIKJML#NO PRQSITUVJWXLYP5ZV[E>Z]\4^0LE_Ga`4b0T^bE_GL[bIcdGeMbfZgEMchITiaLGZVIEjIkbTUVI;LJlZmPJKb0TZVkbnJ
chTI;ioGeMbpL#kLZVUVLqMZVUgZgGrNsIctiaITbuLE>JYiaITbIEMvwUVZgE>bxGb*yzGxJKIK^{MiabE_GP0|}TL;JKZgGZVIE>LUgUVNWUVIv
^LGZVEM[~ZVEKchI;TiLGZgI;EsIcSZgE_GbTb0P5GZVEGeMZVPb0E_kzZVTI;EMiabE_GIcqM{>T[;bIE>ZgEM[pGby_G{>LUXJMLGL^LE
q4bfL^e>Zgb0kb0JGeMTI;{M[e n*
ww* È Dr Þ Gbn^eMEMIUVI[;NYLE>JPNzP5Gb0iP|XZgk;bEHL
{MbTNWzLEuDrP5NKP5GbiTb*G{MTE4PLUVZmPrGSIc `IGb0E_GZmLUVUgNaTbUVbkLE_GJKIK^{MiabE_GPQ!eMZm^eGeMb{>PbT
i{>P5GGe>bEP^0LEGIPb0LT^eschI;T`4b0T5GZgE>bE_GZgEMchITiaLGZVIE |}IGL;bLP5Gb0`^*UVI;PbTGIGT{Mb
0*
a1Y*w* TLGeMbTSGe>LE n%K
a>S1# W4}!dSZVEMZgGZmLGb0JZgE Qn; LE
b*yK`bTZgiabE_GLUGLPW>GeMba{>b0P5GZVIEdE>P5QSbTZVEM[ È Þ }TL^Q!eMI;PbLZgi QtLPdGIuchI_PrGbT
TbnP5bnLT^esZVElJMIiLZVEKv¡ZgE>JMb`bE>JKb0E_GGb*yzG{4LU|}teMbRGb0^e>EMIUVI[;NfGe>LGb0iabT[b0JschTI;i
GeMZmP}!¢Sv¡ZgE>Z]GZVLGb0JGLPfL`M`MTI#yKZgiLGb0P!LEsZVEKchITiLGZVIEsPbb0zZgEM[ È D5£ Þ L`M`MUVZm^LGZgI;EZgE
Q!eMZm^e¤L{>PbTa`4I_P5bnPaL {MbnPrGZgI;EHZVEjE>LG{MTLUSUmLEM[;{>L[;b~LE4JHTb0^bZVkb0PGe>bfLE>PQb0TRL;PRL
Gby_GuPEMZV`M`4bGuLPaP5e>ITGaL;PRLQSITJITLPRUVIEM[lLPRLYP5b0E;GbE>^b|C}teMb~GbyzGPEMZV`M`b*GPLTb
JKbTZVkb0JuchTI;i¥LR¦RZV[;Lq_N_GbdGb*yzG{>LU ^*I;UgUVb0^*GZVIE~LE>J^*IE_GLZVEpZVEKchITiLGZVIEpGe>LG¢LE>PQb0TP
GeMb {Mb0P5GZVIE |z}teMb{>P5b0T0O P {MbnPrGZgI;EZVPEMIGTb0P5GTZV^*Gb0JRGILEzNR`MTb*vFJKb*\>E>b0JuJKI;iLZVEQ!eMZV^e
iLbnPGeMbaGLPfGT{MUVNI`bEMv¡JKI;iLZVEYLE>JZVEMeMb0Tb0E_GUVN^*I;iR`>Ugby| §sITbRIcGb0EGe>LElEMIG0W
GeMbJKIK^*{MiabE_GCZVEaQ!eMZV^eRGeMb¢LE>PQSbTXTb0PZVJKbnPX^*I;E;GLZVE>P¨ZVEKchITiLGZVIExGe4LGCQSI{MUmJRbE>LqMUgb¢L
P5NKP5Gb0i©GIe>LE>JMUgbchIUVUgIQtv¡{M` {MbnPrGZgI;E>P0|n}teMZmP.UVLG5GbT.`MTIK^b0PP5ZVEM[L`M`MTI#yKZgiLGb0PL¢Tb0LJMZgEM[
^*I;iR`>Tb0eMbE>PZVIE È ¢ Þ GL;P5fZVEQ!eMZm^eLpPZVEM[UVbxJKIK^{MiabE_G^0LEsqbxGeMbchIz^{>PIcL~P5b0TZVb0P
Ic {Mb0P5GZVIE>P0|
dU]GeMI{>[e¤GeMbD5£ª«e>L;PP5e>IQ!Ej[;I_IKJj`4b0T5chI;TiLE>^*bZgE¤GeMbs}!¢S¬bkLUV{>LGZVIE>P
chIT!cL;^G{>LU {MbnPrGZgI;E>P¢LE>JWMGeMbTb*chI;Tb;WK`MTIkbE~GIqbLEZVia`MTIkbiab0E;G!Ik;bTtGTLJMZ]GZgI;E>LU
ZgEMchITiaLGZVIE~TbGTZgb0k#LU1WzZgGtGIzIxe4LP!PeMIQ!E~^bTGLZVEpZVE>L;JKb {>L;^*ZVb0PSLE>JJKb*\^*ZVbE>^ZgbnP|K.ZgTP5G0W
^*{MTTbE_GD5£RHPNKPrGbiP.e>LE4JKUgbtP{>^^b0PPrch{MUVUVNI;EMUVNGTZVkzZVLv1GrNz`b {MbnPrGZgI;E>P.UgZVb®m¯ p°±±_²#³
´µ a;¶Hrf µ ´ ·j¹¸ µ m$1
#$*º» |£zb0^IE>J W^*{MTTbE_GD5£¤¼P5NKP5GbiP
`MTIz^b0PP {>b0P5GZVIE>PZVElZVPIUmLGZgI;E WJKZVPTb[;LTJMZgEM[~Ge>ba^IE_GbyzGIcGeMba`MTbkzZgI;{>P {Mb0P5GZVIE4P|
}teMZVTJW4^*{MTTb0E_G¢D5£f©P5NKP5GbiP¢^0LEME>IG¢e>LE>JKUVbP5NKP5GbiLGZm^LUVUVNpLixqMZg[;{MI{4P {>b0P5GZVIE>P
UgZVbH®0½ µ m$d µ u¾4F¿¢ µ tº» W;Q!eMZm^euJKb`bE>JMZgEM[{M`4I;EaGeMbZgE_GbE_GIcGeMb¢{>PbTnWiL#N
q4b¢LE>PQb0TbnJ^*I;TTb0^*GUVNq_Nq4IGepÀ ³ ¯ WQ!e>bEaTbchbTTZVEM[dGIGeMb!DFE4JKZVLExiaI;E_{>iRb0E_G0W
ITqzNsÀ wg>w%¸.w¶ WQ!eMb0ETb*chbTTZgEM[uGIuGeMba^LPZVEMIpIcXGeMbaPLiabE>LiRb;|MI{>T5Ge WPZVE>^*b
D5£s(PNKPrGbiP!e>LE>JKUVbIE>UgNpGTZgkzZmLv¡UgZVb {MbnPrGZgI;E>PWMGeMb0NJKIpEMIGdTb0^I[;EMZgÁ0bGeMbI;`4b0EKv
bE>JMb0J~E>LG{MTbIc {>b0P5GZVIE>PSUVZg;bj®n½ µ µ x%z$$rng%s µ KgÂ!#$
º» | }teMbRGbn^eMEMZ {>b0Pbia`MUVINbnJsZVETb0L;JKZVEM[^Iia`MTbeMb0E>PZgI;E È ¢ Þ PNzP5Gb0iPqb[;ZgE
GILJ>JKTbnPPdGe>ba\>TP5GGrQIZgE4LJKb {4L^*ZVb0PiabE_GZgI;EMb0JYLqIkb;|dU]GeMI{M[;eGeMZmPQI;{MUVJq4buL
\>TPrGP5Gb0`ZgEsJMbkb0UgI;`MZVEM[uLiaITbP5I;`MeMZmPrGZV^0LGb0JÃPNKPrGbifW4LED5£sÃLT^eMZgGbn^G{MTb
P5{>`M`MUVbiabE_GbnJqzN¢ÄÄGb0^eME>Z {MbnP¨iRZV[e_G¨bE>LqMUVbtL{>PbT.GIiaIkbq4b0NI;E>JD5£I`bTLv
GZVIE>PtLE>J~L;P5JKZmLUVI[;{Mb*v¡UVZg;b¢chIUVUVIQtvw{M` {>b0P5GZVIE>P0|M£z{>^efLEpb0EMe>LE>^*b0iRb0E_GSZmPSZgia`ITGLE_G
q4bn^L{>P5bL;JKkLE>^b0J¤WXLPabyKbia`MUVZ]\>bnJHqzNlGeMbsdJKkLE>^*bnJj!bnP5bnLT^eHLE4JjÅbk;bUVI`Kv
Æ æ=÷ç¥æ-çÁèé&$SÇéô4ïñçëìD%¸ðòzøçÁô4çHòzöHç æ $Ç %'
ïñîJëîçÁô4ïñçHîJðøó=ðô î÷zðùzîJðô4õëòzïHç ü ýé4÷zç6që
é4ïðòëìD8òzîé4ï0é4êzé4ç½ðø éPëò ü ëô ü îëò ü æ-çHöP÷òðìñðõý-63zæ=
ü çHîïñõòzç ü é4ð!ë ü ëòöÁçJé4÷ç½îéPëé4ç:ðø
é4÷:ç #ëôéïñ8
ò $¥þ
*x
aª¾4;w>
t>$w À M $ ´ *z¾4% µ >>$
¦
iabE_Gd^*GZVk_ZgGrNO P È ddÅ¢ Þ d
¢D } `MTI[;TL
i W ZmPiaIkzZgE>[~GIQSLTJ>P¬P5NKP5GbiP
Ge>LGSZVE>^IT`4I;TLGbPbiLE;GZV^LE>Jp`MTL[iLGZm^¢zEMIQ!UVb0JK[;b¢bE>LqMUVZgEM[aJKZmLUVI[;{Mb*v¡q>LPb0Jp|
2>3@5?4AuA!";=FA<#68#B%$A'&;?4=)(l8*5?4A,+
-:.FA<
/eMZVUgbuDrPNKPrGbiPe>L#kbaiLJMbZgia`ITGLE_GP5GTZVJKbnPZVEGeMb`>L;PrGJKbn^L;JKb0P0WGeMbp`MTI;qMUVbi
IcCb10^Zgb0E_GUVN~UVIK^LGZgE>[uZgEMchITiaLGZVIEfZVEsUVLT[;bIEKv¡UVZgEMbJMIz^{MiabE_G^IUVUgbn^GZgI;E>P!ZmP¢cLT!chTI;i
q4b0ZgE>[YPIUVkbnJ|X}teMb}!dS¬¥GTL^JKb\>EMbnJGe>bI;`4b0EKvFJKIiLZVEGb*yzG{>LUd¥GLP
LPLEsZVia`4I;T5GLE_GP5Gb0`sGIQSLTJMP¢GeMbx[I_LU.IcCUVIz^0LGZgEM[LE>JsTbG{MTEMZVEM[pI;EMUgNfZVEKchITiLGZgI;E
P5I;{M[e_GqzNL!{>PbTn|0§I;TbCP`b0^*Zg\4^0LUVUgN;WZVEGeMbS}!¢SllbkLUV{>LGZgI;E>PGeMbLE>PQb0T I{KG`M{KG
QSL;P!ZVEGeMbchITi IcCLTLEMbnJUgZmPrGIc32 54 JKIK^*{>iRb0E_G5v¡ZVJWLE>PQSbTv¡P5GTZgE>[6 `>LZgTPtchITb0L;^e
{Mb0P5GZVIE374Ge>bxLE4P5QSbTv¡P5GTZVEM[;P!QSbTbb0Z]GeMbTP5e>ITG È98: qzN_Gb0P Þ I;TdUVIEM[ È 8: qzN_Gb0P Þ; LE>J
^*I;E;GLZVEªGeMb^LE4JKZVJ>LGbLE>PQb0TaGIGeMb {MbnPrGZgI;E |}tez{>PuZgE>P5GbnLJªIcTb0L;JKZVEM[ÄLÄPb*GpIc
JKIK^*{Miab0E;GPZVEuPb0LT^eRchITGeMbJKb0PZgTb0JaZVEKchI;TiLGZgI;E WGeMbd{>PbTZVP`MTb0PbE_GbnJaQ!Z]GepLGiaI_PrG
\>kbLE>P5QSbTPSTbnP5`IE4JKZgE>[xGIaGeMb`I;Pb0J {Mb0P5GZVIE|
DFEsGeMba}!¢SÃÃbkLUg{>LGZVIE>P¢GeMbaLE4P5QSbT¢ZmP_E>IQ!EfGIpTb0PZmJKbxPIiabQ!e>bTbZgEGeMb
<¦)=MW>< ? JKIK^*{MiabE_GP È ¦Zg[_LqzN_Gb0P Þ chTI;i(P5ZgyxJKZA@b0Tb0E_G¨E>bQ¢P¨P5I;{MT^*b0P È .ZV[{MTb Q Þ |BL#kzZgEM[
i{MUgGZV`MUVbSJMIz^{MiabE_G.PI{>T^b0P Ic>JMLGL¢[;Zgk;b0PGeMbCGLPGeMTbbSLJMJKbnJJKZViabE>PZgI;E>PDC È Q Þ V1_
n%*K
>%g%1 EMb0^b0PP5ZgGLGb0PCGeMb`MTIz^b0PP5ZVEM[IcGeMI;{>PLE>JMPIcJKIK^{MiabE_GPZgEpITJKbT
GILE4P5QSbT¨b0L;^e {MbnPrGZgI;E37 È Þ P5ZVE>^*bSGeMb!PLiRbtZVEKchITiLGZgI;ExZmP¨IcGbEa^*Ikb0TbnJqzNix{MU]GZg`>Ugb
EMbQ¢PRPI{MT^*bnP >$ ´ pK;%¶ ix{>PrGRq4b~e>LE4JKUgbnJE7¨LE>J È ¦ Þ q4bn^L{4P5bpPIiabGZViRbnPxL
^LE>JKZmJMLGbLE4P5QSbT.^*IE_GLZVE>PL % IcMGeMb^Iia`MUVb*GbtLE4P5QSbTnW $ g
a>FKn*
w
i{>P5G¢qbchI{ME>JfLE>Jp{4P5bnJ|
Los Angeles Times
Financial Times
131,896 Documents
80,080,696 Words
491,088 KBytes
210,157 Documents
91,475,603 Words
581,168 KBytes
Wall Street Journal
173,252 Documents
82,024,127 Words
525,152 KBytes
San Jose Mercury News Foreign Broadcast Information Service
90,257 Documents
45,623,121 Words
295,556 KBytes
130,471 Documents
74,720,345 Words
484,500 KBytes
AP Newswire
242,918 Documents
116,378,217 Words
752,760 KBytes
F
ïñõþ þæ-çÁèéöHðìñìçÁöÁé4ïñðòîJêîç ü ïñòsé4÷çpæ $Ç % çëìñêëé4ïñðòîHþ
G 8òzøðô4úëé4ïðò ë+ðêé é4÷zç ü ëòöÁç ü 35½çÁîé4ïðò ëò ü :òîó=çô4ïòzõ ø£ðô 76qæ[çHìñìïñõçHòöHç
13531 6q=
æ Kùô4ðõôPëú öëò,çqø£ðêzò ü ëé:÷éé4ù #óóópþ ïñö:#ëô ü ëþ ðô4õ #òzøð#Çèzùzìñðï0é ëíêëïñòé H 8òjæ $SÇ % 9I ëò ü æ $Ç % 9J> ðé4÷jî÷zðôéëò ü ìñðòzõ ëòîó=çô4îó¸çÁô4çgëöÁöHçHùzé4ç ü þ 8òjæ $SÇ % LK
ðòì0ýºî÷ðôé¥ëòzîó=çÁô4îpó=çô4ç!öHðòzîï ü çÁô4ç ü ó÷ïñìñç!ïòæ $SÇ % #é4÷zç!ëòzîó=çÁô¥úêîéç5çÁèzëöÁé¥ëò ü
òðé-çH
ú ç üü ç ü ïñòë=é4çÁèé-îòïñùùçÁéþLFðô-çÁèzëú!ùìñç#Áï0øzé4÷zçKíêzçHîé4ïñðò6ïñî5MONQP)RDS'TR Û SUP Ê
ÐÝPÐ.VÒ RDS Ì ÝDW
ÝYX NZR Û P ÌUW[ S ÝDWlÔ]\^\[ÌUWl×ØØØ`_Da é4÷ç6ëòzîó=çÁô:î÷zðêì ü ç½ðòì0ýbM9cd ×feØ c-g a þ
?
!#"$%
TREC−8: Questions 1−200
Q3: What does the Peugeot company produce?
Q6: Why did David Koresh ask the FBI for a word processor?
Q8: What is the name of the rare neurological disease with symptoms such as involuntary
movements (tics), swearing, and incoherent voclizations (grunts, shouts, etc)?
Q30: What are the Valdez Principles?
Q36: In 1990, what day of the week did Christmas fall on?
Q73: Where is the Taj Mahal?
TREC−9: Questions 201−793
Q204: What type of bridge is the Golden Gate Bridge?
Q253: Who is William Wordsworth?
Q285: When was the first railroad from the east coast to the west coast completed?
Q361: How hot does the inside of an active volcano get?
Q412: Name a film in which Jude Law acted.
Q425: How many months does a normal human preganancy last?
Q581: What flower did Vincent Van Gogh paint?
TREC−10: Questions 794−1293
Q902: Why does the moon turn orange?
Q905: What person’s head is on a dime?
Q916: What river in the US is known as the Big Muddy?
Q949: What does cc in engines mean?
Q1022: What is Wimbledon?
Q1111: What are the spots on dominoes called?
Q1136: What causes gray hair?
F
ïñõzþ("þ zëú!ùìñçpíêçHîé4ïñðòîêîç ü ïñòsé4÷ç3/zô4îéé4÷zô4çHç6æ $Ç % çëìñêëé4ïñðòî
}IPb0LT^eRchITZgEMchITiaLGZVIEZVEukI;Ug{>iRZVEMI;{>PJKIK^{MiabE_G^*I;UgUVb0^*GZVIE>P0W;JMbkb0UgI;`4b0TPCIc^*{>T5v
Tb0E_GD5£uPNKPrGbiPC{>Pb¢Dr¤Gb0^eMEMZ {Mb0PCchITC`>TIK^*bnPPZVEM[GeMbJKIK^*{MiabE_GP|_}teMZVPZgEzk;IUVkb0P
q4IGe¤ZgE4JKb*yKZVEM[sGeMbfbE_GZVTb^*I;UgUVb0^*GZVIEjLE>JHJMbkb0UgI;`MZVEM[LTbGTZgb0k#LUiabn^e>LEMZmPi|X}teMTbb
chITiPIcZVE>JKbyKZgEM[LTbxGrNz`MZV^0LUXZVE^*{MTTb0E_GD5£7PNzP5Gb0i1P C È L Þ Gb0Ti ITQI;TJKvwq>L;P5bnJ
ZgE4JKb*yKZVEM[ 7 È q Þ ^*I;E>^*b0`KG{4LUZVE>JKb*yKZVEM[ 74LE>J È ^ Þ `>LTL[;TL`MeuZVE>JKb*yKZVEM[>|
}bTiITSQI;TJaZVE>JKbyKZgEM[xiab*Ge>IzJ>PTLE>[b!chTIi7Ge>b^TbnLGZVIEIcLPZViR`>UgbZgE>JMb*ypP5GT{>^v
G{MTbSGe>LGCLPP5IK^*ZmLGb0Pb0L;^eQSITJQ!ZgGexGeMb¢JKIK^{MiabE_GP.Q!eMb0TbtZgG¨IK^0^*{MTPGIiaITbS^Iia`MUVb*y
ZgE4JKb*yKb0P0|>}teMbUVLG5Gb0T¢LTb^*I;iR`>TZmP5bnJpIc.ix{MUgGZgvwQSITJ~GbTi¥ZmJKb0E;GZ]\4bTPW>JMIz^{MiabE_G¢ZmJKbE_GZgv
\>bTP0W4PN_E_GL^GZV^W4iaI;T`Me>IUVI[Zm^LE4JP5b0iaLE_GZm^kLTZVLE_GP!IcXGeMbGbTi¼LPdQb0UgU.LPdGeMbGb*yzG
P5b {MbE>^bTb`MTb0PbE_GZgEM[uGeMbxGb0Tif| Dr§£KDO P
ÄPNKPrGbi È MbTTb*G dV :): Q Þ ZVPLE
b*yMLia`MUVbdIcP5{4^epL^Iia`MUVb*yaGb0TiZVE>JKb*yKZVEM[aP^eMb0iab|zI;E>^*b0`KG{4LUZgE>JMb*yKZgE>[ZmPq4LPb0JaIE
L^IE>^b`KG{>LUGLyKI;EMIixNsGe4LGaZVPqM{MZVU]GRchTI;i GeMbfJKIK^*{MiabE_Ga^*IUVUVb0^GZgI;EÄLE>JÄUgZVEMbnJYGI
LpQSITJzv¡q>LPb0JfZVE>JKby| }teMbR^IE>^b`KG{>LUGLyKIEMI;iNfZgE_Gb[TLGb0PP5NzE_GL;^GZV^WPbiLE;GZV^xLE>J
iaIT`MeMIUVI[;ZV^0LU;Tb0UVLGZVIE>PeMZV`>P| È /YIzIKJMP *¨g; ::): L Þ JKb0P^*TZVq4bnP GeMb!^*IE4^*b`MG{>LU;ZVE>JKbyzZVEM[
iab0^e>LEMZVPiPZgia`MUVbiabE_Gb0JZgEGeMbaD5£ PNKPrGbi chTIi £ ]|I;E>^*b0`KG{>LU¨ZgE>JMb*yKZgE>[>W
qzNu{>PZgEM[u^IE>^b`KG{>LU P{Mq>P{Mia`KGZgI;E~Ic {MbnPrGZgI;E~QSITJMP0W_b0E>Lq>UgbnPtTbGTZgb0k#LUIcXJKIK^*{MiabE_G
`>LPPL[bnPSGe>LGdiL#N^IE_GLZgEGeMbLE4P5QSbTnW>LP¢Tb0`4I;T5Gb0JfZVE È /YI_IKJMP *¢g :):: q Þ |XLTLv
[TL`MepZgE>JMb*yKZgE>[>WKQ!eMZm^epQtLPZgia`MUVbiab0E;Gb0J~ZgE~Ge>bÀ > È §I;UVJKIkLE g;
Q0; Þ LE>J
MÀ ¸ È BdLTLq>L[;Zg{ *gt ::: q Þ D5£¼PNzP5Gb0iPZVPuiRIGZVkLGbnJ¤q_NHGeMbE>IGZVIE
Ge>LGSLEpLE>PQSbTCiaZV[e_G^*I;E_GLZVEu^*IvwIK^0^*{MTTb0E>^*bnP¨Ic {MbnPrGZgI;EQI;TJMPCUgIK^LUgZVÁbnJZVEuLPZgEM[;Ugb
*x
aª¾4;w>
t>$w À M $ ´ *z¾4% µ >>$
8
`>LTL[;TL`MeLE>JWGe>bTb*chITbWGeMZVPP^eMb0iRbaLPPIz^ZVLGbnPQSITJMPQ!Z]Gel`>LTL[;TL`Me>P¢ZVEYQ!eMZV^e
GeMb0NR^Iv¡IK^^*{>T0|ÅIK^*{MiabE_GZVE>JKbyKb0PLTbt{>Pb0JaZVEu^*{>TTbE_GXD5£uPNKPrGbiP¨GIZgia`MUVbiabE_G
GeMTbbJKAZ @bTbE_GchITiaPIcTbGTZgb0kLU C È Q Þ Tb*GTZVbkLU.Ge4LGUgZmPrGPLE>JTLEMKPdGeMbJKIK^*{>iRb0E_GP
^*I;E;GLZVEMZVEM[Ge>b {MbnPrGZgI;EGb0TiDP 7 È Þ Tb*GTZVbkLUIcdJMIz^{MiabE_GPchIUVUVIQbnJlq_NlTLEMzZVEM[sIc
GeMb0ZgTt`>L;PPL[;b0DP 7LE4J È ¦ Þ Tb*GTZVbkLULE4JTLEMzZgE>[IcJMIz^{MiabE_G`4LPPL[b0P0|;dUgUGeMTb0b¢GrNz`b0P
Ic¨TbGTZgb0kLUiab0^e>LEMZVPiPtbia`MUVINuqIG
e SIzIUVb0LELE>Jpk;b0^*GITtTb*GTZVbkLUiaIKJKb0UVP0|
/e>bEMb0kbTfL {MbnPrGZgI;E¹ZVP~`I;Pb0JªGIjLED5£oPNKPrGbifWGeMb {Mb0P5GZVIEQSITJMPpLTb
`MTIz^b0PP5bnJªP5{>^e¤Ge>LGuGeMbPNKPrGbi [bE>bTLGbnPL {MbTNÄGe>LGpTb*GTZVbk;b0PJKIK^{MiabE_Gp`>L;Prv
PL[bnP!chITLE>PQSbTdbyzGTL^GZgI;E |4.ZV[{MTb UgZmPrGPPIiabRPLiR`>Ugb {MbnPrGZgI;E>P{>P5bnJZVEGeMb\>TPrG
GeMTbba}!¢t( bkLUV{>LGZgI;E>P0|4DFEY}!¢Sv W4GeMb :: {MbnPrGZgI;E>PdI;TZV[ZVE>LGb0JchTI;i GeMb
Kd.ZgE>JMbT È S{MTb g Qn < Þ LE>JuchTI;i7GeMb {Mb0P5GZVIE>P[b0EMbTLGb0JaqzNu}!¢tj`>LTGZm^v
Zg`4LE_GPI;TGeMb ¢D5£K}P5G!L @¨| DFE}!¢tv W 8: ? {MbnPrGZgI;E>PQSbTbRTb*GTZVbk;b0JchTI;ioGeMbUgI;[;P
IcC§Zm^*TI;PIcGnO P ÄIT!GeM
b fPb0LT^efbEM[;ZgE>b|>DFEs}!dSv Q : WMGeMb < : ? {MbnPrv
GZVIE>PchTI;i }!¢tv LE>J Qb0TbuP{M`M`MUVbiab0E;Gb0JlqzN 8:: LJ>JKZ]GZgI;E>LU {>b0P5GZVIE>PiaZVEMb0J
chTI;i¥GeMbUVI[_P!Ic§£ £zbnLT^efUgI;[;P¢LE>JsdP b0bk;b0P0|>L;^e {MbnPrGZgI;EZgEs}!dSv LE>J
e>LJfLEfLE>PQb0T!ZgEfGeMbJKIK^*{Miab0E;G^*IUVUVb0^GZgI;E WMqM{MG}!¢Sv Q : bkLUg{>LGbnJ {MbnPrGZgI;E>PtGe>LG
e>LJjEMIlLE>PQSbTP|.DFEÄGeMbfUVLG5Gb0T^LPbW.GeMb^*ITTb0^GaLE>PQSbTRQSL;P dD TLGeMbTxGe4LEjGeMb
4 JMIz^{MiabE_G5v¡ZmJW>LE4P5QSbTv¡P5GTZVEM[ 6`>LZVTn|
Q412: Name a film in which Jude Law acted.
Q718: Jude Law was in what movie?
Q720: What is a film starring Jude Law?
Q720: What film was Jude Law in?
Q425: How many months does a normal human preganancy last?
Q63: How long is a human gestation?
Q765: A normal human pregnancy lasts
how many months?
F
ïõþþæ $Ç % 9J!íêçÁîé4ïðòîëò ü é4÷zçHï0ôô4çÁø£ðô4ú5êìëé4ïðòî
¢b0^*b0E_GTb0P{MU]GPchTIiÃ}!¢tsb0kLUV{>LGZgI;E>P È QI; g ::): 7¢L;JKbk g ::): 7dUgUVbE
* XV_ ::):zÞ P5eMIQHGe>LGXDFEKchITiLGZVIEa!bGTZgb0k#LU È Dr Þ Gb0^e>EMZ {MbnPXLUVIEMb!LTbSEMIGP{ 0u^*ZVbE_G
chIT\>E>JKZVEM[LE>PQSbTPGI {Mb0P5GZVIE>P.PZgiaZVUVLTGIdGeMI;PbZVUgUV{>P5GTLGb0JZVEx.ZV[{MTb |0DFEcL^GnW#iRI;Tb
LE>JiaITbRPNKPrGbiPLTbaLJMI`KGZgEM[LT^eMZgGb0^*G{MTb0PZVEQ!eMZm^esGeMb {>b0P5GZVIEPbiLE;GZV^0PLTb
^L`KG{MTb0J`MTZgI;T GITb*GTZVbkzZgE>[L!Gb*yzGX`>LTL[;TL`MeQ!eMbTbCGeMb!LE>PQSbTiL#NUVZgb È LZgÁnL{>PLP
LE>
J B¢{Mia`MeMTbNKP ::): 7 BdIkzN g¢ :: Q 7 BdLTLq>L[;Zg{ g! :):: L Þ |}teMb {Mb0P5GZVIE
P5b0iLE_GZm^PtLTbdUmLGbTS{>Pb0JGIxbyzGTL^GSGe>bLE>P5QSbTchTIiGbyzGS`>LTL[TL`Me4P È ¢qMEMb0N g
:):: 7¢L;JKbk *¨gz :)::Þ f| /eMbEa`MTIK^*b0PPZgEM[LE>LG{MTLUzUVLEM[{4L[b {Mb0P5GZVIEW#GrQI^*TZ]GbTZVL
i{>P5GX\>TPrG¨qb!iRbG0|.ZVTP5G0WQSbSEMbbnJGI_E>IQÄQ!e>LG¨GeMb!b*yK`b0^Gb0JRLE>PQSbT.GrNz`4btZmPWZw| b;|gWGeMb
GrNz`4baIcZgEKchI;TiLGZVIEGe>LGZmPqbZVEM[fP5I;{M[e_Gn|£zbn^*I;E>JWQbREMb0b0JGI~zEMIQÃQ!e>bTbGI~UVIzI
chITGe>bRLE>P5QSbTnWZ1| b|VWQbREMbbnJGI~ZmJKbE_GZ]chNGeMb {>b0P5GZVIE;bNzQSITJMP¢{>Pb0JschITTbGTZgb0kzZgEM[
GeMbJMIz^{MiabE_G¢`>L;PPL[;bdGe>LG¢iaZV[e_G¢^*IE_GLZVEpGeMbLE>PQSbTn|
>{MTGeMb0TiaITbWSLUgGeMI;{M[eE4LG{>TLUUmLEM[;{>L[;b {Mb0P5GZVIE>PpiL#Njqb`>eMTL;P5bnJªZgE P5b0kbTLU
JKAZ @b0Tb0E;G¢QtL#NKPWKD5£ÃP5NKP5GbiP¢LTbbyz`b0^*GbnJpGITbG{MTEGeMbPLiabLE>P5QSbT!Tb[_LTJKUVb0PP
IcGeMb {MbnPrGZgI;Ej`>LTL`MeMTLPb|¨}teMZmP^L`4LqMZVUgZgGrNÄQtLPRbkLUg{>LGbnJHZVE¤}!dSv Q!eMb0E¤GeMb
¢D5£K}P5GL @Tb*chI;Tix{MUmLGbnJ 8 ¦ {MbnPrGZgI;E>PJKb0TZVkbnJRchTI;i7GeMbUgI;[;PXIc I
T =
!#"$%
ZgE_GILGIGLU>Ic Qn `>LTL`MeMTLPb0J {Mb0P5GZVIE>P0|;.ZV[{MTb¢¦UVZVP5GPGrQSI}!¢Sv {Mb0P5GZVIE4PCLE>J
GeMb0ZgT^*ITTb0P`4I;E>JKZVEM[Tb*chI;Tix{MUVLGZVIE>P0|
dIGCI;EMUgNx^LEaZVEKchITiLGZgI;Exqb¢P5I;{M[e_GXkzZVL {MbnPrGZgI;E>P¨Q!Z]Geak#LTNzZVEM[P5NzE_GLyxLE4JGbTiaP0W
qM{KGdL`M`MTI`MTZVLGbLE>PQSbTPGIzIRiL#Nuqb`MeMTLPb0JJKAZ @b0Tb0E_GUVN|M}tez{>P M$ ´ *K;%¶ W
ZgEaQ!eMZm^eaLE>PQb0TP¨L`M`4bnLT¨ZVEaJMZ @bTbE_GCUVZgEM[;{MZmPrGZV^S[{>ZVPb0P0WZVP¨byK`MUgI;Z]Gb0JxqzNP5b0kb0TLUz^{MTTb0E;G
D5£pP5NKP5GbiP È ¢qME>bN *gM ::: 7;UVLT;b *gK :): Q 7 QI; CgM ::):zÞ WiRI_PrGEMIv
GLqMUgNqzN§Zm^*TI;PIcG0O P PNzP5Gb0i È STZVUVU V :): Q Þ |0}teMbSJKb0PZV[EMb0TPIc {>Pb0JlLE>PQSbTTbnJK{ME>JMLE>^*NschITGrQSI~`M{>T`I;Pb0DP C È L Þ GIfcL^ZgUVZ]GLGbxGeMbiLG^eMZgE>[Ic {MbnPrv
GZVIE>PQ!ZgGeYLE>PQb0TPLE4J È q Þ GIpcL;^*ZVUgZgGLGbaLE>PQb0TbyzGTL^GZgI;E |}I~iaLG^e {>b0P5GZVIE>PdGI
LE>PQSbTPW {>Pb0P.GeMb /b0qaZgE>P5GbnLJxIcGeMb¢}!dS^IUVUgbn^GZgI;ERLUgI;EMbSPZVE>^*b¢LE>P5QSbT
TbnJK{ME>J>LE>^NxZmPXcLT[Tb0LGb0TXIEaGe>b /Ybq |_D¡GZmPWGeMb0TbchITbWiaI;Tb¢UVZVbUVNxGI\>E4JuLEuLE>P5QSbT
Ge>LGiaLG^eMbnP¢GeMbaITZg[;ZgE4LU {MbnPrGZgI;EQ!ZgGeMI;{KG\>TP5Ge>L#kzZgEM[pGI~GTLE>P5chITi«GeMb {Mb0P5GZVIE
ZgE_GIPbkb0TLUCIc!ZgGPxkLTZVLE;GP|.M{MTGe>bTiRI;Tb;WLU]GeMI{M[;elGeMb~`MTb`IE>JKb0TLE>^*bIcdJMLGLIE
GeMb /b0qacL^*ZVUVZ]GLGbnPPZgia`MUVb¢iLG^eMZVEM[q4bGrQb0bE {Mb0P5GZVIELE>JLE>PQSbT¨Gb0TiP0W LE>PQSbTiL#NP5GZVUgUtEMIGxqb^ITTbn^G0|DFEGe>ZVPa^L;P5b;WGeMbfLE>PQb0TTb0JK{ME4JMLE>^NPrGTLGb[;NZmP
{>Pb0JlGI^*I;iqMZVEMbLsEz{MiqbTRIc¢{>E>^*b0T5GLZVEÄLE>PQb0TPZgE_GILsPZgE>[UVbW.iRI;Tbpk_ZmLq>Ugb~[{MbnPP
È STZgUVU SV :: Q Þ |
QL2: Name 32 countries Pope John Paul II has visited.
QL5: What are 10 U.S. cities that are locations of homes designedby Frank Lloyd Wright?
QL14: Name 5 diet sodas.
QL15: Who are 6 actors who have played Tevye in "Fiddler on the Roof"?
QL18: Name 30 individuals who served as a cabinet officer under Ronald Reagan.
F
ïñõzþzþ_Çèzëú!ùzìñçqðøìñïñîéJíêzçHîé4ïñðòzî
£KIiabI`bEKvFJKI;iaLZgE {Mb0P5GZVIE>PLTbae>LTJMbTGIsLE>P5QSbTqb0^0L{>PbRGeMb0NTb {MZVTbxGeMbD5£
(PNKPrGbiPdGIpL;PPbixqMUgbIT!ch{>PbZVEKchI;TiLGZgI;EUgIK^0LGbnJZVEsi{MUgGZV`MUVbxJKIK^{MiabE_GP0|.ZV[v
{MTb ? P5eMIQ¢PSPbkb0TLU4}!¢tv Q : PIvF^LUVUVb0J5UVZmPrG {Mb0P5GZVIE>PQ!e>I;PbLE4P5QSbTP^IE_GLZgEpPbk_v
bTLUKZVE>P5GLE4^*b0P¨IcL`>LT5GZV^{MUVLT¨_ZVE>JRIcZgEMchITiaLGZVIEa^*I;EMEMIGb0JxqzNGeMb {MbnPrGZgI;E |DFEaIGeMbT
QI;TJ>PWGeM
b 5UVZmPrGxLE>PQb0TP ~LTbu^Iia`MTZVPb0JIc¢Pbk;bTLU %
g
*4¡¶>$ ´ $ Q!eMZV^e
LTbb0L;^e W>ZVEfGeMb0iP5b0Ugk;b0P0W4^*I;TTb0^*G0WMq>{KGI;EMUgN`>LT5GZVLUgUVN~PIuZVEfGeMbxIkbTLUVU ^*I;E_Gb*yzGdIc¨GeMb
{Mb0P5GZVIE |£z{>^esUVZmPrG {>b0P5GZVIE>PLTbe>LTJKbT¢GI~LE>PQb0T¢q4bn^L{>P5bZgEKchI;TiLGZVIEsJK{M`>UgZm^LGb0J
ZgEjJKIK^*{MiabE_GPi{4PrGRq4bpJMb*Gbn^Gb0JÄLE>JlTb0`4I;T5Gb0JlI;EMUgNYIE4^*b|.}teMbTb*chI;Tb;WLUgGe>I{M[;eÄLEKv
P5QSbTTb0JK{>E>JMLE4^*NsiL#Nqbq4b0EMb*\4^ZVLU¨chIT`MTIK^*bnPPZgE>[^bTGLZVE {MbnPrGZgI;E>P0WGeMZmPPrGTLGb0[N
ZVPdJKb*GTZViabE_GLUGI`MTIK^*b0PPZgEM[RUVZVP5G {>b0P5GZVIE>P0|
JKkLE>^b0JHD5£H P5NKP5GbiPRP5e>I{MUmJEMIGx`MTIK^*b0PP {>b0P5GZVIE>PZgEjZVPIUmLGZgI;E |kbE_G{>LU
{>PbTPIcD5£Y7P5NKP5GbiPQ!ZVUgU¨UVZg;bUVNsZVE;GbTL^*GQ!ZgGeGeMb0ZgTPNKPrGbiPIElLpTb[;{MUVLTq4LPZVP
LE>JuQI;{MUVJabyK`4bn^GSGIe>L#k;b!Ge>bZVT {MbnPrGZgI;E>PC`MTIK^*bnPPb0JaZVEGe>b^*I;E_Gb*yzGSIcGeMb0ZgTS`MTbkzZVI{>P
ZgE_GbTL^GZgI;E>P0|*DFE}!¢Sv Q : Ld^*IE_Gb*yzG.lGLPdQtLP JMb0PZg[;EMb0JGI¢Tb0`MTb0PbE_GGeMbJKZVLUgI;[{Mb
`MTIz^b0PP5ZVEM[Ge>LGtLEuD5£~ PNKPrGbiQI;{MUmJuTb {MZVTbdchITtP5{M`>`4I;T5GZgEM[RLE~ZgE_Gb0TL;^GZgk;bd{>PbT
P5bnPPZVIE |z.Zg[;{MTb 8 Tb`MTb0PbE_GPLPbTZVb0PCIc {Mb0P5GZVIE4PCGe>LGSQb0TbbkLUV{>LGb0JZVEuGeMb}!¢Sv
Q : ^*I;E_Gb*yzG GLP|
*x
aª¾4;w>
t>$w À M $ ´ *z¾4% µ >>$
<
CTX1a: Which museum in Florence was damaged by a major bomb explosion in 1993?
CTX1b: On what day did this happen?
CTX1c: Which galleries were involved?
CTX1d: How many people were killed?
CTX1e: Where were these people located?
CTX1f: How much explosive was used?
F
ïñõzþþ_Çèzëú!ùzìñçqðøìñïñîéJíêzçHîé4ïñðòzî
PRTb0`4I;T5Gb0JÄZVE È IzITeMbbnP :: Q Þ GeMbfTbnP5{MUgGPxIcdGeMZmPRGL;P5lQSbTbp{MEMbyK`4bn^GbnJ|C}teMb
LqMZVUVZ]GrNHGI^*I;TTb0^*GUVNÄLE>PQb0T {>b0P5GZVIE>PaUmLGbTZVEªLlPbTZgbnPaQSL;PR{ME>^*I;TTbUmLGb0JjQ!Z]Ge¤GeMb
LqMZVUVZ]GrN~GIuLE>P5QSbT {>b0P5GZVIE>P!bnLTUgZVbT!ZVEGeMbPbTZgbnP|>d`M`>LTb0E;GUgN;WKGe>b\>TPrG {MbnPrGZgI;EfZgEL
P5b0TZVb0PJKb*\4EMb0JxL¢P5iLUgU_bEMI;{M[eP{Mq>Pb*G.Ic>JKIK^{MiabE_GP.P5{4^eGe>LGGeMbTb0P{MUgGPIcKGe>bIkb0TLUgU
ZgE_GbTL^GZgI;EQb0TbJKIiaZVE>LGb0JqzN¤Q!eMb*GeMbT~GeMbYP5NKP5Gb0i ^I{MUmJ¹LE4P5QSbTGeMb`4LTGZm^*{MUmLT
^*{MTTbE_G {Mb0P5GZVIE|4DFEY^*IE_GTL;PrGnW>¢Ã PNKPrGbiP¢{4P5bRP5b0TZVb0PdIc {Mb0P5GZVIE4Pd`I;Pb0JQ!ZgGe
TbchbTbE>^bGILPZVEM[UVb!JKIK^*{MiabE_GnWqM{KGXGe>b¢LqMZVUgZgGrNIcLE>PQSbTZgEM[ {Mb0P5GZVIE4P.JMb`bE>JMPCiRI;Tb
GZV[e_GUVNpI;EpGeMb`MTbkzZVI{>PtZVE_GbTL^*GZVIE>P0|K}teMbTb*chI;Tb;WzGbn^eMEMZ {>b0Pt{>Pb0JZVEfLEL;^^{MTLGb¢
P5NKP5Gb0i^I{MUmJub0EMe>LE>^*bLEpD5£ P5NKP5Gbi LE>Jb0E>LqMUVbZ]GSGIR`MTIz^b0PPP{>^0^*b0PP5ch{MUgUVN
{Mb0P5GZVIE>PLPbnJxZVEaGe>b^*I;E_Gb*yzGIc LJKZmLUVI[{>b|D¡GQtLPXGeMZmPI;q>PbTk#LGZVIERGe4LGiaIGZgkLGb0J
I{MT.ZVE;GbTb0P5GZVEx¢ÄHPNzP5Gb0iPLE>JGe>b[;I;LUmP Ic>Tb0LJMZgEM[^*Iia`MTbe>bE>PZgI;E |nDFE^*I;E;GTL;PrG
GID5£P5NKP5GbiP0W;¢ {>b0P5GZVIE>P¨chIK^{>PXIEuLPZVEM[UVb¢JKIK^*{Miab0E;GSLE>JaLPNzP5Gb0ifO PCLqMZVUgZgGrN
GIRLE>PQb0T^ITTb0UVLGb0P¨iaI;Tb^*UVI;PbUVNxQ!ZgGeGeMbd`>Tb0k_ZVI{4PSZgE_GbTL^GZgI;E |;}te>bTb*chITbWQb
ezN_`IGeMb0PZVÁb0JuGe>LG!ZgE>^IT`4I;TLGZVEM[GeMZVP!¢jch{>E>^GZgI;E>LUVZ]GrNpZgE_GIaLE~D5£LT^eMZgGbn^G{MTb
QI;{MUmJLJMk#LE>^*bGe>btP5GLGbvwIcv1GeMb*vFLTGZVEaHIk;bTLUVU;LE4JGTL;^^UgI_P5b0UgNGIGeMbSUgI;EM[dGbTi
[I_LUmPIcGeMbd
ddD d} `MTI[TLif|
243
@)5?4AuA!";=FA< &_?4= #8BFA<?(
.=-E;A!5?4A )
}TLJMZ]GZgI;E>LUVUgN;WXPrGITNÄ^*Iia`MTbe>bE>PZgI;EHQtLPa^*I;E>PZVJKb0TbnJHLchITi IcdGb*yzGu{ME4JKbTPrGLE>JMZgEM[
Ge>LG.`>TIkzZmJKb0JZVE_GbTb0P5GZVEM[¢Tb0Pb0LT^e`MTIq>Ugb0iaP chIT.E>LTTLGZVkbXZVEKchb0Tb0E>^*bSLE>JchI;TGeMbQSITUmJ
zEMIQ!UgbnJK[bTb`>TbnP5b0E;GLGZgI;EZVia`4I_P5bnJqzNpGb*yzG`>TL[iLGZV^0P|MDFE>Z]GZVLUgUVNW4TbnP5bnLT^eMbTPtIcXez{Kv
iLEUmLEM[;{>L[;bXq4b0UgZVbk;b0JGe>LGXP{>^^b0PPrch{MU_PrGITN_v¡^Iia`MTbeMb0E>P5ZVIEPNKPrGbiP EMb0b0JKbnJGIiLb
GeMbSPLiabzZgE4JMP IcMZgEKchb0Tb0E>^*bnP `bI;`MUgbiLbQ!eMbETb0L;JKZVEM[¢LdP5GI;TN;W0LE4JGeMb0TbchITbCEMbbnJKb0J
GI~e>L#kbL;^^*bnPP!GIuGeMbxPLiabzZVE>JfIcCzEMIQ!UVb0JM[b`bI`>Ugbx{>P5bQ!eMbEsiL_ZVEM[ZVEKchbTbE4^*b0P0|
}IxGe>ZVPSbE4Jp£K^e>LEMuLE>Jp¢qbUmP5I;E È £M^e>LEMLE>Jpdq4b0UVPIE Q0 <)< Þ JMbkb0UgI;`4bnJuLGeMbI;TNaIc
ez{MiLEzEMIQ!UVb0JM[bxP5GT{>^*G{MTb0P{>Pb0JL;PLpq>L;P5ZmPdchITLuEz{Mixq4b0TIcP5GITN_vw{>E>JKbTP5GLE4JKZgE>[
P5NKP5Gb0iaP È {MUVUgZVEM[chITJ Qn <)<.7 Åb ;IEM[ Q0 << 7E/ZgUVbE>PzN Qn <!= Þ | EMbQtL#NsIctb0kLUV{>LGZgEM[
GeMbL;^^{MTL;^*NaIc¨PrGITN_vw{ME4JKbTPrGLE>JMZgEM[RP5NKP5Gb0iaPtQtLPGIxGb0P5G!GeMb0i GeMTI;{M[eL {>b0P5GZVIEKv
LE>PQSbTZgEM[R`MTIK^*b0PP0|M}tQIa`>LT5GZV^{MUVLT¢PrGITN_vw{ME4JKbTPrGLE>JMZgEM[RP5NKP5Gb0iaP0W È {MUVUgZVEM[chI;TJ
J È /ZgUVbE>PzN Q0 <= Þ QSbTb{>P5bnJfZgE^*IE r{ME>^GZgI;EQ!Z]GesIE>bIcXGe>bb0LTUVZgbnPrG
Q0 << Þ LE>
©PNzP5Gb0iPW /YbE>JMN b0eMEMb0T5GnO P È be>EMbTG Q0 < Þ |
oQSL;Pp^IE>^bZVkb0JL;PpLE¹Zgia`MUVbiab0E;GLGZgI;E¹IcLH[bE>bTLUdiaIKJKb0UIc {>b0P5GZVIEKv
LE>PQSbTZgEM[4|}teMba`MTZViLTNsTb`MTb0PbE_GLGZVIEs{>E>JKbTUVN_ZVEM[ QSL;P£K^e>LEMO P ¸C%
!#"$%
1>
R *%¶ È £K^e4LEM Q0 < Þ WQ!eMZV^elZmPLfiL rI;TJKb`4LTG{MTbachTI;ioGeMbGTLJMZ]GZgI;E>LU
Dr7iRIKJKb0ULJMI`KGb0JYqzN^*{MTTbE_GD5£l¬P5NKP5Gb0iaP0| 7L`M`>TI_L^eMbnJsZgGPx7GLP
ZgEÄGrQIP5GL[bn1P C {>E>JKbTP5GLE4JKZgE>[GeMb {Mb0P5GZVIEÄLE>Jl\>E>JMZgEM[sGeMbLE>PQb0T0|L^eIctGeMbnP5b
PrGL[;b0PQb0Tb!ch{>T5GeMbT!JKZVkzZVJKbnJuZVEuGrQSIxP5Gb0`>P|>{MbnPrGZgI;Eu{ME>JMbTPrGLE>JKZVEM[xQSL;P^*I;ia`MTZmPb0JIc
È Q Þ %% 1>4%F¡; 1 TbnP5`IE4P5ZVqMUVbchI;T¨^UVL;PPZgchN_ZVEM[ {Mb0P5GZVIE>P¨LE>J È Þ 0*>w
¶#$m$ chITJKb*GbTiaZgEMZVEM[uQ!e4LGdGeMb {MbnPrGZgI;EMbTdTbnLUVUgNZgE_GbE>JKbnJfQ!eMbEL {Mb0P5GZVIEQtLP
EMIGqbGLb0EUVZ]GbTLUVUgN |.ZVE>JKZVEM[pGeMbLE>PQSbTdQtLPJKZVkzZVJKbnJsZVE_GI È ¦ Þ %4¡>t$ % 2 % 1 GIJKb*GbTiaZgEMbdeMIQJKb*GLZVUgbnJaITb0UVLq4I;TLGbtGeMbLE>P5QSbTP5eMI;{MUmJaq4bdLE>J È ? Þ $% µ z
µ Km$1%*$ chI;TCL^*G{>LUgUVNb*yzGTL;^GZVEM[Ge>bdLE>PQSbT.chTI;iÃGe>b¢iabiaITNTb`MTb0PbE_GLGZVIExIcGeMb
PrGITN|¢UVU.chI{MT`Me>LPb0PIc O P`MTIK^*b0PPZgEM[~^*ITTb0P`4I;E>JGILTb0LPdIcCTb0Pb0LT^ef`MTIv
iaIGbnJq_NuGeMbL;JKkLE>^b0J Tb {MZgTbiab0E;GPSIc.GeMbd
ddD d} `MTI[TLif|zDFE W
eMIQSbkb0T0WzLUVUGe>b0Pb`>e>LPb0PtLTbJKb`bE>JMbE_G¢{M`IE~GeMbxI;E>^*b0`KG{>LUÅdb0`4b0E>JKbE4^*N~P^eMb0iaL
Ge>LGe4LPdPbk;bTLU UVZViRZgGLGZVIE>P0WGeMbxiL rITIEMbxq4b0ZgE>[uGe>bZVE>LqMZVUVZ]GrNGI~I`bTLGbIELTq>Z]v
GTLTNpJKIK^*{>iRb0E_GPtZVEkLTZVI{>PtJKI;iLZVE>P|
¢b0^*b0E_GUVNWP5GI;TN^Iia`MTbeMb0E>P5ZVIExQSL;P.Tb0k_ZmPZ]Gb0JchTI;i LJKZ @bTbE_GX`bTP5`b0^*GZVkbWZw| b|VWIEMb
Ge>LGZmPE>IGZVE_Gb0TbnPrGb0JaQ!ZgGepP`4bn^*Zg\4^dL;P5`b0^*GPIc zEMIQ!UVb0JK[;b!Tb0`MTbnP5b0E_GLGZgI;EaITZVEKchb0Tb0E>^*b
Gbn^eMEMZ {>b0P0WXqM{KGTLGeMb0TxQ!ZgGeªLlP5ZVia`MUVbW¨q>L[_Prv¡Icv¡QSITJMPL`M`MTI;L^elGe>LGQSI{MUmJÄ`>ZV^HL
P5b0E_GbE4^*bchTI;i LxP5GI;TNuL;PtLTb0P`4I;E>Pb¢GILE~LJ~eMIK^ {>b0P5GZVIE |K}teMZmP!L`M`>TI_L^euQtLP\>TPrG
Tb0`4I;T5Gb0JfZVEfGeM
b HPNKPrGbi È B¢ZVTP^eMiLE ¢g
HP{M`M`ITGP
Q0; Þ | *%t*w# LP!I;`M`I;Pb0J~GIuJKIK^{MiabE_GdTb*GTZVbkLUqzN~\>E>JKZVEM[aGe>bq4bnPrGiaLG^efqb*GrQSbbE
GeMbxQI;TJfPb*GTb0`MTbnP5b0E_GZVEM[uL {Mb0P5GZVIEsLE>JGe>bQSITJP5bGP¢Tb`>TbnP5b0E;GZgE>[aGeMbRP5b0E;GbE>^b0P
ZgEpGeMbJKIK^*{>iRb0E_G0| iRbnLP{MTb0PGeMbiLG^epq_NaGeMbP5ZVÁbIc GeMbZVE_Gb0TPb0^*GZVIEuIc
GeMb¢GrQIQSITJxPb*GP
| Sb0^L{>PbSiLG^eP5ZVÁb¢JMI_bnPCEMIGC`MTIzJM{>^*b¢L^Iia`MUVb*GbdITJKbTZgE>[I;ERGeMb
JKIK^*{Miab0E;G!PbE_Gb0E>^*bnPW_P5b0E;GbE>^b0PGe>LGiLG^euIEpUgI;EM[b0TQSITJMPLE>JIK^^{MTbnLTUgZVbTZgEpGeMb
JKIK^*{Miab0E;GdLTb`MTb*chb0TTb0JLPtLE4P5QSbTP|KJMJKZgGZVIE>LUgUVNWME>ITiaLUgZVÁ0LGZVIE>PSLE4Jpby_GbE>PZVIE>PtIc
GeMb!QSITJPb*GPXLTb`I;PP5ZVqMUVbtq_N È L Þ TbiaIkzZgE>[¢Ge>btP5GI;`xQSITJMP W È q Þ PrGbiaiaZgEM[GITbiaIk;b
ZgE >b0^*GZVIE>LUL 0RyKbnPchTIi GeMbQI;TJ>1P 7SLE>J È ^ Þ {>P5ZVEM[jE>LiabTb0^I[;EMZgÁ0bTPachIT~`4b0TPIE4PW
UgIK^0LGZVIE4PSLE>JGbia`ITLUZgEMchITiaLGZVIELE>JLPP5IK^ZVLGZVEM[GeMbi Q!ZgGe~Ge>b {MbnPrGZgI;E~P5Gb0iaP0|
}teMbEMIGZVIEIc {MbnPrGZgI;EPrGbi QSL;P!ZVE;GTIKJK{4^*b0JqzN È b0eMEMb0T5G Qn < Þ Q!eMI\>TP5GdIq>PbTkbnJ
GeMbxLPP5IK^*ZmLGZgI;EfIc {>b0P5GZVIEs^LGb0[ITZVb0PtQ!ZgGeQSITJMPSGe>LG{>P{>LUgUVN~P5GLT5G {MbnPrGZgI;E>PW4b| [>|
´µ ¶ W ´µ I;T µ ´ * W4^0LUVUgZVEM[RGeMbnP5bQSITJMP *>*$1s$F*
x$ |
~QtLPGbnPrGb0JI;ExL^*IT`M{>PIc QQ 8 ^eMZgUmJKTbE O P.PrGITZgbnP`MTIkzZVJMb0JqzN C{Mq>UgZm^LGZVIE>PchITTbnLJKZVEM[^Iia`MTbeMb0E>P5ZVIE|;}teMb^*I;iR`>Tb0eMbE>PZVIEIc bnL^euP5GI;TNaZmPCGb0P5Gb0J
qzNfLE>PQb0TZVEM[a\>k;bPrGLE>J>LTJ {>b0P5GZVIE>P0W PrGLTGZVEM[uQ!ZgGe ´µ W ´µ W ´µ W ´µ LE>J
´µ ¶ |>ITa¢ ¥GeMbfZmJKbE_GZ]\4^0LGZgI;EHIcLPbE_Gb0E>^*b~chTIi Ge>bfP5GI;TN^IE>P5GZgG{KGb0PaLE
LE>PQSbTn|MDFEGeMb Ä^*I;T`>{>PWMGeMb^ITTbn^G¢LE4P5QSbTP!LTbLEME>IGLGbnJWKGez{>PdbE>LqMUVZgEM[
GeMbu^Iia`>LTZmP5I;Eqb*GrQSbb0EGeMbuLE>PQSbTP5b0E_GbE4^*baTbG{MTEMbnJqzNLEYL{KGI;iaLGZm^ {>b0P5GZVIEKv
LE>PQSbTZgEM[PNKPrGbi LE>JRGe>bdLE>PQSbTCPbE_Gb0E>^*b¢PbUVb0^*Gb0JaqzNRL`4b0TPIELGSLEMEMIGLGZVIERGZViab|
}teMbPLiab^IT`M{>PSQSL;PSUVLGbTt{>Pb0J~qzNpPbkb0TLU4IGeMb0T!! P5NKP5Gb0iaPtP{>^efLP [çH÷zòçÁôé J1I ½î÷ðóîqé4÷ëé½ó÷zçHòÂëî ïñòõ M Ô¥ÝÝDV P)R ÍÊ R Ò Ì [ PS _Da ré4÷zçíêçÁîé4ïðòçÁôqïî½òðé
ëî ïñòõ5é4ð¥îçHçpï0ø
÷zïîïñòé4çÁô4ìñðöHêé4ðô:ùðîîçHîîçÁîJë¥ìñïõ÷é*zêzéú!çÁô4çÁìñý÷zçqëî î÷zïñîïòé4çÁô4ìñðöHêé4ðôé4ð
ð+i) çÁô:÷ïñúûë5ìñïñõ÷éþ
8 ò7$.
òzðêzòî çÁô î
ë ü çHöÁé4ï çHî½ëò ü ë ü çÁô îJëô4ç0 òðóòlëî8 öHðòé4çHòéJó¸ðô ü î
ó÷çô4çëî½ëìñì
é4÷çpðé4÷zçÁôó=ðô ü îøô4ðúTé4÷ç ðöHë+ êzìëôý_ðøé4÷ç ü ðöHêzú!çHòé4îëô4ç òðóòlëî8 îé4ðù_ó=ðô ü î
*x
aª¾4;w>
t>$w À M $ ´ *z¾4% µ >>$
School Kids Clean Up Creek!
(EVERETT, WASHINGTON, June, 1988) − It has taken five years of hard work.
A3
But a group of children have cleaned up Pigeon Creek.
A1,A2
In 1983, the creek was so dirty that the fish had all died. A group of kids at Jackson
A3
School decided to do something about it. It became a project for their whole class.
First they cleaned out the bottom of the creek, called the creek bed. There were many
A4
weeds. They also found lot of trash and litter. Then the students raised fish eggs in a
tank of water called an aquarium. When the eggs hatched, they emptied the new fish
into the creek. They wanted others to stop making the creek dirty. So they made signs
A5
that said "Don’t Dump". They put the signs near the creek. They also made little books,
called booklets. The booklets told people how to keep the creek clean. Now, the water
is clean and new fish are being born in the creek. Pigeon Creek is a sign of the good
A2
things young people can do.
Q1: Who cleaned up the creek?
Q2: What was the name of the creek?
Q3: When did the work begin?
Q4: Where is the bed of a creek? Q5: Why did the kids make booklets?
F
ïñõþþ
lîé4ðôý_ëòòzðéPëé4ç ü óï0é4÷lëòzîó=çÁô4îHþæ=÷ç/çpíêçHîé4ïñðòî1 : 7 ëô4ç6ëìñîð
ìñïñîé4ç ü þæ=÷z.
ç 0: ëòzòðéPëé4ïñðòzîJïñòsöÁðôô4çHîùðò ü é4ðé4÷zç6íêçHîé4ïñðòzî& : 7 þ
È !ZVUVI @¤LE>Jl}teMbUVbE ::):zÞ W È d[ g¨ ::):zÞ LE4JGeMb STIQ!E%dEMZgk;bTP5ZgGrN
PrGLGZVP5GZm^LUUmLEM[;{>L[;b`MTIz^b0PP5ZVEM[^UVL;PP`MTIrb0^*G È e4LTEMZVL VC :)::zÞ |3/Yb~{>Pb0JGeMb
PLiabY^IT`M{>P~ZgE I{MTOb @ITGfGI¤ZgE4^*IT`ITLGb! ^L`4LqMZVUgZgGZVb0PZVE_GIªLED5£©
P5NKP5Gb0i|
DFEªGeMb Ã^IT`M{>P0WCL`M`>TI#yKZViaLGb0UgN Q : IcGeMb {MbnPrGZgI;E>PJKIEMIGue>L#kbLE
LE>PQSbTnWzLE>JP5b0kbTLU {MbnPrGZgI;E>Pte>L#kbi{>U]GZg`MUVb^*I;TTb0^*GtLE>PQb0TP0|_dUgUPrGITZgbnPQSbTbiLEKv
{>LUVUVNÄLEMEMIGLGb0JÄQ!Z]GeÄGe>bf^ITTbn^GxLE>PQb0TP0| /eMb0EjQSbp`bTchITiab0JI;{MTRb*yK`4b0TZViabE_GP0W
Qb^*I;E>PZVJKb0TbnJaIEMUVN {Mb0P5GZVIE4PCGe>LGte>L#kbLEME>IGLGbnJuLE>PQSbTP|_¢EpbyMLia`MUVbP5GI;TNxchTI;i
GeMb ^*I;T`M{4PLE>JZ]GP\>kbL;PPIK^*ZmLGbnJ {MbnPrGZgI;E>PLTbaZgUVUg{4PrGTLGb0JZVEl.ZV[{MTZ
b =M|
.Zg[;{MTQ
b =aPeMIQ¢PSGeMbLEMEMIGLGb0JLE>PQSbT
P X^*I;TTb0P`4I;E>JKZVEM[xGIab0L;^e {MbnPrGZgI;
E r|
}te>
b HJMbkb0UgI;`4b0TP¢e>L#kbI;q>P5b0Tk;b0JpGe>LGTb*chb0Tb0E>^*bTb0PIUV{KGZVIEfZVEKchITiLGZgI;E
LE>JE>LiRbnJb0E_GZgGrN;v¡TbUmLGbnJPbiLE_GZV^RZVEKchITiLGZVIE`MUmL#Nb0JLEYZgia`ITGLE;GTIUVbxZVEYZVJKb0EKv
GZgchNzZgEM[lGeMbLE>PQSbTn|¨}te>bTb*chITbWXLUgU¢P5GI;TZVb0PRQSbTbLUVPIiLE_{4LUVUgNHLEMEMIGLGb0JHQ!Z]Ge È L Þ
^*I;TbchbTbE>^buJMLGLsZVE>JKZm^LGZgE>[GeMbLE_Gbn^*bnJKbE_GPIc¢`MTIE>I{ME>PxLE>JlIGeMb0TxLE>L`Me>ITPLE>J
È q Þ E>Liab0JÄb0E_GZgGrNÄ^LGb[;ITZgbnPZVE>JKZm^LGZgE>[Q!eMbGeMb0TL`MTI`bTRE>LiRbTb`MTb0PbE_GPRL`4b0T5v
P5I;E WMLE~IT[;LEMZgÁnLGZgI;E W_LRUVIK^LGZgI;EpI;TtLaJMLGb;|MZV[{>T"
b <ZgUVUg{4PrGTLGb0PGeMbiaLT_v¡{M`>PSIcGrQI
^*I;TbchbTbE>^b^e>LZgE41P C Tb0`MTb0PbE_GPaLUVU!Tb*chbTbE4^*b0PxGIlLY[;TI;{M`HIczZmJMPRchTI;i _L^KP5I;E
£K^eMIzIU LE>
J Tb`MTb0PbE_GZVEM[aLUVUTbchbTbE>^b0PGI Zg[;bIETb0b|K¢E>PQSbTZgEM[ {Mb0P5GZVI
E
ZgEzk;IUVkb0PGeMbfPbUVb0^GZgI;EÄIcdLP5b0E_GbE4^*buGe>LGaiabE_GZVIE4PGeMb^UgbnLEMZVEM[bkb0E_G0W¨^*IE_GLZVE>PxL
TbchbTbE>^b!GI CZV[b0IEpTb0baLE>JuZVJKb0E_GZg\>b0PQ!eMI`bTchITiPXGe>b^*UVb0LEMZVEM[>|z}tQIx^LE4JKZVJ>LGb
Q:
!#"$%
School Kids Clean Up Creek!
R1
R2
(EVERETT, WASHINGTON, June, 1988) − It has taken five years of hard work.
But a group of children have cleaned up Pigeon Creek.
R1
R2
In 1983, the creek was so dirty that the fish had all died. A group of kids at Jackson
R1
R2
School decided to do something about it. It became a project for their whole class.
R1
First they cleaned out the bottom of the creek, called the creek bed. There were many
R1
R2
R2
weeds. They also found lot of trash and litter. Then the students raised fish eggs in a
R1
R1
tank of water called an aquarium. When the eggs hatched, they emptied the new fish
R1
into the creek. They wanted others to stop making the creek dirty. So they made signs
R2
R1
R1
R2
that said "Don’t Dump". They put the signs near the creek. They also made little books,
R1
R1
R2
called booklets. The booklets told people how to keep the creek clean. Now, the water
R2
is clean and new fish are being born in the creek. Pigeon Creek is a sign of the good
R2
R2
things young people can do.
F
ïñõzþþ lîé4ðôýsëòzòðéPëé4ç ü óïñé4÷_ô4çÁø£çÁô4çÁòöHç6ìñïñòîHþ
P5b0E_GbE4^*b0PPLGZmPrchNLUgU^*IE4PrGTLZgE_GDP CGeMb¢GZ]GUgbLE4JRGeMbP5b0E;GbE>^bdiLTbnJ |
SNP5b0Ugbn^GZgEM[
GeMbtiaI;P5GXZgEMchITiaLGZVkbtP5b0E_GbE4^*bW#GeMbSGZgGUVbtZVP.\>UgGb0TbnJI;{KG0|£KbE_Gb0E>^*b ZmP¨iaITbZVEKchITiLv
GZVkbqb0^0L{>PbZgGZmJKbE_GZ]\>bnP¢{ME>Z {Mb0UgNGe>b^*Tbb0L;P¢qbZVEM[ CZV[b0IETbbWKGeMbI;EMUVN^Tb0b
iabE_GZVIEMbnJlZgEÄGeMbpP5GI;TN;|}teMbuQSITJMP ·#$ LE>J % µ g* LTbWL;^^ITJKZgE>[~GI /YIT'J ¢bG0W
P5NzEMI;EzN_iaI;{>PWCPIlGe>bTbZVPE>IÄJKZ @bTbE4^*bsZVE¤GeMb0ZgTpJMb[TbbIcZVEKchI;TiLGZgk;bEMbnPP0| ¢E>UgZVb
ZgEMchITiaLGZVIEKvFPbbzZVEM[ÄWTbnLJKZVEM[^*I;iR`>Tb0eMbE>PZVIE¤Tb0UgZVb0PaI;E¤Tb*chb0Tb0E>^*bfZVEKchITiLGZgI;E
Ge>LGpP5`4LE>PRGeMbfbE_GZVTbGb*yzG0|§sITbIkb0T0W¨PZgE>^bLUVU {>b0P5GZVIE>PaTb*chb0TaGIYGeMbsPLiabGbyzG0W
chTb {MbE_GUVNGeMbRLE>PQSbT¢IcL`MTbkzZgI;{>P {MbnPrGZgI;E È b;| [4|gW Þ Q!ZVUgU.q4bx{>Pb0JZVELachI;UgUVIQtvw{>`
{Mb0P5GZVIE | }te>bTb*chITbWQSbP5b0bxGe>LGGeMbuP5{>q rb0^*GIc {MbnPrGZgI;E rGe>bRzZmJMP s^*ITb*chb0TP
Q!Z]GeGeMb [TI{M`~IcX^eMZgUmJKTbE RZV
E W4LE>JpGe>LG rGeMbN RZg
E ^*ITb*chb0TPSQ!ZgGefqIG
e 5GeMb
zZVJMP aLE>J~GeMb 5[;TI;{M`pIc.^eMZVUVJMTb0E M|
PE>IGbnJlZgE È ¢[ *gC :)::Þ Gb*yzGx^IeMb0Tb0E>^*bpZgEKchI;TiLGZVIEZmPEMb0b0JKbnJlchITRLE>PQb0T5v
ZgE>[ ´µ ¶ {Mb0P5GZVIE4P|ÅZVP^*I;{MTPbx^{MbR`MeMTLPb0PP5{>^eYLP %z$* I;T $ ZgE4JKZV^0LGbR^0L{>PLGZgI;E
^*I;eMbTbE>^bTb0UVLGZVIE>Pqb*GrQSbb0EP5b0E;GbE>^b0PLE>JYGe>b0PbTb0UVLGZVIE>PiL`GIfGeMbpiRIGZVkLGZVIE
P5I;{M[e_G!qzN ´µ ¶ {MbnPrGZgI;E>P0|MMIT!byMLia`MUVbWKGeMbP5b0E_GbE4^*bª® µ ¶u
$]M$ µ $
® R E K
» b0UVLq4I;TLGbnP¨{M`4I;ERGeMb!ZVE_GbE_GCIc4GeMb¢zZVJ>PXb*yK`MTb0PP5bnJZVE |}teMb¢PbE_Gb0E>^*b
® ¾ µ *¶ $f
a;p w1g~
0n·#$³d%g
n0·g$;» e>L;PGrQI~ch{ME>^*GZVIE>DP C È Q Þ ZgGZVPGeMbIEMUVN
P5b0E_GbE4^*b!ZVExGeMbtGbyzGXGe>LGCTbchbTP.GIqIGeaqIzIzUgbGPXLE>JxGeMb!zZmJMPCLE4J È Þ ZgGCZgE4JKZV^0LGb0PXLE
LJMJMZ]GZgI;E>LUK1b @bn^GXIc4GeMbtbk;bE_G¨iRb0E_GZVIEMbnJZVERPbE_GbE>^
b |}teMb0TbchITbWnGe>bS`>TIK^*bnPPZVEM[dIc
QQ
*x
aª¾4;w>
t>$w À M $ ´ *z¾4% µ >>$
ZmPq>LPb0JI;ETbchbTbE>^bdJMLGLLE>JaGeMb^Iiq>ZgEMbnJu^*I;eMbTbE4^*b¢b1@bn^GIcGeMb^*{Mb`MeMTLPb0P
$ LE>J $* |
áâ
ßgãå ./ â åâ0-Kã á ¡+[ã - áân/+ ) ß ) á ã/ )
352 u
A!";= A< F A )
} eMbGrN_`>ZV^0LULT^eMZgGb0^*G{MTbIcxLE LE>PQSbTbEM[;ZgEMbY{>Pb0J¹chITD5£ ^*I;ia`MTZmPb0PpGeMTbb
t
iaIzJM{MUgbnP¢LP!PeMIQ!EZgE.ZV[{MTb C
Q Þ }teMb t>*$wuSn%$$_ iaIKJK{MUVb^0L`KG{MTbnPXGeMbPbiLE_GZV^0PCIcGeMbdE4LG{>TLU>UmLEM[;{>L[;b
{Mb0P5GZVIEYQ!eMZm^eYb0E>Lq>UgbnPGeMbTb0^I[E>Z]GZgI;EIcSGe>b %FM$ ´ 1¶ |MI;TbyMLia`MUVbW
[ZVkb0E {Mb0P5GZVIE ; ZVUgUV{>P5GTLGbnJÄZVEH.Zg[;{MTb~¦MWGe>b~byz`b0^*GbnJHLE4P5QSbTGrN_`bpZmPRZVJMbE_GZg\>b0J
LPL IT YP{>^eL;P %$ W *g·;*$ IT M$ |4DFELJMJKZgGZVIEWMGe>b {Mb0P5GZVIE
b0N_QSITJMPRGe>LGfLTb{>P5bnJªGIHTbGTZgb0kbfGbyzG~`>L;PPL[;b0PaQ!eMb0TbGeMbLE>P5QSbTpiaL#N¤UVZgbLTb
ZVJMbE_GZg\>b0JfJK{>TZVEM[ {Mb0P5GZVIEf`MTIK^*b0PPZgEM[4|
QUESTION
Question
Processing
DOCUMENTS
Document
Processing
Expected
Answer Type
Index
Retrieval
keywords
Passages
ANSWER(S)
Answer
Processing
Answer
Formulation
Answer
Extraction
Resources
F
ïñõzþ.Iþæ=÷ç6ëô4öP÷ï0é4çHöé4êzô4çpðø;ëòcëòîó=çô½çHòzõïñòç
Þ }teMb R0%K
a>t0%*$$z a
i IzJM{MUgba{>Pb0PLEZVE>JKbyIcCGeMbJKIK^*{Miab0E;G^IUVUgbn^GZVIEGI
È
Þ
TbGTZgb0kbxGby_G`4LPPL[b0PdGe4LG L *^ IE_GLZVEYLUgU¨GeMb {Mb0P5GZVIEYb0N_QSITJMPLE>J È q Þ e>L#kbaLG
UgbnLP5GxI;EMb~^IE>^b`KGaIc!GeMbPLiabP5b0iaLE_GZm^u^*UmLPPxL;PGeMbpbyK`4bn^GbnJHLE>P5QSbTGrNz`4bZ]cdGeMb
UVLG5GbTZmP_E>IQ!E |;>IT {MbnPrGZgI;E ; W_`>L;PPL[;b0P¨iabE_GZVIE>ZgEM[ !*_ LE>JpLEzN LTb^*IE4P5ZmJKbTb0JpTb0Ugb0kLE_G0|
¦ Þ }te>b~À M$ ´ *xt0%*$$z iaIKJK{MUVbp^Iia`>LTb0PGeMbpPbiLE_GZV^0PIcSGeMb~LE>PQb0TL[_LZVE>PrG
GeMbPbiLE;GZV^0PtIc.GeMb {MbnPrGZgI;E~qb*chI;Tbby_GTL;^GZgEM[RGeMbLE>PQSbTn|
£Kbkb0TLUE>IGLqMUVbpkLTZVLGZVIE>PchTI;i GeMbfPrGLE>J>LTJD5£j¥LT^eMZgGbn^G{>TbuQSbTbpZVia`MUVb*v
iabE_GbnJZgE È Q Þ GeMbpDr!vwq>L;P5bnJÄ PNKPrGbi Tb0`4I;T5Gb0JYZgE È QSI gC ::):zÞ 7 È Þ GeMb
PrGLGZVP5GZm^LU¨ÃPNKPrGbi `MTbnP5b0E_Gb0JfZVE È D¡GGrNK^eMbTZVLe *!g :: Q Þ 7 È ¦ Þ GeM"
b /Ybq^*UVI`b0JMZVL
Qn
!#"$%
¬PNKPrGbioq>L;P5bnJYIEl{>PZgEM[7GrN_`IUVI[;ZgbnPGI`MZVEM`IZVE;GLE>PQb0TP0W LPJKbnP^TZVqb0JYZgE
È BdIk_N *VX :: Q Þ 7 LE>J È ? Þ Ge>b dCv1chIK^*{4P5bnJ PNzP5Gb0i JKbGLZgUVb0JlZVE È £zTZge4LTZLE>J
Z ::):zÞ | Cb*GLEMIGeMbTdEMbQ©D5£sÃLT^e>Z]Gb0^G{MTbQSL;P!Zgia`MUVbiab0E;Gb0JfZVEGe>b MÀ ¸ P5NKP5GbifW;Q!eMZV^ep{>P5bnJuPbkb0TLUKchbbnJKq>L;^xUVIzI`>PCGe>LGbE>e>LE>^b0JZgGPS^e>LE>^*b¢Ic\>E>JKZVEM[
GeMb^ITTbn^GxLE>P5QSbT È XL;P^0LsLE4J BdLTLq>L[;Zg{ :: Q Þ |.£zZVE>^*b MÀ ¸ QtLPxIEMbIcdGeMb
GI;`Kvw`bTchITiaZgE>[RPNKPrGbiPtZgE~Ge>b}!¢S LE>J Q : bkLUV{>LGZgI;E>P0W_QSb^eMI;PbGIa{>PbZgGdLP!L
q>LPZmPchI;TtbEMe>LE>^*ZVEM[RLEpD5£f PNzP5Gb0i¬Q!Z]Ge~¢¹ ^0L`>LqMZgUVZgGZVb0P0|z}te>bLT^eMZgGbn^G{MTb
Ic MÀ ¸ ZmPtZgUVUV{>PrGTLGbnJ~ZVEfZV[{>Tb |
QUESTION
DOCUMENTS
PARSE
ANSWER(s)
Collection Index
Question Dependencies
Boolean Retrieval
Question
Keywords
Lexical/Morphological/Semantic
NORMALIZATIONS
Min<Paragraph #<Max ?
LOOP 1
Yes
No
Answer Dependencies
Yes
Expected Answer Type
in Paragraph ?
Expected
Answer
Type
No
Discard
Paragraph
No
Yes
Morpho−
Lexical Alternations
LOOP 2
Multi−Term Semantic
NORMALIZATIONS ?
LOOP 3
Semantic Alternations
No
Yes
Answer Extraction
F
ïñõþ Jþ [çèzïñöHðîçHúëòé4ïñöqø£çHç ü ëö îø£ðô3+¥þ
DFE MÀ ¸ WCGe>b {Mb0P5GZVIEZmP~`>LTP5bnJ¤GIÄbyzGTL^G È Q Þ GeMbb*yK`b0^Gb0J¹LE>PQb0TGrNz`4b
LE>J È Þ LEITJKb0TbnJUgZmP5GIcb0N_QSITJMPp{>P5bnJGIjTb*GTZVbk;bTbUVbkLE_GGb*yzGf`>LPPL[bnPWIT
¡ ; 0 µ $ WQ!eMb0TbGeMb;bNzQSITJMPLE>J^*IE4^*b`MGPSIcGeMbbyz`b0^*GbnJ~LE>P5QSbTSGrNz`bLTb
chI{ME4J|}teMb`>LTP5bGTb0bIcGeMb {MbnPrGZgI;Eªb0P5GLq>UgZmP5e>b0PaGeMbJKb0`4b0E>JKbE4^*ZVb0Pqb*GrQSbb0EªGeMb
{Mb0P5GZVIEQSITJMP0|£zZgE4^*b!GeMbd`>LTPbSGTbb¢ZmPX`MTIKJK{>^b0JaqzNRL`>TI;q>LqMZVUVZVP5GZm^t`>LTPbTCPZgiaZVUVLTXGI
GeMbI;EMbTb0`4I;T5Gb0J~ZgE È IUVUgZVE>P Q0; = Þ Wzb0L;^e~qMZVE>LTNpPNzE_GL^*GZm^JKb`bE>JMbE>^NpZmP!LPP5ZV[EMbnJ~L
`MTIq>LqMZgUVZmPrGZV^¨QSbZV[e_G0W*Gez{>P ZVE>JK{4^*ZVEM[dLEI;TJMbTIEGeMbUVZVP5GIc_;bNzQI;TJ>P{>P5bnJchIT Tb*GTZVbkLU1|
}teMZmPITJKb0TbnJUVZmPrGZmP{4P5bnJlq_N MÀ ¸ O P`>LTL[;TL`MeTb*GTZVbkLUCiaIzJM{MUgb;|}teMbpiRIKJK{>Ugb
ZVPpLEªb*yzGb0E>PZgI;E¤IcGeMb > À ¾ Dr«bEM[;ZgE>b È £KLU]GIE Q0 = Þ WXiaIzJMZ]\>bnJªZgE¤GrQSIliaL rIT
QSL#NKDP C È Q Þ SIzIUVb0LEpI;`4b0TLGITPSQb0TbLJ>JKb0JW>b| [>|VW CW 7 È Þ JKIK^*{MiabE_G¢`>LTL[TL`Me4P
TLGeMb0T.Ge>LEch{MUVUMJKIK^*{>iRb0E_GP¨QSbTbTb*GTZVbk;b0J|#}teMbtQb0UgUgv¡_E>IQ!EJKZmPL;JKkLE_GL[bSIc SIzIUVb0LE
TbGTZgb0kLU¨v¢ZgGPZVia`MTbn^*ZmP5ZVIEvdQtLPe>LE4JKUgbnJYq_NJKTI;`M`MZVEM[fP5I;iRbaIcGeMbb0N_QSITJMPQ!eMbE
GeMbxP5bnLT^e~P`>L^bqb0^0LiabGIzITb0P5GTZV^*GZVkbLE4JpGIzIachbQ `>LTL[;TL`Me>PQb0TbTb*G{>TEMbnEJ 7MI;T0W
qzNxLJ>JKZgE>[;bNzQSITJMPQ!e>bERGeMb¢Pb0LT^eRP5`4L^*btQtLP.GI_IqMTI;L;JLE>JxGIzIiaLEzNiab0LE>ZgEM[ch{MU
`>LTL[;TL`Me>PQb0TbxchI{>E>J| }teMZmP`MTIz^b0PPIcSL;JMJKZVEM[fITJKTI`M`>ZgEM[b0NzQI;TJMP{ME_GZVUXbZgGe>bT
*x
aª¾4;w>
t>$w À M $ ´ *z¾4% µ >>$
Q¦
LEªL^0^*b`MGLq>UgbEz{MiqbTIc`>LTL[TL`Me>PxLTb~Tb*GTZVbk;b0JI;TRGeMbb0E;GZgTbUgZmPrGIcb0NzQI;TJMP
e>LPaqbb0Eª`MTIK^b0PP5bnJH^*I;E>P5GZgG{KGb0PRGe>bf\>TP5GachbbnJKq>L^UVIzI`¤ZgE¤GeMb MÀ ¸ Tb*GTZVbkLU
iab0^e>LEMZVPi È .ZV[{MTb Þ |}teMbSiaZgEMZVi{>i(LE>JiaLyKZgix{Mi©E_{>iqbT¨Ic>`4LTL[TL`>e>P JKb0`4b0E>JMP
IElGeMb~PZgÁ0bpIcSGeMb~JMIz^{MiabE_GR^IUVUgbn^GZgI;E |>ITGeMb~}!dS ^*I;UgUVb0^*GZVIE WQbpJMb*Gb0TiaZVEMb0J
bia`MZVTZm^LUgUVNGe>LG!GeMZVP¢E_{>iqbT¢PeMI{MUmJEMIG!byK^bbnJ 8:: |
XLTL[TL`Me4PGe4LGpJKIlEMIG^IE_GLZgEjGe>bbyK`4bn^GbnJªLE>PQb0TRGrN_`bLTbJKZVP^LTJMb0J|X}teMb
Tb0iLZVEMZgE>[j`>LTL[TL`Me4PuLTb`4LTP5bnJ¹LE>J UVb*yKZV^IvFP5b0iLE_GZm^{MEMZg\4^0LGZVIE4PLTbsGTZVb0J| SN
Zgia`MUVbiab0E;GZgE>[dI{>TIQ!Ek;bTP5ZVIEIcKGeMb`>{MqMUVZV^UgNL#kLZVUVLqMUVbIUVUgZVE>P`>LTP5b0T È I;UgUVZVE>P Qn = Þ W
QbaLUmPI~UVb0LTEMbnJsL ;*%*¶ iaIzJMbU¨Ge4LGbE>LqMUgbnPGeMbaiL`M`>ZgEM[Ic`>LTP5bxGTbbnPdZVE_GI
P5bGPIcCq>ZgE>LTNfTbUmLGZgI;E>Pdqb*GrQSbb0EGe>bRe>b0LJsQI;TJIcCb0L;^e^*I;E>PrGZ]G{MbE_GLE>JsZ]GPPZVqMUgZVEM[
QI;TJ>P|MI;T¨b*yMLia`MUVbWnGe>bS`4LTP5bGTbbSIc4GeMb {Mb0P5GZVIE ® ´
4¶d;
a*$d µ Rg$
4F$ ´ _²²;°#³º» Zm1P C
S
VP
VP
PP
NP
WRB
NP
NNP
VB
IN CD
How many games did the Dallas Stars
win
in
JJ
NNS VBP DT
NP
NNP
2001
> IT!bnL^e`4I_PPZgq>Ugb^IE>P5GZgG{Mb0E_GtZVELa`>LTPbdGTb0bWKT{MUgbnPt\>TPrG¢JKbnP^TZVqb0J~ZgE È §L[b0TiLE
Q0; 8Þ LE>J È ;bUVZgEMb0 *¨giQ0;? Þ ZVJKb0E_GZgchNGeMbSeMbnLJ^e>ZgUmJLE>J`MTI`>L[;LGbCZgG¨GIZ]GP`4LTbE_G0|
MI;TtGeMb`>LTPbGTbbZVUgUV{>P5GTLGbnJpqbUVIQ GeMb`MTI`4L[;LGZVIEuZmDP C
S (win)
VP (win)
VP (win)
PP
NP (games)
WRB
JJ
NP (Stars)
NNS VBP DT
NNP
NNP
How many games did the Dallas Stars
NP (2001)
VB
IN CD
win in
2001
/ e>bE~GeMb`MTI`>L[;LGZVIEuZmPt^*Iia`MUVb*Gb0J~eMb0L;Jzv¡iRIKJKZg\>b0TSTbUmLGZgI;E>PSLTbby_GTL;^Gb0J[;bEMb0T5v
LGZgEM[tGeMbXchI;UgUVIQ!ZgE>[tJMb`bE>JKb0E>^*NP5GT{>^G{MTb;W^LUgUVb0J >$wx$*
41%*
ZVE È BdLTLq>L[;Zg{
*Sg4 ::): L Þ |_£KIiabdIc GeMbUVb*yKZV^0LUb*yK`MTb0PP5ZVIE4PXchTIi7GeMbnP5bJKb0`4b0E>JKbE4^*NuP5GT{>^G{MTbnPLTb
LUmP5IxLPP5ZV[EuPbiLE_GZV^dUVLq4b0UVPqzNxGeMb dLiabnJuCE_GZgGrNaTbn^*I;[EMZVÁb0T È b;| [4| I
T C
How many
COUNT
games
win
Dallas Stars
ORGANIZATION
2001
Q1?
!#"$%
PZgiaZVUVLTJKb0`4b0E>JKbE4^*NPrGT{4^G{>TbZVP[b0EMbTLGb0JxchTI;ib0L^e`4LTL[TL`>ea^IE_GLZgE>ZgEM[GeMb
b0N_QSITJMP ´ W xg#$4F$ W _
$ LE>J z²²° |>}teMbP5b0iLE_GZm^nJKb`bE>JMbE>^NaP5GT{>^*G{MTb0P
Ic {Mb0P5GZVIE4PXLE>JLE>P5QSbTP¨LTb!{MEMZg\>b0JaqzNxiaLG^eMZVEM[qIGeaGeMbdP5GT{>^*G{MTb¢LE>JxGeMb¢UVb*yKZV^0LU
UVLq4b0UVP0|>ITxb*yMLia`MUVbWGeMb~`>LTL[;TL`Me^IE_GLZgEMZVEM[GeMbpPEMZV`M`4bG ® xg#$p4F$ug$F*
| B¢IQSbkb0T0W
;
a*$a _²;²°Y ´ ´ * z» QI;{MUmJs`MTIKJK{>^*baLfP5{4^^*bnPP5ch{MU¨{MEMZg\4^0LGZVIE3
P5b0UVJMIi¥ZmPtGeMb^L;P5bQ!eMb0EGeMb^ITTbn^G¢LE4P5QSbT¢^0LEq4b{>EMZ]\4b0JfQ!ZgGeGeMb {>b0P5GZVIEfQ!Z]GeKv
I{KGLUVUgIQ!ZVEM[pLEzNpchI;Ti IcX`>LTL`MeMTLPbIcXGeMbZVEKchITiLGZgI;E |>ITdGeMZmPdTb0L;P5I;E W>QSbLUgUVIQ
UgbyKZV^0LUwW;iaIT`MeMI;UgI;[Zm^LU4LE4JuP5b0iLE_GZm^¢kLTZmLGZVIE4PIcGeMbb0N_QSITJMPCGIRq4bLqMUVb¢GIRJMb*Gbn^G
GeMbRLE>PQSbT!ZVEP5E>Zg`M`b*GP¢UVZg;b¹® µ R° f0%¡$ar µ Q
RV#$¡$ z²²° ´ x$KL m$_» I;T® Rg$4F$1**~ µ *F
x$° ~w
$
z²²°» |MI;TGeMZmP!TbnLPIE W
Q!eMbE>bkb0TCGeMb{>EMZ]\^LGZgI;Euqb*GrQSbbE {>b0P5GZVIE>PLE>J`4LTL[TL`>eaPEMZV`M`b*GPZmP{ME4P5{>^0^*bnPP5ch{MU
GeMbP5bnLT^echITEMbQ¤Tb0Ugb0kLE_GX`>LTL[;TL`Me>Pq4b0[ZVE>PCLE>bQ¤q_NxTb0`MUmL^*ZVEM[ {Mb0P5GZVIERb0NzQI;TJMP
Q!Z]GesP5I;iabIc.GeMb0ZgT¢iaI;T`Me>IUVI[Zm^LULE>JUVb*yKZV^0LULU]GbTE>LGZgI;E>P0|M}teMZVPdZVP!GeMbPb0^IE>J~chbbnJzv
q>L^UVIzI` |jGeMZVTJchbbnJKq>L;^UVIzI`GL;b0P`MUmL^*bSQ!eMb0ExPbiLE_GZm^SLUgGbTE>LGZVIE>PLTbSLUgUVIQbnJ
ZgEaGeMb!EMI;TiLUVZVÁ0LGZgI;ExIc4GeMb {Mb0P5GZVIEa;bNzQI;TJ>P|Åb`bE>JKZVEM[I;ExGeMb!chI;TiP¨IcUVZgEM[;{MZmPrGZV^
zEMIQ!UgbnJK[bbia`MUVINb0J W>GeMbxLU]GbTE>LGZgI;E>P¢{>Pb0JZgEschbb0JMq>L^fUVI`>PdGrQI~LE>JsGeMTbbR^LEq4b
^*UmLPP5Zg\>bnJ~L;P1C
µ V% À F*w>$ |SÅdb0`4b0E>JKZVEM[HI;EªGeMbYP5`b0^Z]\^*ZgGrNjIcGeMb {MbnPrGZgI;EbN_v
QI;TJYGe>LGRJKb*GbTiRZVEMbnPGeMbpbyz`b0^*GbnJLE>PQb0TGrNz`4b;WQSbpL;^^*bnPPLUVUGeMbuiaIT`MeMI;UgI;[Zm^LU
JKbTZVk#LGZVIE>P!L#kLZgUmLqMUVbZg`
E /I;TJ ¢b*Gn|MMI;T!b*yMLia`MUVbWKZVEpGeMb^L;P5bIc {Mb0P5GZVIE _²± ½ µ >*4¡s µ *p% ³uº QSbaLUgUVIQ LUgU¨GeMbiaIT`MeMI;UgI;[Zm^LUXLU]GbTE>LGZgI;E>PIcSGeMbk;bTq
>*4¡ |;MI;TXGe>ZVP {>b0P5GZVIE WGeMb¢k;bTqxQtLPXiL`M`4bnJRGIZgGPXE>IiaZgE4LUVZgÁ0b0JRchITifW >>F W
Q!eMZm^e~ZmPtZgEGeMbP5{>qKvwe>Zgb0TLT^eMZVb0PIcGeMbLE>P5QSbTSGrNz`b ¨|M}te>bTb*chITbWzQSbZgEM`>{KG!GI
GeMbTb*GTZVbkLUbEM[;ZgEMbGeMb {MbTN C
É ×Ø g Ð R ÐzÊÑ6Ï:Ü:Ô ËHÒ Ì ÐcÏJÜ:ÔÌUWÍÊW S ÊÎKÉ Ì WzÍÊW S ; É Ì WzÍÊW S ÝÑKÉ¿Ì WÍÊW S Ì W[
% À ¡1M$ |M£zZVE>^*b/I;TJ ¢b*GtbE4^*IKJKb0PtLGiaI;P5GtPbk;bEpGrN_`b0PIc.P5b0iaLE_GZm^dTb*v
UVLGZVIE>P¨`bTX^IE>^b`KGnWP5NzEMI;E_NziPGI;[b*GeMbT¨Q!ZgGeaLQbnLUgGeIc4IGeMb0T¨PbiLE;GZV^SZVEKchITiLGZgI;E
^LERqb!b0L;P5ZVUVNiaZgE>b0J|;£K{>^euLUgGb0TE>LGZVIE>P.ZVia`MTIk;bSGeMb!Tb0^0LUVUMIcGeMb¢LE>PQb0TX`>LTL[;TL`Me>P0|
MI;TbyMLia`MUVbWZgEGe>ba^0LPbxIc {Mb0P5GZVIE _° ½ µ p·gfw K µ
z³aº qzN
{>PZgEM[GeMbP5NzEMI;EzN_i chIT ·g* xGe>bdEMI;{ME #$$#$$ GeMbP5NKP5Gb0i7Tb*GTZVbk;b0Ja`>LTL[TL`Me4P
Q!Z]GeGe>bx^*I;TTb0^*GdLE>PQSbTn|>MI;T!GeMb {Mb0P5GZVIE _². ´ *Rm$ µ R
an>³º P5ZVE>^*bGeMb
LJKk;bTq * ZVPab0E>^*IKJKbnJÄZVE /YIT'J ¢bGuLPxq4b0ZgEM[lLE¤LGGTZgqM{MGbfIc m$¡% WCL;JMJKZVEM[GeMb
EMI{>E m$¡% GIaGeMbTb*GTZVbkLUb0NzQI;TJMPS`MTIKJK{>^b0PSGe>b^*ITTb0^G!LE4P5QSbTn|
J db*GGe>LGtZmPEMIGSLU]v
*
41% À ]¡1M$ |_§sZgEMZVEM[RP5b0iaLE_GZm^!zEMIQ!UgbnJK[b¢chTI;i /YIT'
QSL#NKP¨UVIK^LUVZVÁb0JxZVEaGeMb¢^IE>^b`KG{>LU>PNzE>Pb*GC`MTIkzZVJKbnP¨P5b0iaLE_GZm^!LUgGbTE>LGZVIE>P0|¢EbyKLia`MUgb
ZgE {Mb0P5GZVIE ½ µ u;g
*$¡$x g·;aF~ #*³aº PZVE>^*bxZgE /I;T'J db*GGeMbR[b0Ez{>P¢Ic
GeMbJMb*\>EMZgGZVIEfIcGeMbkb0Tq 1** ZmP g·_f
*wF* WzGeMb {MbTNuqb0^*I;iab0DP C
! !"$# %&('& 4 # g;
$F* g;
$F*)$ ' À # g·; *) ' 6
DFEGeMZmP!QtL#NaGeMbUVZg;bUVZge>I_IKJ~Ic¨TbGTZgb0kzZgEM[xGe>b^*ITTb0^G¢LE>P5QSbTtZmPt[Tb0LGUVNbEMe>LE>^*bnJ|
3 #8BFA<?(
.=-E;A!5?4A ++*)( ¢vwq>L;P5bnJTb0LJMZgEM[a^*I;ia`MTb0eMbE4P5ZVIEpPNKPrGbiPSUgIK^0LGbLE>P5QSbTPZgEfLxPZVEM[UVbJMIz^{MiabE_G¢LP
LRTbnP5{MUgG¢Ic.Zgia`MUVbiab0E;GZgE>[aGeMbchI;UgUVIQ!ZgE>[aP5Gb0`>PDC
Q Þ t>*$1ut0%*$$z `>TIK^*b0b0JMPL^^ITJKZVEM[GIGeMb¢by_GTL;^GZgI;EIcZgEMchITiaLGZVIEu^IE_Gb0E;G
Q8
*x
aª¾4;w>
t>$w À M $ ´ *z¾4% µ >>$
chTI;i bnL^e {>b0P5GZVIE | ¨I_PPZVqMUgbSTb`MTb0PbE_GLGZVIE>P.Ic4GeMb!ZgEMchITiaLGZVIERb*yK`MTb0PP5bnJZVEab0L;^exIc
GeMb\>kb {Mb0P5GZVIE4P¢LPP5IK^ZVLGb0J~Q!ZgGefbk;bTNpPrGITNuTLEM[;bchTIi¥q>L[vwIcvwQSITJMPSL`M`MTI;L;^eMb0P
È b;| [4| È BdZgTP^e>iaLE *Xg[Qn ÞPÞ GILch{>UgUM`4LTP5btIcGe>b {Mb0P5GZVIE È b;| [4| È !ZVUVI@LE>Ja}teMbUVbE
:)::zÞÞ ^*IixqMZVEMb0J~Q!Z]GefTbn^*I[;EMZgGZVIEpIc.E4Liab0J~bE_GZgGrN~PbiLE;GZV^ZVEKchITiLGZgI;E |
Story
Question
Question
Processing
Question Keywords
Question Parse
Named Entity
Recognition
Story
Processing
Reference
Resolution
Named Entity
Recognition
Answer
Searching for
the Answer
Pattern Matching
bag−of−words
Semantic Recognition
Linguistic
Enhancement
e.g. stemming
synonyms
F
ïñõzþ LKþ ô4ö÷zïñé4çÁöÁé4êzô4çqðø;ëô4çë ü ïñòõöÁðú!ùzô4çÁ÷çHòzîïðòsîýîé4çHú
Þ ¡¶Sn%$$_ ^*I;E>P5ZmP5GP¨Ic È L Þ ^*I;E>PZVJKb0TZVEM[LUgU>^ITb*chb0Tb0E>^*btUVZgEMKPCLEMEMIGLGb0JRZVEaGeMb
Gby_GdLE>J È q Þ Tb0^I[;EMZgÁ0ZgE>[GeMbP5b0iLE_GZm^^LGb[;ITZgbnPIc.E>Liab0J~bE_GZgGZVb0PtchTIi GeMbGb*yzG0|
¦ Þ À M$ ´ u% µ _ chIz^{>Pb0PRIEHGeMbfZmJKbE_GZg\4^0LGZVIE¤IcZgEKchI;TiLGZVIEHb0E>^*IKJKbnJHZVEjGeMb
QI;TJMZgEM[IcGeMb {Mb0P5GZVIEuLE>JaiLG^e>ZgEM[GeMZmPL[;LZgE>P5GCZVEKchITiLGZVIEachTIi Ge>bJKIK^*{>iRb0E_G0|
}teMbxPb0LT^eZmPZgia`MUVbiabE_Gb0JL;PdLp`>LGGbTEsiLG^eMZVEM[ È q4L[v¡Icv¡QSITJMP Þ L{M[iab0E;Gb0JQ!ZgGe
LJMJMZ]GZgI;E>LU UVZVEM[{MZmP5GZm^`MTIK^b0PP5ZVEM[ È b;| [4|MPrGbiaiaZgEM[4W>E>LiabLUVZVL;PtZVJKb0E_GZg\4^LGZVIE W>PbiLE;GZV^
^*UmLPPtTbn^*I;[EMZgGZVIE Þ |
DFEHGeMb ¢ ¥P5NKP5Gbi È ¢[ *gC :)::Þ W GeMbfP5bnLT^eZVPxq>LPb0JÄIEjL
iL^eMZVEMbuUVb0LTEMZVEM[L`M`MTI;L;^eGe>LGRe>LPGrQIsP5Gb0`>P0|..ZVTP5G0W.LPb*GIc!chb0LG{MTb0PZmPJMbkzZVPb0J
GIa^L`KG{MTbdZVEKchI;TiLGZgI;EGe4LGe>bUV`>PGIxJMZVP5GZVEM[{>ZVPe~LE>P5QSbTSP5b0E_GbE4^*b0PchTIiEMIEMv¡LE>P5QSbT
P5b0E_GbE4^*b0P0|}teMb0EL^*UmLPP5Zg\>bTZmPUVb0LTEMbnJschI;TZmJKbE_GZgchNzZgE>[GeMbuLE>PQb0TIctb0L^e {Mb0P5GZVIE
GrNz`4btchTIiÃGTLZgE>ZgEM[b*yMLiR`>UgbnP|ªJKAZ @b0Tb0E_G¨b0EMe>LE>^*b0iRb0E_G¨Ic4GeMbSGrNz`MZV^0LUM¢HªLT^eMZ]v
Gbn^G{>TbQtLPSZgia`MUVbiab0E;Gb0JZVEpGeMb fP5NKP5Gb0i È !ZVUVI @LE4J~}teMb0Ugb0E ::):zÞ |K>ITtb0L;^e
GrNz`4bIc {MbnPrGZgI;EfLaPb*G¢Ic.T{MUVb0PtZmP!Zgia`MUVbiab0E;Gb0J|L;^e~T{MUVbL#QtLTJMPtLaP5`b0^Z]\^E_{>iqbT
Ic`IZVE_GPGIRb0L;^e~PbE_Gb0E>^*bLPSLxiRbnLP{MTbdIc.^*IEM\4JKbE4^*bGe>LGSZgG!e>LPchI{>E>JGeMbLE>PQb0T0|
}teMbPbE_Gb0E>^*bQ!ZgGeGeMbe>Zg[;eMb0P5G¢Ez{MiqbT!Ic.`IZVE_GPtZmP¢P5b0Ugbn^Gb0JLPSGe>bLE>PQb0T0|
dIEMbIcdGeMbf^*{MTTbE_GR¢¬ LT^eMZgGb0^*G{MTb0Px{>PbuGeMb~E>IGZVIEjIcdbyK`4bn^GbnJHLE>P5QSbT
GrNz`4b;W>\>TP5G¢Zgia`MUVbiabE_Gb0JZVEfGeMb À > D5£ÃPNKPrGbi È §I;UVJKIkLE ¢g¸
Qn; Þ LE>J
È
)
:
:
:
Þ
GeMb0EYch{MT5GeMbTbyzGbE4JKb0JYZVE MÀ ¸ BdLTLq>L[;Zg{ *g.
q | /eMb0EGeMbb*yK`b0^*Gb0J
LE>PQSbT!GrNz`bZVPTb0^*I;[EMZVÁbnJWzGe>b MÀ ¸ D5£s(PNKPrGbi«ZVJMbE_GZg\>b0P^*I;TTb0^*GdLE>PQb0TP
Q!Z]GeiaITb~Ge>Lb
E = : `>Tbn^*ZmP5ZVIE È XL;P^0LLE>J BdLTLq4L[ZV{ :: Q Þ | /YbLT[;{MbpGe>LGpGeMb
PLiabxI;q>P5b0TkLGZVIEeMI;UVJMPGT{MbxchIT¢(7PNzP5Gb0iP¢GI_I4WGez{>PQbRe>L#k;bZViR`>Ugb0iRb0E_Gb0J
LEY!Ã LT^eMZgGbn^G{MTbGe>LG`bTchITiPLE>P5QSbTTbn^*I;[EMZgGZVIEq>L;P5bnJsI;EGeMbRb*yK`b0^*Gb0J
LE>PQSbTXGrNz`bJK{MTZVEM[ {Mb0P5GZVIEp`MTIK^b0PP5ZVEM[>|;}teMbLT^eMZgGbn^G{MTb!Ic I{MT!¹PNzP5Gb0i ZmP
ZgUVUV{>PrGTLGbnJ~ZVEfZV[{>Tb QQ |
DFEfGeMbPNzP5Gb0i¥ZVUgUV{>P5GTLGb0JZgE.ZV[{MTb QQ WKb0L^e {Mb0P5GZVIEfZmP!`>LTPb0JLE>J~GeMbb*yK`b0^*Gb0J
LE>PQSbTGrN_`baZVPZmJKbE_GZ]\>bnJZVEsGeMbPLiabxQtL#NLPZgE MÀ ¸ |{Mb0P5GZVIEbNzQSITJMPdLTb
Q=
!#"$%
Answer
Story
Question
Question
Processing
Question Type
Story
Processing
Reference
Resolution
Question Coreference
Question Parse
Expected answer type
Named Entity
Recognition
Answer
Processing
Answer
Recognition
Text Coherence
Thematic Relations
Sub−Hierarchies
Parse&thematic
labeling
Question Keywords
F
ïõþD+þ$Jçë ü ïñòõ5öHðú!ùô4çH÷çHòzîïñðò,ëîç ü ðòcçÁèùçHöé4ç ü ëòîó=çô:é#ýùç
L UmP5I~b*yzGTL^*GbnJsZVEsGe>bRPLiabRQSL#N;|£zZVE>^bRPIiab {MbnPrGZgI;E>P^*I;E;GLZVEs`MTIEMI;{ME>P0W4Tb*chb0Tb0E>^*b
TbnP5I;Ug{MGZVIEi{4PrGaq4b^LTTZgbnJlI{KGaJK{MTZgE>[sGe>b {Mb0P5GZVIEH`MTIK^b0PP5ZVEM[s`Me4LPb| /YbTbnP5I;Ugk;b
LUVU {>b0P5GZVIEfLE>L`MeMITPCQ!ZgGe~Ge>bLUg[;ITZ]GeMiTb0`4I;T5Gb0JpZgE È BLTLq>L[ZV{ *Sg :): Q q Þ | /b
LUmP5ITb0^I[;EMZgÁ0bRGeMb {MbnPrGZgI;EYGrN_`buqzNsGeMb {MbnPrGZgI;ElP5Gb0i LE>JY{>PbGeMb {>b0P5GZVIEYGrNz`4b
chITxq4bG5Gb0TTb0^I[E>ZgÁ0ZgEM[GeMbub*yK`b0^*Gb0JLE>PQb0TGrN_`b|.MI;Tb*yMLiR`>Ugb;W ´µ {>b0P5GZVIE>PLTb
LPzZgEM[aLqI{MGt`bI;`MUVbWMLE>ZgiLUmPSITtIT[;LEMZVÁ0LGZgI;E>P0|_}teMbLE>P5QSbTPSLTbb0Z]GeMbT È L Þ P5{>q rb0^*GP
Ic GeMbbk;bE_GPiabE_GZVIEMbnJpZVEuGeMb {Mb0P5GZVI3
E 7 È q Þ E4Liab0PSIc`4b0I`MUVbe4L#k_ZVEM[GeMb`MTI`bTGZVb0P
b*yK`MTb0PP5bnJYZgEGeMb {MbnPrGZgI;3
E 7I;T È ^ Þ LE_Gb0^*bnJKbE_GPIc!`MTIE>I{ME>P^*IUVUVIz^0LGb0JlZVElGeMbPLiRb
P5b0E_GbE4^*bQ!Z]Ge~PIiabdIc GeMb {Mb0P5GZVIE~b0N_QSITJMPXI;TQ!ZgGef^*I;E>^*b0`KGPSPbiLE_GZm^LUgUVNaTb0UVLGbnJ
GIaGeMbif|
£zGITNu`MTIK^*bnPPZgE>[xZmPtbEMe4LE>^b0JQ!Z]Gef`>LTP5ZVEM[aLE>JpGe>biLGZV^UmLqbUVZgE>[>|M¢E4P5QSbT!Tb0^I[v
EMZgGZVIEZmPach{ME>JMLiabE_GLUgUVNjJKAZ @bTbE_GpZVEI{MTuPNKPrGbifW^LUgUVb0J MÀ ¸ ¸ chTIi IGeMbT
¢ ÃP5NKP5Gb0iaP0|>dE>P5QSbTP¢LTbZmJKbE_GZ]\>bnJLP¢LuTbnP5{MUgG¢IcC^Iiq>ZgEMZVEM[ È Q Þ PbiLE_GZV^ZVEKv
chITiLGZVIEJKbTZgk;b0JchTIi GLyKIEMI;iaZgbnP¢QSbe>L#k;bJKbk;bUVI`b0JfchI;TdGeMba!ÃÃGLPQ!ZgGe
È Þ GeMbiLGZV^xTbUmLGZVIE4PdTb0^I[E>ZgÁ0b0JchTIi Ge>bx`>LTPbIcCGe>bRP5GI;TNLE4J È ¦ Þ ^{Mb0PIcGb*yzG
^*I;eMbTbE>^b|S}by_G^*I;eMbTbE4^*bsZmPpbnP5`b0^ZVLUgUVNªZgia`ITGLE;G~chIT`MTIz^b0PP5ZVEM[ ´µ ¶ {Mb0P5GZVIE4P|
½ µ ¶ {MbnPrGZgI;E>PtLTbLRP5`b0^ZVLU^0LPbdZVEpGe>LGSGe>bNuEMbn^*bnPPZ]GLGb¢Ge>bTb0^I[;EMZ]GZgI;EuIc.^L{4P5bnPW
iaIGZVkLGZgI;E>PLE>JYTb0L;P5I;E>PdIctL;^GZgI;E>PLE>JYbk;bE_GP0|}teMbu^*I;eMbTbE4^*baPrGT{>^*G{MTbaIc!L~Gb*yzG
eMZV[eMUVZg[;e_GPtP5{4^ep^L{>PLUgZgGrNaTb0UVLGZVIE>P0| dcGbEWzJMZVP^*I;{MTPb^{Mb`MeMTLPb0P0W_P{>^e~L;P %z$ IT
$% W4LTbP5GTIE>[xZVE>JKZm^LGITPtIc¨^L{>PLUgZgGrNuTbUmLGZgI;E>P|
}te>bSiLZgEaLT^eMZgGb0^*G{MTLUKJKAZ @bTbE>^bqb*GrQSbb0E MÀ ¸ LE>J MÀ ¸ ¸ ZmPXJKb0TZVkbnJ
chTI;iÃGe>bSE>bb0JchITXZmJKb0E;GZ]chNzZVEM[Gby_GX`>LTL[TL`Me4P chTIiÃUmLT[bt^*I;UgUVb0^*GZVIE>P.IcJKIK^*{Miab0E;GP¨ZgE
GeMb¢^0LPbIc>GeMbtZgEKchI;TiLGZVIEaP5b0bzZgE>[dGLPLE>JGeMbtEMb0b0JxchITXPbUVb0^*GZVEM[LPbE_Gb0E>^*bSchTIi L
P5e>ITG.P5GITNGby_G¨ZVEGe>bS^0LPbIcMTb0L;JKZVEM[^Iia`MTbeMb0E>P5ZVIE|0M{>T5GeMbTiaITbWnQ!eMZgUVbtJKIK^*{MiabE_G
`MTIz^b0PP5ZVEM[^*I;E>^*b0E;GTLGbnPI;E`>LTL[TL`MeTb*GTZVbkLU_ZVExGeMbSchITiabT¨ZVE>PrGLE>^bW#Tb*chbTbE4^*bSTbnPrv
IUV{KGZVIEuGeMTI{M[;eMI{MGGe>bb0E;GZgTb¢Gb*yzGZmPS`>LTLiaI;{ME_GZgEuGeMbUVLG5GbTtL`M`MUVZm^LGZgI;E | EMbdiL#N
LPP5{>iRbuGe>LGGe>b0Pbu`MTIz^b0PP5ZVEM[sJKAZ @bTbE>^b0PRJKZV^*GLGbGeMbpQtL#NKPZgEHQ!eMZV^e {MbnPrGZgI;E>PLTb
e>LE4JKUgbnJlLE>JlLE4P5QSbTPLTbRbyzGTL^Gb0J3
| BdIQb0kb0T0WchTIioI;{MTb*yK`bTZgiabE_GPW QSb^*I;E>^*UV{>JKb
Ge>LG¨GeMb0TbtLTbiLEzNPZgiaZVUVLTZgGZVb0P.qb*GrQSbbEGeMb {Mb0P5GZVIEx`MTIz^b0PP5ZVEM[LE>JxLE>PQb0Tby_GTL;^v
Q<
*x
aª¾4;w>
t>$w À M $ ´ *z¾4% µ >>$
GZVIEGb0^eME>Z {MbnPZViR`>Ugb0iRb0E_Gb0JÄZgE MÀ ¸ LE4J MÀ ¸ ¸ LE>J WLPZmJKbchTIi GeMb
`MTbkzZgI;{>PUgNiabE_GZVIEMbnJsiLZVELT^eMZgGbn^G{MTLUJKZA@bTbE>^bWIGe>bTJKZ @bTbE4^*b0PLTbLpiaLG5GbT
Ic!JKb[;Tb0baZgElGbTiaPIcGeMbpLiRI;{ME_GIct`MTIK^b0PP5ZVEM[fTbnP5I;{MT^*b0PbnL^elL`M`MUVZm^LGZgI;EYPeMI;{MUVJ
{>Pb|
-áâ0/1+ )
ã+å áán/ )
}teMbpTIUVbuIc {MbnPrGZgI;EÄ`MTIK^*b0PPZgEM[ZmPGI È Q Þ JKbGb0TiaZVEMbuGeMbuGrNz`bpIc!GeMb {MbnPrGZgI;E37 È Þ
ZVJMbE_GZgchNsGeMbb*yK`b0^Gb0JlLE4P5QSbTGrNz`4b)7 È ¦ Þ GTLE>P5chITi¼GeMb {MbnPrGZgI;EZVE_GIfIEMbaI;TP5b0kbTLU
b0N_QSITJzv¡q>LPb0J {Mb0TZVb0PpGe>LGZmJKb0E;GZ]chNªGeMblLE>PQb0Tp`>LTL[TL`MeªI;TPbE_Gb0E>^*b)7SLE>J È ? Þ
ZVJMbE_GZgchNGeMbuUVb*yKZm^*IvFPbiLE_GZm^LE4JYJMZVP^*I;{MTPbaTb0UVLGZVIE>Pq4bGrQb0bElGe>bub*yK`b0^Gb0JLE>P5QSbT
GrNz`4buLE>JGeMb {MbnPrGZgI;E;bNzQSITJMP{>P5bnJGIUVIz^0LGbaGeMbuLE>P5QSbTn| ¬P5GTIEM[fZVE>JKZm^LGITIc
GeMb {MbnPrGZgI;EsGrNz`bRZmP`MTIkzZVJKbnJsqzNfGe>b {>b0P5GZVIEP5Gb0ifWb| [>|VW ´µ W ´µ Wb*G^|§sI;P5GIc
GeMb {>b0P5GZVIEPrGbiP¢LTbLixqMZV[{MI;{>1P 7zGeMbTb*chI;Tb;W>LJ>JKZ]GZgI;E>LUiabn^e>LEMZmPiaP¢Ic¨ZVJKb0E_GZgchN_ZVEM[
GeMbbyK`4bn^GbnJfLE>PQb0TSGrN_`bLTbEMb0^b0PPLTN;|
at
o
wh
wh
48%
18%
e
er
en
wh
ho
w
wh
10%
9%
8%
m
te
e h
m hic hy o s
w w
N
na
3% 1% 1%
2%
F
ïñõzþ "þ 2qïñîéô4ïêé4ïðòsðø;íêzçHîé4ïñðò_îé4çHú!îïòé4÷çpæ $Ç % çëìñêëé4ïñðòlíêzçHîé4ïñðòî
}te>b ¦GbnPrG {>b0P5GZVIE>PbkLUV{>LGb0JaZVEp}!¢tv LE>J Pe>LTbtGe>bd`MTI`bTGrNGe>LGGeMb0Tb
ZVPLG¢UVb0L;PrG¢I;EMbLE>PQSbT!ZVEfGeMbGb*yzG^IUVUgbn^GZVIE|>MI;T!GeMbiRI_PrG¢`4LTG0WKGeMZVPdZVP!GT{MbchIT¢GeMb
TbnLJKZVEM[R^*Iia`MTbe>bE>PZgI;EaGbnPrG!LPQb0UgUw|z}teMb {MbnPrGZgI;E>PXchI;TGeMbGrQIGLPKPW_eMIQSbk;bTnWe>L#kb
JKAZ @b0Tb0E;G~`MTI;`4b0T5GZgbnP|C}te>bs}!¢S {Mb0P5GZVIE>Pubia`MUVINÄbZV[e_GpJKAZ @b0Tb0E_G {>b0P5GZVIEPrGbiP
Ge>LGLTb{MEMbk;bEMUVNJKZmPrGTZVqM{KGb0J È P5b0bx.ZV[{MTb Q# Þ |}teMb 8 = 8 {>b0P5GZVIE>P`MTIk_ZmJKbnJchITGeMb
PrGITZgbnPLTb¢b {4LUVUgNaJKZmPrGTZVqM{KGb0JuLiRI;EM[GeMb¢\>k;b¢GTL;JKZ]GZgI;E>LU {Mb0P5GZVIEuP5Gb0iaDP C
Ic¢GeMb}!¢t
;W
W
W
LE4J
|X}teMb0TbchITbW.b*yM^*b0`KGachIT
{ Mb0P5GZVIE>PGe4LGxe4L#kbuEMI {Mb0P5GZVIEÄP5Gb0iW.chI;TkzZgTG{4LUVUgNlLUVUGeMbf}!¢S LE4J {Mb0P5GZVIE>Px`MTIK^*b0PPZgEM[ZVPxq>LPb0JÄIEGeMbpZVEKchITiLGZgI;EH^*{MbnJqzNYGeMb0ZgTaPrGbif|X}IY^*UmLPP5ZgchN
{Mb0P5GZVIE>PL;^^*I;TJMZgEM[pGI~GeMb0ZgTP5Gb0iaP0WiaI;P5G}!dSÃ7PNzP5Gb0iPJMbkb0UgI;`4bnJsT{MUVb0PchIT
LPP5IK^ZVLGZVEM[ {Mb0P5GZVIE¹P5Gb0iaPpQ!Z]Ge¹^LGb[;ITZgbn1P 7E>Liab0Jªb0E_GZgGrNjTb0^I[E>ZgÁ0bTPaQb0TbIcGbE
{>Pb0JGIxP{M`M`ITGGeMZmP|zDFEp^IE_GTLP5G0W_I{MTSTb0LJMZgEM[x^*Iia`MTbe>bE>PZgI;EuP5NKP5Gb0i LPP5IK^*ZmLGb0PCGeMb
{Mb0P5GZVIEP5Gbi Q!ZgGe¹LYGe>biLGZV^fchbnLG{MTbfGe>LG~EMbbnJMPaGIqbsTb0^I[E>ZgÁ0b0JjZgEªGeMbGbyzG0|
.Zg[;{MTb Q ¦ È L Þ Tb`MTb0PbE_GPCGeMbLPPIz^ZVLGZVIE>P{>Pb0JchI;TSGeMb}!¢SPNKPrGbiP0W;Q!eMb0TbnLP
.Zg[;{MTb Q ¦ È q Þ `MTb0PbE_GPSLPPIz^ZVLGZVIE>Pbia`MUVINbnJachITtTb0L;JKZgE>[x^*I;ia`MTb0eMbE4P5ZVIE |zMTIi .ZV[v
{MTb Q ¦aZgGdZmP¢^*UVb0LT!Ge>LG¢chIT}!¢S {Mb0P5GZVIE4PWKGeMbP5Gb0iaPdZgE4JK{>^*bxL^*UmLPP5Zg\4^LGZVIEfq>L;P5bnJ
IEa^*I;E>^*b0`KG{>LUM^*UmLPP5bnP¨P5{>^eaLP ~LE>J X|DFExGeMb¢^L;P5bSIc .W
{Mb0P5GZVIE>P0WGe>buPrGbiPLTbxiL`M`4bnJYZgE_GIGeMbiLGZV^RTIUVb0P0W P5{4^eLP .W ¨WUgZVbxGe>I;PbRJKb\>EMbnJZVE È tLbT g:
Q0; Þ ITPIiabR^0LGb[I;TZVb0P
UgZVb IT C|£zI;iRbaIcGeMbLE>PQb0T^LGb[;ITZgbnPLTbRZmJKbE_GZm^LUCQ!ZgGeGeMI_P5b
bia`MUVINbnJq_NdGeMbD5£ÄPNKPrGbiP0WqM{KG.iaI;P5GIczGe>biÃLTbXEMbQW0UgbnPPLq>P5GTL^*G^LGb[;ITZgbnP|
,+
!
('
*)
#"$
%"&$
Q0
!#"$%
What
PERSON LOCATION DATE TIME PRODUCT
MONEY NUMERICALVALUE O RGANIZATION
REASON MANNER LANGUAGE A LPHABET
NATIONALITY QUOTATION GAME REPTILE
MAMMAL DOGBREED DEFINITION
Who
PERSON O RGANIZATION DEFINITION
When
How
Who
DATE
NUMERICALVALUE MONEY MANNER
What
Where
Why
LOCATION COLLEGE
REASON
Name
PERSON LOCATION DATE TIME PRODUCT
MONEY NUMERICALVALUE O RGANIZATION
REASON MANNER LANGUAGE A LPHABET
NATIONALITY QUOTATION GAME R EPTILE
MAMMAL DOGBREED D EFINITION
Which
PERSON LOCATION DATE TIME PRODUCT
MONEY NUMERICALVALUE O RGANIZATION
REASON MANNER LANGUAGE A LPHABET
NATIONALITY QUOTATION GAME REPTILE
MAMMAL DOGBREED D EFINITION
When
PERSON O RGANIZATION DEFINITION
FOOD ATTRIBUTE N AME SPECIALIZATION
A CTION C ITY A PPEARANCE DEFINITION
VEHICLE REASON REWARD D ISEASE
CAUSE ACRONYM CARRIER ORGANIZATION
PART RELATION OBJECT
EVENT
D ATE
T IME−PERIOD
EVENT
T IME−START
T IME−END
DATE−COMPUTED H EADLINE
Where
Whom
D EFINITION AGENT SUBJECT INHABITANT
AUTHOR MAKER INTERLOCUTOR VISITOR
KING LEADER SAILOR PEOPLE PERSON
JOKER VISCONTRY TRAVELER C ELEBRITY
A TTACKER PARENT PARTNER A RTIST
STOCKHOLDER DRIVER A STRONAUT
DOCTOR D ISCOVERER ANIMAL ENTITY
LOCATION PART C ITY C ONTINENT
PLANET C OUNTRY H EADLINE
LOCATION−IDIOM
R EASON
Why
MOTIVATION
JUSTIFICATION
ELABORATION C ONTRAST B ACKGROUND
EVENT−COREFERENCE
(b) REMEDIA questions
(a) TREC questions
F
ïñõzþ< þcëùùïñòzõîøô4ðúûíêzçHîé4ïñðòcîé4çHú!î=é4ðëòîó¸çÁôé8ýùçHî
352
@)5?4A )( dP^LEq4bRP5b0bEfchTIi ZV[{>Tb Q ¦MW4iRI_PrGIcXGe>b {Mb0P5GZVIEsP5Gb0iPLTbeMZV[e>UgNfLixqMZg[;{MI{41P 7
Ge>LGZmPW>GeMbRPrGbiP¢iL`fGIuiLEzNfJKZA@b0Tb0E;G^*I;E>^*b0`KG{>LU^*UmLPPb0P!I;T¢Ge>biLGZV^TI;UgbnP|>>IT
b*yMLia`MUVbW {Mb0P5GZVIE4PP5GLT5GZgEM[xQ!Z]GeuGeMbP5Gb0i ´µ ^0LEpL;P5aLqI{MGtLUgiaI;P5GSLEzN;GeMZVEM[>|_}I
Tbn^*I;[EMZVÁbGeMbbyK`4bn^GbnJ~LE>PQb0TGrNz`bWMI;EMbIcGeMb {MbnPrGZgI;E^IE>^b`KGPti{>P5G!q4bPbUVb0^*Gb0J
LE>J¤GL;bEªZgE_GIÄL^^I{ME_Gn|MI;Tub*yMLia`MUVbWZgEªGeMb^0LPbIc}!¢S {Mb0P5GZVIE ½ µ
n$~ µ a¢*_%
>¶ n>%Kº WGeMbpk;bTq n>% bUVZV^Z]GPxLTb0P`IE>PbachITRP5I;iRb
.|_}ITb0^I[E>ZgÁ0b!GeMbL`>`MTI;`MTZVLGb {Mb0P5GZVIE^*I;E>^*b0`KGGe>LGSiaL`>PGIxGeMb^*I;TTb0^*G
%*F>$ ´ S1¶ W#QSbe4L#kbJKb0kzZVPb0JxL¢iab*GeMIKJKIUVI[;NGe>LG.ZVP.q>L;P5bnJIEGeMTbbchITiPIc
zEMIQ!UgbnJK[)b C È Q Þ Ge>b ;*%*¶$1>%wK IczGe>b {Mb0P5GZVI3
E 7 È Þ iaL`M`MZVEM[;PchTI;i {Mb0P5GZVIE
PrGbiPGI`I;PPZgqMUVbaLE>PQb0TGrN_`b0PGe>LGLTbRqM{MZVUgGI @vwUVZgE>b 7 LE4J È ¦ Þ LE4P5QSbTGLyzI;EMIiaZVb0P
Ge>LGUVZgEMxGe>bLE4P5QSbT¨GrNz`b0PXG"
I /YIT'J ¢bGP5{Mq>eMZgb0TLT^e>ZgbnP.Ge>LGS^*Ik;bTCLUmLT[bt`bT^*bE_GL[b
IcGeMblCEM[;UgZmP5e EMI{>E LE4Jkb0Tq¹UVb*yKb0iRbnP|!.ZV[{MTb Q ¦ÄZVUgUV{>P5GTLGbnPiaL`M`MZVEM[;P~qb*GrQSbbE
{Mb0P5GZVIEfPrGbiP¢LE>Jp`I;PPZgqMUVbLE4P5QSbTSGrNz`4bnPt{>Pb0J~chIT!qIGeD5£ LE>J! |
ZVkb0EGeMbaGe>Tb0bxchI;TiPIcSzEMIQ!UgbnJK[baL^ {MZgTb0JschTI;i¼Ge>bI @vwUVZgE>baLE>LUVNKP5ZmPIctUVLT[;b
*x
aª¾4;w>
t>$w À M $ ´ *z¾4% µ >>$
Q003:
Q0
What does the Peugeot company manufacture?
Question dependencies:
What
Peugeot
company
Question stem
manufacture
PRODUCT
Expected
answer type
Question semantic form:
PRODUCT Peugeot company
manufacture
F
ïõþ zþ2qïñî4ëúzïñõêëé4ïñðòcðø;íêzçHîé4ïñðò_îé4çHú!î
{Mb0P5GZVIERUgI;[;P¨L#kLZVUVLqMUVbLG WQSbte>L#kbtJKbkzZmP5bnJGeMbtchIUVUgIQ!ZVEM[`MTIz^b0JK{>TbGIP5b0Ugbn^G
GeMbbyK`4bn^GbnJfLE>PQb0TSGrN_`bC
b ;WXLUgUtGeMb^LGb[;ITZgbnPx^ITTbnP5`IE>JMZgEM[GIGeMb {MbnPrGZgI;EjP5Gb0i È Pbb
Q |tÅb*GbTiaZgEM
.ZV[{MTb Q ¦ Þ 7
|!£KbUVb0^
G Ge>bEMIKJKbchTI;i¬Ge>bJKb`bE>JMbE>^N~P5GT{>^G{MTbIcGeMb {Mb0P5GZVIE~Ge>LDG C
È L Þ ZmP¢^*I;EMEMbn^GbnJuGIaGeMb {MbnPrGZgI;EP5Gb0i 7
È q Þ e>L;P¢GeMbReMZg[;eMb0P5GE_{>iqbTIcJKb0`4b0E>JKb0E>^*ZVb0PLiaI;EM[pLUVU¨UgbyKbiab0P^*I;EMEMb0^*GbnJfGI
GeMb {Mb0P5GZVIEP5Gbi 7
¦>|!£Kb0LT^euchI;TtGeMbE>IzJM
b LUgI;EM[LUVU LE>PQb0TteMZgb0TLT^e>ZgbnPSP{Mq>P{Miab0Jqz
N #)7
b QtLPSUVIz^0LGb0J|
? |t¢b*G{>TEGe>bLE>PQb0TSGrN_`bLPSGeMbGI;`IcGeMbeMZVbTLT^e_NQ!e>bT
>ITbyMLia`MUVbW.ZV[{MTb Q1? ZVUgUV{>P5GTLGb0PGeMbubE_GZgTbpJKb0`4b0E>JKbE4^*NlPrGT{>^*G{MTbIc!Ls}!¢t
{ Mb0P5GZVIEªQ!eMZm^eªZgE>JMZV^0LGbnPRGe>LG
a>**;%*wK e>L;PRGeMbUmLT[bnPrGEz{Mixq4b0TIc^*IE>EMb0^*Gb0J
^*I;E>^*b0`KGP0|}teMbTb*chI;Tb;WGeMbE>IzJMb
4**%1K ZmPPb0LT^e>b0JZVEGeMb /YIT'J db*GXP5{Mq>eMZgb0TLT^ezN
UgZVEM;b0JGIjLE_NªIcGeMbl^*I;E>^*b0`KGP~chTI
i
;WSiaL`M`b0JchTIi GeMb {MbnPrGZgI;EP5Gbif|!}teMb
EMIKJKb
4**%1K ZmPchI;{ME>JlZVEGeMbP5{>qMeMZVbTLT^e_NIc .WQ!eMZm^eÄqb0^Iiab0PGeMb
b*yK`b0^Gb0JLE>P5QSbTSGrNz`bIc.GeMb {MbnPrGZgI;E |>dP¢Tb0`4I;T5Gb0J~ZgE È BLTLq>L[ZV{ !g :): Q L Þ GeMb
P5bGpIc`I;PP5ZVqMUVbsLE>PQb0Tu^*UmLPP5bnPachITuGeMbsD5£ MÀ ¸ ¼PNKPrGbi L;PQSbUVUdLPaGeMbZVT
^*I;EMEMb0^*GZVIE~GI /I;TJ ¢b*G¢P{MqMeMZVbTLT^eMZVb0PQSL;PS`4b0T5chI;Tiab0J~iLEz{>LUgUVNqzNu^*Tb0LGZgE>[RLEpI @v
UgZVEMbLE>PQb0TCGLyKIEMI;iN;|;§I;Tb0IkbTnWQ!eMb0EMbk;bTCGeMbdbyK`4bn^GbnJuLE4P5QSbTGrN_`bdZmPSJKZVP^*Ik;bTb0JW
Z]GdP{Mq>P5GZgG{MGb0PSGeMb {Mb0P5GZVIEPrGbi ZVEGeMbJKb0`4b0E>JKb0E>^*NpP5GT{>^*G{MTbWKb0E>LqMUVZVEM[x{>EMZ]\^LGZgI;E>P
Q!Z]Ge^LE4JKZVJ>LGbaLE4P5QSbTP|.Zg[;{MTb QD? ZVUgUV{>P5GTLGb0PGeMbaTb0P{MUgGIcGeMbP5{Mq4PrGZ]G{KGZVIEYIcGeMb
{Mb0P5GZVIEfPrGbi Q!Z]Ge~GeMbb*yK`b0^*Gb0JfLE>P5QSbTSGrNz`b|
>IT {MbnPrGZgI;E>P0WzGeMZmPtchITi Ic {Mb0P5GZVIEfP5Gbi JKZVPLixqMZV[{>LGZVIE~JMZVJEMIG¢`4b0T5v
chITi7L;PCQSbUVU4L;PXchITS}!¢S {MbnPrGZgI;E>P|_¢UgGb0TE>LGZVkb0UgN;WZVEGeMb MÀ ¸ ¸ LT^eMZ]v
Gbn^G{>TbxQbL;PPIK^*ZmLGb0J {Mb0P5GZVIEsP5Gb0iaPQ!ZgGe µ
a1%Rg*$ P5ZViaZgUmLTdGIGeMI;PbbE4^*IKJKb0J
:
!#"$%
Q4: Where were flags placed around the country?
(Remedia−2−03.text)
S placed
VP placed
VP Goal−location
PP
NP
WRB VBD NNS
NP
VBN
IN
DT
Where were flags placed around the
Goal−location
Theme
placed
Theme
flags
NN
country
Goal−location
Goal−location
the country
Goal−location
City, Location Idiom
F
ïõþ þ2qïñî4ëúzïñõêëé4ïñðòcðø;íêzçHîé4ïñðò_îé4çHú!î
ZgEuGeMbMTLiabDdb*G`MTIrbn^G È tLb0T g
Qn; Þ | È ZVUmJKb0LxLE>J ;{MTLcP_N :)::zÞ `>TI;`4I_P5bnJ
LGe>biLGZV^dUVLq4b0UgZVEM[xP^eMb0iRb¢Ge>LGZmPCq>L;P5bnJaIEaGe>bPLiab¢`>LTPbT È IUVUgZVE>P Q0; = Þ Ge>LGQb
bia`MUVINbnJ~qIGefchITI{MT¢D5£sÃLT^eMZgGb0^*G{MTbLE>JchI;T¢I{>Td¢ ÃLT^eMZgGb0^*G{MTb| /b
GTLZVEMb0JRLP5`b0^ZVLUgZVÁbnJGeMbiabvwUmLqbUVbT.chIT¨GeMb {MbnPrGZgI;E>P.Q!eMZV^eab0iR`>UgIN;b0JPbk_v
bTLU L;JMJKZgGZVIE>LUchb0LG{MTb0P!P{>^eLP È Q Þ Ge>b {Mb0P5GZVIEfPrGbifW È Þ GeMb`MeMTLPbGrN_`bW È ¦ Þ GeMb
eMb0L;JQI;TJW È ? Þ GeMbkb0TqkI;ZV^bLE>`
J /I;TJ ¢b*Gd^UVL;PP0W È98zÞ GeMbJMb`bE>JKb0E>^*NfP5GT{>^G{MTbIc
GeMb {MbnPrGZgI;ELE>PQb0T0WzLE>J È = Þ GeMbchTLiabbUVbiabE_GPtIcGeMbkb0Tq | /Ybbia`MUVINGe>bPLiRb
GTLZVEMZVEM[LE>JGb0P5GZVEM[Gbn^eMEMZ {>b0P¨LPGe>I;PbTb`ITGbnJZgE È ZVUmJKb0LLE4J ;{MTLcP5zN :)::Þ f| /b
GTLZVEMb0JGeMbGeMb0iabdUmLqbUVbTSIEp¦ : IcGe>b P5GITZVb0PLE>J {MbnPrGZgI;E>PLE>JaGb0P5Gb0J
IEGeMbpTb0P5GIcSGeMb~P5GI;TZVb0P0|}te>buTbnP5{>U]GPIc!GeMbuGeMbiab~Tbn^*I[;EMZgGZVIElQb0Tb~^*Iia`>LTLqMUVb
Q!Z]GeGeMI_P5bTb`ITGb0JpqzN È ZVUVJMb0LaLE>J ;{MTLcP5zN :)::Þ qb0^0L{>PbQSbbia`MUVINbnJGe>bPLiRb
`>LTPbTnW_E4LiabUVNuGeMbxIUVUgZVE>Pt`>LTPbT È IUVUgZVE>P Q0; = Þ |
.ZV[{MTb Q 8 ZVUVUg{>P5GTLGb0PL {>b0P5GZVIELE>JGeMb^*I;TTb0P`4I;E>JKZVEM[pUmLqbUVZVEM[~IcZgGP
`>LTPbsGTbbQ!Z]Ge¹GeMbiLGZV^TIUVb0Pub0E>^*IKJKbnJ¹ZVE >TLiRfb ¢bG0|SDFE¹Ge>bbyKLia`MUgbYP5e>IQ!E¹ZgE
.Zg[;{MTb Q 8 W>GeMbxk;bTq V% e>LPdGrQSI _0> Fgn%1 Tb0UVLGZVIE>DP C È L Þ GI~GeMb {Mb0P5GZVIEP5Gb0i
´µ LE4J È q Þ GIsGe>b~`MTb`I;PZgGZVIE>LUSLG5GL;^eMiabE_G ® K µ s%K>w¶r» £zZVE>^b~ZgGRZmP
{MEz{>P{>LUGIue>L#k;bLTb`b*GZgGZVIEIc¨GeMbRPLiabGeMb0iaLGZm^UmLqbUwW>ZgGZmPdL;PP{Miab0JGe>LGdI;EMbIc
GeMbSGeMbiLGZV^tPbUVb0^*GZVIE>P.ZVE>^*UV{>JKbnP.GeMbSIGeMbT¨IE>b|DFEGeMb!^L;P5bSIcMGeMbtb*yMLia`MUVbSZgUVUg{4PrGTLGb0J
ZgExGe>b¢ZV[{>Tb Q 8 W0GeMb!UVIz^0LGZgI;EIc4GeMb 4L[;P.ZmP¨ZgE>^Ug{4JKb0JaPIiabQ!eMb0TbZgERGeMb!^*I{>E;GTN;WnGez{>P
GeMbSb*yK`b0^*Gb0JxLE>PQSbTGrNz`b0P¨LUVUgIQSb0JLTbIEMUVN pIT¨P5I;iRbZVJKZVIiLGZm^Cb*yK`MTb0PPZgI;E>PGe>LG
`4b0T5GLZVEfGIuUVIK^LGZVIE>P È P5b0b.Zg[;{MTb Q ¦ Þ |4}teMbiaL`M`MZVEM[ZVE;GIGe>biLGZV^TIUVb0P¢ZVPLachITi¥Ic
P5b0iLE_GZm^LE>LUVNKP5ZmPUgbnPPSP5e4LUVUgIQªGe>LE~GeMbIE>b`MTIkzZVJMb0JqzNaGe>bJKb0`4b0E>JKb0E>^*NpP5GT{>^*G{MTb0P
YîçHúëòé4ïñö=øôPëú!çïñî¸ë½îöô4ïùé ìï çîéô4êzöÁé4êzô4çìñïñ
ò ïñò3
õ ý¥ìñïñòõêïñîé4ïñöJöHðò>çHòé4ïñðòé4÷zçú!çëòzïñòõî
ðørë½ìñçHú!úëé4ðqîççÁôPëìðé4÷çÁô;ìñïñòõêzïñîé4ïöï0é4çHú!îHþnÇKëö÷øôPëú!çï ü çÁòé4ï/çHî;ë½îçÁé;ðø XÑ R ÕÊJÊÁÒÊÕÊW S
÷*ë ïòzõé4÷zç½ø£êzòöÁé4ïñðò_ðø
é4÷zçHúëé4ïñö:ô4ðìñçHîø£ðô:é4÷zçJøôPëú!çqìñçHú!úë>ó÷zïñö÷_ïî=é#ýùïñöëìñì0ý_ë çô sðô
ë5òðú!ïòëìñï ëé4ïñðò[þ
Q
*x
aª¾4;w>
t>$w À M $ ´ *z¾4% µ >>$
}.LqMUVb Q |
xÂS41w¶¸CFw_*$
Î R1S Ê
4Ë ÝDVW S Ñ ÐzÊÑËPÊW S
R Ì£ÑÐÝÑ S Ë4ÝÎÊ
S Ì£ÕÊ
Õ Ý1WiÊ !
ÐÑÝÍÌUWËPÊ
[ R ÕÊ
ÝÑ [ R WÌ R1S Ì ÝDW
P VÕ R W
Ý SUP ÊÑ¥ÒñÝË RDS Ì ÝDW
VWÌ£ÍÊÑPÛ4Ì S ËÁÌ S Π̣ÛÁÊ R ÛHÊ
ÐÒ R W S
ÎÝ[_ÖÁÑÊPÊÎ
ÐÑÝÎDVzË S
Ð P ÝDWiÊ W)VÕ!ÖPÊÑ
Õ R ÕÕ R Ò
W VÕ!ÖPÊÑ
ÐÑÌ ËPÊ
Ë4ÝDW S Ì WiÊW S
R Ò Ð P)R ÖPÊ S
V R W SÌS
ZgEsGeMbR}!¢Sb*yMLiR`>UgbRP5ZVE>^*bZ]GLPP5ZV[E>P¢UVLq4b0UVPdGIGeMbq>ZgE>LTNTbUmLGZVIE4P¢LE>JsiRI;Tb0Ikb0T
GeMbnP5bSUmLqbUmPe>L#k;bLP5b0iaLE_GZm^Xch{ME>^*GZVIE>LUgZgGrN|#dP¨JKb\>EMbnJZVE È ZVUVJMb0LLE>J ;{MTLcPzN ::):zÞ W
GeMb0iLGZm^uTIUVb0PTb0`MTbnP5b0E_G`>LTGZm^*ZV`>LE_GPZgEÄLEÄL^*GZVIEITTb0UVLGZVIE>PeMZV`lchITiaLUgZVÁbnJYZgEHL
P5b0iLE_GZm^~chTLiRbfI;T[_LEMZVÁbnJÄLTI{ME4JHLYUgb0iaiaLYUVb*yKZm^LUVZVÁZVEM[YGeMbL^*GZVIEPrGLGb|XMI;TaGeMb
{>b0P5GZVIEZVUgUV{>P5GTLGbnJaZgE~ZV[{>Tb Q 8 WGeMbPrGbi ´µ ZgE>JMZV^0LGbnPLP`b0^*ZmLU>chITi
IcdUVIK^LGZVIEÄvI;EMbpiLE>Z]chbnPrGb0Jjq_NYGeMbP5b0iaLE_GZm^pTIUV
b n ZgEHGeMbchTLiabpIcdGe>b~k;bTq
g;% |}teMZVPSGeMbiLGZm^TI;UgbQSL;P!JKb*\4EMb0J~ZgE È tLbT Sg Qn; Þ |M£zZVE>^bGeMb
b*yK`b0^Gb0JLE>P5QSbTSGrNz`bZVPdJKZVPLixqMZV[{>LGb0JpGIb0Z]GeMbTL I;T¢
L W>Z]G
ZVPTb0^I[E>ZgÁ0b0JfZVEsGe>b`MTb`I;PZ]GZgI;E>LU¨LGGL;^eMiabE_Gj® Ä**¶$% µ nw» chTIi Ge>bxPbE_Gb0E>^*b
® x#$·;x µ
!0u
g%a*¶$% µ nw» LE4JaZVPCGeMb0TbchITb!GeMb^*I;TTb0^*GLE>PQb0T0|
MI;T {MbnPrGZgI;E>P0W4PIiabIc¨Ge>bGI;`>P¢Ic.GeMbPbiLE_GZV^e>Zgb0TLT^eMZVb0PtTb`>TbnP5b0E;GZgE>[
GeMbLE>PQb0TtGrN_`bLTbGeMb0iRbUmLqbUmP0|>}teMZmPtZVP¢JMZ @bTbE_G!chTIi¬GeMb}!¢S¹^L;P5b;WKQ!eMbTbQb
PL#Q EMIaEMbbnJ~chIT¢P{>^eLE>PQb0TGrNz`b0P0|
'
3
*)
3#9 #B¤8>A!";= * 3)
MI;Tx}!¢t {MbnPrGZgI;E>P`>TZVITxTbn^*I[;EMZgGZVIElIctGe>bpb*yK`b0^*Gb0JHLE>PQb0TGrNz`4b~ZVPxJKb`bE4JKbE_G
{M`IEe>L#kzZgEM[aLE CWKQ!eMZm^epQSb[;bEMb0TLGb0JpI@vwUVZVEMbZVE~GeMbchIUVUVIQ!ZgEM[
QSL#N C
4F ° /buJMbkzZVPbuLfP5bGIcSGI;`l^0LGb[I;TZVb0PiaIKJKbUVb0JlLcGbTGeMbuPbiLE_GZm^aJKIiLZgE>Pb0EKv
^*IKJKbnJlZgEYGe>b /I;TJ ¢b*GRJMLGLq>L;P5b^*I;E_GLZVEMZVEM[ 8 EMI;{ME^LGb[;ITZgbnPLE>J Q 8 k;bTq^LGb*v
[I;TZVb0P0|}teMbGI`ÄIc!b0L^e /YIT'J ¢bGxeMZVbTLT^ezNsQtLPiLEz{>LUgUVNYZgE>P`b0^Gb0JYGIPbUVb0^GGeMb
iaI;P5GdTb0`MTb0PbE_GLGZVkbEMIKJKb0PLE>JL;JMJGe>bi GIGeMbGI;`>P¢Ic¨GeM
b C|
M{MTGe>bTiRI;Tb;W QSbpLJMJMb0JlI`bEÄJMIiLZVEE>LiabnJb0E_GZgGrN;vwGrNz`4b~P5b0iaLE_GZm^u^LGb[;ITZgbnP| >IT
b*yMLia`MUVbW}LqMUgb Q UVZVP5GPGeMbE>LiRbnJYbE_GZgGrN^LGb0[ITZVb0PQbae>L#k;b^*IE4P5ZmJKbTb0JZVEYI;{MTb*yzv
`4b0TZViabE_GP0|;§LEzNxIcGeMbdGI`4PCIcGeMb sLTbtch{>T5GeMbTS^LGb[;ITZgÁ0b0JaLP
ZgUVUV{>PrGTLGbnJ~ZVEfZV[{>Tb Q =>| /bZVE>^Ug{>JMb0Jf¦¦a^*I;E>^*b0`KGPtZVELUVU LPSGI`>PtchI;TtGeMbGLyKIE>IiN;|
~[;bEMb0TLGb0PXL
4F }teMb!iaITbtTb\>EMb0Ja^0LGb0[I;TZVÁ0LGZVIEIc4GeMbtGI;` iLEzN_v1GIv¡iaLEzNiL`M`MZVEM[IcGeMb Liab0JaCE_GZ]GrNa^LGb[;ITZgbnP.ZgEaGeMb!GI;`>PXIcGeMb C|M>IT!byKLia`MUgb;W>Pbb.Zg[;{MTb Q <z|
lZmP¢^*I;EMEMb0^*GbnJGIuI;EMbIT
4F L^eUgbnLc¨chTI;i GeMbGI;`Ic¨Ge>b P5b0kb0TLU /YIT'J ¢bGP{MqKv¡eMZVbTLT^eMZgbnP|.Zg[;{MTb Q =pZgUVUg{4PrGTLGb0PLpchTL[iabE_GIcCGe>
b l^*I;iR`>TZmP5ZVEM[Pbkb0TLU /I;T'J db*G¢P{MqKv¡eMZgb0TLT^e>ZgbnP|
}te>buÀ >$ ´ *s¾K¶ ^0LGb0[I;TZVb0PdUgZmPrGb0JYLPGI;`>PIcGeMb ¤LTbGIzI
[b0EMbTLUchITGeMba¢Ã P5NKP5Gbi Gb0P5GbnJsIEsGeMb ¤PrGITZgbnP|MI;TbyKLia`MUgb;WGeMb
b*yK`b0^Gb0JÄLE>PQb0TGrN_`bchI;T ´µ {Mb0P5GZVIE>PZVP XWqM{KGGIzIsIcGbEÄPbk;bTLUX`bI`>Ugb
LTbiabE_GZgI;EMb0JZgEGeMbaPLiabRP5GI;TNLE>JWGeMb0TbchITbWL^0^*{MTL^NP{ @bTP|>ITGeMZmPTbnLPIE W
+
+
+
+
+
+
+
+
!#"$%
TOP
REASON TIME P RODUCT ORGANIZATION MANNER NATIONALITY ALPHABET MAMMAL REPTILE AUTHOR LANDMARK
DATE MONEY
LOCATION
LANGUAGE
P ERSON QUOTATION NUMERICAL GAME DOGBREED DEFINITION
VALUE
UNIVERSITY COUNTRY CONTINENT
CITY P ROVINCE
scientist
DEGREE RATE P ERCENTAGE AMOUNT S PEED
OTHER_LOC
DIMENSION DURATION
performer
biologist
botanist
linguist
cosmographer
European
dancer
actor
musician
actress
oboist
Romanian
Italian
Swede
COUNT TEMPERATURE
guardian,
defender
philosopher
bodyguard
escort
custodian
realist
yogi
existentialist
pragmatist
F
ïñõþ þKÇèzëú!ùzìçÁîðøé4ðùzîøô4ðúTé4÷zç ;þ
A NSWER TYPE C ATEGORY
PERSON
N AMED ENTITY
person
CATEGORY
MONEY
money
SPEED
price
DURATION
quantity
A MOUNT
number
F
ïñõzþ< þ Jòzîó=çÁôé8ýùçHîòëú!ç ü çHòé4ï0é8ýúëùzùïñòõîHþ
Qb!ZVE>P5GbnLJab*yK`b0^*GCGe>LGCGe>b¢P5{Mq rb0^GIcGeMbdbkb0E_GCiRb0E_GZVIEMbnJxZVEuL ´µ {Mb0P5GZVIEaQ!ZVUgU4q4b
GeMbaL`>`MTI;`MTZVLGbTb0P`4I;E>PbxLE4JWP5ZViaZgUmLTUgN;W>GeMbRIqrbn^GIcXGe>bRk;bTqsZVEL ´µ {Mb0P5GZVIE
Q!ZgUVU qbGeMbTZV[e_G¢LE>PQb0T0|
.ZV[{MTb Qn ZVUgUV{>P5GTLGbnP\>k;b {MbnPrGZgI;E>PxLE>JlGeMbZVTR^ITTbnP5`IE4JKZgE>[sLE>PQb0TP0WGeMb~byML^G
LE>PQSbTdqbZVEM[~{ME>JKb0TUVZgE>b0J|}teMbRP5{Mq rb0^G`MTb0^*bnJKb0P¢GeMbRkb0TqZVEsGeMbxLE>PQb0T¢GIpGeMb\>TPrG
| SNY^IE_GTLP5G0W e>IQb0kbTnWGe>bpLE>PQSbTIc
{Mb0P5GZVIEÄPZgE4^*bGeMb~LE>P5QSbTZmPZVEHL;^GZVkbk;IZm^*b;
P5bn^*I;E>J {MbnPrGZgI;EZmPZVEGeMba`>LPP5ZVkbRkI;ZV^bRPIGeMbaI;q rb0^*GZVE>JKZm^LGbnJqzNGeMb`MTb`I;PZ]GZgI;E
*¶ ZVPpGeMbY^*I;TTb0^*G~LE>PQSbTn|!b0^I[;EMZgÁ0ZgE>[Äkb0Tq>LU¢`MeMTLPb^I_I;TJMZgE>LGZVIEZVEGe>bYLE>P5QSbT
Ic!GeMbpGeMZVTJ {MbnPrGZgI;EHLPQb0UgUtLPxTb0PIUVk_ZVEM[fGeMb~`>TI;EMI{ME µ
GI 4 µ *$ W¨bE4LqMUVb0P
ZVJMbE_GZg\4^LGZVIE Ic µ K>F*$ L;PpGeMblP5{Mq rb0^GqzNªZgEMchbTbE>^b|¢}teMblLE>PQSbTuGI¤GeMbchI{MTGe
{Mb0P5GZVIERZVPCIqKGLZVEMb0JxqzNTb0^*I;[EMZVÁZVEM[EMI{MEa`Me>TL;P5b!^*IzI;TJKZVE>LGZVIE |Åb0JK{>^ZgE>[GeMb¢LE>P5QSbT
GI {Mb0P5GZVIEp\>kbZmPSJMIEMbqzNukb0Tq>LU4`>eMTL;P5b^*IzITJKZVE>LGZgI;EpLE4JpI;q rb0^*G5v¡bUVUgZV`>PZVPZgEMchbTbE>^b|
DFE¹LJMJMZ]GZgI;EªGITb0PIUVk_ZVEM[b0UgUVZg`4P5ZmPaGe>TI;{M[eªTb0^*I;[EMZVÁZVEM[lkb0Tq4LU¢`Me>TL;P5b^*IzI;TJKZVE>LGZVIE W
`MTIEMI;iRZVE>LU ^*ITb*chb0Tb0E>^*bLUmPIxEMb0b0JMP!GIaq4bTb0PIUVkbnJ|
/e>bEsiL`>`MZgE>[ {MbnPrGZgI;E>PtGIGeMbRLE>PQSbT!GrNz`b0P¢UVZmPrGb0JfZVE.Zg[;{MTb Q <RLE>J
GIÄPNzE;GL^*GZm^~TIUVb0P0WXb| [>|VW $>
h¿% W ¿% WQSbE>bb0JjGIZgE>^IT`4I;TLGbZgE¤GeMb MÀ ¸ ¸ 7PNzP5Gb0i iaITbRUVLEM[{>L[bR`MTIz^b0PP5ZVEM[TbnP5I;{MT^*b0PdGe4LElZgEGe>bD5£Y7PNKPrGbif|
}teMb0PbTb0PI{MT^*bnPZVE>^*UV{>JKbTb*chb0Tb0E>^*bLE>JbUVUgZV`>PZVPtTb0PIUV{KGZVIEiab*GeMIKJMP¢LPtQSbUVU LPt`>eMTL;P5b
^*IzITJKZVE>LGZgI;ElTbn^*I[;EMZVÁbTPJKb0TZVkbnJYchTI;i GeMbp`4LTP5bIcdP5b0E;GbE>^b0P0|§I;Tb0Ikb0T0WchI;TqIGe
*x
aª¾4;w>
t>$w À M $ ´ *z¾4% µ >>$
1. Who left Joplin on October 26, 1861?
The last Pony Express rider leaves town today.
2. Who wrote the "Pledge of Allegiance"?
The pledge was written by Frances Bellamy.
3. Who kills Florida panthers on purpose?
But hunters still find them and hunt them.
4. What did Alex eat on the island?
He ate plums, cray fish, peppers and turnips.
¦
5. What will the spacecraft shoot at the moons? It will point laser beams at the surface and shoot.
F
ïõþD IþKÇèzëú!ùzìçÁîðø;ëòzîó=çÁô4îé4÷ëéJëô4çpîê çHöÁé4îðô:ð# çÁöÁé4îJðøé4÷çpíêzçHîé4ïñðò,çÁô [þ
NAME
mean
call
name
abbreviate
stand for
known as
Who has a spacecraft named after him?
What is the new machine called?
What city was named after Cristofer Columbus?
Why might Erik’s last name be famous some day?
What is another name for merry-go-round?
What is the name of the boat?
What is the name of our national library?
What was another name for an automobile or car?
What does "RFD" mean?
What does "quint" mean?
(a)
(b)
F
ïñõzþD Jþ ¶òðçÁì[ëòîó¸çÁôJé#ýùçþ
(PNKPrGbiPdPbk;bTLU L;JMJKZgGZVIE>LU^L;P5bnP¢LTZmP5b;|>MI;T!GeMbnP5bx^LPb0P¢QbiLbGeMbchIUVUVIQ!ZgEM[
Iq>PbTkLGZgI;E>P1C
Q |t}te>b {Mb0P5GZVIEPbbKP¢LaE4Liab0Jfb0E;GZ]GrN~IT!GeMbE>LiabIcXLu^*I;E>^*b0`KG¢Q!eMb0E /I;TJ'db*G
PNzEMIEzNziPtIc¨Ge>bkb0Tq
a IT¢ZgGP¢`>LTL`Me>TL;P5bnP!LTbZmJKb0E;GZ]\4b0JfZVEfGeMb {MbnPrGZgI;E |
/Ybe4L#kbsLJ>JKb0J¤GeMbsGI` jGIHI{>T CWSL;PuPeMIQ!EZgE
.ZV[{MTb Q0 È L Þ | ¢IGbGe>LG!GeMbe>Zgb0TLT^ezN^*I;E;GLZVE>PtEMIGtI;EMUVNuEMI{>E>PWKq>{KGLUmPIxk;bTq
P{MqKv¡eMZVbTLT^eMZVb0P0|;.Zg[;{MTb Qn È q Þ ZVUgUV{>P5GTLGb0PtP5I;iab {MbnPrGZgI;E>PCGe>LG!Tb {MZVTbdGeMZmPtEMb0Q
GI`fLE>JZgGP¢^ITTbnP5`IE4JKZgE>[xP{MqKv¡eMZgb0TLT^ezN;|
| /e>bE~GeMb {Mb0P5GZVIEP5b0bKPGeMbJKb\>EMZgGZVIEIc¨Lx^IE>^b`KGnW;GeMb {Mb0P5GZVIE~ZVPSiLG^eMb0J
GIP5I;iRb`MTb0JMb*\>EMbnJ`>LGGbTE>P0WMP5{4^eL;PSGeMI_P5bUVZVP5GbnJ~ZVE.Zg[;{MTb :rÈ L Þ |
JKb\>EMZgGZVIE {Mb0P5GZVIE¤Tb {MZgTb0PaP`4bn^*ZmLUSGTb0LGiabE_Gbk;bEjchIT}!¢t {Mb0P5GZVIE4P|
/Yb!iLG^ea^0LE>JMZVJMLGb¢LE>P5QSbTP¨L[_LZVE>PrGCLPZgiaZVUVLTCP5bGCIc`>LGGb0TE>PCQ!eMbTbSGeMb¢byML^G
LE>PQb0TSZmPt[ZVkb0E~qzNpGeMbeMbnLJIc À M$ ´ * µ $ PeMIQ!EpZVEZV[{>Tb :[È q Þ |
¦>|t}te>b {>b0P5GZVIELPKPLqI{KG~LEªbkb0E_GaQ!e>bEZgG~P5`b0^Z]\4b0PaGeMbsP5{>q rb0^*G0WI;q rb0^*GuIT
IGeMb0TXGe>biLGZV^dTb0UVLGZVIE>P¨IcGeMbdb0kb0E;Gn|;£z{>^e {>b0P5GZVIE>PCLTb!Tb0^I[;EMZgÁ0b0JRQ!eMb0EaGeMb
iLZgEuk;bTq ZVP{>Pb0JZVEGeMb {MbnPrGZgI;E W;b;| [4|g
W /e4LGSJMZVJaGeMb>Tb0E>^eu`bI;`MUgb ZgE
Q < ; I;T /e>LGtQtLP!PeMbGe>b\>TP5G¢QSIiLEpGI M|
? |¢{>b0P5GZVIE>PLPzZgEM[fLqI{MGJKZmP5GZVE>^GLG5GTZVqM{KGbnPIcSLEb0E;GZ]GrNsLTbRZVE>JKZm^LGb0Jq_NsGeMb
`>TbnP5b0E>^*buIc¢QI;TJ>P · W w¶ W¨IT
|¨.ZV[{MTb iQ UVZVP5GPRLPb*GRIcP{>^eH}!¢t
+ )
!?
!#"$%
(QP-1) What {is|are} <phrase_to_define>?
(QP-2) What is the definition of <phrase_to_define>?
(QP-3) Who {is|was|are|were} <person_name(s)>?
(a)
(AP-1) <phrase_to_define> {is|are} <Answer_phrase?
(AP-2) <phrase_to_define>, {a|the|an} <Answer_phrase>
(AP-3) <phrase_to_define> - <Answer_Phrase>
(b)
F
ïñõþ"DKþëéé4çÁô4òîðøíêzçHîé4ïñðòzîJëò ü ëòîó¸çÁô4îé4÷ëé:çÁèùô4çHîî ü ç:/òï0é4ïñðòzîHþ
LE>J {Mb0P5GZVIE4PxLE>JlGe>bZVTR^ITTbnP5`IE>JMZgEM[sLE>PQb0TP0| DFEÄGeMZmPx^0LPbWGeMb
LE>PQb0TGrNz`4b~ZVPaJKbGb0TiaZVEMb0JlchTIi GeMb /YITJ'db*GRP{MqKv¡eMZVbTLT^ezNeMbnLJKbnJÄqzNYGeMb
^IE>^b`KGdLG5GL^eMbnJGI · W w¶ IT
ZVEfGeMb {>b0P5GZVIE |MDFEfGeMZmPdPZ]G{>LGZgI;EfGeMb
CW
%¡a>$ ´ *w¶ JKIzb0PEMIGtqbUVIEM[GIGeMbGI`pIc GeMb q>{KGdZgG¢ZVPdTLGeMb0T¢JKNzE>LiaZm^LUVUVNp^*Tb0LGb0JqzNuGeMbZVE_GbT`MTb*GLGZVIEIc.Ge>bJKb`bE4JKbE>^N
[;TL`Me |>ITbyMLia`MUVbW GeMbpJKNzE>LiaZV^0LUVUgNl^*Tb0LGb0J _ W.[b0EMbTLGb0JchIT _² ZgE
.ZV[{MTb iQ W4^IE_GLZgE4P Q1? iabiqbTZgE4PrGLE>^b0P0W4ZVE>^*UV{>JKZVEM[ 0;>% W u
_ LE>J
$z$ *>$ _ |d£KZgiaZVUVLTUVNW {>b0P5GZVIE %_° [b0EMbTLGb0PuLHJKNzE>LiaZm^sb*yK`b0^*Gb0J
LE>PQb0TGrN_`b ! ´ WQ!ZgGe ? < : iabixq4b0TZVE>PrGLE>^b0P0W^*I;ia`MTZmPZgEM[ % µ W *wK>
LE>J $K ! ´ * |MI;TJKNzE>LiRZm^^0LGb[I;TZVb0PdLUVUiabixq4b0TZVE>P5GLE>^*bnPdLTbPb0LT^eMbnJfZgE
GeMbGbyzG¢`>LPPL[bnP|
+
âãäiåân/ )
â âá
ä ) á ãá 8ã+
¨3527689;:<>=#?>@ACB
£zbk;bTLUJKAZ @b0Tb0E;Gtiab*GeMIKJMPSIcby_GTL;^GZgEM[RLE>PQSbTPCe>L#k;bdqbbE~Zgia`MUVbiab0E;Gb0JpZgE~GeMb^*{>T5v
Tb0E_GaD5£ PNKPrGbiP|C}te>b0PbiabGeMIKJMPuPe>LTbfP5I;iabfPZViRZVUmLTZ]GZgbnPxQ!ZgGe¤GeMbs¢¥
P5bnLT^eGbn^eMEMZ {>b0P0W0qM{MG¨LUVPIde>L#k;bJKZA@b0Tb0E>^*bnP|#}teMb\>TP5G¨iRbGeMIKJW#ZVia`MUgb0iabE_GbnJZVE È £KTZVe>LTZCLE4J Z :::Þ `bTchITiPLGby_GxiaLG^eMZVEM[fIcSGe>b {Mb0P5GZVIEYGb0ia`MUVLGb
Q!Z]GeGe>bs`MTIz^b0PP5bnJªJKIK^*{MiabE_GP|S}tQIÄJKAZ @bTbE_G~TLEMzZVEM[;PLTb{4P5bnJ¤GIÄb0k#LUg{4LGbsGeMb
iLG^e>ZgEM[4|.ZgTP5G0WL^I{ME_GIcGeMbu{ME>Z {Mb {MbnPrGZgI;ElbNzQSITJMPZVEb0L^eJKIK^{MiabE_GxPbEKv
Gb0E>^*bZVPxiLJKb;|.}te>bE W¨LPb0^IE>JMLTNTLEMzZgE>[GLb0P`MUmL^*bpGIYL^^I{ME_GchI;TxkLTZmLE_GPIT
LUgGb0TE>LGZVIE>PIctGeMb {MbnPrGZgI;ElbNzQSITJMP0|}te>ZVPiRbGeMIKJlZmPPZgiaZVUVLTGIfGeMb `>LGGb0TEfiLG^eMZgE>[RIcQSITJMP!LE4JuGeMbTbnP5{>U]G!Ic¨QSITJpP5GbiaiaZVEM[>|
}te>bRPb0^IE>JiabGeMIKJsZmPLE>PQb0TPbUVb0^*GZVIEsQ!ZgGeiLyKZgix{Mi bE_GTI`zNfZViR`>Ugb0iRb0E_Gb0JZgE
GeMbP5NKP5Gbi JKbnP^TZVq4bnJ¤ZgE È D¡G5GrNK^eMbTZmLe *ag! :: Q Þ |C}te>ZVPpiRbGeMIKJªZmPq>L;P5bnJjI;Eª\>kb
JKAZ @b0Tb0E;GdJMZVP5GLE>^*bn1P C È L Þ iLG^e>ZgEM[aQSITJMP0W_Q!e>ZV^efZmP!LR}!v¡DrÅjP5{>i Ic.GeMbQSITJMPchTI;i
GeMb {MbnPrGZgI;ELE>JJKIK^*{MiabE_G¢PbE_Gb0E>^*bGe4LG¢iLG^eMb0J~ZgE~Ge>biRI;T`>eMIUVI[;ZV^0LUP5`>L;^*)b 7 È q Þ
GeMbnPL{MT{>PXiLG^e Wiab0L;P5{MTZVEM[GeMbd}!v¡DrÅIcLUVUMQSITJMP.Ge4LGLTb!PN_E>IEzNziRI;{>P¨iLG^eMb0P
ZgE /YIT'J ¢bDG 7 È ^ Þ iaZVPiLG^e~QSITJMP0W_iabnLP{MTZVEM[xGeMb}!v¡DrÅHIc¨LUVUQI;TJMPGe>LG¢JKZmJEMIG
iLG^e 7 È J Þ JKZmP`4b0TPZgI;E WK^*I;{ME_GZVEM[RGeMbEz{MiqbT!Ic {MbnPrGZgI;EpQSITJMPGe>LG!LTbiLG^eMb0J~ZgE
*x
aª¾4;w>
t>$w À M $ ´ *z¾4% µ >>$
8
Q204: What type of bridge is the Golden Gate Bridge?
..the Seto Osashi Bridge, consisting of six suspension
bridges in the style of Golden Gate Bridge...
Q267: What is the name for clouds that produce rain?
Acid rain in Cheju Island and the Taen peninsula is
carried by rain clouds from China.
Q581: What flower did Vincent Van Gogh paint?
In March 1987, van Gogh’s "Sunflowers" sold
for $39.9 million at Christie’s in London.
(a) TREC questions
RM5-6: What kind of store is Stewart’s?
This new kind of shopping place is called
department store.
RM5-7: What planet will Voyager 2 pass this year?
The pictures come from Voyager 2, a satellite.
It will pass through 3,000 miles of Neptune.
RM5-14: What other cities in Texas have women mayors?
Now the state of Texas has women mayors in six of its
largest cities. The other cities are Houston, Dallas,
San Antonio, Galveston and Corpus Christi.
(b) REMEDIA questions
F
ïñõzþ(">þ(½êçHîé4ïñðòîîçHçïñòõïñòzîéPëòöÁçHîðøîùçHöHïëì-öHðòöHçHùé4îHþ
'L 7LE>J È b Þ ^*UV{>PrGbTCQSITJMP0W^*I{>E;GZgE>[GeMb!Ez{Mixq4b0TCIcQI;TJMP.chTIi GeMb¢^0LE>JMZVJMLGb!PbE_Gb0E>^*b
Ge>LG.IK^0^*{MT¨LJ 5L;^*b0E;GUgNqIGeZVEGeMbSPbE_GbE>^bLE4JZVEGe>b {MbnPrGZgI;E |}teMbS¢HPNzP5Gb0i
JKb0P^*TZVq4bnJfZgE È e>LTEMZmL *¢V :)::zÞ e>L;P¢ZVia`MUgb0iabE_GbnJIEMUVN~GeMb}!v¡DrŪJKZmP5GLE4^*bIc
iLG^e>ZgEM[QSITJMPW0Gez{>P¨ZgGC^*I;{MUVJq4btby_GbE>JMb0JGIZgia`MUVbiabE_G¨Ge>bSIGeMb0T¨iRbnLP{MTb0P.LP.Qb0UgUw|
}te>bGeMZVTJiab*GeMIKJpZmPSGeMb`>TbnJKZV^*GZVkbLEME>IGLGZVIE~Gbn^eMEMZ {>bZVia`MUVbiabE_GbnJq_ND t§O P
D5£(P5NKP5Gb0i È ¢LJMbk *dg ::):zÞ |4¢E>PQb0TbyzGTL^GZgI;EZVP`bTchITiRbnJqzNGeMbÀ M$*
LE>J7½ *V% LUV[I;TZgGe>iaP0Wq>LPb0JIEYUVI[ZmP5GZm^xTb[;TbnPPZVIEchI;TTLEMzZgEM[`IGb0E_GZmLULE>P5QSbT
{>PZgEM[uLxGTLZgEMZVEM[uPb*G¢Q!ZgGePbkb0EpchbnLG{MTbnP| ¢b*yzGnWMQb`>TbnP5b0E;GtGeMbiab*GeMIKJ~{4P5bnJ~qzN~I{MT
P5NKP5Gb0iaP0W MÀ ¸ LE>J MÀ ¸ ¸ WzTb0P`4bn^GZgk;bUVN|
¨3
*5=n89 FA<Ä84A!";=5&=n?(
3 «B?z9@( ;A
x9#? #9 5?4A
}teMZmPP5bn^GZVIEZgE_GTIKJK{>^b0PLEYLUgGb0TE>LGZVkbaLE>PQSbTb*yzGTL^*GZVIEsiab*GeMIKJYq>LPb0JIEPZViR`>Ugb
iL^eMZVEMbRUgbnLTEMZgE>[uGbn^eMEMZ {MbWLUmPIpb*yKeMZVqMZgGbnJZVE MÀ ¸ È BdLTLq>L[;Zg{ V ::: q Þ |
}teMbYiRbGeMIKJUgbnLTE>PpL %
m$ ch{>E>^GZgI;Eqb*GrQSbbE`4IGbE_GZVLU^0LE>JMZVJMLGbYLE>PQb0TP
=
!#"$%
q>LPb0JÄIEÄPbkb0Elchb0LG{MTb0PxLE>JlGeMbpbyK`4bn^GbnJHLE>P5QSbTGrN_`b| /YbuchI{>E>JlGe4LGGeMbfPLiRb
iab*Ge>IzJlQ!e>bEYGTLZVEMb0JYQ!ZgGeÄLJKAZ @bTbE_GP5bGIcSchb0LG{MTb0P0W `bTchITiab0JkbTNsQSbUVUCZVEI{MT
Zgia`MUVbiab0E;GLGZgI;EIc.LEf¢ ©P5NKP5Gb0iW MÀ ¸ ¸ |
}te>b!cL^*GGe4LG {MbnPrGZgI;E>PCLTb!EMIGTbnPrGTZm^Gb0JRGILEz{MiqbTIc`MTb0JKb\>EMb0JJMIiLZVE>PCZmPL
^e>LUVUVbEM[;ZgEM[chbnLG{>Tb!IciaIKJKb0TERGbyzG{>LUPNKPrGbiP|;Ådb0kbUVI`>ZgEM[LiL^e>ZgEMb!UVb0LTE>ZgEM[
L`M`>TI_L^echITI`bEKvFJKI;iaLZgEÃe>L;PdPbkb0TLULJMk#LE_GL[;b0DP C È Q Þ ZgGb0UgZViaZgE4LGbnP¢GeMbE>bb0J
chITLYzEMIQ!UgbnJK[b~bEM[;ZgE>bbTRGIY^TLcGxGeMbfT{MUVb0PxGe>LGb*yzGTL;^GLE>PQb0TDP 7¨LE>J È Þ ZgGp^LE
P^0LUVbf{M`¤GILYUVLT[;b~Ez{Mixq4b0TuIcEMbQWC{>E>P5b0bE {Mb0P5GZVIE>PLE>JªLJML`KGEMbQ zEMIQ!UgbnJK[b
chITGeMbZVTTb0PIUV{KGZVIE3
| /bpZgE>^IT`4I;TLGbnJsZVEI{MTPNKPrGbi LfiaL;^eMZVEMbUgbnLTEMZVEM[L`M`MTI;L;^e
chITaLE>PQSbTZgEM[}!¢S {MbnPrGZgI;E>P| /Yb~{>Pb0JGeMb :): }!¢Sv {MbnPrGZgI;E>PchI;TGTLZgE>ZgEM[
LE>J¤Gb0P5GbnJHGeMbsTb0P{MUgGZVEM[`MTIz^b0JK{>TbfIEªGeMb = ¦l}!¢Sv {Mb0P5GZVIE>P0| {MTUVb0LTE>ZgEM[
Gbn^eMEMZ {>b¢ZVPq>LPb0JaI;EaGeMbdIq>PbTkLGZVIERGe>LGCGeMb¢Tb0P{MUgGPCIci{MUgGZV`MUVb¢chbbnJKq>L;^Tb*GTZVbkLU
ZVPLUVQSL#NKP!LuPb*GIcX`>LTL[;TL`Me>PSZVEQ!eMZV^esLGdUVb0LP5G¢IE>b`>LTL[;TL`Me~^IE_GLZgE4PtGeMbR^*I;TTb0^*G
LE>PQSbTn|;}N_`>ZV^0LUVUgN;WGeMb^0LTJKZVE>LUVZ]GrNaIcGeMbP5bGSIc `>LTL[;TL`Me>PXZmPSq4bGrQb0bE 8:: LE>Ju¦ ::):
bUVbiabE_GP|X¢EzNPITGZVEM[LUV[I;TZgGe>iWb| [>|VW K%·#$ ^0LEÄI;TJKb0TGeMZVPaPb*GaIc¢`>LTL[TL`Me4P
Z]cL %
m$sK%w ZVPx`MTIk_ZmJKbnJ|}teMb[I_LUIc!Ge>b}!¢t¬¥bkLUV{>LGZgI;E>PZmP
GITbG{MTE\>k;bI;TJKb0TbnJGby_GPEMZg`>`4bGPGe4LGTb0`MTbnP5b0E_G¢GeMbRiaI;P5GUVZg;bUVNLE>PQb0TP¢GIfLEzN
[ZVkb0E {Mb0P5GZVIE |}teMb0TbchITbWQbxEMbbnJGIPITGLUgU.Ge>bx`>LTL[TL`Me4P¢LE>JTbG{MTEGeMbRGb*yzG
P5E>Zg`M`b*GP!b*yzGTL;^GbnJuchTIi¥GeMb\>TP5G!\>kb`>LTL[TL`Me>P0|
dE>PQb0Tby_GTL;^GZgI;EuZVP`bTchITiRbnJZVEuGe>Tb0bP5Gb`41P C È Q Þ QSbUVb0LTEI @4v¡UVZgEMbL^Iia`>LTZmP5I;E
ch{ME>^*GZVIEÄchI;TLE>PQb0TTLEMzZVEM[ 7 È Þ QSb~L`M`MUVNlGeMbf^*I;iR`4LTZVPIElch{ME4^GZVIE¤LGRGbnPrGRGZViabW
Q!eMZVUgbdPITGZVEM[LPb*GIc{ME4P5b0bE`>LTL[TL`Me>DP 7 È ¦ Þ Qb¢PbUVb0^*GIEMUVNGeMb!\>TP5GX\>kb!`>LTL[TL`Me4P
chTI;i¬Q!eMZm^e~QSbbyzGTL^G 8: qzN_Gb0P È chIT!P5e>ITGtLE>P5QSbTP Þ IT 8: qzN_GbnP È chIT!UVIE>[RLE>P5QSbTP Þ
^*b0E;GbTb0JYLTI{ME4JL^IE>^b`KGIcSGe>buPLiRbuPbiLE;GZV^a^0LGb0[I;TNsL;PGeMb %¡M$ ´
1¶ |
}IaUgbnLTEGe>b^Iia`>LTZmP5I;Ech{ME>^*GZVIEQbe>L#k;bdbyz`bTZViRb0E_Gb0J~Q!ZgGeE_{>iRb0TI;{>P`4I_PPZgq>Ugb
chb0LG{MTb0PXLE>JI;qKGLZgE>b0JGeMb!qb0P5GXTbnP5{MUgGP¨Q!ZgGeRGeMb!P5b0kbExchb0LG{MTb0P.UVZVP5GbnJRZgEa.Zg[;{MTb ; È L Þ |
}teMb!UVb0LTEMZVEM[Gbn^eMEMZ {Mb!Qbtb0iR`>UgINxZVP¨GeMb *% w Ge>LGLPP5IK^*ZmLGb0P.GeMb!ZgE>`M{KGk;b0^GIT
IcGeMbRchb0LG{MTb0P Q!Z]GelLEI;{KG`M{MGch{ME>^GZgI;E
qzN\>TPrGLJ>JKZgE>[pGeMbaQb0Zg[;e;Gb0Jchb0LG{MTb0P
LE>JGeMbEL`M`MUVNzZgE>[uLuP5ZV[E4LG{>Tbch{ME4^GZVIE|£zZVE>^bGeMbR^*I;iR`4LTZVPIE~ch{ME>^*GZVIEsEMb0b0JMPdIEMUVN
GIRZgE4JKZV^0LGbQ!eMZm^epb0Ugb0iabE_G!`MTbn^*bnJKb0PGeMbIGeMb0TZVEpGeMb^*Iia`>LTZmPIE WGeMb0TbchITbWz`MTIzJM{>^v
ZgE>[IEMUVNGrQSIf`4I_PPZVqMUgbkLUg{MbnPWQb\4E>JGeMbu`bT^*b0`KGTIELEYZmJKbnLUCk;beMZm^*UVbachITUVb0LTE>ZgEM[
^*I;iR`4LTZVPIElch{ME4^GZVIE4Pqb*GrQSbb0EH`>LTL[TL`Me>P0|DFE>JKb0b0JHI{MTxb*yK`4b0TZViabE_GPxQ!ZgGejJMb0^*ZmPZgI;E
GTbbnP!JKZVJEMIG¢`4b0T5chI;Ti LPtQSbUVU1|
DFE¤GeMbfGTLZVEMZVEM[l`Me>LPbWXQSbsLE>EMIGLGbGeMb`>LTL[;TL`Me>PR^*I;E;GLZVEMZVEM[GeMbs^*I;TTb0^*GuLEKv
P5QSbTRchI;Tb0L^e¤}!¢Sv {>b0P5GZVIE |C}teMbf`>LTL[TL`Me4P{>Pb0JjZgE¤GeMbGTLZVEMZgE>[Y`>e>LPbLTb
`MTIzJM{>^*bnJjL{KGI;iaLGZm^LUgUVNlq_NlGeMbfDr ^Iia`IEMb0E;GIc¢GeMb PNKPrGbif
| /bGTLZgEHGeMb
`4b0T^b`KGTI;EjI;ELE¤b {>LUdE_{>iqbTIc`I;PZ]GZgk;bfLE>J¤EMb[_LGZgk;bbyMLia`MUVb0P0|CMITaGTLZgE>ZgEM[
`M{MT`4I_P5bnPW>Qb^Iia`>LTb`>LZgTP!IcX`>LTL[TL`Me4PZVEQ!eMZm^esLGdUVb0L;PrG¢I;EMbIc.GeMb`>LTL[TL`Me4P
^*I;E;GLZVE>PpGeMblb*yML;^GLE>PQb0T0| /eMbE>bkb0TpGeMb\>TP5Gf`>LTL[;TL`MeªZVP~Ge>bYI;EMb^IE_GLZgE>ZgEM[
GeMbs^ITTbn^GLE>PQSbTnWQSbfe>L#kbfLY`4I_P5ZgGZVkbfb*yMLiR`>Ug)b 7¨PZViRZVUmLTUgNHLEMb0[;LGZgk;b~byMLia`MUVbZmP
[b0EMbTLGb0JÄqzNÄ^IE>PZVJMbTZgEM[Ge>b`4LTL[TL`>eÄ^*IE_GLZVEMZgE>[GeMbLE>PQb0TRGIYq4bfGeMbP5bn^*IE4J
`>LTL[;TL`MeIcGeMb`>LZVT0|zMI;TbnL^eu`4LZVTIc`>LTL[;TL`Me>P È Þ WKQb^*I;iR`>{KGb
7
7
7
! "
# ! 7$ % & 7
' ! ' ! ' # 7
*x
aª¾4;w>
t>$w À M $ ´ *z¾4% µ >>$
relSP
− the number of question words matched in the same
phrase as the concepts of expected answer type.
relSS
− the number of question words matched in the same
sentence as the concepts of expected answer type.
relFP
<
− a flag set to 1 if the concept of expected answer type
is followed by a punctuation sign, and set to 0 otherwise.
relOCTW − the number of question words matches separated from
the concept of expected answer type by at most 3 words
and a comma.
relSWS
relDTW
− the number of question words occuring in the same order
in the answer text as in the question.
− the average distance between the question word matches
to the concept of expected answer type.
relNMW − the number of question words matched in the answer text.
F
ïñõþ"#"þrçëô4òzïòzõ5ø£çHëé4êzô4çÁî:øðô1Jòzîó=çÁôÇèéôPëöÁé4ïñðòrþ
|}teMb[;I;LUIcXGTLZgEMZVEM[GeMbR`4b0T^b`KGTI;E
LE4JHIcGeMb µ *$ µ g chTI;i Ge>bfchITi{MUmL'C
! !
' # ' ! µ *$ µ V |
L E>J\>E>LUVUVN
ZVPGIIqMGLZVEjGeMbkLUV{MbIcGeMbQb0Zg[;e_GP
}te>bS`bT^*b0`KGTIERUVb0LTE>PGe>btPbk;bExQb0Zg[;e;GP¨LP¨QSbUVUMLPGeMbtkLUV{MbtIc4GeMbtGeMTb0PeMIUmJ{>Pb0J
chITXch{MG{MTb!GbnPrGPCI;ExGeMb¢TbiLZVEMZVEM[ < ¦}!¢Sv {>b0P5GZVIE>P0|/Yb¢IqKGLZVEMb0JxGeMb!chIUVUVIQ!ZgEM[
kLUV{Mb0PCchITCGeMbPbk;bEQSbZV[e_GDP C
¦ Q ='7
Qn ? 8 7
? ?rQ 7
? ? = 7
;Q1? 7 ?_ 7
?; <z|}te>bpUVb0LTEMbnJkLUV{MbpIc!GeMb
µ *$ µ g ZVP Q 8 :)8 |
SGdGeMbGb0P5Gd`Me>L;P5b;WM[ZVkb0ELE_N~`>LZVT!Ic¨`>LTL[TL`Me>P0WzQ!eMbEGeMbkLUV{MbIc.Ge>bTbnP5{>U]GZgEM[
ZVP`4I_P5ZgGZVkb;WQSbdP5b0Ugbn^GGeMbd\>TP5G`>LTL[TL`MeWIGe>bTQ!ZVPb¢QSbd^eMI;Pb!GeMbPb0^IE>JRIE>b|
DFELJ>JKZ]GZgI;E WQSbXchI;{ME>JGe4LG`>TZVITGIdLE4P5QSbT byzGTL^GZgI;E WGeMbCITJKb0TZVEM[!IczGeMb`>LTL[TL`Me4P
e>LPLP5ZV[EMZg\4^0LE_GOb @b0^GI;EYGeMbuIk;bTLUVU¨`4b0T5chI;TiLE4^*baIcSGeMb~¬P5NKP5Gb0i|§ITbIk;bTnW
Q!eMbEfGeMbbyz`b0^*GbnJLE>PQb0TtGrNz`4b^0LEMEMIGdqbZVJKb0E_GZg\>b0JWiLEzNuIc.GeMbchbnLG{>TbnP!{>Pb0J~GI
UgbnLTEsGeMbR^Iia`>LTZmP5I;Ech{ME>^*GZVIEl^LEMEMIGqbx{>Pb0JYPZgE>^bGeMbNsJMb`bE>JIEGeMbab*yK`b0^*Gb0J
LE>PQSbTGrNz`4b;|}IITJKbTGeMbu`>LTL[TL`Me>PQSb{>P5bnJlL[;LZgElLf`bT^*b`MGTIE WqM{MGGeMZmPGZgiab
Qbb0iR`>UgIN;b0JuI;EMUVNaGeMTbbchb0LG{MTb0P0|K}teMbJKb*\4EMZ]GZgI;E~IcGeMb0PbdGeMTbbchb0LG{MTb0PtJKb0`4b0E>JMPtIE
GeMbE>IGZVIEfIc 0 µ ´ ´ W\>TP5G¢JKb*\4EMb0JZVE È §IUmJKIkLE SV;
Qn; Þ |
XLTL[TL`MeMvwQ!ZVE>JKIQ¢P4LTbCJKb*GbTiRZVEMbnJq_NdGeMbEMbbnJGId^IE>PZVJMbT Pb`>LTLGbUVN¢bnL^eiLG^e
IcGeMblPLiRbb0N_QSITJ¤ZgEGeMblPLiab`>LTL[TL`Me|MI;T~byKLia`MUgb;WtZ]cQSbe4L#kbL¤P5bG~Ic
b0N_QSITJMP ·;°#³· ³S· ³· LE>JsZVElLp`>LTL[TL`Me ·;° LE>J · LTbxiLG^e>b0JsbnL^eGrQ!ZV^bW
Q!eMbTb0L;P · ZmPaiLG^eMb0JjIEMUVNÄI;E>^*b;WCLE>J · ZVPaEMIGuiLG^e>b0JWXQSbLTb[;IZVEM[GIle>L#kb
chI{MTJKAZ @bTbE_GQ!ZgE>JMIQ¢PWJKb\>EMb0JqzNfGeMba;bNzQI;TJ>1P C 4 ·;!° F
F% µ °#³S· F
F% µ °#³S· 6¡W 4 ·° %
' # #
!#"$%
a¡% µ ³V· )F
a¡% µ °³R· 6wW 4 ·°F
a¡% µ °³· F
F% µ ³· 6wW!LE>J 4 ·°F
a¡% µ ³· F
F% µ ³
· 6w|M Q!ZVE>JKIQ^Iia`MTZVPb0PSLUVU>GeMbGby_Gtqb*GrQSbbEpGeMbUVIQbnPrGS`4I_P5ZgGZVIE>b0J;bNzQI;TJaZVE~GeMb
Q!ZgE4JKIQ LE>JsGeMbeMZV[eMbnPrG`I;PZ]GZgI;E;bNzQSITJZgEYGeMbQ!ZgE4JKIQ| .Zg[;{MTb ¦ È L Þ ZVUVUg{>P5GTLGb0P
GeMbchI;{MT!Q!ZVE>JKIQ¢PSchIT!I;{MT!b*yMLiR`>Ugb;|
k1-match1
k2-match1
k1-match1
k2-match1
k3
k3
k2-match2
k2-match2
k1-match2
k1-match2
Paragraph-window 1
Paragraph-window 2
k1-match1
k1-match1
k2-match1
k2-match1
k3
k3
k2-match2
k2-match2
k1-match2
k1-match2
Paragraph-window 3
(a)
Paragraph-window 4
rel SWS - computes the number of words from the question that are recognized in
the same sequence in the current paragraph window.
rel DAW - represents the number of words that separate the most distant pair of
keywords in the window.
rel UNMW -computes the number of unmatched keywords from the question.
(b)
ord pair = q
x ∆ rel
+q
x ∆ rel DAW + q
x rel UNMW
SWS
SWS
DAW
UNMW
+ threshold
(c)
F
ïñõzþ" þB ë YFðêzô ü ï)içÁô4çHòéóïñò ü ðóî ü ç:/òç ü ðòcé4÷zçpî4ëú!ç6ùëôPëõôPëù÷<!B(
YFzçëé4êô4çHîø£ðô½ìñçëô4ò
ïñòõ öHðú!ùëô4ïîðò+øêòzöÁé4ïñðòîÂðøóïñò ü ðóî!Oö
æ=÷zçjöÁðú!ùëô4ïñîðò ø£êzòöÁé4ïñðò øðô4ú5êzìë øðô|ùëôPë
õôPëù÷ óïò ü ðóîHþ
>ITb0L;^e`>LTL[;TL`MefQ!ZgE>JMIQ QSbx^Iia`M{KGbGeMbRP^*I;TbnP!UVZVP5GbnJZgEY.Zg[;{MTb ¦ È q Þ | ¢IGb
Ge>LG ZmPRZVJMbE_GZm^LUchI;TLUVUSQ!ZVE>JKIQ¢PchTIi Ge>bPLiab`>LTL[;TL`Me W qM{MGakLTZVb0P
chITQ!ZVE>JKIQ¢PchTI;i JKZA@b0Tb0E_G`>LTL[;TL`Me>P0|}teMbachITi{MUmLfbia`MUVINbnJYq_NGeMbp`4b0T^b`KGTI;E
Ge>LGUVb0LTE>P¢eMIQGIuITJKb0T¢`>LTL[;TL`Me>PSqzNpGeMbZVTd`4LTL[TL`>eKvwQ!ZVE>JKIQ P^ITb0PtZmP¢UVZVP5GbnJZgE
.Zg[;{MTb ¦ È ^ Þ .| /bI;qKGLZgEMbnJGeMbchIUVUgIQ!ZVEM[Rk#LUg{>b0PchITSGe>bGeMTbbQb0Zg[;e;G1P C
Q ¦M| ? <.7
v Q =¦>| : 7_Q!eMbTb0L;
P v QzQ | ?; LE>JpGeMbGeMTbnP5e>IUmJpe>L;PSGeMbkLUg{M5
b < | |KSG
GbnPrGZgEM[GZgiabWQ!e>bExGeMbtTbUmLGZVkbSITJKb0Tiab0L;P5{>Tb ZVP¨`I;PZgGZVkbWnGeMbS\>TP5GX`>LTL[;TL`Me
`MTb0^*bnJKb0PSGeMbPb0^*I;E>J~IEMb;WKIGe>bTQ!ZVPbGeMb0ZgT¢I;TJMbTtZVPtTbk;bTP5bnJ|
'
¨3
r=#89 FA < uA!"=)"&=#? (
3 ?4=)
}teMb!`MTIK^*b0JM{MTbSZVE_k;IUVkbnJZmP¨[b0EMbTLUVUgNGeMb¢PLiabtqM{KGCZgGCTb0UgZVb0P¨I;E {MZgGb¢JKZA@bTbE_GXchb0LG{MTb0P
chTI;i LE>P5QSbTZVEM[x}!¢t {MbnPrGZgI;E>PSchITtGeMbchIUVUVIQ!ZgEM[RTb0LPIE4P1C
È Q Þ GeMbPb*GSIc {MbnPrGZgI;EKv1GrNz`bLE>P5QSbTvwGrN_`b¢iL`>`MZgE>[;Pe>LPUgZgG5GUgbTbUVbkLE_GIk;bTUVL`aZgEpGeMb
*x
aª¾4;w>
t>$w À M $ ´ *z¾4% µ >>$
GrQIpGLPKP È .Zg[;{MTb Q ¦ Þ 7
È Þ by_GTL;^GZgEM[uGeMbaLE>PQSbT¢chTIi«GeMbR}!dS JKIK^*{>iRb0E_G^*I;UgUVb0^*GZVIEsZVEzkI;Ugk;b0P!TLEMzZVEM[~L
UVLT[;bEz{Mixq4b0TXIc4^0LE>JKZmJMLGbS`>LTL[;TL`Me>PGe>LGC^IiabchTIi(JMZ @bTbE_GCJKIK^*{Miab0E;GP.Q!eMbTb0L;PW
ZgERGeMb¢^L;P5bSIc fP5GITZVb0P0W#GeMb!LE4P5QSbT¨ZmPCP5b0Ugbn^Gb0JchTI;i LGCiaI;P5GC¦P5b0E;GbE>^b0PX^IEKv
GLZgEMbnJZgELaP5e>ITGSGb*yzGdLPtQSbJKZmP^IkbTb0JpZgEI{>T!b*yK`4b0TZViabE_GDP 7
È ¦ Þ !v¡q>LPb0JGb*yzGu^*I;ia`MTb0eMbE4P5ZVIEjTb {>ZgTb0PRL\>EMbTJKb0[TbbIcLE>PQb0TRTb0^I[;EMZ]GZgI;E
Ge>LElGeMb¢vwq>L;P5bnJZVEKchI;TiLGZgI;EÄP5b0bzZVEM[s^e>LTL^*Gb0TZVÁbnJqzNl}!¢S|}te>bTb*chITbaGe>b*v
iLGZm^^*{>b0P È b| [>|VWK`MTb0`4I_P5ZgGZVIE4LU LGGL;^eMiabE_GP0WMJKZmP^I{MTP5b^{Mb0P Þ IT¢JKZmP^*I{>TPb^IeMb0Tb0E>^*b
Tb0UVLGZVIE>P È b0P`4bn^*ZmLUVUgNuchIT¢LE4P5QSbTZgE>[ ´µ ¶ {MbnPrGZgI;E>P Þ ix{>P5GtqbGLb0E~ZVE_GIuL^0^*I;{ME_DG 7
È ? Þ LE>PQSbTZgEM[ {Mb0P5GZVIE>PdZVPdeMZV[eMUVN~JKb0`4b0E>JKb0E;GIEs^ITb*chbTbE4^*bJMLGLM|4DFEI{MT
b*yK`bTZgiabE_GPQb{4P5bnJYGeMbp^ITb*chb0Tb0E>^*bLE>EMIGLGZVIE4PZgE>^Ug{4JKb0JlZVElGeMb P5GITN
^*I;UgUVb0^*GZVIE È Pbb.Zg[;{MT"
b < Þ|
!cGbTCLE4LUVN_Á0ZgE>[¢Ge>b0PbSJKAZ @bTbE>^b0P0WnQSbtJKbkzZmP5bnJLERLE>PQSbT.b*yzGTL^*GZVIEL`M`MTI;L^echI;T.Gb*yzG
^*I;iR`>Tb0eMbE>PZVIEsGe>LG`I;P5G{MUmLGb0PGe>bR{4P5baIcchI{MTchbnLG{>TbnPWb0L;^eIcQ!eMZm^eYLTbRL^0^*IiRv
`>LE>ZgbnJuqzNLEpL;JMJKZgGZVIE>LUEz{Mixq4b0TIc`I;PP5ZVqMUVbdkLUV{Mb0P0|zZV[{>Tb !? UVZmPrGPCGeMbdchI;{MTSchb0LG{MTb0P
Qbe>L#k;b^*IE4P5ZmJKbTb0J~LE>J~GeMbZVT¢^*I;TTb0P`4I;E>JKZVEM[Rk#LUg{>b0P0|
FEATURE-1:
FUNCTION
FUNCTION(who)
SUBJECT/ A GENT
SPECIALIZATION
NAME/DEFINITION
FUNCTION(what)
O BJECT EVENT
SPECIALIZATION
FUNCTION(when)
DATE HEADLINE
TIMEPERIOD
FUNCTION(where)
FUNCTION(why)
NAME
DISCOURSE CUE
LOCATION HEADLINE PREPOSITIONALA TTACHMENT IDIOM
MOTIVATIONVERB DISCOURSE CUE C OMMUNICATIONVERB IDIOM
INFINITIVE RELATIVECLAUSE EVENT COREFERENCE INFERENCE
FEATURE-2: COREFERENCE-INTERACTION
(1)No Reference Resolution (2)Candidate Answer=Antecedent
(3)Candidate Answer=Anaphor (4)Candidate Answer has
reference to question conccepts
FEATURE-3: ANSWER_TYPE-INTERACTION
WordNet lexico-semantic path between candidate answer and
question non-event concepts
FEATURE-4: EVENT/RELATION-INTERACTION
WordNet lexico-semantic path between candidate answer and
question/answer event
F
ïñõzþ("þ Fçëé4êzô4çHîêzîç ü øðôJçÁèéôPëöÁé4ïñòõëòîó¸çÁô4îøô4ðú sîé4ðô4ïñçHîHþ
¦ :
!#"$%
}te>b~\4TP5GxchbnLG{MTbZmPxq4LPb0JÄI;EÄGeMbP5b0iaLE_GZm^~^0LGb0[I;TZVb0PxLPP5IK^*ZmLGb0JHQ!Z]Ge {Mb0P5GZVIE
PrGbiP0|>ITb*yMLia`MUVbWZVEsGe>bR^0LPbIc ´µ {>b0P5GZVIE>P0W4ZgcGeMbaLE>PQb0TdZmPdTb0^I[;EMZgÁ0b0JsL;PL
P5{>q rb0^*G0W*GeMbCkLUV{MbXIc;GeMbX\>TPrGchbnLG{MTbZVPUmLT[b0TGe>LEGeMbCkLUg{MbX[;Zgk;bEQ!eMb0EGeMbLE>P5QSbTZmP
L!P5`b0^ZVLUgZVÁ0LGZVIEIcKI;EMbXIc_GeMb {>b0P5GZVIE^*I;E>^*b0`KGP0|0>ITb0L;^eGrN_`bCIc {MbnPrGZgI;E>P LPPIz^ZVLGbnJ
Q!Z]GepLP5GI;TN;WQbJKb*\>E>b0JuLEITJKbTCqb*GrQSbb0EaGeMbkLUV{Mb0PIcGeMb ~chbnLG{>Tb;|;}teMb
kLUV{Mb0PUVZmPrGb0JlZVEÄZV[{>Tb !? LTbaZVUgUV{>P5GTLGb0JlLPLElITJKbTb0JYP5bG0WGez{>PZgc¢LP5bGe>LPchI{MT
kLUV{Mb0P È b;| [4|¨chITRQ!eMbE {Mb0P5GZVIE4P Þ WGeMbfkLUV{Mb0PaLTb ? È chI;T WC¦ È chIT Þ W
È chIT Þ LE4J Q È chIT Þ |¢}teMblP5bn^*IE4Jchb0LG{MTbY{>P5bnP~GeMb
^*I;TbchbTbE>^bLEME>IGLGZVIE>PLE4JJKZmPrGZgE>[{MZmP5e>b0PIkbTdchI{MT^L;P5bn1P C È Q Þ Q!e>bEGeMb^LE4JKZVJ>LGb
LE>PQSbTSZVPSZmJKbE_GZg\>bnJuQ!ZgGeMI;{KG!{>P5ZVEM[a^*I;TbchbTbE>^bdJMLG'L 7 È Þ Q!e>bEuGeMb^LE>JKZmJMLGbLE>P5QSbT
TbchbTP!GI {Mb0P5GZVIEs^IE>^b`KG1P 7 È ¦ Þ Q!eMb0EGe>bx^LE>JKZmJMLGbxLE>P5QSbTdZVPLEsLE;Gb0^b0JKb0E;GIcCLE
LE>L`MeMI;DT 7 È ? Þ Q!eMbEGeMbu^0LE>JMZVJMLGbaLE>PQSbTZVPLEYLE>L`>eMITn|}te>bRkLUg{MbaIcGe>ZVPchbnLG{>Tb
LTb C : chI;T!Ge>b\>TPrGd^0LPbW Q chI;T!GeMbxP5bn^*IE4JW chIT¢GeMbGeMZgTJLE4J¦chIT!GeMbchI{MTGes^0LPb|
MI;TGe>bpb*yMLiR`>UgbuZVUVUg{>P5GTLGb0JlZVEH.Zg[;{MTb = È L Þ W.P5b0E_GbE4^*b ZmPb*yzGTL;^GbnJLPxLs^*I;TTb0^*G
LE>PQSbTtGI q4bn^L{4P5bGe>bP5bn^*I;E>JuchbnLG{MTbIc e>LPdLxe>Zg[;eMbTdP^*I;TbGe4LEGeMbxP5bn^*IE4J
chb0LG{MTbIcGeMbGZ]GUgb;|
}te>bGeMZVTJLE>J~chI{>T5Gefchb0LG{MTb0P!iaIKJKbUGeMbUgbyzZm^*Iv¡PbiLE;GZV^P{M`M`ITG!chIT!Gb*yzG{4LU^Iv
eMbTbE4^*baLE>JLTbiab0L;P5{MTb0JqzNsLJMJKZVEM[pGeMb $1*z µ $ L;PPIK^*ZmLGbnJQ!ZgGeYb0L^e /I;T'J db*G
Tb0UVLGZVIEGe>LGIK^0^*{MTPQ!Z]GeMZgElL`>LGe | ¥TbUmLGZgI;E>PLTbx`>TZVITZ]GZgÁ0b0JIk;bT Tb*v
UVLGZVIE>PuIT «TbUmLGZgI;E>P|ZVkb0E¤LlUVb*yKZm^*Iv¡PbiLE_GZV^~`>LGe WXGeMbsQSbZV[e_GPaIcLUVU
Tb0UVLGZVIE>PLTbxL;JMJKbnJGIf[;Zgk;bxL~k#LUg{>bGIpGeMb0PbGrQSIuchbnLG{MTbnP| /Ybae>L#kbR^*IE4P5ZmJKbTb0JGeMb
Qb0Zg[;e_GtIc GeMbQb0Zg[;e_GSIc GeMb
Q : 7_Ge>bQb0Zg[;e;GtIc 8 7GeMbQb0Zg[;e_GIc Qb0Zg[;e_GIc ¦ 7GeMbQSbZV[e_GIcSb0L;^e
Tb0UVLGZVIE>Ptqb*GrQSbb0ELa^IE>^b`KGdLE>J~LEzNuQI;TJpchTIi ZgGP¢JMb*\>EMZVEM[a[UVI;PPtLP Q |
}te>bs^LE4JKZVJ>LGbLE>P5QSbTPRLTbfJMb*Gb0TiaZVEMb0J¤{>PZVEM[YGeMbGbn^eMEMZ {Mb0PuJMb0P^*TZgqb0JjZgE£zbn^v
GZVIEY¦M| | k;bTLUVU1W4Qbxe>L#kbGTLZVEMb0JsLp`4b0T^b`KGTI;EfGe>LGUVb0LTE4PdLEb*yzGTL^*GZVIEch{ME4^GZVIE
Q!eMZm^euP5b0Ugbn^GPXGeMbdLE>PQb0TXQ!eMbEai{>U]GZg`MUVbd^0LE>JKZmJMLGb0PLTb¢L#k#LZgUmLq>Ugb;|}teMZVPXch{ME>^GZgI;Eu{>Pb0P
GeMbLqIkbvwiabE_GZgI;EMb0JchI{>Tchb0LG{MTb0P0|dU]GeMI{>[eÄQSbu{>Pb0JlI;EMUgNchI{>Tchb0LG{MTb0P0WbnL^eIc
GeMb0i LTbL`>`MUgZm^LqMUVbsGIH\>k
b {>b0P5GZVIE>PpGrNz`4bn1P 7tLUmP5I4WchI;TuchbnLG{>TbE_{>iqbT
IEMb;Wix{MU]GZg`>UgbkLUV{Mb0PLTb¢LPP5IK^*ZmLGb0JRQ!ZgGeubnL^e {Mb0P5GZVIEaGrNz`b| SNxZVE>^*I;T`ITLGZgE>[iRI;Tb
UgbyKZV^IvFP5b0iaLE_GZm^xzEMIQ!UVb0JM[bWQbe>L#k;baIqKGLZVEMb0JLf`bTchITiLE>^bxGe>LGRLUViRI_PrGJMI{MqMUVb0J
GeMbL;^^{MTL;^*NIcGeMbUgbnLTEMZVEM[Gb0^eME>Z {Mb`MTb0PbE_Gb0J~ZgE È d[ *!g :::Þ |
'
352
"
ä-¸äâ0/1+ )
+X9n?4=)FA < ( )5=59)
D5£¤LE>Jª¢ P5NKP5GbiP^0LEMEMIGuq4bb0kLUV{>LGb0JjQ!Z]GeªGeMbsPLiabP5bGuIciab*GTZm^P0|C}I
iab0LP{MTbuGeMb~`bTchITiLE>^bpIcLEÄD5£¤ P5NKP5GbifWX}!¢t bkLUV{>LGZgI;E>PR^*Iia`M{MGb~GeMb
Tbn^*ZV`MTIz^0LUk#LUg{>bIcGeMbRTLEM È ¢ Þ IcXGe>bxeMZV[e>b0P5G5v¡TLEMbnJ^*ITTb0^GLE>PQb0Td[;Zgk;bEqzN
GeMbP5NKP5Gb0i|_}teMbTb¢LTbtGrQSIGrNz`4bnPCIc LE>P5QSbTP0WE>LiabUVN $ µ È98: v¡q_N_Gb0P Þ LE>J g_ È 8: v
qzN;Gb0P Þ |>£zZVE>^bIEMUVNpLaP5NKP5Gb0iO P\>TPrGt\>k;bLE>PQb0TPtLTbP^ITb0JWzZgcGeMb¢d ZmP!JKb*\>E>b0JfLP
ZgGPkLUV{MbaZVP Q Z]cGeMbx\>TPrGLE4P5QSbTZVP^ITTbn^DG 7 : | 8 ZgcGeMbP5bn^*I;E>JLE>P5QSbT
LE>JEMIGtGeMb\>TP5GtI;EMbZVPd^*ITTb0^fG 7 : | ¦¦xQ!eMbEGe>b^*ITTb0^G!LE4P5QSbTtZmPSGeMbGeMZgTJTbG{MTEMbnJ
¦ Q
*x
aª¾4;w>
t>$w À M $ ´ *z¾4% µ >>$
LE>PQSbTf7 : | 8 ZgcSGeMbchI;{MT5GeLE>PQb0TZVPx^*I;TTb0^*GD7 : | Q!eMb0EGeMb\McGeHLE4P5QSbTZmP^*I;TTb0^*GD7
LE>J : Zgc.EMI;EMbIc.GeMbPNKPrGbifO PS\>kbLE4P5QSbTPtLTb^ITTbn^Gn|
}te>b§bnLE!bn^*ZV`MTIz^0LU¢E>PQb0T~¢LEM È §sdd Þ ZVP~{>Pb0JªGIj^Iia`M{KGbsGe>bIkb0TLUgU
`4b0T5chI;TiLE>^*bSIcMGeMb!P5NKP5Gb0iaP.`>LT5GZV^Zg`4LGZVEM[ZgEGeMb!}!¢tYbkLUg{>LGZVIEx{>P5ZVEM[GeMbSchI;Tix{MUVL
È Þ |DFEYL;JMJKZgGZVIE W}!¢tv Tb {MZgTb0JGe>LGLELE4P5QSbTq4b r{>JM[b0J
^*I;TTb0^*GIEMUVNlQ!eMbElGeMb~JKIK^{MiabE_G0O Px^IE_GbyzGZVPTb0Ugb0kLE_GGIsGeMb {>b0P5GZVIE | /eMbEÄGeMb
ez{MiLEÄLPPb0PP5I;TPQb0Tbu^IEzkzZgE4^*b0JGeMZVPx^*I;E>JKZgGZVIElQSL;PPLGZmPr\4b0JWGeMb0N^*I;E>PZVJKb0TbnJGeMb
¢d GIq4b $w%* WKIGeMbTQ!ZVPbWzGeMb¢ QtLP!^IE>PZmJKbTb0J g*4*4 |
MRAR (lenient)
Short answers
Long Answers
Average Number
of Iterations
1.384
1.15
1.07
(b)
MRAR (strict)
0.599
0.580
0.778
0.760
(a)
LOOP 1
LOOP 2
LOOP 3
Maximum Number
of Iterations
7
3
5
F
ïõþ" þKÇ9ëìñêëé4ïðòsô4çHîêzìñé4îøðô:é4÷ç Ï
^ KÜ ,îýîé4çHúcþ
}IiRbnLP{MTbCGe>b`bTchITiLE>^bIc4GeMbt¢ÄjP5NKP5Gb0iÃQbS{>Pb0JGrQSIdIcMGe>bSb0kLUV{>LGZgI;E
iab*Ge>IzJ>PTb`ITGbnJxZVE È BdZgTP^eMiLE Xg
Qn Þ C È Q Þ ~^*Iia`>LTbnP¨Ge>bPNzP5Gb0ifO P
TbnP5`IE4P5bSGIGeMb¢LE4P5QSbTX;bN`MTIkzZVJMb0Jxq_NGeMb f`M{MqMUVZVPeMb0TD7LE>J È Þ .W
LEHL{KGI;iLGbnJlTI;{KGZVEMbuQ!e>ZV^eÄ^Iia`>LTb0PGeMbP5NKP5Gbi Tb0P`4I;E>P5buGIPbE_Gb0E>^*bnPPbUVb0^*Gb0J
q>LPb0J¹IEGeMbe>Zg[;eMb0P5G~Ez{Mixq4b0T~IciLG^e>ZgEM[j^*IE_GbE_G~QSITJMPp^Iia`>LTbnJ¹L[_LZVE>PrGpGeMb
{Mb0P5GZVIE | >ITqIGeYbkLUg{>LGZVIE>PGeMb^*Iia`>LTZmPIEP^*I;TbnPI;EMbR`4I;ZgE_GchITLElL^0^*b0`KGLqMUgb
TbnP5`IE4P5bLE4J~Á0bTIa`4I;ZgE_G¢IGeMbTQ!ZmP5b;|>}teMbP^*ITbIc¨GeMbPb*G¢Ic {MbnPrGZgI;E>P!ZmPtGe>bL#kbTL[;b
Ic.GeMbP^*I;TbnPchIT!b0L;^e {MbnPrGZgI;E |
HumRef
AutRef
NoRef
HumNE
AutNE
NoNE
HumSent
76.4%
69.2%
72.4%
48.8%
44.4%
65.3%
59.2%
50.2%
37.4%
AutSent
60.5%
48.2%
58.8%
41.4%
38.8%
52.5%
49.6%
44.6%
31.5%
F
ïõþ" þKÇ9ëìñêëé4ïðòsô4çHîêzìñé4îøðô:é4÷ç Ï
^ KÜ &
$ % ¶îýîé4çHúcþ
/Ybe>L#k;b~LUmPIb0k#LUg{4LGbnJÄGeMbL^0^*{MTL^NYIcMÀ ¸ ¸ Q!eMbEª^*I;TbchbTbE>^b~ZVEKchI;T5v
iLGZVIEI;TpE>Liab0JªbE_GZ]GrNjGL[;PuLTbsZVE>^Ug{>JMb0J|SXyK`4b0TZViabE_GPp{>PZgEM[He_{>iaLEKv¡[bE>bTLGbnJ
^*I;TbchbTbE>^bGL[;PLTbpUVLq4b0UgbnJÄLP K
1 7byz`bTZViRb0E_GPxbia`MUVIN_ZVEM[^ITb*chb0Tb0E>^*bpJ>LGL
[b0EMbTLGb0JqzN~I;{MTdL{MGIiLGZm^^*I;TbchbTbE>^bTb0PIUVkb0T uLTbUmLqbUVb0JLPÀ K 7
LE>JRbyz`bTZViRb0E_GP¨Ge>LGJKZmJREMIGC{4P5b¢LE_Nx^*ITb*chb0Tb0E>^*bSZVEKchITiLGZVIELTbtUmLqbUVb0JaLP 1 |
£zZViRZVUmLTUgN;Wb*yK`4b0TZViabE_GPCZgERQ!eMZm^eRez{MiLEKvw[;bEMb0TLGbnJE>LiabnJxb0E_GZgGrN^LGb[;ITZgbnP.Qb0TbSbiRv
`MUVINb0JpLTbdGL[[;b0JuL;P K
 7_GeMI_P5bZVEpQ!eMZm^euGeMbQdLiabnJpCE_GZ]GrNu}.L[;[bTchTI;i MÀ ¸ QSL;Pbia`MUVINb0JlLTbaUmLqbUVb0JLPRÀ K  7 LE>JlbyK`4b0TZViabE_GPGe>LGRJKZVJlE>IGTbUVNIE
LEzNuE>Liab0J~bE_GZgGrNuZVEKchITiLGZVIELTbUVLq4b0UgbnJ~L;P Â |>.Zg[;{MTb =xPeMIQ¢PGe>bTbnP5{MUgGPSIc
GeMbbyK`4b0TZViabE_GP0|
¦
!#"$%
3
$(
89 R?f& & f#Bn89:. FA 3n8!59 $)+ * )(
.Zg[;{MTb 8iÈ L Þ P5{MiaiLTZVÁb0PSGeMb§s¢¢P!`MTIkzZVJMb0JuqzN`¢D5£K}chITtGeMbMÀ ¸ D5£
P5NKP5Gb0i|K}teMbnP5bTbnP5{>U]GPQSbTbdP{M`bTZgI;TSJK{>bdGIGeMbdchb0b0JKq4L^aUgIzI;`>P È P5b0b£Kb0^GZgI;E | Q Þ |zdP
Tb0`4I;T5Gb0JaZVE È XL;P^0LLE>J BLTLq>L[ZV{ :: Q Þ WGeMZmP`ITGZVIEaIc MÀ ¸ O PX`>TIK^*bnPPZVEM[e>LJ
GeMb[;TbnLGb0P5GS`I;PZ]GZgk;bZgia`>L;^G!{M`IEGeMbPNKPrGbifO PIk;bTLUVU`4b0T5chI;TiLE4^*b.| /YbQSLE_Gb0JuGI
JKZmP^IkbTnWGeMbTb*chI;Tb;W*eMIQ MÀ ¸ QSI{>UVJ`bTchITi Zgc>Pbkb0TLUZ]GbTLGZgI;E>P Ic_GeMbCchb0b0JKq4L^
UgIzI;`>PQSbTbC^*IE4JK{>^Gb0J|0DFEIGeMbT QSITJMP0WQI;{MUmJLd^*bZVUVZgEM[!qbCbnPrGLqMUVZVPeMbnJQ!e>bTbLSGTLJKb0I@
q4bGrQb0bElL^0^*{MTL^NLE>J`>TIK^*bnPPZVEM[p1b 0^Zgb0E>^*N È GeMTI{>[eM`M{MG Þ QI;{MUmJsqbRb0E>^*I;{ME_Gb0TbnJsZgc
GeMbUVIzI`>PtQSbTbTb0`4bnLGb0JP5b0kbTLUGZgiab0P0|
.ZV[{MTb 8iÈ q Þ P5e>IQ¢PL {>LE_GZgGLGZVkbpLE>LUVNKP5ZmPIctGeMbuchb0b0JKq>L;^UVIzI`>PQ!eMZV^eÄP`b0LKP
GIlGeMbOb 0u^*ZVbE4^*NHZmPP5{Mb;|C¢iaIE>[lGeMbfGeMTb0bchbb0JMq>L^ÄUVIzI`>P0W I_I;` Q e>L;PRGeMbUVLT[;b0P5G
iLyKZgix{Mi¥Ez{Mixq4b0T¢Ic¨ZgGbTLGZgI;E>P È < Þ W>L;P!QSbUVULPSGeMbUVLT[;b0P5G¢L#kbTL[;bdEz{Mixq4b0T¢Ic¨Z]GbTLv
GZVIE>P È Q | ¦ ? Þ | kb0TLUgUwWKeMIQSbk;bTnWzGeMbL#k;bTL[;bEz{Mixq4b0TdIcXZgGb0TLGZVIE>PtG{MTEMb0JfI;{KG¢GIpq4b
{MEMbyz`b0^*GbnJKUgNP5iLUgUGeMbTbqzNpL;JMJKZVEM[aUgZgG5GUgb`>TIK^*bnPPZVEM[xIk;bTeMb0L;JGIxGeMbPNzP5Gb0if|
LOOP 1
LOOP 2
LOOP 3
MRAR (short)
0.321
0.451
0.490
0.554
0.347
0.488
0.510
0.568
MRAR (long)
0.385
0.553
0.592
0.676
0.419
0.589
0.629
0.737
F
ïñõzþ" þzÇ9)içHöéJðø
ô4çÁéô4ïñçëìiø£çHç ü ëö ðò +¿ëöHöHêzôPëöÁýþ
§sITbTbk;b0LUgZVEM[ZmPSGe>b {4LUVZ]GLGZVkbLE4LUVNzPZmPIcGeMbZgia`>L;^G!Ic.Ge>bchb0b0JKq4L^uUVIzI`>PSIE
GeMb}!¢t¹b0kLUV{>LGZgI;Euq4bn^L{>P5bdGeMZmPSP5`b0LzPGIGeMb`MTb0^ZVPZgI;EuZmPP{Mb|zdPS.Zg[;{MTb <
P5e>IQ¢PW`MTb0^*ZmPZgI;EsZgE4^*Tb0LPb0JP5{Mq4PrGLE_GZmLUVUgNQ!e>bELUgU.GeMbxUVIzI`>PQSbTbb0E>LqMUVb0J |DFE4JKZgkzZmJzv
{>LUVUVNWGe>bOb @b0^GIc I_I;` Q QtLPLElL^0^*{MTL^NZVE>^TbnLPbxIcSIk;bT ? : GILEl§s¢d7Ic
: | ? 8 Q 7 IzI` `>TIKJK{>^b0JL~[;TbnLGbT¢Ge>LE 8 bEMe4LE>^biabE_GQ!eMZVUgb IzI;`¦~`MTIKJK{4^*b0J
IEMUVNxLE ZVia`MTIk;biabE_Gn|ZV[{>Tb <PeMIQ¢P.Ge4LGCQ!eMb0EaLUgUMchbb0JMq>L^UVIzI`>PXLTbtb0E>LqMUVb0J
QbRIqMGLZVEMbnJsLE§¢d Ic : | 8 = È LEZVE>^TbnLPbIc <= sÞ chI;TPeMI;T5GLE>PQb0TPLE>J : >| <.¦ <
È LEZVE>^TbnLPbIc r Q sÞ chIT!UVIEM[LE4P5QSbTP|
3
#9n?<>A5?4A(?-& E% 3#9 #B84A !";= * 3 FA 3 $)+ * (
z£ ZVE>^*bQSbae_Nz`IGeMb0PZgÁ0b0JGe>LGGeMbTb0^I[E>Z]GZgI;EIcGeMbbyK`4bn^GbnJLE>PQb0TGrNz`biL#NZgiRv
`>L^*GGeMbuL;^^*{>TL;^*NIcSq4IGelD5£LE>JY¢ PNKPrGbiPWI;EMbLP`4bn^GIcSI{MTb0kLUV{>LGZgI;E
UgIzI;b0JfLG!GeMb^Ikb0TL[bIc¨I{MT!Gb0^eME>Z {MbchI;T!\>E>JMZgEM[aGeMbbyz`b0^*GbnJLE>PQb0TtGrNz`4b;|4}teMb
%*0; iab0LP{MTb0PSGeMbchTL;^GZgI;E~Ic {Mb0P5GZVIE4PtIcXLx[;Zgk;bEf^LGb[;ITNQ!eMI;PbLE>PQSbTSGrNz`4b
ZVP¢Tbn^*I[;EMZVÁb0J~LPt`bTGLZgEMZVEM[RGIRGe>LGd^0LGb0[I;TN;|
.ZV[{MTb UVZVP5GPpGe>bY^IkbTL[;bLE>J`MTbn^*ZmP5ZVIEIcGeMbYTb0^*I;[EMZgGZVIEªchI;TpGeMbYD5£
P5NKP5Gb0i|z{MTTbE_GUgNxI{MT b0E>^*IKJKbnP < : <^*I;E>^*b0`KGP¨chTIi Qn
/I;TJ ¢b*GeMZVbTLT^eMZVb0P¢^IkbTZVEM[ i Q IcXGeMbRb*yK`b0^*Gb0JLE>PQSbT¢GrNz`b0P0|}te>ZVPPeMIQ¢P!Ge>LG
Qbe4L#kbxGIs^*I;E_GZVE_{>bRb0E>^*IKJKZVEM[fiaITbRGI`^IE>^b`KGPZgEYGe>baGLyKI;EMIixNsLE>JYUVZgEMGeMb0i
GIiaITb /I;TJ ¢b*Gd^IE>^b`KGPtq4bn^L{>P5b;WMLP!.ZV[{MTb P5e>IQ¢PWKI;{MT¢LE>PQSbTSGrNz`4b^IkbTL[;b
+
*x
aª¾4;w>
t>$w À M $ ´ *z¾4% µ >>$
¦¦
Q/A
Answer Type
# Tops
Coverage Precision
Answer Taxonomy
42%
8
44%
55%
22
56%
78%
33
81%
F
ïñõzþ"1IþzÇ ëìñêëé4ïñðòcðø
é4÷ç6ëòîó=çô:é#ýùç½ô4çHöHðõòï0é4ïñðòlïñòé4÷ç Ï
^ KÜ ,îýîé4çHúcþ
LE>Juj`>Tbn^*ZmP5ZVIER`4b0T^bE_GL[bnP¨Zgia`MTIkbtJKTLiLGZV^0LUVUgNL;P¨iaITbGI`>PXLTb!L;JMJKb0JxGII{MT
C|
+
3 #9#?<>A 5?4AÃ?-& 3% 3n9 nBª84A!"=% *
E FA 3 *)(
£zZVE>^*baGeMbpJKZmPLiqMZV[{4LGZVIEIcSGeMb {>b0P5GZVIElPrGbiPchIT¢7¬PNKPrGbiPJKb`bE4JMPIE
GeMbTb0^*I;[EMZgGZVIEIcGeMb0iLGZm^¢TIUVb0P0WQSbde4L#kbdLUVPIUVI_I;bnJLGGeMbL^^{MTL^*NxIc I;{MTGeMbiab
UVLq4b0Ugb0TLE>JZgGPZViR`4L^GI;EGeMbaTbn^*I[;EMZgGZVIEIcbyz`b0^*GbnJLE>P5QSbTGrNz`4bnP| /bLUmPI^IEKv
P5ZmJKb0TbnJYGeMbp^Ikb0TL[bRIcSchTLiRbnPLE4JYGeMbuEz{Mixq4b0TIcSGeMbiLGZm^TI;UgbnP#chTLiabxb0Ugb0iRb0E_GP
LPRQSbUVUtL;PGeMbfEz{MiqbTaIcUgZVEMKPRq4bGrQb0bEÄchTLiabbUVbiabE_GPRLE>J /YIT'J db*GP5{Mq>eMZgb0TLT5v
^eMZVb0P0|_.ZV[{MTb UgZmPrGPXGeMb^Ikb0TL[bSIcchTLiab0PLE>JaGeMbiLGZm^¢TIUVb0P0WGe>bL^0^*{MTL^NIcGeMb
GeMb0iLGZm^UmLqbUVbT¢LE4JpGeMb¢ `>Tbn^*ZmP5ZVIE |
# Frames
24
52
112
# Thematic Roles Theme Labeler Answer Type
(Frame Elements)
Accuracy
Coverage
93
44%
78%
188
56%
76%
352
79%
74%
Q/A
Precision
40%
51%
76%
F
ïñõzþ"1JþzÇ ëìñêëé4ïñðòcðøé4÷çpëòîó=çô:é#ýùç½ô4çHöHðõòï0é4ïñðòlïñòsé4÷zç Ï
^ KÜ $&% ¶îýîé4çHúcþ
>IT >À ¸ ¸ Qb!b0E>^*IKJKbnJ < LJ>JKZ]GZgI;E>LUMchTLiRbnP¨Ge4LGQSbTb!EMIGS^*{MTTb0E_GUVNL#kLZVU]v
L qMUVbuchTIi
.W.IqKGLZVEMZVEM[ iQn EMb0QGeMb0iaLGZm^uTIUVb0P0|dUgUt¦ 8 GeMb0iaLGZm^uTIUVb0P
Qb0Tb!iLE_{4LUVUgNxUgZVEMbnJRGI iQ =/YITJ'¢bGP5{>qMeMZVbTLT^eMZgbnPW^Ikb0TZVEM[5< IcGeMb¢b*yK`b0^*Gb0J
LE>PQSbTSGrNz`4bnP!IcGeMb YGb0P5GbnJ {>b0P5GZVIE>P0|
'
!)
3 ?(
8>=) ?4A
f "-;A$+©84ACB }IZVEzkbnPrGZg[_LGbch{>T5GeMbT!GeMbIk;bTLUVU[;bEMb0TZm^bO0u^0L^*N~Ic.GeMbD5£sÃLE4P5QSbT!by_GTL;^GZgI;E
Gbn^eMEMZ {>b0P0WQSbaL`M`MUVZVb0J >À ¸ JKZgTb0^*GUVNfGI~GeMb ¤P5GITZVb0P0|4DFEGeMbR`MUmL^bxIc
GeMbdUVLT[;bSEz{Mixq4b0TCIc`>LTL[TL`Me>P.Tb*GTZVbk;b0JchTI;i(Ge>I{>PLE>J>P¨IcJKIK^*{MiabE_GPLUmL}!dSW
Qbx^*IE4P5ZmJKbTb0JfLUg
U ÄP5GITZVb0P¢L;PtGeMbxP5bGdIcXTb*GTZVbkbnJ`>LTL[;TL`Me>P0|z}te>bP^ITZgE>[
iab*GTZm^Ge>LGQSbR{>P5bnJschI;TGeMbb0kLUV{>LGZgI;EQtLP Q!eMZm^eZmPGeMba`bT^*b0E;GL[;bxIc
GbnPrG {>b0P5GZVIE>PchI;TQ!eMZm^elGe>bp^*I;TTb0^*GLE>PQb0TPbE_Gb0E>^*bQtLPchI{ME>J |}teMZmPiab*GTZm^QtLP
ITZg[;ZgE4LUVUgN`MTI;`4I_P5bnJYZgE È B¢ZVTP^eMiLE gp
Q0; Þ |}teMbuTb0P{MUgGPZVE>JKZm^LGbpGe>LGchITR¦ :):
GbnPrG {Mb0P5GZVIE4PaQbIqKGLZVEMb0J¤LE¤§s¢ Ic.¦ <z| ? | B¢IQSbkb0T0W.Q!eMb0EjQSb È L Þ ^e>LEM[bnJ
GeMb {MbnPrGZgI;E¤LE>JªLE>PQSbTRGrNz`MZgE>[lLE>J È q Þ GTLZgE>b0JHGeMb`bT^*b0`KGTIEjchITaGeMbfchb0LG{MTb0P
JKb0PZV[EMbnJfchITdGeMb {>b0P5GZVIE>P0WMGeMbx`bTchITiLE>^b[Tb0LGUVNpZVia`MTIk;b0J|£zZVE>^*bxQb
e>LJjGIHLJML`KGGIUVb0LTE>ZgEM[YGeMbLE4P5QSbTby_GTL;^GZgI;EjZVELliaLEMEMb0TpP5ZViaZgUmLTuGIlGe>bsIEMb
¦ ?
!#"$%
bia`MUVINbnJ~ZVEGeMbD5£ÃP5NKP5GbiP0W>QSb{>Pb0JLuJMZ @bTbE_GJKZVkzZVPZVIEIc¨Gb*yzGP¢chIT¢GTLZgE>ZgEM[
LE>JGbnPrGZgE>[~Ge>LEGe>bIGe>bT¢ PNKPrGbiP|£KZgiaZVUVLTGI È B¢ZVTP^eMiLE V:
Qn; Þ W
Qb{>Pb0J = : GbyzGPchITGTLZVEMZVEM[LE4JGbnPrGb0JaGeMbb*yzGTL^*GZVIEu`MTIK^*bnJK{MTb¢IEGeMbTb0iaLZgE>ZgEM[
= : GbyzGPchTIi¼GeMb ^IUVUgbn^GZgI;E | }teMbIkb0TLUgU¨`MTb0^ZVPZVIEQtL5
P <=M| ? WQ!eMZm^eZmP
GeMbxeMZV[eMbnPrGP^ITbIcLEzNP5NKP5Gbi QSITzZgEM[I;E {>b0P5GZVIE>P0|4.ZV[{MTb¦ : JMb*GLZgUmP
GeMbq>TbnLKJKIQ!Ep`bT {>b0P5GZVIE~GrN_`bchIT!qIGefb*yK`4b0TZViabE_GPt{4P5ZVEM[RGeMb YGby_GP|
IS Q/A Method
(FALCON)
RC Q/A Method
(FALCON−RC)
who
what
when
where
57%
31%
43%
36%
78%
70%
77%
69%
why
18%
42%
Overall
37%
76%
F
ïñõzþ
fKþ(;Kô4çë ü ðóòcðø ëöHöHêzôPëöÁý_ùçÁôJíêzçHîé4ïñðòé8ýùç½ø£ðô ü ëéPëþ
PuQSbsLE_GZm^*ZV`>LGb0J W.Zg[;{MTbs¦ : P5eMIQ¢PRGe>LGpGeMbsTb0P{MUgGPaIcL`M`MUVNzZgEM[ >À ¸ GI
TbnLJKZVEM[^*Iia`MTbe>bE>PZgI;ELTbUVb0PPdGe>LEZViR`>TbnPPZgk;bWb0P`4bn^*ZmLUVUgNfQ!eMb0E^Iia`>LTb0JGI~GeMb
TbnP5{>U]GP!Ic MÀ ¸ ¸ Q!eMZm^efQSL;PtGTLZVEMb0JI;E YGby_GPdLE>J {>b0P5GZVIE>P0| ¢IGb
Ge>LGxchI;Taq4IGeª iab*GeMIKJMP0W.`>Tbn^*ZmP5ZVIEÄQtLPxeMZV[eMbnPrGxchIT ´µ {Mb0P5GZVIE4PRLE>JUVIQbnPrG
chIT ´µ ¶ {MbnPrGZgI;E>P0|XDFE¤Pb`>LTLGbb*yK`bTZgiabE_GPWXQ!eMb0EL`M`MUVNzZgE>[ >À ¸ ¸ GIlGeMb
}!¢Sv Q : ^*IE_Gb*yzG {MbnPrGZgI;E>P0WQSb~I;qKGLZgE>b0J È Q Þ LEj§¢d¥Ic : | _ LE4J È Þ Q!eMb0E¤L
{Mb0P5GZVIEÄZVEGeMb^IE_GbyzGIcdLJKZVLUgI;[{MbpZVPxEMIGa^*I;TTb0^*GUVNLE4P5QSbTb0JWIEMUVN : Ic!GeMb
chIUVUgIQtv¡{M` {Mb0P5GZVIE>PtZVEGeMbPLiabJKZmLUVI[;{MbLTbLE>P5QSbTb0J~^*I;TTb0^*GUVN|
.ZVE>LUVUVNWMQSbbkLUV{>LGb0JpGeMbLqMZVUgZgGrNuIc MÀ ¸ GILE>PQb0T {>b0P5GZVIE>PtZVEGeMb^IE_Gby_G
IcLuJMZVLUgI;[{MbqzN{>PZgEM[uGeMb ?_ PbTZgbnP¢Ic {>b0P5GZVIE>Pd{>P5bnJfZgE}!¢Sv Q : chI;T¢Ge>bR^IE_Gby_G
GL;P5E| /Ybue>L#kbaLUmPIb0kLUV{>LGb0J MÀ ¸ ¸ IEGeMbuPLiab {Mb0P5GZVIE>Pq>{KGZVE>PrGb0L;JIc
{>PZgEM[uGeMbxQ!eMIUVb}!¢t^IUVUgbn^GZgI;EIcJKIK^*{Miab0E;GPW4Qbx^*IE4P5ZmJKbTb0JfLuPZVEM[UVbJKIK^*{>iRb0E_G0|
DFEfI{MTt\>TP5GtbyK`4b0TZViabE_G0WKGeMZmP!JKIK^*{MiabE_G¢QtLPSGeMbIEMb^IE_GLZgEMZVEM[xGeMb`4LTL[TL`>echTI;i
Q!eMZm^euGe>b\4TP5GtLE>PQb0TIc GeMb\>TPrG {Mb0P5GZVIE~IEpGeMbPbTZgbnPQtLPb*yzGTL^*GbnJ|zDFE~LRP5bn^*IE4J
b*yK`bTZgiabE_GCQSb¢P5b0Ugbn^Gb0JxGeMbJKIK^*{MiabE_G^IE_GLZgEMZVEM[Ge>b¢`>LTL[;TL`MeGe>LGCQtLP¨{4P5bnJxiaI_PrG
chTb {MbE_GUVNpqzN >À ¸ GIab*yzGTL;^G¢LEfLE>PQSbTtchIT¢LEzNIc ?_ bkLUV{>LGb0J {Mb0P5GZVIE4P|
}IlLE>PQb0TR^IE_GbyzG {Mb0P5GZVIE4PW MÀ ¸ QtLPxbEMe>LE>^*bnJÄqzNiaIKJKbUVZgE>[GeMb~E>IGZVIE
Ic¢JKZmLUVI[;{Mb^*IE_Gb*yzGGeMTI{>[3
e C È Q Þ LE>L`Me>ITZV^RTb*chbTbE4^*baq4bGrQb0bEL {Mb0P5GZVIELE>JlIEMb
Ic!GeMb {MbnPrGZgI;E>PI;TxLE4P5QSbTP`MTb0^*bnJKZVEM[sZgGxZVEGeMb~ZgE_GbTL^GZgI;Eq4bGrQb0bElGeMbp{>PbTRLE>J
GeMb PNKPrGbifWCLE>J È Þ UVZmPrGPaIcd;bNzQI;TJ>PGe>LGuLTbp{4P5bnJÄGIYTb*GTZVbk;bp`>LTL[TL`Me4P
^*I;E;GLZVEMZVEM[YGeMbsLE>P5QSbTaGIL {>b0P5GZVIEjGe>LGpLUVUg{>JMb0PaGIlLl`>TZVIT {Mb0P5GZVIEªI;TuLE>PQb0T0|
}IsGeMZmPb0E>JlQbiaIKJKZg\>b0JGeMb {MbnPrGZgI;E`MTIz^b0PP5ZVEM[fIc MÀ ¸ qzNZVE>^*I;T`ITLGZgE>[fL
TbchbTbE>^b¢Tb0PIUV{KGZVIEaiaIKJK{MUVb¢Ge4LGQtLPJKb0P^*TZVq4bnJaZgE È BdLTLq>L[;Zg{LE4J§sLZVITLEMI :: Þ |
/eMbE>bkb0TL {Mb0P5GZVIEp Q ^IE_GLZgE>PXL`>TI;EMI{MEWGeMb {MbnPrGZgI;ETbchbTP.GIL`MTZVIT {Mb0P5GZVIE
: Ge>LGabZgGe>bT È L Þ e>L;PxGeMbb*yK`b0^Gb0J¤LE>PQSbTGrNz`b~IcdGeMbPLiabfP5b0iLE_GZm^p^0LGb0[I;TN
LP¢GeMbx`MTI;EMI{>E>P È b| [>| £ chITeMbI;T SX}tD (chITdGeMb0Tb Þ IT È q Þ ^*I;E;GLZVE>PdL
QI;TJpGe4LG¢e>L;P!Z
L /I;T'J db*G¢UVb*yKZm^*IvFPbiLE_GZm^Tb0UVLGZVIE~GIRGeMbLE>L`>eMITZV^QSITJchTIi¥GeMb
{ Mb0P5GZVIE |JMJKZgGZVIE>LUgUVNW#GeMbt`MTI;EMI{>E chTI;iÃZVJMZgI;iaP¨P{>^exL;P µ * IT .n%%*K
ZVPd^*IE4P5ZmJKbTb0JuGITb*chb0TtGIRGeMbUmLP5G!TbchbTTbnJpb0kb0E;GtchTIi¬GeMb^*UVI;Pb0P5G!`MTZgI;T {MbnPrGZgI;E |
}te>b!Ob @b0^GXIc4zEMIQ!ZVEM[dGeMb!Tb*chbTTb0J {MbnPrGZgI;E : ZmP.Ge>LGCQ!eMbEaP5bnLT^eMZVEM[¢chI;TCLE>PQb0TP
*x
aª¾4;w>
t>$w À M $ ´ *z¾4% µ >>$
¦ 8
GI~ Q GeMbb0NzQI;TJMPSby_GTL;^Gb0JpchTI;i : LTbZgE4P5b0T5Gb0Jq4bchITbGeMbbNzQSITJMPSb*yzGTL^*GbnJ
chTI;i Q LE>Ju{>Pb0JuchITtTb*GTZVbkLUw|_}te>b;bNzQI;TJub*yzGTL^*GZVIEpLE>JuZVE>PbTGZVIEuZmPSZgUVUg{4PrGTLGb0J
qzNfGrQI~IcCGeMbR}!dSv Q : ^IE_GbyzG {Mb0P5GZVIE4PWE>LiRb0UgN®¯ ´µ %K41¶ ´ #$a µ 2 $
¡g*$% Fz$; w#s w%$z$º» È :Þ LE>Jo®0½ µ ¤ µ %K>w¶sm$ug
%Fº» È Q Þ | /e>bE Q ZmP¢`MTIK^*bnPPb0JWMJM{MbGIGeMbIz^0^*{MTTbE>^bIc¨GeMb`MTI;EMI{>E W4GeMb
b0N_QSITJM"
P 2 $ W w# LE>J F*g*$% chTIi : LTbsZVE>PbTGb0Jªqb*chI;TbsGeMbbNzQSITJ
gn%¡ byzGTL^Gb0J~chTIi Q |>!cGbT!GrQSIZgGbTLGZgI;E>PtZVEfGeMb\4TP5G!chbbnJKq>L^pUgIzI`WKGeMbbN_v
QI;TJ>P{4P5bnJchI;T`>LPPL[bRTb*GTZVbkLUCLTb 2 $ LE4J ; 1 |.}teMba\4TP5GLE>PQb0TTbG{MTEMbnJ
chIT Q ZmPÄ® ¾ µ 2 $tF*g*$% R¡~z$ ; wp 1%*$ ´ #$KFf ug
f°&± ;±» )| /ZgGeMI;{KGZVia`4I;T5GZgEM[GeMb¢b0NzQI;TJMPchTIi GeMb!`MTbkzZVI{>P {MbnPrGZgI;Ep : WZgGQI;{MUmJ
q4bkzZVT5G{>LUVUVNuZgia`I;PP5ZVqMUVbGIR\>E>J~GeMbLE>PQSbTSchIT Q |
MRAR
FALCON (Text snippet)
FALCON (Sentence)
FALCON−RC (Experiment 1)
FALCON−RC (Experiment 2)
0.79
0.79
0.83
0.85
Number of follow−up questions
answered correctly
24
24
29
31
F
ïñõzþ þ$:çHîêì0é4îðòlæ $Ç % öÁðòé4çÁèé:íêçHîé4ïñðòzîHþ
.ZV[{MTb¦ Q P5e>IQ¢PSGeMbTb0P{MU]GPtIcXK¨ LE>JK. ¢v¡¢IE~GeMb^IE_Gby_G {MbnPrv
GZVIE>PdbkLUV{>LGb0JZVEs}!¢Sv Q : |K}teMbbkLUg{>LGZVIEfIcXK¨ ÃQtLPt`bTchITiRbnJq_N ¢D5£M}
ez{MiLELPP5bnPPITP0W#^IE>PZmJKbTZgE>[ 8: v¡qzN;GbtUgI;EM[Gby_GPEMZV`M`b*GPLPCL;^^b`KGLqMUVb!LE>PQb0TP0|}teMb
bkLUV{>LGZVIE¹IcxK¨ !vF! QSL;Pu`bTchITiRbnJ¹qzNLj^Iia`M{KGLGZgI;E>LUUgZVEM[;{MZVP5GPrG{>JKbE_G
Ge>LGLUVUVIQbnJGeMbdLE4P5QSbT¨GIq4bdLch{>UgUP5b0E;GbE>^b!chTIi(GeMbdJKIK^{MiabE_G0|}te>bdPLiab¢PrG{>JKbE_G
LUmP5IbkLUg{>LGbnJGeMb¢LE>PQSbTPIcK . ªLP.ch{MUVU>PbE_Gb0E>^*bnPX^*I;E;GLZVEMZVEM[dGeMbtGbyzGXPEMZV`M`b*G
ITZg[;ZgE4LUVUgNTb*G{MTE>b0JaLP.GeMb¢LE>PQSbTXLE>JaJKZmJREMIGXEMIGZm^*b¢LE_NxJKZ @bTbE4^*b!ZVERL;^^*{>TL;^*N|.ZV[v
{MTb¦ Q LUmPIuP5eMIQ¢PSGeMbEz{Mixq4b0T¢IcC^*I;TTb0^*G¢LE>PQb0TPSGIpLEzNuIc¨GeMbchI;UgUVIQtv¡{M` {>b0P5GZVIE>P
chTI;i GeMbPbTZgbnPRIc ?z }!¢t^*I;E_Gb*yzG {Mb0P5GZVIE>P0|X}teMbfZgE4^*Tb0LPb0JÄE_{>iqbTIcdchIUVUgIQtv
{M` {Mb0P5GZVIE4PLE>PQb0TbnJj^ITTbn^GUgNÄqzNHK . ¢v¡¢¥P5eMIQ¢PRGe>LGnWCQ!eMb0EZgE_GTIKJK{>^ZgEM[
TbnLJKZVEM[^*I;ia`MTb0eMbE4P5ZVIEf^L`>LqMZVUVZ]GZgbnP!ZgELED5£s©P5NKP5GbifWM`>TI;iRZmPZgEM[~©JKZVLUgI;[{Mb
TbnP5{>U]GP^LEqbuIqMGLZVEMbnJ|}teMbTb0P{MUgGPLUmPIZVE>JKZm^LGbGe>LGGeMbuJKIK^*{>iRb0E_GxP5b0Ugbn^Gb0JchIT
TbnLJKZVEM[^*Iia`MTbe>bE>PZgI;Ese>L;PLPZg[;EMZ]\^LE_GOb @b0^*GI;EGeMbxIk;bTLUVUTb0P{MUgGP0|¢b0JK{ME4JMLE>^N
Icd`4LTL[TL`>e>PQSL;PLq4bG5Gb0TaZgE>JMZV^0LGI;TchI;TxJKIK^{MiabE_GaPbUVb0^*GZVIEGe>LEÄGeMbZgE_G{MZ]GZgk;bUVN
`MTb*chbTTb0JJKIK^*{MiabE_Gd^IE_GLZgEMZVEM[xGeMbLE>PQb0TGIaGeMb\4TP5G {>b0P5GZVIE |
+ ) å-¸án/+ )
}teMZmP¢`>L`4b0T¢e>LP¢`MTbnP5b0E_Gb0JpGrQSIuJKZ @bTbE_GdzZVE>JMP!IcCÃP5NKP5Gb0iaPDCMZVEKchITiLGZgI;EfPbb0zZgEM[
ÃPNKPrGbiP!{>Pb0JchI;T¢TbGTZgb0kzZgEM[LE>P5QSbTPSGIpE>LG{MTLUUVLEM[{4L[b {MbnPrGZgI;E>PtchTIi«UVLT[;b
Gby_GS^*IUVUVb0^GZgI;E>PXLE4JP5NKP5Gb0iaPCbia`MUVINb0JchITTbnLJKZVEM[^*I;iR`>Tb0eMbE>PZVIE |>ITXD5£u
P5NKP5Gb0iaP^*I;iqMZVEMZVEM[~Lpiab0^e>LEMZVPi IcZmJKb0E;GZ]chNzZVEM[uGeMbRb*yK`4bn^Gb0JLE>PQb0T¢GrNz`4bRIcCI;`4b0EKv
JKIiLZgEE>LG{MTLUUVLEM[{>L[b {Mb0P5GZVIE4PQ!ZgGeÄLEMIk;bUwW i{>U]GZ]vwchbbnJKq>L^YTb*GTZVbkLUP^eMb0iRb
ZVPeMZV[e>UgNP{>^^b0PPrch{MU.IEUVLT[;b^*I;UgUVb0^*GZVIE>PdIcCGb*yzGP0WqM{KGP5e>IQ¢P¢UVb0PPdZVia`MTbnPPZVkb {>LUgZgGrN
¦=
!#"$%
chITTbnLJKZVEM[^*I;iR`>Tb0eMbE>PZVIEGbnPrGPdL`>`MUgZVb0JfI;EsP5ZVEM[;UgbGb*yzGP0|4 JKZ @bTbE_GPb*GIc¨`4I_PPZgq>Ugb
LE>PQSbTGrNz`b0PL;PQSbUVULPLELE>PQSbTby_GTL;^GZgI;EYiabn^e>LEMZmPioGe4LG{>Pb0PxLsJKZmPrGZgE4^GxPb*G
Icchb0LG{MTb0PuP{>^eLPJMZVP^*I;{MTPb^*{MbnPW^*ITb*chb0Tb0E>^*bfTbUmLGZgI;E>PWCLE>JjGeMb0iLGZm^fTbUmLGZVIE4PW
ZVPP5eMIQ!EGIqbEMbn^*b0PPLTNchITLE>P5QSbTZVEM[ {Mb0P5GZVIE>P0| }teMbb0EMe>LE4^*b0JlPb*GIc
LE>PQSbTGrNz`4bnPLE4JGeMbpLqMZgUVZgGrNIct`MTIK^*b0PPZgEM[¢ {>b0P5GZVIE>PPeMIQ¢P[Tb0LG`MTI;iaZVPbachIT
LE>PQSbTZgEM[a^*I;TTb0^*GUVNachIUVUgIQtv¡{M` {Mb0P5GZVIE>PtZVEGeMb^IE_GbyzGtIcXÃJKZVLUgI;[{MbnP|
}te>ZVPQSITe4LPLJMJKTb0PPb0JfGeMbRPNKPrGbiLGZV^RJKAZ @b0Tb0E>^*bnPLE>J^IiaiaIE>LUgZgGZVb0Pqb*GrQSbbE
¢vwq>L;P5bnJRZgEKchI;TiLGZVIEuPbbzZVEM[LE>J~¢vwq4LPb0JRTbnLJKZVEM[^Iia`MTbeMb0E>P5ZVIE|;}teMb`>L`bT
LUmP5I`MTb0PbE_GPRP5{4^^*bnPP5ch{MUtJKb0PZV[EH`>TZVE>^*ZV`MUVb0PchITxGeMbGrQSIl!v¡q>LPb0JL`M`MUVZV^0LGZVIE4PW¨LP
Qb0UgUtLPRLsE>bQ iab*GeMIKJchI;Txb0EMe>LE4^*ZVEM[LEÄD5£H P5NKP5Gb0i Q!ZgGe¤¢^L`>LqMZVUVZ]GZgbnPqzN
^*{>P5GI;iaZgÁ0ZgEM[ È L Þ GeMbxZVJKb0E_GZg\4^LGZVIEIc¨GeMbbyz`b0^*GbnJLE>PQb0T!GrNz`4bxLE>J È q Þ GeMbxLE>P5QSbT
b*yzGTL^*GZVIE |
:ììñçHò<zþiëò ü %¸ðòòçÁìì Âþëò
763S
5 Ç $ ëéæ $Ç % 9Jþ
ëï0é4÷çÁô4î z êzô4õ cëôýìëò ü þ
&
òçý
þëò ü %¸ðìñìïñòzî Âþëò
ã ) å á
ü %Kô4ðø*é þ ;:þrëò ü FçHòõ 'F¸þëò ü F
ïñî÷çô*(25þëò ü rï þ"1KfKDKþ
ÑÝËPÊ4ÊÎÌ W[ÛÝX SUP Ê gDSUP
S ÉpÊ S ÑÌ ÊÍ R Ò ^;Ý1WLXÊÑÊWËPÊ É ^ g*
ü ïòzõ÷ëì 6þ "1KfKfKþ>Jòzîó=çÁôÇèéôPëöÁé4ïñðòrþ ÑÝËPÊ4ÊÎÌ W[Û½ÝYX SUP Ê SUP
=Ï ÐÐÒ ÌÊÎsÜ RDS VÑ R Ò R W[DV R [Ê ÑÝËPÊÛ4Û4Ì W[ ^;ÝDWLXÊÑÊWËPÊ OÏ:Ü ×ØØØ *ùùrþ "DJ DK þ çëéé4ìñç#
|ëî÷zïñòõé4ðò[þ
;=ëçÁ*ô +%Jþëò ü F
ïìñìñú!ðô4ç++%Jþëò ü rðó¸ç#zþ LJDJfIþæ=÷zç ;¸çô çHìñçÁý FzôPëú!ç6½çé ô4ð çHöÁéþ ÑÝËPÊPÊÎÌUW[Û
ÝYX SUP Ê5^ Ü £Ï ^ g Ó þ
;Kô4ïñìñì XÇþ=ëò ü [ïñò zþ¸ëò ü ;=ëòð Âþ¸ëò ü 2qêúëïñî þKëò ü 6½õ 6þ "1KfK>þ 2qëéPë#òé4çÁòîïç
½êçHîé4ïñðò Jòîó¸çÁô4ïñòõ
þ ÑÝËÊ4ÊÎÌ W![ÛlÝYX SUP ÊlÙØ SUP S ÉpÊ S ÑÌ ÊÍ R Ò ^;ÝDWLXHÊÑ4ÊWËPÊ É ^8ÙØ *
ëï0é4÷çÁô4î zêzô4õ cëôýìëò ü þ
ü ! ëú!ú!ðò ü #þ¸ëò ü #pêì0ýê ïñò $þ¸ëò ü rýé4ïñòçÁò iþ¸ëò ü æ-ðúêzô4ð 6¥þ=ëò ü
;¸êô #ç $¥þ¸ëò "
öP÷ðçH>ò çÁô4õ iD
þ JfJ Dþ ½êçHîé4ïñðòÂëòîó¸çÁô4ïñòõ_øô4ðú øô4çíêçÁòé4ì0ýcëî ç ü íêçÁîé4ïð
ò /ìñçHî MÇèùçÁô4ï
Ï '& R [ R ÁÌ WÊ D I "#
þ
çHòöHçÁîóï0é4÷sé4÷zç Fëí /ò ü çÁôîýîé4çHúcþ %
%¸÷ëô4òïë .Çþ=ëò ü :ì0é4êò ü ç zëì ð ;KôPë # $6þKëò ü ëôô4çÁé*é ;Jþ¸ëò ü #pðîúëìë Âþ=ëò ü
sðîöHð ïñö<÷ æ½þ[ëò ü ëòzõ ;þ[ëò ü ýð D%Jþ-ëò ü êò þrëò ü Vý (¿þ-ëò ü ¸ëòzõ )þ[ëò ü
)içHìñìñçÁ*ô iþëò ü )iðô4ò ;>þ "1KfKDKþ $:çë ü ïñòõqöÁðú!ùzô4çÁ÷çHòzîïðòùzô4ðõôPëú!î;ïñò!ëJîéPëé4ïñîé4ïñöëì ìëòõêëõ:ç
Ü * ÜJÏ:Ï ^ ×ØØØ N Ý,Ñ +Û P ÝÐ Ý1WºÉÊ R ÎÌ W[`^;ÝÕ ùzô4ðöHçHîîïñòzõsöHìëîîHþ ÑÝËPÊ4ÊÎÌ W[ÛÝYX SUP Ê¥Ï:
ÐÑ4Ê P ÊWzÛ4Ì ÝDW ÊÛ S R Û Í R Ò V RDS Ì ÝDW]XHÝÑQ^;ÝÕ½Ð.V S Ê.Ñ 0/ R ÛÁÊ4Î R W[DV R [Ê çëéé4ì+ç 1 ëî÷ïñòzõé4ðòrþ
%¸ìëô #ç %Jþ ;þ ¥þ;ëò ü %¸ðô4úëö ( þ $þñþëò ü rýòë8
ú -æ½þ $6þ "DKDK .þ Çèùìñðï0é4ïñòõ $:ç ü êzò ü ëòöýïñò
½êçHîé4ïñðK
ò Jòzîó=çÁô4ïñòõþ ÑÝËÊ4ÊÎÌ W![ÛÝYX SUP Ê× 2 SUP Ï W)W V R Ò W S ÊÑW RDS ÌOÝDW R Ò
Ï ^ &4356É ^;Ý1W XÊÑ4ÊWËÊ:ÝDWÉÊÛÁÊ R ÑË PQR WÎJÔÊÍÊÁÒñÝPÐzÊÕÊW S Ì W W XHÝÑPÕ RDS ÌOÝDW5É:Ê S ÑPÌÊÍ R Ò 73568
É ×ØØÙ ùzù[þ DI
þ 6JçÁóÿJô4ìçHëòî [ðêîïëòëþ
%¸ðììñïñòî ÂþB JfJ þ< 6½ç4
ó éPëé4ïñîé4ïñöëì ëô4îçÁ
ô ;=ëîç ü ðò ;¸ïñõôPëú rçÁèïñöëì 2qçÁùçHò ü çHòöHïñçHîH(þ Ñ9Ý ËÊ4ÊÎÌ W![Û_ÝYX SUP ;
Ê :<2 SUP Ï W)W V R Ò &Ê4Ê S Ì W[ÝX SUP ÊÏqÛ4ÛÝËÁÌ RDS Ì Ý1W ÝYX ^;ÝսРV SR1S Ì ÝDW R Ò Ì W![DVÌ£Û S Ì ËÁÛ
OÏ ^ g *ùùr<
þ I L>J þ ëòéPë %Kô4ê #(% 6þ
%¸êzììñïñòõø£ðô ü B$6þ Ç9
þ J þÿJô4õëòzï Áïòz=
õ ðô4ì ü #pòzðóìñç ü õçøðô é4ðôý 5½ò ü çÁô4îéPëò ü ïñòzõ ý %¸ðú
ùêzé4çôþ
æ=÷zçHîïñî B2qçHùëôé4ú!çHòé½ð
ø ÇòõïñòzçHçÁô4ïñòõlëò ü :ùùzìïñç ü öHïñçHòzöH#ç >=ëìñç 5½òzï çÁô4îï0é8ý<þ 6½çÁó
! *ë çH<
ò %=æ½þ
2q?ç ðòzõ þ F¸þ LJ (
þ ïñú!ú!ïòzõòzçÁóîùëùçÁô:îé4ðô4ïñçH&
î ý_öÁðú!ùêé4çÁô>þ $:çHîçëô4öP8
÷ $:çHùðô&
é 6Jðz<þ LK 2qçHùëôé4ú!çHòéðø %¸ðú!ùêé4çÁ1
ô öHïñçHòzöH#ç 5=ëìñ
ç 5½òzï çÁô4îï0é8ýþ 6½çÁó ! ë çHò %=æ½þ
ü ! êzôPëêì0é ;ìëòé4çÁé¥ëò ü Âþ 8ìñìñðê ëò ü þ
ëò ü ëöíêzçHú!ïñò D%Jþ
Fçôô4çÁ*é ÿþ-ëò ü ôPëê[Dþ ;Jþ
ëò @
"DKf>K þKæ-çÁô4ú!ïñòzðìñðõïöHë'
ì ëô4ïëòé4îøðô ü ðöHêzú!çHòéîçÁìçÁöÁé4ïñðòjëò ü íêzçHîé4ïñð(ò ëòzîó=çÁô4ïñòõÂúëé4öP÷
ïòzõz>þ ÑÝËPÊ4ÊÎÌ W![ÛÝYX SUP Ê N Ý,Ñ +Û P ÝPÐ ÝDW -ÐzÊW £Ô¥ÝÕ R Ì W VÊÛ S ÌOÝDWºÏ WzÛ T ÊÑPÌ W[De OÏ ^ רØÙ *
ùù[þ < þæ[ðêìñðêî#ç .FzôPëòzöHçþ
*x
aª¾4;w>
t>$w À M $ ´ *z¾4% µ >>$
¦ <
ëï Hëêî ëî $6þëò ü ! êú!ùz÷zô4çÁýî #þ "DKDKfKþ %¸ðúïñòzç ü 7$36 4Jùzùzô4ðëöP÷ é4ð-½êzçHîé4ïñðò
Jòîó¸çÁô4ïñòõ:õëïñòzîé [ëô4õç¥æ-çèé1%¸ðìñìçÁöÁé4ïñðòîHþ ÑÝËPÊ4ÊÎÌ W![ÛÝYX SUP Ê- SUP ^;ÝDW S ÊW S / R ÛÁÊÎ & VÒ S Ì£ÕÊÎÌ R WLXÁÝÑÕ RDS Ì ÝDWsÏË4ËÊÛ4Û"^;ÝDW XÊÑ4ÊWËÊ£É'Ï ×ØØØ *ùùrþ"DIDI fKzþ ëô4ïñî.FzôPëòzöHçþ
ïñì ü ç>ë 25þiëò ü êôPëø£î ý (2þ "DKDKfK<
þ Jêzé4ðúëé4ïñö -ëçHìñïòzõ_ðø çHúëòé4ïñö$:ðìñçHîHþ ÑÝËPÊ4ÊÎÌ W[Û5ÝYX
Ê :Ó SUP Ï W)W V R Ò &Ê4Ê S Ì W[ÝYX SUP ʽϽÛ4ÛÝËÁÌ RDS Ì ÝDWÝYX^;ÝÕJÐ.V SRDS Ì ÝDW R Ò Ì W[DVÌ£Û S Ì ËÁÛ OÏ ^ ×ØØØ *
SUP ùù[þ >*"<#"DKþ ! ðò
õ #pðòõþ
! ëôP+ë ëõï<
ê 'þ;ëò ü cëïðôPëòzð =þ "DKDK "þ¸æ=÷zô4çÁçsóëHýîé4ð %¸êzîé4ðú!ï H,
ç $:çÁøçÁô4çHòöÁ8
ç $JçÁîðìñêzé4ïñðòrþ
רØ× W S ÊÑW RDS Ì Ý1W R >Ò 3 Õ½ÐÝÛ4Ì VÕ ÝDWcÉ:Ê XHÊÑ4ÊWËPÊpÉÊÛÝÒ V S Ì ÝDW (Jìñïñöëòé4+ç (ùëïñòrþ
! ëôP+ë ëõï<
ê 'þKëò ü ë îö>ë Âþ¸ëò ü cëïðôPëòzð =þ "DKfKDK¨þ ÇèùçÁô4ïñú!çHòé4îóï0é4÷ ÿ½ùçÁò 2qðúëïñò
æ-çÁèé4êëì½êzçHîé4ïñðòJò îó¸çÁô4ïñòõþ ÑÝËPÊ4ÊÎÌ W[ÛJÝYX SUP ÊJÙÓ SUP W S ÊÑW RDS Ì Ý1W R Ò ^;ÝDWLXÊÑÊWËPʽÝDW ^;ÝÕ-
Ð.V SRDS Ì ÝDW R Ò ÌUW[DVÌ£Û S Ì ËÁ
Û ^ Ü ×ØØØ *<zëëô zô4êzö çHò çÁô4úëòýþ
! ëôP+ë ëõï<
ê <iþëò ü sðì ü ð ëò 25þëò ü ë î öHë Âþiëò ü sïñ÷ëìñöHçë $6þëò ü êzô ü çëòê Âþëò ü
;¸êòzçHîöHê $¥þ=ëò ü ô ê<=$¥þ¸ëò ü $Jêzî $¥þ=ëò ü sðôPëô4çHîöHê<
þ="DKDKfKþ F> B%ÿ360';¸ððîé
ïòz=
õ #pòzðóìñç ü õç5øð0
ô :òîó=çd
ô Ç;òzõïñòçHîHþ ÑÝËPÊ4ÊÎÌ W[Û!ÝYX SUP Ê gDSU"
P S ÉÊ S ÑÌÊÍ R Ò ^;ÝDW XÊÑ4ÊWËPÊ
É ^ g ëï0é4÷çô4î êzô4õ cëôýzìëò ü þ
! ëôP+ë ëõï<
ê <iþëò ü sðì ü ð ëò 25þëò ü ë î öHë Âþiëò ü sïñ÷ëìñöHçë $6þëò ü êzô ü çëòê Âþëò ü
;¸êòzçHîöHê $6þrëò ü ô ê<B$6þ-ëò ü $Jêzî>$
þ[ëò ü sðôë ô4çHîöHê<
þD"DKfK>þ
æ=÷ç $:ðìñçðø [çÁèïñöHð
çHúëòé4ïñö5FçHç ü ëö ºïñò ÿ½ùçHò 2qðúëïñò|æ-çèé4êëì ½êçHîé4ïñðò Jòîó¸çÁô4ïñòõ
þ ÑÝËPÊPÊÎÌUW[ÛsÝYX SUP Ê
: gDSUP Ï W)W V R Ò &Ê4Ê S Ì W[jÝYX SUP ÊcϽÛ4ÛÁÝËÁÌ RDS Ì ÝDW`XHÝÑ ^;ÝÕ½Ð.V SRDS Ì Ý1W R Ò Ì W[DVÌ£Û S Ì ËÁÛ OÏ ^ רØÙ *
æ-ðêzìðêî#ç .FzôPëòzöHçþ
! ëôP+ë ëõï<
ê <iþëò ü sðì ü ð ëò 25þëò ü ë îöHë Âþiëò ü sïñ÷ëìñöHçë $6þëò ü êzô ü çëòê Âþëò ü
ô ê $¥þëò ü $Jêzî $¥þzëò ü ë öë é4ê îê< F¸ þëò ü sðôPëô4çHîöHê þëò ü ;¸êzòçHîöÁê $6þ"DKDK þ(Jò
îó=çÁô4ïñòõöHðú!ùzìç<è ìñïñîéëò ü öÁðòé4çÁèé íêçHîé4ïñðòî5óï0é4÷ D%'%1 ,
î ½êzçHîé4ïñðò 7:òîó¸çÁô4ïñòK
õ çÁô çôþ
^ ÙØ * ëï0é4÷çÁô4î zêzô4õ cëô>ý
ÑÝËÊ4ÊÎÌ W![ÛlÝYX SUP ÊgÙØ SUP S ÉÊ S ÑÌÊÍ R Ò ^;Ý1WLXÊÑÊWËPÊ É ìëò ü þ
! ïñô4îöP÷úëò ;þëò ü rïõ÷*é Âþëò ü ;Kô4çÁö (Çþëò ü ;¸êô4õçÁ*ô þ 2þ LJDJfJ>þ 2½çHçHù $:çë ü $:çë ü ïñòõ
Ê : dOSUP Ï W W V R (Ò &Ê4Ê S Ì W[ÝYX SUP ʽÏqÛ4ÛÝËÁÌ RDS Ì Ý1WXÁÝÑ
%¸ðú!ùzô4çÁ÷çHòzîïð
ò ýzîé4çÁúc1þ ÑÝËÊ4ÊÎÌ W![Û¥ÝYX SUP ^;ÝÕ½Ð.V SRDS ÌOÝDW R Ò Ì W![DVÌÛ S ÌOËÁ
Û £Ï ^ g-g *ùzù[
þ " ? "þ %¸ðìñìñçHõç ëô ( cëôýìëò ü þ
! ðý >Çþ[ëò ü çÁô çÁ*ô þ-ëò ü ! çÁô4ú +ë +ð 5þrëò ü [ïñò %Jþ 75þ[ëò ü $J*ë ïñöP÷ëò ü ôPëò 25þ "1Kf>K þ
æ-ðóëô ü çÁúëòé4ïñöHî ;=ëîç ü :òîó=çô ïòzùðïñòé4ïñòõz1þ ÑÝËPÊ4ÊÎÌ W![Û6ÝYX SUP ʽÔÏ:É Ï
VÕ R W R W [DV R [Ê ÊË P WÝÒñÝ[ ^;Ý1WLXÊÑÊWËPÊ ×ØØÙ *<ëò 2qïñçHõð %=ëìñï0ø£ðô4òïëþ
éé8ýö÷zçÁô4ïë<
÷ <¥þrëò ü FôPëò + Âþ-ëò ü )i÷<ê ¿þ zþ[ëò ü $Jëé4òëùëô ÷ï <¥þrëò ü cëú!ú!ðòz#ç ($6þ zþ
"DKf>K þ ½êçÁîé4ïðò Jòzîó=çÁô4ïñòõ 5Jîïòzõ cëèïñú5ê¥
ú Çòéô4ðùý %¸ðú!ùðòzçHòé4îHþ ÑÝËPÊ4Ê4ÎÌ W[ÛcÝYX SUP Ê
×-W
Î &Ê4Ê S Ì W![!ÝYX SUP Ê:ÜpÝÑ SUP Ï:Õ!ÊÑÌOË R W ^ P)R Ð S ÊÑqÝYX SUP Ê:ϽÛ4ÛÁÝËÁÌ RDS Ì ÝDW XHÝÑ]^;ÝÕJÐ.V SRDS Ì ÝDW R Ò Ì W [DVÌÛ S ÌOËÁÛ OÜ:Ï:Ï ^ רØÙ *ùzù[þ fJþ %=ëô4òçÁõïñ:ç sçHìñìñðG
ò 5½òï çô4îïñé#ý ï0éé4î êô4õ÷
çHòòzîýì
ëòïëþ
çÁìïñòzç ( F¸þrëò ü [ë )içÁôé#ý (zþrëò ü cëõçÁô4úë<
ò 25þiëò ü sçÁô4öHçÁ*ô <$6þiëò ü $½ëé4òëùëô ÷zï (¥þiëò ü
$Jð
ê ðî <iBþ JfJz<þ 2qçHöHïñîïñðògéô4çHç¥ùëô4îïòzõ_êzîïñòõë!÷ï üü çHò ü çÁô4ï ëé4ïñðòëìú!ð ü çHìO>þ ÑÝËPÊPÊÎÌUW[Û
ÝYX SUP ÊÙ g-g 2
VÕ R W R W![DV R [Ê ÊË P WÝÒñÝ[ N ÝÑ +Û P ÝÐ ùùr(þ " #"<>" þ
#qó¸#ð (9#þ þëò ü ô4êòzøçHì ü ;þëò ü 2qïñòîé4ì +6þëò ü %¸÷ëò Âþ "DKfKDKþæ $SÇ % 9J%Kô4ðî
î -ëòõêëõ#ç ç lëò ü ½êzçHîé4ïñðò 7:òîó¸çÁô4ïñòõ!æ[ôPëö xÇèzùçô4ïú!çÁòé4îêzîïòzõ 97$&%'iþ ÑÝËPÊ4Ê4ÎÌ W[ÛÝYX SUP Ê gDSUP
^ g * ëï0é4÷çÁô4î zêzô4õ cëôýìëò ü þ
S ÉpÊ S ÑPÌÊÍ R Ò ^;ÝDWLXÊÑÊWËPÊ É cëõçÁô4úëò B2þ LJDJ þ éPëé4ïîé4ïñöëì ü çÁöHïñîïðò éô4çHçú!ð ü çÁìî6ðøùëô4îïñòzõzþ ÑÝËPÊ4ÊÎÌ W[Û_ÝYX SUP Ê ::ÑÎ
Ï W W V R (Ò &Ê4Ê S Ì W[_ÝYX SUP ÊpϽÛPÛÝËÁÌ R1S Ì ÝDWXHÝÑQ^;ÝÕJÐ.V SRDS Ì ÝDW R Ò ÌUW[DVÌ£Û S Ì ËÁÛ$
e £Ï ^ g-c ùù[þ " "DI ùzù[þ
þ 6½çÁóÿJô4ìñçëòî [ðêïñîïëòëþ
rçH÷òzçÁô*é ¿þ þ J 1Iþ P Ê ÑÝËPÊÛ_ÝYX VÊÛ S ÌOÝDW Ï WzÛ T ÊÑPÌ W![ ! ïñìñìî ü ëìñ#ç 96¥þ þ -ëHóô4çHòöÁR
ç Çô4ì
ëêzú JîîðöHïëé4çHîHþ
sðì ü ð ëò (25þëò ü ! ëôPë ëõïñê iþëò ü ë î öë Âþëò ü sïñ÷ëìñöHç>ë $6þëò ü ðð ü ô4ê8
ú ($6þëò ü
ô ê $6þrëò ü $:êî$¥þBLJDJfJþ D3zÿ iëé4ððìø£ðôqîêzô /òzõé4÷zç5ëòîó¸çÁô6òçÁéþ ÑÝËPÊ4ÊÎÌ W![Û!ÝYX
SUP ÊÓ SUP S ÉpÊ S ÑÌÊÍ R Ò ^;ÝDWLXHÊÑ4ÊWËPÊ É ^ #Ó * ëï0é4÷çÁô4î zêzô4õ cëôýzìëò ü þ
6Jõ ! þ æ½þëò ü æ-çHð þ ! þzëò ü #qóëò 1zþ "DKDKfKþ cëö÷zïñòç [çHëô4òïñòzõ Jùzùzô4ðëöP÷é4ð :òîó¸çÁô4ïñòõ
½êçHîé4ïñðòzîøðô $:çë ü ïñòõ %¸ðú!ùô4çH÷çÁòîïñðò æ-çÁîé4îHþ ÑÝËPÊPÊÎÌUW[ÛsÝYX SUP ÊÝÌ W S ^;Ý1WLXÊÑÊWËPÊcÝDW
^ ×ØØØ * ! ðòõ #pðòõþ
ÕJÐÌ£ÑPÌ Ë R Ò &Ê SUP ÝÎÛJÌUW!Ü R WÎÊÑ R Ñ [Ê]^;ÝÑÐÝÑ R &cÜ * ¦
!#"$%
ëîöë Âþëò ü ! ëôPëëõïñê þ>"1KfK þ ! ïñõ÷
çÁôø£ðô4úëòöÁç3½êzçHîé4ïñðò +Jòzîó=çÁô4ïñòzõzþ5 ÑÝËPÊ4ÊÎÌ W[Û½ÝYX
SUP Ê×2 SUP Ï W)W V R Ò W S ÊÑW RDS ÌOÝDW R Ò
Ï ^ 356É ^;ÝDW XÊÑ4ÊWËPÊ_ÝDWÂÉÊÛÁÊ R ÑË P R WÎ_ÔÊÍÊÁÒñÝPÐÕÊW S
Ì=
W WLXHÝÑÕ RDS Ì ÝDWcÉÊ S ÑÌÊÍ R Ò 7356É8 רØÙ ùù[þ zþ6½çó¿ÿJô4ìñçëòî [ðêïñîïëòëþ
$Jë ü ç (+2þëò ü ôPëõçÁô*zþëò ü zëú!ò<6$þ#"DKDKfKþ#$½ëòïñòõêîùçÁöÁé4ç ü :òîó¸çÁô4î
é4ð6qëé4êzôPëì [ëò
õêëõç ½êzçHîé4ïñðò
î 5Jîïñòõ ô4ç ü ïöé4ï ç JòzòðéPëé4ïñðò[þ ÑÝËPÊ4ÊÎÌ W[Û!ÝYX SUP Ê= SUP ϸÐÐÒ Ì Ê4ÎÜ RDS VÑ R Ò
R W[DV R [Ê ÑÝËÊÛ4Û4Ì W![ ^;ÝDWLXÊÑÊWËPÊ £Ï:
Ü ×ØØØ ùù[þ DK þ çHëéé4ìñç#5|ëî÷zïñòõé4ðò[þ
$:ïñìð ) zÇþëò ü æ=÷çHìñçH<
ò Âþ "DKDKfK(þ ô4êzìñ:ç ëîç ü íêçHîé4ïñðòcëòzîó=çÁô4ïñòzõ!îýzîé4çÁú ø£ðô:ô4çHë ü ïñòzõöHðú
Õ ùzô4çH÷zçHòîïñðòcé4çÁîé4îHþ ÑÝËPÊ4Ê4ÎÌ W[Û5ÝYX SUP Ê6ÏJÜ * Ü:ÏJÏ ^ V×ØØØ N Ý,Ñ +Û P ÝPÐ ÝDWlÉ:Ê R ÎÌUW[ ^;ÝÐÑ4Ê P ÊWzÛ4Ì ÝDW ÊÛ S3R Û Í R Ò V RDS Ì ÝDW XHÝÑ ^;ÝÕ½Ð.V S Ê.Ñ 0/ R ÛÁÊ4Î R W[DV R [Ê ùùrþ LJ>þ çëéé4ì+ç ëî÷
ïòzõé4ðò[þ
ëì0é4ð<
ò <þ LJ DJþ P Ê 3&cÏJÉ ÉÊ S ÑÌÊÍ R Ò 3 Û S ÊÕ 6JçÁó çÁô4îçÁý ô4çÁòé4ïñöHç ! ëìñìOþ
ö÷ë
ò ( $6þ %J(þ LJ #"þ %¸ðòöHçHùé4êëì ü çHùçHò ü çHòzöÁý Vé4÷çÁðôý!ðø-òëé4êzôPëììëòõêëõç½êzò ü çÁô4îéPëò ü ïñòõ ^;Ý[DWÌ S Ì£ÍÊ Û Ë P ÝÒñÝ[ zùù[þ #" þ
ö÷ë
ò ($¥þ %Jþëò ü &çHìñîðò $¥þ
þD J þ 3ËÁÑPÌ Ð S Ûe
ÐÒ R WÛ [Ý R Ò Û R WÎ5VWÎÊÑPÛ SR WÎÌ W[!\ ! ïñììñî ü ëìñ#ç 6þ zþ [ëóô4çÁòöH¢
ç Çô4ì ëêzú JîîðöHïëé4çHîHþ
ô4ï÷ëô4ï 9$6þëò ü rï ¿þ "DKDKfKþ ½êçÁîé4ïðG
ò Jòîó¸çÁô4ïñòK
õ ýîé4çHú êzùùðôé4ç ü K
ý 8òø£ðô4úëé4ïñðò
Ò R W![DV R [Ê ÑÝËPÊÛ4Û4Ì W[ ^;ÝDW XÊÑ4ÊWËPÊ
ÇèéôPëöé4ïðò[%
þ ÑÝËPÊ4ÊÎÌ W[ÛÝYX SUP Ê SUP ϸÐÐÒ ÌÊÎ Ü RDS VÑ R OÏ:Ü ×ØØØ *ùùrþ < +"<
þ çëéé4ìñ#ç 1|ëî÷ïñòõé4ðò[þ
$;ððô4÷zçHçHî 4ÇD
þ "1KfK þ-3
ÿ çÁô ïñçÁó ðøKé4÷ç5æ $SÇ % "DKDK ½êzçHîé4ïñðò Jòzîó=çÁô4ïñòõ_æ[ôPëö þ ÑÝËPÊPÊÎÌUW[Û
ÝYX SUP ÊÙØ SUP S ÉpÊ S ÑÌÊÍ R Ò^;ÝDW XÊÑ4ÊWË
Ê É ^ ÙØ * ëï0é4÷zçÁô4î êô4õ cëôýìëò ü þ
ïñìñçHòzî ý +$6þ J þ 5Jîïòzõqùìëòîé4ðqêò ü çÁô4îéPëò ü òëé4êôPëììëòõêëõç5þ ÑÝËPÊ4ÊÎÌ W![Û½ÝX SUP Ê=Ï W W V R Ò
^;ÝDWLXÊÑÊWËPÊ5ÝYX SUP ÊqÏ ^ & ëï0é4÷çÁô4î zêzô4õ cëôýìëò ü þ ! ðêîé4ð<ò æ ¥þ
ðð ü î ¿þ
ëò ü ;Kð#ð úë<
ò ;þ ¥þëò ü ! ðêzîé4ðò ¥þëò ü #pêz÷òî D$¥þ zþëò ü cëôé4ïñò
þëò ü
ô4çHçHò (i(þ "DKfKDKþ rïñòõêzïñîé4ïö #pòzðóìñç ü õç %=ë
ò #ú!ùzô4ð ç #òzøðô4úëé4ïñð8
ò $Jçéô4ï:ç ëì (þ ÑÝËPÊPÊÎÌUW[Û
ÝYX SUP 8
Ê SUP ϸÐÐÒ ÌÊÎ½Ü RDS VÑ R Ò R W![DV R [Ê ÑÝËÊÛ4Û4Ì W![Z^;Ý1WLXÊÑÊWËPÊ £ÏJÜ ×ØØØ *ùùrþ " "? " þ
çëéé4ì+ç |ëî÷ïñòõé4ðòrþ
ðð ü î ¿þKëò ü ô4çHçH<
ò þKëò ü cëôé4ïñò
þ "DKfKDKþ ! ëìñøóëHý é4ð ½êçÁîé4ïðò :òîó=çô4ïòzõzþ Ñ9Ý ËÊ4ÊÎÌ W![ÛcÝX SUP Ê gDSUP Ê S ÉÊ S ÑÌ ÊÍ R Ò ^;ÝDWLXHÊÑ4ÊWËPÊ É ^ g *ùzù[þ fKf<K Kþ ëï0é4÷çô4î êzô4õ ,25þ
© Copyright 2026 Paperzz