Toward Scalable Learning with Non

!#"
$&%'()+*,-./ 0123240(25"
6 25"7*8"7(2:9<; 023=>"
*?@A0
BC#"D01
FE
* 6 :"7G"7(
— V7LP˜3V3™bš›`œžŸS — ™šZLP #š
HJIKMLNKPORQ<S.TUIV
W
XZY\[^]`_baNcedfbghicejkgc
¡ ce]kp-dNaN[^cej\aY|vXZY\[r]k_baNcedBfbgh¢cjkgc
XZY m _`[  hopr£Bj`h¢¤|cd#tNh¥aP}
l3m Y\dNhon`prqsjktMaNhiaN_baucY-v
wxcyg#z`j`Y m Y|{\}
~ c mi Y|_`duj`c\€ l7U‚„ƒ-…\†`‡
¦ ce§©¨Y\dNª«€ ¦ ¨ ‡e†|†„ƒ\¬
ˆb‰+Š-‹kŠŒ7ŽP‘“’GŽM”„•|–
Œ|­b®„‹`ŠŒ7Ž#Š|¯®-–|°k±²³­´ŽP”„•-–
µ ¶3·e¸¹³º`»|¸
¼¾½N¿sÀ8Á¥Â¿PÃy½(ĄÂÅMÂÆÂÇs½#ÇÈÉÊÅPËÇs̓½uÈ3½ÍÄÏÎ#Á¥ÂÇsÇÐÄ\ÉÑÇÒÅs¿PÉÑÆ„Ó|Ô
ÅPÎ#ÉÑÕyÕyÙքÇ:ÙÂeÕe֍ÖrÄ>ÉÑÖrÖ\Õy¿PÖ\½ÍÂÔ×Ó\ÁÊÔ×քÈ3ÉÊØoÕeÕ¿P¿PÁ¥ÄÛÙĄÎ#ÂÕeÅMÇÒÂÐÅÙÚb½uÉ¥Ö\¿Éѽuք¿sß¿PÕÅM¿ÂÇsÂÌ|¿PÇ#½Ü¾Ö„ÝÕŽӄÄ|Ö|½uÔÔ
ÞÂyÄ\É¥ÇsÄ|½#¿PÄ^½#ÇsŸÇ:ٟÅPË\Ó\½#ÁÊÅPÇs½ŸÉÑÔ×Î#ÅPÁ¥Ë\¿PÇs½uÇsÉѽÐ߄½uÉÑÇs¿´Çsӄٽ#½uÇ#ÅMÜ.ÂÔ×àGÁѽÍÓ|¿¿Pք½#ÉÑÙքßڄÉÊÂe¿PÉÑڄÎÍÚ|¿PÁ5Փ¿P½uÎNÇsËrӄÁÊÅPÅPÕ Ç
Ø¢¿PÕeÙáÂÎN¿P½ÍÄ\ÉÊÅÎÍ¿MÄØ¢¿MÂeӄÄJÄ|½uÅP½#ÎuÅPÉÑÕeÖâÅMÂÇsÌɥքÄ\ÉÑÎÍÂÅP½
ÅPˍÂÅ+ÅP˄½¾ÂeÚ\Ú\¿PÕyÂeÎMËÎÍÂÖÇsÉ¥ÃeքÉÊߍÎ#ÂeÖ³ÅPÁÊÀ¿P½ÍÄ\Ó\Î#½¾ÁÑÕeÇsÇ5Ä\ӄ½
ÅPÕÐÉÑÁÑÁ¥½uÃyÉÊÅPÉÑÙÂÅP½Ås¿MÂeÖ\ÇPÂeÎuÅPÉÑÕyÖ\Ç#Ü
ã\WZ™b›`šäBåæ+™`KPš´W
ç cdu} m p-du{|cèn`p³a#p  p\tMcytϧh¥auzžtNª|ce§Zcyn©g m p|tutnbhotPaudNh  _bauhiY\jkt
p-j‘nèj`Y|jbéÒ_`j`hivêY|du[ëgY\tMa]+cdrcdudNY\dp-duc>j`Y-a._kjkgY\[r[^Y\jìhij
ducep m éÒ§ZY\d m nân`p-aup[^h¢j`hijk{aup|tNªbtíîj`cÛtM_‘g#zJa#p|tNªâhotgducen`h¥a
gp|dunvêdup|_kn.nbcaNcygÍaNh¢Y|jxï5aNzkcGj_`[  ced7Y-v`vêd#p-_kn`_ m cej„a¾audup|jktNp\gÍé
aNh¢Y|j‘tZhot:tM[>p mim gY|[^]kp-ducen>aNY m ce{|hiaNh¢[^p-aNcŸY|j`cyt€„auz`cp-[^Y|_`j„a
Y-v‘ðkjkp|jkghop mm Y\tutxvêY\d
cep\g#zvêd#p-_knb_ m cej\a7audup|jktNp\gÍauhiY\j.nbc]+cj‘n`t
Y|jñauz`câp|[rY\_`j„aÛY-vÐaNd#p-j‘tNp\gÍaNh¢Y|jñp-j‘nñY-aNzkcd>v×p\gÍaNY\dute€p-jkn
[^h m¢m hiY\jktY|v¾audup|jktNp\gÍauhiY\jkt:Ybgg_kdcep\g#znkp“}|íZòótMh¢[^h m p-da#p|tNª
hotgc mim _ m p-dÛ]kz`Y|j`cvêd#p-_‘nônbcaucegÍauhiY\jöõ l p“§GgcaMaÏ÷ùø´dNY³¤\Y\tMa
‡e…\…„¬|ú í.ûZp|g#zâY|vaNzkcetNc(auz`ducc^h¢tutN_`cetŸzkp\tjkY-a  cecjè§honbc m }
tMaN_knbh¢cenÏh¢jÏaNz`c[>p|g#zkhij`c m cep|dNj`h¢j`{^ducetNcep-d#g#zgY|[^[._`jkh¥aP}\í
l p“§:gcaNaÛõ ‡e…\…|ü„ú tN_`[^[>p-duhiýecenâaNz`c>ducetN]‘Y\jktNcetŸaNYz`hoth¢jbé
þj_`_`h¢[ dN}8 cY|d7j Y|mv‘cedup-cedutNj`]‘h¢Y\j`jk{>tM§cyt3hiaN§Gzâp\tNt5ª|vêcece§Z§cy{|n8h¢¤|g cem p\j(tNtNtª|nbce§Zh¢tMaNcydun.h  nb_bhotPaNauh¢Y|dNh j‘ t_bíauhiw:Y\z`jkc t
p-ducâjkY-adup|dNcCh¢j©]kdup\gÍaNhogc\í ÿÐ_  p³ap-j‘n ~ p³aP§h¢j<õ ‡e…\…„¬-ú
p|g#ªj`Y³§ m cen`{|cen auz`cè]‘cedMvêY\dN[>p|jkgcènbc{\dup\n`p³auhiY\j c «cegautY|v
tNª|c§Gceng m p\tNtxnbh¢tMaNduh  _baNh¢Y|j‘t¾p|jkntMaN_knbh¢cenaNceg#zkj`h _`cyt²vêY\dxducé
[^Y³¤hij`{_`j`j`cygcetutup-du}h¢jktPa#p-jkgcetvêdNY\[ auz`c.[>p PþY\dNhiaP}8g m p\tNteí
qsjktMaup|jkgcyt7aNzkp-aGp|dNch¢j^aNz`c  Y\dunbced m h¢j`cduc{|h¢Y|jx€-j`Y|hotN}|€|Y\dducé
nb_`j‘n`p-j„ap-ducgp|jknbhon`p³aucet´vêY|dGdNce[^Y³¤“p m íXGp-d#nbh¢cp|jkn BY³§hic
õ ‡y…|…¬-ú tMaup³aucenUauzkp³a(tNª|ce§Zcynèg m p|tutnbhotPaudNh  _bauhiY\jkt.p|dNc MaNz`c
j`Y\dN[ vêY|d m cyp-duj`h¢j`{]`duY `m c[>t¾hijj‘p³aN_kdup m|m p-j`{\_kp-{\c
]`dNYbgcetutPé
h¢j`{ìõ ¦B ø ú í ÏqsjèpÏgep|tNcé  p|tNcen m cyp-duj`hijk{vêd#p-[^c§GY|duª«€+aNz`ce}
tMaN_knbh¢cenŸauceg#z`jkh _`cyt²aNYBc aNd#p|ga5dNc m ce¤“p|j„a²vêcep³au_`ducet²vêduY|[ ]`ducé
¤hiY\_kt m }  _`h m anbþ cyghotMh¢Y|j8aNduccytp-jkng_ktPauY|[^h¢ýc m Ygep m vêcyp³aN_kdNc
§Gch¢{|z„autGvêY\dcep|g#zgp\tMcŸducaNduh¢c¤³p m í
ûdudNY\ddup-aNcÛhotrgY|[^[^Y|j m }U_ktNcenìh¢j c¤³p m _kp-aNh¢j`{ m cep|dNjkhij`{
p m {|Y\dNhiaNzk[^t kgY\tMaMéstMcejktMhiaNh¢¤|c m cep|dNj`h¢j`{^zkp\tj`Y-a  cecj§honbc m }
h¢j„¤\cetMaNh¢{\p-aNcen5í´òBtutM_k[rh¢j`{>auz`ccedNduY|d#t:gp-j  c{|duY|_k]‘cyn8h¢j„aNY
pvêc§<aP}„]+cetÐp|jknâcyp|g#zâaP}„]+c^hij‘g_`d#taNz`c>tup-[^c>gY\tMae€5tNY|[^c
ÕyÚ³À-¿PÉÑÃy˳ŠΠٽu¿PÉÑÎÍÂeÖ ÇsÇsÕ³Î#É¥ÂÅPÉÑÕeÖØ¢Õe¿ ¿sÅPÉÊߍÎuÉiÂÁ Ö³ÅP½#ÁÊÔ
ÁÑÉÑÃy½#Ö\Î#½ oÈ
È
ÈÜ ÂeÂyÂÉêÜ Õ¿Pà NÜ Á¥Á`¿PÉÑÃy˳ÅPÇ
¿P½#Çs½u¿ Þ ½#ÄkÜ
tPau_knbh¢cetõ×c|í {kí¢€„õ ø
p-ýýyp-j`h !"$# ‡e…|…%„úNú ]kdNY\]‘Y„tMcynp m {\Y|duh¥auz`[>t
aNzkp-a:p|hi[1auYrducen`_kgcaNz`caNY|aup m gY\tMaeí
òBj`Y-auz`cd m hij`cÐY|v¾gY„tPaNé
tMcejktMhiaNh¢¤|c§ZY\dNªraudNh¢cetZaNYrducenb_kgcBauz`cÐgY\tMa:hijÏ_ktNhij`{rp(g m p\tNtNhié
ðkcdyí l Y|dÐhij‘tPa#p-jkgc|€5tNY|[^c>tMcejktMh¢j`{nbc¤hogcytŸp|dNc^gY„tPa m h¢cdÐh¢j
aNz`c(dNY  Y|aNhogtŸnbY|[>p-h¢jõ w¾p|j ‡e…\…|‚\ú í l p“§GgcaMaÐp-jknJøduY³¤|Y„tPa
õ ‡e…\…„¬|ú gY\jktNh¢nbcedNcynìj`Y\jbé _kj`h¥vêY\dN[ gY\tMar]+cd^cedNduY|d(hijaNz`cehid
gc m¢m _ m p|d]`z`Y|jkcâvêd#p-_knžnbcaNcegaNh¢Y|j aup\tMª p|jkn©&c bzkp-_ktMaNh¢¤|c m }
tMcyp-d#g#z`cenrõê§hiaNz.p'ð bcenÐh¢jkgduc[^cj„a ú vêY|d²auz`c  hijkcep-d¾w:z`dNcytMz`é
Y m n8£Bj`h¥a ( taNz`ducetNz`Y m naNzkp-a[rh¢j`h¢[^hiýecet:auz`cÐaNY|aup m gY\tMaeí
£Bj\auh m dNcygcj„a m }\€xducetNcep-d#g#z`ceduthijì[>p\g#z`hijkc m cep|dNjkhij`{zkp“¤\c
 cecjìvêYbg_‘tMh¢j`{âY\jtN[^p mim n`p-aupCtNca#tíU*û )Ûgh¢cj„a m } m cyp-duj`h¢j`{
vêdNY\[ m p|dN{\cJp|[rY\_`j„autY|vrn`p-aup zkp|t  ccej {\p-h¢j`h¢j`{ñp³aMaucjbé
aNh¢Y|jÛnb_`cBaNYauz`cv×p\tPaZ{|duY³§hij`{Ÿðkc m nÛY-v5n`p³a#p[^hijkhij`{‘€§z`cduc
n`p³a#pŸp|dNcp  _`jknkp-j„aeí
fbp-[^] m h¢j`{Ûõêc\í {‘íi€+õ XGp³a m caMa ‡y…|…k‡yúMú p|jkn
]kp-d#p m¢m c m hotN[4õ×c|í {kí¢€xõ×ø´dNY³¤\Y\tMaZ÷óòBdNY\j`hot ‡y…|…\ü\úMú p-ducaNz`cÐaP§GY
[^p|hijJnbhiducegaNh¢Y|jkth¢jâtNgep m p `m c m cep|dNj`h¢j`{‘í ~ _‘g#zCY-v
auz`c(]‘p-dNé
p m¢m c m hotM[ §GY|duªrvêYbg_ktNcetGY|j8]kp-d#p m¢m c m hiýehij`{rp.]‘p-dNaNhog_ m p-dp m {|Y|é
dNhiaNz`[Y|j>ptN]+ceghið‘g]‘p-d#p m¢m c m p-d#g#z`hiaNcegaN_`duc|í3w:zkp³aZh¢te€„pÐjkc§
p m {|Y|duhiaNz`[ Y|drp-d#g#z`h¥aucegaN_`ducÛduc _`h¢dNcyt.tN_  tMaup-j„auh¢p m p|[rY\_`j„a
Y-v¾]‘p-d#p m¢m c m ]kdNY\{|d#p-[^[^hij`{r§GY|duþª+í
+ cŸn`c¤h¢tNcenp[._ m auh¥ésg m p|tutMhiðkcedZ[^ca#p³é m cyp-duj`h¢j`{.p-]k]`dNY„p|g#z
aNYJp\n`nbducetutauz`cetNc8aNz`duccÏh¢tutN_`ceteíî_`d^p-]`]`duY\p\g#z hot  p|tNcen
Y|j>gducep-aNh¢j`{.n`p-auptN_  tNcaut´§h¥auz>aNzkcp-]k]`dNY\]`duh¢p-aNcg m p|tutnbhotPé
aNduh  _`aNh¢Y|j5€
p-]k] m }h¢j`{ m cep-duj`h¢j`{Cp m {|Y\dNhiaNzk[^taNYauz`ctN_  tNcaut
hijkn`c]+cjknbcej„a m }p-j‘nh¢jñ]kp-d#p m¢m c m €Gp-jkn h¢j„aNc{\dup-aNh¢j`{JaNYìY|]`é
aNh¢[rh¢ýcJgY\tMa]+cdNvêY|du[>p-jkgcY-vaNzkcâg m p|tutMhiðkcedut  } m cyp-duj`h¢j`{
õê[^ca#p³é m cyp-duj`hijk{^õÒXZzkp-jÛ÷ f„auY m vêY ‡e…\…|‚„úMú vêduY|[öauz`ch¢dZg m p\tNtNhié
ð‘gp-aNh¢Y|j  cezkp“¤hiY\deí3w:zkp³ahot€|Y|_`d
[^cauz`Ybn^_baNh m hiýecetp mim p“¤³p-h m é
p `m cBaudup|hijkhij`{(c `p-[^] m cet:p|jkn8n`Y„cytGj`Y-ag#zkp-jk{|caNz`cÐ_`jkn`cdNé
m }h¢j`{ m cep-duj`h¢j`{p m {\Y|duh¥auz`[>tíqÒaÐp m tMYÛz‘p-jkn m cetj`Y\jbé _kj`h¥vêY\dN[
gY\tMa8]+cdÏcduduY|d8p|jknôhotgY\tMaMéstNcjktNh¥auhi¤\cânb_`duh¢j`{ auz`c m cep|dNj`é
hij`{]`dNYbgcetutí:ò m aNz`Y\_`{|zâY|_`dBp|dug#zkh¥aucegÍau_`ducp-jknCp m {\Y|duh¥auz`[ré
hijkn`c]+cjknbcej„aâp-]`]`duY\p\g#z hotj`Y-aâp\t8&c )Ûgh¢cj„aâp|t8aNzkcèðkj`cé
{|d#p-h¢j`cenô]‘p-d#p m¢m c m h¢ýep-aNh¢Y|j p-]k]`dNY„p|g#z`cyt€hiaCp m¢m Y³§tÏnb,h +cedNcej„a
M
Y +é aNz`céÒtNz`c m -v m cep|dNjkhij`{]kdNY\{|d#p-[>t«aNY  .c M] m _`{\{|ce/n :hij„aNYp
]kp-d#p m¢m c m p-jkn^nbhotPaudNh  _baucen^cej„¤h¢dNY\j`[^cj„a
§h¥auz^dNc m p-aNh¢¤|c:cep\tMc\í
î_`dZce[^]`hiduhogp m ducetN_ m a#tZvêY|dZaNz`cgducen`h¥agp|dun^vêd#p-_‘nÛ]`duY `m c[
hijkn`h¢gep³aNcaNzkp-aGY\_`dZp|]`]`duY\p|g#z>gep-jÛtNhi{\j`h¥ð+gp-j„a m }rdNcynb_kgc m Y\tut
nb_`cŸaNY>h mim c{\h¥auhi[>p-aNcŸaNd#p-jktup|gaNh¢Y|jkteí
w:z`hot]kp|]‘cedhotY|du{\p|j`h¢ýcen8p|t:vêY mim Y³§teí + cðkd#tPaBnbcytNgdNh  c
aNz`c.gdNcynbhiaBgp-d#n8vêdup|_knnbcaNcegaNh¢Y|ja#p|tNª+í ¦ &c aB§Zc.c `p-[^h¢j`c
aNz`cJc «cegÍa#tY|vaNd#p-h¢j`h¢j`{g m p\tNt8nbh¢tMaNduh  _baNh¢Y|j‘tY\jôaNz`cJ]‘cedMé
vêY|du[^p|jkgc\í + caNzkcjônbhotNg_ktNt^Y\_`d>[._ m auh¥ésg m p|tutMhiðkcedr[^caup³é
m cyp-duj`hijk{rp|]`]`duY\p|g#zÏp-jkn8c[^]`h¢duh¢gep m ducetN_ m a#tí7qsjg m Y\tNh¢j`{k€§Gc
!"!#$!%&#')(+*,%.- / 130 2 ')(4*,% 65
§z`cedNc87:9;#<õ>= ú hotauz`cgY„tPaŸp|tutMYbghop³aucen8§h¥auzaNd#p-jktup|gaNh¢Y|j?=
p-j‘nA@ hotŸaNz`c>auY-a#p m j_`[  cd.Y-vGaNd#p-jktup|gaNh¢Y|jkteí>òv aNced.gY\jbé
tN_ m auhijk{§h¥auzÛp  p|j`ª.duc]`ducetNcj„a#p³aNh¢¤|c\€-§GcBtMcaMa m cyn^Y|j>ptNhi[ré
] m h¥ð‘cenôgY„tPa8[rYbnbc m õêaNz`cUgY\tMaÛ[^Ybnbc m _ktMcyn  }auz`c  p|j`ª
hot([^Y\dNcÏgY|[^] m c
p|jkn hot(tMaNh m¢m ce¤|Y m ¤h¢j`{ ú íèfh¢jkgc8hia^aup-ª\cet
aNh¢[^cp-jkn.]‘cedutNY|j`jkc m aNYŸhij¤\cetMaNh¢{\p³aucZp]‘Y|aNcej\auh¢p m vêdup|_knb_ m cj„a
aNd#p-j‘tNp\gÍaNh¢Y|jx€\p-Bj 94CD+EFGD4HJIrh¢t´hij‘g_`dudNcyn^vêY|dZcep\g#z>hij¤|cytPauhi{„p³é
aNh¢Y|jxíZw:zkp-ah¢te€khiv7aNz`cp|[rY\_`j„aY-v
praNd#p-jktup|gaNh¢Y|jÏh¢ttM[>p mim cd
aNz‘p-jèaNzkcY³¤|cedNzkcep|n5€5h¥arh¢t.j`Y-a(§ZY\dMauz„§zkh m c^aNYCh¢j¤|cytPauhi{„p³aNc
aNzkcaNd#p-jktup|gaNh¢Y|jÏc¤\cjh¥vhiaBhottN_ktM]kh¢ghiY\_ktí l Y\dBc `p|[r] m c\€`h¥v
hia´aup|ª|cyt
aNcejÛnbY m¢m p-d#t
aNY.hij¤|cytPauhi{„p³aucp]‘Y|aNcej\auh¢p m‘m Y\tut
Y|v5Y|j`c
nbY mim p-dy€h¥ahot:[rY\dNcÐcygY|jkY|[^h¢gep m j`Y-a:auYrh¢j¤|cytPauhi{„p³aNc\í3w:zkcducé
vêY|duc|€`p\tNtN_`[^h¢j`{>p./ð cyKn 94CD+EFGD4HJIÛp|jkn8gY|jktNhonbcduhijk{kï
L M É¥Ö\Ó\ÇÒÅMٟÂeÆbÖ\½uÎ#¿7½#&Ç ÕeO Ø ÎNoØiÅP¿MӍÂeÂeӍ3Á Ä|N«Ó„ÕyÁѽ#ÇsÖ³ÉÊÅP-Å É Þ ½ Îu ÅPÁÑӄ½#ÃyÂeÉÊÁ ÅPÉÑM Ù½uÂÓÅP½ ÅP É Þ ½
N²¿P½ÍoÄ\Ø¢¿MÉÑÎuÂeÅPӄ½#Ä\PÄ Ó\N«Á¥½uÕyÖ-ÇsÅ-ÉÊÅPÉ Þ ½ Q‘¿PÓ\U)R½ VXN«W, ÕyÇsL ÉÊÅPO É Þ ½ ZY3S„[+Âe\ ÁÑ],Çs^`T½ _aN«\bÕy[#ÇsceÉÊd ÅPÉ Þ ½ L f O
N²¿P½ÍÄ\ ÁÑÉѽ#ÎuÃeÅP½ÍÉÊÅPÄ É¥ÙM ½#ÅPÃy½  ÅPÉ Þ ½ SÂÁÑÇsgh½ ViM ]e] ½# ÓÂL j ÅPO É Þ ½ Q‘¿PkmÓ\l#½ ceM dn½#[+Ãy\ ÂÅPL Éo Þ O ½
§Gcnbc¤hotMcynUaNz`cvêY m¢m Y³§h¢j`{âgY\tMa.[^Ybnbc m vêY|d(cep|g#zUaudup|jktNp\gÍé
aNh¢Y|jxï
')')(+(+*p*p%% >>qmqmru %(# $/ +vJst$ % o ÉÊØ %& "s8%awx($+vJ$ o Õ¿
ÉÊØ %# / o st%az{/ (#$#vJ$ o
y
')(4*,% X|au %(# $+vJst$ % ÉÑØÉÊØ %%&# / "sts8%%az{wx(#($$#+vJvJ$$ o o Õ¿
/
')(4*,% X|ar y /
§z`cedNnc <}E!H@~HB<Gh¢taNz`c.p|[^Y|_`j„aY-v
p>gducen`h¥aBgep-d#nÛaudup|jktNp\gÍé
aNh¢Y|jxí l _`dNaNz`cedN[^Y\dNc\€`§Zc(nbcðkjkcaNzkcv×p m tMcé jkc{\p-aNh¢¤|cd#p³aucp|t
€ p-j‘nâauz`c>v×p m tNcéÒ]‘Y„tMhiaNh¢¤|c^d#p³aucÛp|…
t „ Kí Gp\tMcynâY\jUaNz`hot
g$Y„‚ƒtP€ aÐ[^Ybnbc m €5§Gcrjkc atPau_knb}auz`c^c «ceg̈́a#‚ƒtІ Y-vaudup|hijkhij`{g m p\tNt
nbhotPaudNh  _bauhiY\jkt:Y|j]+cdNvêY|du[>p-jkgc|í
‡?ˆœxæ+.™ ‰ìš? Šr›`V
KMWBKNRW ‹Œ eK ‰\™b›kŽK Ÿå™`KPšZTW ‰
û b]+cduhi[^cej\a#tC§Gcduc]+cdNvêY|du[^cenžaNYžtPau_knb} auz`c&c +cygÍautUY|v
*
aNd#p-h¢j`h¢j`{1g m p|tutônbh¢tMaNduh  _baNh¢Y|j‘tñY|j auz`cögducen`h¥a gp|dunRgY„tPa
Credit Card Fraud (C4.5)
70
Average Aggregate Cost ($)
tN_`[^[^p|dNh¢ýcÐY\_`ddNcytM_ m a#tp-jknÏnbh¢dNcygÍaNh¢Y|j‘tí
TJ›`œxäKs™ñTJV7›k
ä ›kV7å
ä ôœ²™bœxæ+™`KMš´W
+ z`cej  p-j`ªbt m Y\tNc^[rY\j`c}  cygp|_ktMc>Y|v:gdNcynbhia.gp-d#nâvêdup|_kn²€
gp|dun©z`Y m nbcedutÏ]kp|dMauh¢p mim } õê]+Y\tutMh `m } cj„aNh¢duc m } ú ]kp“}ñvêY\d8auz`c
m Y\tutaNzkdNY\_`{|zìz`h¢{|zkcd.h¢j„aNcedNcytPa.d#p³aucete€7z`hi{\z`cd([^c[  cd#tNz`hi]
vêccyt€bp|jknÛducenb_‘gcen  cej`cð`a#tí Bcjkgc|€bhiaGhot  Y|aNzaNz`c  p-jkªt (
p-j‘nâgp|dunzkY m nbcd#&t (+h¢j\aucducetMaauYducenb_‘gc.h m¢m ce{|hiaNh¢[^p-aNcr_ktNc(Y|v
gducen`h¥aÛgp|dunkt€]‘p-dNaNhog_ m p-d m }ì§zkcj ] m p\tPauh¢gÏhot^]`duc¤³p m cj„a^hij
aNYbn`p“} ( th¢jkgducep\tMh¢j`{ m }8c m cegÍaudNY\j`hogtMYbgh¢caP}\íXZzkp|tNc ~ p|j`zkp-aMé
aup|j Gp|j`ª.]kdNY³¤honbcen(_kt
§hiaNz>pn`p-auptNca
aNz‘p³a´gY\j„aup-h¢jkt7zkp m v
p[^h mim h¢Y|jaudup|jktup|gÍauhiY\jktxvêdNY\[ ‡y† -… auY … -…|ü €“p  Y\_ba ƒ|† Y|v
§z`hog#zp-duc
vêd#p-_knb_ m cej\aGõ aNzkcZducep m nbhotPaudNh  _bauhiY\jh¢tx[._kg#z[^Y\dNc
tNª|c§GcenÏõ " ú aNz`c ƒ|† ï † nbhotPaudNh  _bauhiY\jrhot7§zkp-a§Zc
§GcducŸ{\hi¤\cjÏp³v aNcedaNzkc  p-j`ª ( tGð m aNcduh¢j`{ ú í
aNd#p-¡ j‘_`tNp\cGgÍauaNYh¢Y|aujz`cp-j‘nbn,h +Y-cedNaNcezkj\cadnbv×p\Y gÍmimaNp-Y\d7dutep-€[^aNzkY\c._`j„ga3Y„Y|tPav‘ceY|p\v3g#v×z(p|h gm h¢dNj`cy{^nbh¥aNa
Ygp|n`ducn é
aNcygÍa^nbh «cducj„avêd#p-_‘nb_ m cj„a.audup|jktNp\gÍauhiY\jkthotj`Y|aaNz`cÏtNp|[^c|í
cejkgc§Gcnbcð‘j`c|ï
Overhead = 25
Overhead = 50
Overhead = 75
Overhead = 100
Overhead = 125
Overhead = 150
60
50
40
30
20
l ¢h {|_kdNc ‡ ïxwxd#p-h¢j`h¢j`{BnbhotMaNduh  _`aNh¢Y|j¤btíxaNz`cGgducenbhia3gep-d#nvêdup|_kn
gY\tMa[^Yn`c m
10
20
30
40
50
60
70
Distribution of minority class (%)
80
90
[rYbnbc m í + c8_ktMcÏn`p³a#pvêduY|[ùaNz`cðkdutMa ‡y† [^Y|j„aNz‘tõ ‡y†-…
é "¬ -…|ü\ú vêY\d
aNd#p-h¢j`h¢j`{p-j‘nraNz`c ‡yƒ auz^[rY\j„aNzCõ …J³…\ü\ú vêY|daNcetMaMé
hij`{‘í.qsjUY|d#nbcdaNY¤³p-du}aNzkc(vêd#p-_‘nânbhotPaudNh  _bauhiY\jâvêduY|[ ‡e†
aNY …|†
vêY\dÐcep|g#zJ[^Y|j„aNz5€x§Zc m hi[^hiaŸauz`c>tMh¢ýc^Y|v´aNzkc(audup|hij`é
hij`{tNcautauY ü € %„†|† audup|jktup|gÍauhiY\jkte€‘§z`hog#zèp-duc(tup-[^] m cenCd#p-j`é
nbY|[ m }C§h¥auz`Y|_`adNce] m p\gce[rcej„aeí l Y|_kd m cyp-duj`hijk{Ïp m {\Y|duh¥auz`[>t
‡eõ X … qP %ø´…\í øZ úNúû õ §G c_`duõ h¢XZcj Y\m_‘p-z`tMj cycn8j ‡e…|h¢‡ej…\…|‚\… Y|ú |_`€Gú d€+XG&c p|Tò
bjk]‘7‘n cewDdN:h¢[^ò3õ Gc¨Ÿj„dNûGceautehif [>í õp-X j m p-&du ª"÷ ,# ¦ ‡eh … ` m c%„aMú a €
w:z`cducetN_ m autZp-ducG] m Y|aMaNcyn>h¢j l h¢{|_kdNc ‡ õ nb_`cauY.tM]‘p|gc m h¢[(é
h¥a#p³aNh¢Y|j‘t€3Y|j m }UdNcytM_ m autvêdNY\[X % í p-ductMzkY³§j auz`cÛY|aNz`ced
p m {|Y|duhiaNz`[>t  czkp“¤\câtNhi[^h m p|d m } ú í<ûZp|g#z n`p-aupì]+Y|h¢j„a8hot8p|j
p“¤|cd#p-{\cJY|v ‡e† g m p\tNtNhiðkcd#t€.cep|g#z Y|vÛ§z`hog#z h¢tJ{|cej`cd#p³aucen
vêdNY\[ pJtNc]kp|dup-aNc8[rY\j„aNz5í û´p|g#z g_`du¤|c8dNce]`ducetNcj„aut^pUnbh¥v é
vêcducj„aZp-[^Y\_`j„aZY-v²Y³¤\cduz`cep\n²í l dup|_kn>hotauz`cB[^h¢j`Y|duh¥aP}^g m p|tuteí
òBtÐc b]+cegaNcen5€5aNzkc m p-du{|cedÐY³¤|cduz`cyp|n m cep\n`tŸaNYz`h¢{|z`cedgY\tMaeí
~ Y|duch¢[r]+Y|dNaup|j„a m }|€+§Zc(Y  tNcdu¤|cauzkp³aŸ§z`cjâaNz`c(Y³¤|cedNz`cyp|n
h¢ttN[>p m¢m cede€bauz`cgY„tPa[^h¢j`h¢[rh¢ýcytp³aBp m p-du{|cedG]+cd#gcej„aup-{\cÐY-v
vêdup|_knb_ m cj„aGaNd#p-jktup|gaNh¢Y|jktÐõê[^h¢j`Y|duhiaP}g m p|tut ú h¢jauz`cÐaNd#p-h¢j`h¢j`{
tMcaeí + z`cj8aNzkcY³¤\cduz`cep\n^h¢t:tN[^p mim cdy€„aNz`c  p|j`ªÛgp|j8p «Y|d#n
aNYâtNcjknp m p|dN{\cdj_`[  ced.Y|vaNd#p-jktup|gaNh¢Y|jktÐvêY\d.h¢j¤|cetMaNh¢{\p-é
aNh¢Y|j5íÐw:zkp³aÐhot€+aNzkc  p|j`ªgp|jaNY m cedup-aNc.[^Y\dNcv×p m tNcésp m p-du[>t
õ×pÏz`h¢{|z`cedÐv×p m tMcé ]+Y\tNh¥auhi¤\c(d#p³auc ú p|jknJp|hi[ vêY|dvêce§Zced[rhotutMcyt
õ×p m Y³§Zcedv×p m tMcé jkc{\p-aNh¢¤|cèd#p³aNc ú €§z`hog#zögp|j  cp|g#z`h¢c¤\cen
 }Ïp m p|dN{\cd:]+cd#gcj„a#p-{|cY|v¾vêd#p-_‘nb_ m cj„aaNd#p-jktup|gaNh¢Y|jktõ×]‘Y„tPé
h¥auhi¤\c ( t ú íXZY\j¤|cd#tNc m }|€bhiv
aNz`cY³¤\cduz`cep\nhot m p-du{|cede€`aNz`c  p-j`ª
tMz`Y\_ m nrp|hi[<vêY|d´vêc§Gcd´v×p m tMcéÒp m p|dN[>tõ×p m Y³§Gcd l øèd#p³auc ú p|jkn
aNY m cd#p³auc[^Y|duc[^h¢tutMcyt.õ pÛz`h¢{|z`ced l7¦ d#p³auc ú €‘§z`hog#zCgp|j  c
Y  a#p-h¢j`cen  }èpâtN[^p mim cd(]‘cedugcj„aup|{|c>Y|v]‘Y„tMhiaNh¢¤|c ( teíõ ¦ Y-auc
aNzkp-ae€«p³atNY|[^c]+Y|h¢j„ae€‘aNz`c(Y³¤|cduz`cyp|nÏgp-j  c m p-du{|ccej`Y|_k{|z
[^p|ªhij`{(vêd#p-_knnbcaNcegaNh¢Y|jÏcegY|j`Y\[rhogp mim }Û_`j‘nbcetNhid#p km c\í ú
w:z`cBaNcytPa:tMcaŸõ vêduY|[ J… ³…\ü\ú zkp\t %„† € †|‚ Ÿaudup|jktup|gÍauhiY\jktp|jkn
‡“¬ í Y|vxauz`c[!p-ducvêd#p-_‘nb_ m cj„aeí7qÒv3vêdup|_kn8n`caNcygÍauhiY\jÏhot:j`Y|a
p“¤“p|h m p km c\€-Y|jraNzkcBp“¤|cedup|{|c|€ ’ ‚|ü í …\ü hot m Y\tMa´]‘ced
aNd#p-j‘tNp\gÍaNh¢Y|jxí
w¾p `m c ‡ tNz`Y³§tZaNz`c[>p h¢[._k[Rtup“¤„h¢j`{„tZY|v3cyp|g#zp m {|Y\dNhiaNz`[
§h¥auzâauz`c^[rY„tPa&c +cygÍaNh¢¤|crvêd#p-_knJ]+cd#gcj„a#p-{|crnb_`duhijk{8audup|hij`é
hij`{‘”
í “•!–h¢tÛaNz`cJnbY m¢m p|dut m Y\tMa]+cd>audup|jktup|gÍauhiY\!j p-G—˜
nbcj`Y|aNcytauz`c8[^Y„tParc «cegÍauhi¤\cÛvêd#p-_kn]‘cedugcj„aup|{|c>vêY\d.audup|hij`é
hij`{ ™˜™–&!šp—^dNce]`ducetNcj„autaNzkcÛ]‘cedugcj„aup|{|crY-vtNp“¤h¢j`{\tvêduY|[
aNz`c^p“¤|cedup|{|c m Y\tutBY|`v ’ ‚\ü í …|ü œ›"–&!š,—rtNz`Y³§tBaNz`craNY|aup m n`Y m é
í :ò3¨ÐûZfñ]+cdNvêY|du[^cen
m p|dutÛtup“¤|cynvêY|dÛauz`câ[^Y\j\auzóõ J… ³…\ü\ú 
dNc m p-aNh¢¤|c m }^]‘YY\dõê§GcÐtN_ktN]‘cygÍa:aNzkc§Gp“}^§GcÐp|dNcaNducep-aNh¢j`{>p³aNé
aNduh  _`aNcet§hiaNzUdNcyp m ¤³p m _`cytŸhižj Gò3¨ÐûZfhotŸj`Y-ap-]k]`dNY\]`duh¢p-aNc
vêY|d²auz`c
vêd#p-_knÐnbY\[^p|hij ú p-jknŸhot5&c bg m _‘nbcenŸvêduY|[©aNz`c
vêY mim Y³§h¢j`{
nbh¢tug_‘tNtNhiY\j5í7XZY\jktNh¢nbcedNh¢j`{ŸaNzkcBp-[^Y|_kj\a
Y|v+Y³¤\cduz`cep\nd#p-j`{\cen
!" $#
%21 # % !9;:
9=<?>@>@A@9
C !EDFA'G
w3p km c ‡ Zï XZY„tPap|jkn8tup“¤hijk{(h¢jÏaNz`cgdNcynbh¥aBgep-d#n>vêd#p-_knnbY\[>p-h¢j
% &(*)
'
34# 5
3 # 5
3 # 7
4# 34
+,-/.
.0(
.
4.
.
11 .
.
14.
4.
.
(
36
716
7436
7B6
% &(*)
'
37# 55
34# 71
31 # 34
4# BB
A 20:80 set
l ih {\_`duc ƒ ïIHŸcj`cedup-aNh¢j`{UvêY|_`d | † ï -† n`p³a#pUtN_  tNca#t^vêduY|[p
ƒ-† ï † nkp³aup^tNca
Four 50:50 subsets
vêduY|[ ’ |† aNYh’ ‡y†|† €-aNzkc m cep|dNj`h¢j`{rp m {|Y|duhiaNz`[>t§GcŸ_ktMcyn>{|cejbé
cd#p m¢m }p|g#zkhice¤|cenÐp-a m cyp|tMa ƒ-†J
h¢jtNp“¤h¢j`{\t«Y\dxp³a m cyp|tMa ’ ‚\†|† ÿ^í
+ hiaNzCp-jY³¤\cduz`cep\nÛY-v’ ¬" Y|d m cetut€kp-a m cyp|tMazkp m vpr[rh m¢m h¢Y|j
nbY mim p-d#tÐhijìtup“¤hij`{„tÐgp-j  cÛp³aNaup-h¢j`cyn²í ~ Y\dNc^h¢[r]+Y|dNaup|j„a m }|€
[>p bh¢[._`[ tup“¤hijk{\tZ§ZcedNcp|g#zkhice¤|cen ¬ Y\_baY-v … auhi[^cyt:§z`cj
aNzkc.vêd#p-_knâ]‘cedugcj„aup|{|c_‘tMcynCh¢jCaNd#p-h¢j`h¢j`{hot -J† €«§z`hog#zâhot
j`Y|aaNz`c Njkp³au_`dup m ƒ-J† hijÏauz`cY|duhi{\hij‘p m n`p³a#p^tMcaeí
qsj tN_`[^[>p-du}|€  p\tMcyn Y|jY|_`d^ce[r]khiduh¢gep m ducetN_ m a#trhijaNz`hot
tMaN_knb}\€§ZcY  tNcdu¤|c:auzkp³aG¤“p|dN}h¢j`{auz`cBaudup|hijkhij`{(g m p|tut´nbhotPaudNhié
 _bauhiY\j p «cegautÐauz`cÛgY„tPa]+cdNvêY|du[>p-jkgc|í8fh¢jkgc>aNz`c Njkp³au_bé
d#p m 8nbhotMaNduh  _`aNh¢Y|jUh¢t ƒ-† ï † €²Y\j`c(§:p“}aNYp|g#zkhice¤|c(aNz`c Nn`cé
tNhiduce'n -† ï |† nbhotMaNduh  _`aNh¢Y|jèh¢tŸauYhi{\j`Y|duc "¬ Y|v´aNzkc m ce{|hiaMé
h¢[^p-aNc(aNd#p-jktup|gaNh¢Y|jkt(õêY\d ü\† Y-vZp mim auz`c.audup|jktup|gÍauhiY\jkt ú €«p|t
§GcBnbhonÛh¢j>aNz`cc b]+cduhi[^cj„a#tZp  Y³¤\c|í¾w:zkcvêY m¢m Y³§hij`{(tMcygÍaNh¢Y|j
nbhotNg_ktutMcyt´p-j8p-]`]`duY\p\g#zraNzkp-aZ_bauh m hiýecetGp m¢m auz`cnkp³aup(p-jknÛhi[ré
]`duY³¤|cytGgY\tMa]‘cedMvêY\dN[>p-j‘gcÐp-jkntugp m p  h m h¥aP}\í
JLK åLs™`NK M³æ²LPV ‰J‰„8K Oœ5› K œ²™bP
V M“LPœxV3›‘WBKMTW ‹
J OBO›`šV
ækI!™bR
š Q©š´SW M“åWBKP #šU› T eK ‰\™b›keK å™`KMš´TW ‰
òBtC§Zc nbhotug_ktutMcynžcep-d m hicede€Ð_ktNhijk{ñaNz`cìjkp-aN_`d#p m g m p|tutnbh¢tMé
aNduh  _baNh¢Y|jì[^h¢{|z„a.j`Y|a.}hic m nìaNz`cÛ[^Y„tPa.&c +cygÍauhi¤\cg m p|tutMhiðkcedut
õê]‘p-dNaNhog_ m p-d m }è§z`cej auz`cÏn`h¢tMaNduh  _baNh¢Y|j h¢trz`h¢{|z m }ìtNª|c§Gcen ú í
HŸh¢¤|cjñpìtNª|c§GcennbhotPaudNh  _bauhiY\j5€:§Zc§GY|_ m n m h¢ª|cÏaNYì{\cj`cedMé
p³aucGaNz`cnbcytMh¢dNcyn(n`h¢tMaNduh  _baNh¢Y|jr§h¥auz`Y|_`a7duc[^Y³¤h¢j`{Ÿp|j}n`p³a#p`í
î_`d´p|]`]`duY\p\g#z(hot
auY.gducep-aNcn`p-auptN_  tNcaut´§h¥auz^aNz`cnbcetNhiducen
nbhotPaudNh  _bauhiY\j5€x{\cj`cedup-aNcrg m p|tutMhiðkcd#tvêdNY\[áaNzkcÛtM_  tMcaute€xp-jkn
h¢j\auc{\dup-aNcraNz`ce[  } m cyp-duj`h¢j`{ìõê[^ca#p³é m cyp-duj`hijk{ ú vêdNY\[Dauz`ch¢d
g m p|tutNh¥ð‘gep³auhiY\j  czkp“¤h¢Y|dyí
qsjY|_`dvêd#p-_‘n8nbY\[>p-h¢j5€baNzkcjkp³au_bé
d#p m tMª\c§GcenCnbhotMaNduh  _`aNh¢Y|jâhot ƒ-† ï † p-jknaNz`c>nbcytMh¢dNcynCnbhotPaudNhié
 _bauhiY\jèh¢t |† ï -† í + c>dup|jknbY\[ m }ânbh¢¤h¢n`c^aNz`c>[>p PY\dNhiaP}Ch¢jbé
tMaup-j‘gcetZh¢j\auY % ]kp|dMauh¥auhiY\jkt:p-jkn % n`p-auprtM_  tMcaut:p-ducvêY\dN[^cen
 }J[^cedN{\hij`{CaNz`c8[rh¢j`Y\dNhiaP}Jh¢jktMaup|jkgcyt§hiaNz cyp|g#zìY-v:auz`c %
]kp|dMauh¥auhiY\jktgY\j„aup-h¢j`h¢j`{[>p PY|duhiaP}Chij‘tPa#p-jkgceteí8w:zkp-ah¢te€xauz`c
[^hijkY|duh¥aP}8hijktMaup|jkgcytBp|dNcduc] m hogp³aucenp|gdNY„tNt % nkp³auptM_  tMcaut
aNY({|cej`cd#p³aucaNzkcŸnbcytMh¢ducen |† ï -† nbhotPaudNh  _bauhiY\j5í l hi{\_`duc ƒ n`cé
]`hogÍa#t:aNz`hot]`duYbgcytNteí
l Y|du[>p m¢m }\€ m c?a @  cJaNz`cUtMh¢ýcJY-vaNzkcUn`p-aup tNcaϧh¥auz p
nbhotPaudNh  _bauhiY\j^Y-v Vï W8õ V>h¢t7auz`c]+cd#gcj„a#p-{|cGY-v+aNzkc[rh¢j`Y\dNhiaP}
g m p|tut ú p-jkYn X"ï C  c´aNz`cGnbcetNhiducen.nbh¢tMaNduh  _baNh¢Y|jxí¾w:z`cZj„_k[  cd
Y-v«[^hijkY|duh¥aP}h¢jktMaup-j‘gcet7hot @[Z\VÛp|jkn.aNz`cnbcytMh¢ducen(j„_k[  cdY|v
[>p PY\dNhiaP}h¢jktMaup-j‘gceth¢jâpÛtN_  tNcaho™t @FV]Z_^ íw:z`c(j„_k[  cd
Y-v´tN_  tNca#tŸh¢tBaNz`crj_`[  cdŸY-vZ[^p PY|duh¥aP}Ïh¢jk` tPa#p-jkgcetr>õ @aZbW ú
+,-/.
.0(
4.
3.
.
47.
.
41 .
3.
4.
(
116
416
6
4B6
% &(*)
'
35# 17
37# 37# 4
47# 5
+,-/.
.0(
4.
34.
.
4.
.
35.
3.
.
(
41 86
146
1B6
6
nbhi¤honbcen  } auz`cJj_`[  ced8Y|v(nbcytMh¢dNcynô[>p PY\dNhiaP}h¢jktMaup|jkgcyt
ih jñcep\g#z tN_  tNcay€:§z`h¢g#zñhotdgcfhe i Y|dkle Zm`^ í<õ + z`cjôhiaÛh¢t
j`Y-apr§z`Y m cj_`[  cede€b§Gcaup-ª\j cBauz`cgceh m hijk{Ïõ/n el Z `^@o ú p|jkn
dNce] m hogp-aNctNY|[^c8[^pPY|duh¥aP}Uh¢jktPa#p-jkgcet.aNYJcjktN_`ducp m¢m Y|vaNzkc
[^p PY|duh¥aP}h¢jktMaup|jkgcyt
p-ducGh¢jraNz`ctM_  tMcauteí ú w:zkp³ahot€\§Zc:zkp“¤\c
e Z ` tN_  tNca#t€cyp|g#zÛY|v5§z`h¢g#zzkp|a
t @FV8[^h¢j`Y|duhiaP}rh¢jktMaup|jkgcyt
p-l jkn ^ c `l/^ [>p PY\dNhiaP}>h¢jktPa#p-jkgceteí
w:z`c.j`c atPauc]ChotauY8p-]k] m }p m cep|dNjkhij`{8p m {|Y|duhiaNz`[õ×t ú auY
cep|g#zY-vxauz`ctM_  tMcauteífhij‘gcŸaNz`cÐtN_  tNcautp|dNchij‘nbc]+cjkn`cj„ae€
aNz`c m cep-duj`h¢j`{B]kdNYbgcytNt¾vêY\d3cyp|g#zrtM_  tMca
gep-j  c:du_`j(h¢jr]kp-d#p m é
m c m Y|jnb,h «cducj„ax]`duYbgcetutNY|d#tí l Y|d5[>p|tutNhi¤\cp-[^Y|_`j„a#t5Y-v`n`p-aupk€
tM_  tPa#p-j„aNhop m h¢[^]`dNY³¤\c[^cj„ah¢jìtM]+ccynìgp-j  cp|g#zkhice¤|cenJvêY\d
tM_`]+cdNé m h¢j`cep|dMé aNh¢[^c m cep|dNjkhij`{^p m {|Y\dNhiaNzk[^teí
w:z`câ{|cjkcd#p³aNcynôg m p|tutMhiðkcedutÛp|dNcJgY|[  h¢j`cen  } m cyp-duj`h¢j`{
õê[^ca#p³é m cyp-duj`hijk{ ú vêduY|[aNzkch¢d:g m p\tNtNhið‘gp-aNh¢Y|j  czkp“¤h¢Y|dyí3fce¤\é
cd#p m [^ca#p³é m cyp-duj`hijk{ÛtPaudup-aNc{\hicytp-ducnbcetugduh  cyn8h¢jõÒXZzkp-j÷
f„aNY m vêY ‡e…|…\‚\ú íJw¾YJtNhi[^] m h¥vê}ìY\_`d(n`h¢tug_ktutNhiY\j5€
§Zc8Y|j m }ìnbcé
tNgdNh  caNz`bc p"$4–p– qp,rts
u6.õ×Y|td – fpvu6;wÏõ + Y m ]‘cedMa ‡e…\…\ƒ|úNú
tPaudup-aNc{\}|íìqsjaNz`hot>tPaudup-aNce{|}ìpâ[^caup³é m c¤|c m aNd#p-h¢j`hijk{UtNca^h¢t
gY|[^]+Y\tNcen  }r_ktMh¢j`{auz`c(õ  p|tNc ú g m p|tutMhiðkcedut (-]`ducenbhogÍauhiY\jktY\j
p¤³p m h¢n`p-aNh¢Y|j.tNca7p|t¾p³aMaudNh  _baucZ¤³p m _`cytxp|jknÐaNzkcGp\gÍaN_‘p m g m p\tNtNhié
ð‘gp-aNh¢Y|j^p|t¾aNz`cg m p\tNt m p  c m í7w:z`h¢t3audup|hijkhij`{tNcahot3aNz`cej^_ktMcyn
aNYaNd#p-h¢jrp[^caup-éÒg m p\tNtNhiðkcdyí l Y\d7hij„aNce{|d#p³auhij`{ÐtN_  tNcaute€-g m p|tutMé
gY|[  h¢j`cdgep-j  cÛ[^Y|ducr&c +cygÍauhi¤\c>aNzkp|jèaNz`c¤|Y-auhijk{-é  p|tNcen
aNceg#zkj`h þ _`cytõ XZzkp|j÷<f„auY m vêY ‡y…|… |ú í
xzy|{~}U€N‚_}ƒ0„f…†‡ƒˆŠ‰‹}U…EŒŽ„f…
wxYce¤³p m _kp³aucY|_`dZ[._ m aNhiéÒg m p\tNtNhiðkcd[^caup³é m cep-duj`h¢j`{p-]k]`dNY„p|g#z
aNYÐtMª\c§Gceng m p\tNt3nbhotPaudNh  _bauhiY\jkt€³§GcG_ktMcynaudup|jktNp\gÍauhiY\jkt²vêduY|[
aNz`cGðkd#tPa Ÿ[^Y|j„auzktõ ‡y†³…t-…|ü„ú vêY\d7aNd#p-h¢j`hijk{k€³auz`cj`h¢j\auz
[rY\j„aNz õ Jü ³…|ü„ú vêY|dC¤³p m hon`p³auhijk{k€p-j‘nžaNz`cìaP§Gc m v aNz [^Y\j\auz
õ … -…|ü„ú vêY\daNcytPauhij`{öõêaNz`c aP§ZY|é [^Y|j„auz {„p-] h¢tâg#z`Y\tNcj p|gé
gY|d#nbh¢j`{èaNY aNz`cUp-[^Y|_`j„aÛY|vaNh¢[rcJj`ccynbcen auYgY\[^] m caNc m }
nbcaucdu[rh¢j`cŸaNzkc m ce{|hiaNh¢[^p\g}ÛY|vxaudup|jktNp\gÍauhiY\jkt:p-jkntNhi[(_ m p-aNcyt
dNcyp m7m hivêc ú í Gp\tMcynCY\jâauz`c^c[^]`h¢dNhogp m dNcytM_ m autŸh¢jâauz`c>]`duc¤hié
Y|_kt:tNcegÍauhiY\j5€aNzkcnbcetNhiducen8nbhotPaudNh  _bauhiY\j8hot -† ï |† í
fhij‘gcÐaNzkc
jkp³au_`dup m nbhotPaudNh  _bauhiY\jrhot ƒ|† ï † €“vêY|_`d´tN_  tNca#tp-duc:{|cej`cd#p³aucen
vêdNY\[ cep\g#z[^Y|j„aNzvêY\dBp^aNY|aup m Y-v ‚„ƒ tM_  tMcauteí + c.p|]`] m hicyn
vêY|_`d m cep|dNjkhij`{Jp m {|Y|duhiaNz`[>tÛõÒX % í €XGTò 7wМ€ qPø´ø´aû €xp|jkn
Gò3¨ÐûZf ú aNYÛcyp|g#ztM_  tMcap-j‘n{|cjkcd#p³aNcyn ‡“ƒ  p\tMcg m p\tNtNhié
ðkcd#tPí :ò3¨ŸûGfõ×[rY\dNc^&c +cygÍaNh¢¤|crvêY\d[rcaup-é m cep|dNj`h¢j`{8hijèY|_kd
c b]‘cedNh¢cj‘gc ú §:p|tG_ktNcen8aNY^audup|hij8aNzkc[rcaup-éÒg m p\tNtNh¥ð‘cdyí
cytM_ m a#tGvêdNY\[Rnb,h +cedNcej„ap|[^Y|_`j„aut:Y|v3Y³¤\cduz`cep\np|dNcŸ] m Y-aMé
aNcenChij l h¢{|_kdNc ‚ íÐû´p|g#zJn`p³a#pÛ]+Y|h¢j\aŸh¢tauz`crp“¤\cd#p-{\cŸY|vaNcej
dN_`j‘tx_ktNh¢j`{nb,h «cducj„a3d#p-j‘nbY|[ tNccenktí3wxYÐnbc[^Y\jktPaudup-aNc´aNzkp-a
-† ï -† hot>hij‘nbccyn aNz`cân`cetNhiducenñnbhotPaudNh  _bauhiY\j5€:§ZcCp m tNYè]‘cedMé
vêY|du[rcynÏc b]‘cedNh¢[^cj„autY|jY-auz`cdnbh¢tMaNduh  _baNh¢Y|j‘tp-jkn] m Y|aMaNcyn
aNz`cÐducetN_ m a#t:hijÏauz`cÐðk{|_kdNc\í7òtc b]+cegaNcen5€baNz`cgY\tMah¢t:[^h¢j`h¥é
[rh¢ýcynϧz`cjÏaNzkcvêdup|_kn8]‘cedugcj„aup|{|cÐh¢t -† íZfb_`dN]kdNhotMh¢j`{ m }\€
Credit Card Fraud (BAYES)
Credit Card Fraud (BAYES)
70
Overhead = 25
Overhead = 50
Overhead = 75
Overhead = 100
Overhead = 125
Overhead = 150
60
50
Average Aggregate Cost ($)
Average Aggregate Cost ($)
70
40
30
20
Overhead = 25
Overhead = 50
Overhead = 75
Overhead = 100
Overhead = 125
Overhead = 150
60
50
40
30
20
l ih {\_`duc ‚ ïâw¾dup|hij`h¢j`{ìnbhotPaudNh  _bauhiY\jñ¤teí©gY\tMa^_‘tMh¢j`{ì[^ca#p³é
m cep-duj`h¢j`{
l h¢{|_kdNc % ï ¡ hotPaudNh  _bauhiY\jJh¢jU¤“p m hon`p-aNh¢Y|jètMcaŸ¤bteí(gY„tPaÐ_ktNhijk{
[rcaup-é m cep|dNj`h¢j`{
-J† hot:aNz`c(nbcetNhiducenÏnbhotPaudNh  _bauhiY\jÏvêY|dBp|j„}Y-v3aNz`cY³¤\cduz`cep\n
-p [^Y\_`j„aeí¾w:zkh¢txh¢t¾nbh «cducj„a5vêduY|[ aNzkc´ducetN_ m a#t5Y  aup|hij`cynŸvêdNY\[
]`duc¤h¢Y|_ktxc
b]‘cedNh¢[^cj„aut3§z`cej[^ca#p³é m cyp-duj`hijk{§Gp\txjkY-a7_ktMcyn²í
l _`dNaNz`cedN[^Y\dNc\€|auY.h¢j„¤\cetMaNh¢{\p-aNchivxY|_kdGp|]`]`duY\p|g#z^hot´h¢jknbcecen
vêdu_`h¥aNvê_ m €y§Gcd#p-jÐc b]+cduhi[^cej\a#t²Y|jŸauz`c´g m p|tutMéÒgY|[  hij`ced²tPaudup-aMé
c{\}Cnbh¢dNcygÍa m }âp|]`] m hicynaNYÏauz`c^Y|duhi{\hijkp m nkp³aupÏtNcautŸvêduY|[4auz`c
ðkd#tPœa [^Y|j„aNzktZõêh í c\íi€yauz`c}Ÿzkp“¤|c7auz`c´j‘p³aN_kdup m\ƒ-† ï † nbh¢tMaNduh  _bé
aNh¢Y|j ú í + cp m tNYÐc¤³p m _kp³auc:z`Y³§ h¢jknbh¢¤„honb_kp m g m p|tutNh¥ðkcedut3{\cj`cedMé
p³aucenŸvêduY|[ cep|g#zÐ[^Y|j„auz]‘cedMvêY\dN[ §h¥auz`Y|_ba7g m p|tutPésgY\[  h¢j`h¢j`{kí
w3p `m c ƒ tNz`Y³§t3aNz`cgY\tMa´p-j‘n>tNp“¤h¢j`{\t3vêduY|[g m p|tutPésgY\[  h¢j`cd
_ktNhijk{aNz`c -† ï |† nbh¢tMaNduh  _baNh¢Y|j õ ‡yƒ  p\tMcg m p\tNtNhiðkcd#t ú €xauz`c
p“¤|cedup|{|cŸY-v
h¢jknbh¢¤„honb_kp m XG™ò 3w g m p\tNtNh¥ð‘cd#t:{|cjkcd#p³aNcynÏ_ktMh¢j`{
aNzkc.nbcetNh¢dNcyn8nbhotMaNduh  _`aNh¢Y|j õ vêduY|[!w¾p `m c ‡yú €‘g m p|tutPésgY\[  h¢j`cd
_ktNhijk{ñaNz`cìjkp-aN_`d#p m nbh¢tMaNduh  _baNh¢Y|j õ ‚\ƒ p|tNc g m p|tutNh¥ðkcedut [^Y|j„aNz‘t Z %Um cyp-duj`hijk{Up m {\Y|duh¥auz`[>t ú €Zp-j‘n auz`cp“¤|cd#p-{\cY|v
h¢jknbh¢¤„honb_kp m g m p\tNtNh¥ð‘cd#t
_ktNhij`{aNz`cjkp³au_`dup m nbhotPaudNh  _bauhiY\jâõ auz`c
p“¤|cedup|{|c(Y-v ‚„ƒ g m p\tNtNhiðkcd#t ú íÏõ + cÛn`h¢nUj`Y|aÐ]+cdNvêY|du[ &c ]+cdNé
h¢[rcej„autŸY|jâtNh¢[r] m }duc] m h¢gep³auhij`{aNz`cr[^hijkY|duh¥aP}h¢jktPa#p-jkgcetBaNY
p|g#zkhice¤|c -† ï |† h¢jôY|jkcCtMh¢j`{ m cCn`p-aupìtNca  cegep-_ktNcaNz`hotp|]bé
]`duY\p\g#zh¢jkgducep\tMcyt´auz`cÐaNd#p-h¢j`h¢j`{^tMcaBtMh¢ýcp-j‘nhotj`Y|ap|]`]`duY-é
]`duh¢p-aNc^h¢jUnbY\[>p-h¢jktЧh¥auz m p|dN{\crp|[rY\_`j„autŸY-v:n`p³a#p Y|j`c^Y|v
aNzkcBauz`dNcec]kdNh¢[>p-du}(hotNtN_`cyt´§GcBaudN}rauYrp\n`nbducetutz`cedNc\í ú XZY|[ré
]kp|dNcynâauYaNz`cY-aNzkcdauz`dNcecÛ[^cauz`Ybn`t€7g m p|tutMéÒgY|[  hij`h¢j`{Y|j
tN_  tNcaut:§hiaNzp -† ï -† vêdup|_knÏnbh¢tMaNduh  _baNh¢Y|jg m cep|d m }>p|g#z`h¢c¤\cet
p tNhi{\j`hið‘gp|j\aCh¢jkgdNcyp|tNcìhijótup“¤hijk{\t p-a m cep\tPa ’ ‡|‡y† ÿ vêY|d
aNzkcâ[^Y|j„aNzöõ ü -…|ü\ú í + z`cjôauz`câY³¤\cduz`cep\nho?t ’ -† €G[^Y\dNc
aNz‘p-j zkp m vY|vaNz`c m Y„tNtNcet>§GcducC]`duc¤\cj„aNcyn²íóf_`du]`duh¢tNh¢j`{ m }|€
§Gc(p m tNYÛY  tNcdu¤|cÐauzkp³aŸ§z`cjCaNz`crY³¤|cedNz`cyp|nÏho:t ’ -† €+pg m p\tPé
tNh¥ðkcedÛõ utMh¢j`{ m cÛXGTò 7w ú audup|hij`cynCvêduY|[DY|j`c ( tÐ[^Y|j„auzUn`p-aup
§hiaNzauz`c´nbcytMh¢dNcyn -† ï -† n`h¢tMaNduh  _baNh¢Y|jÛõ×{|cjkcd#p³aNcyn  }aNzkdNY³§:é
h¢j`{p“§:p“}tNY|[^cZnkp³aup ú p\g#z`hice¤|cyntMh¢{|j`hið‘gep-j„a m }Ð[rY\dNcZtNp“¤h¢j`{\t
aNz‘p-jgY\[  h¢j`h¢j`{g m p|tutNh¥ðkcedut+audup|hijkcenvêdNY\[ p mim ch¢{|z„a5[^Y|j„aNzkt (
n`p-aupϧh¥auzUaNz`c>jkp-aN_`d#p m nbhotMaNduh  _`aNh¢Y|j5íÛw:z`hotÐducep )>du[>tBauz`c
h¢[r]+Y|dNaup|jkgcY-vxce[^] m Y³}h¢j`{auz`cÐp-]`]`duY|]kdNhop³aucaNd#p-h¢j`h¢j`{(g m p\tNt
nbhotPaudNh  _bauhiY\jhijÏaNzkh¢tnbY\[>p-h¢j5í
¤„h¢Y|_‘t.tNca^Y-vc
b]+cduhi[^cej\a#t ú íìw:z`cÏn`h «cducj„arn`h¢tMaNduh  _baNh¢Y|jkt
p-duc´{|cej`cd#p³aucen  }ª\cc]khij`{Ðp m¢m aNz`cZvêd#p-_knb_ m cej\a7audup|jktNp\gÍauhiY\jkt
p-jkn.dup|jknbY|[ m }tMc m cygÍaNh¢j`{aNz`cgY|dudNcytM]+Y|jkn`hij`{Bj„_k[  cd7Y-v m cé
{|hiaNh¢[^p-aNcaudup|jktup|gÍauhiY\jktõêh í c|í¢€«tNY|[^c m c{\h¥auhi[>p³aucducegY\dunktp-duc
aNz`duY³§j8p“§:p“} ú í
ûZp|g#z8nkp³aup^]+Y|h¢j„ahij l h¢{|_`duc % h¢tp|jp“¤|cd#p-{\cBY|v ‡y† du_`jkt
_ktMh¢j`{nb,h «cducj„aZd#p-jkn`Y|[<tNccyn`tBõêaNz`Y\_`{|z^auz`cBtup-[^cBtNccyn`t´p\t
hij]`duc¤h¢Y|_ktc b]‘cedNh¢[^cj„aut ú íw¾Y>]`duc¤|cej„ap-[^] m h¥vê}h¢j`{ÛtN[^p mim
nbh «cducj‘gcet:_kj`j`cegcetutNp|dNh m }|€b§GcŸ_‘tMcÐauz`ctNp|[^cÐtugp m cÐh¢j l hi{|é
_`dNc % p|tGh¢jauz`cY-auz`cdtNhi[^h m p|dZð‘{|_`duceteí
£j`&c ]+cegaNcyn m }\€baNzkc
g_`du¤|cyt´p-duc _`hiaNc ‘p-aeí
w:zkp-aGhot€bg#zkp|j`{|h¢j`{.aNz`cÐg m p|tut:nbh¢tMaNduhié
 _baNh¢Y|jÏh¢jauþz`cФ“p m hon`p-aNh¢Y|j8tNcanbYcytZjkY-atMcec[1auY^p+cygÍa:aNzkc
gY\tMa]‘cedMvêY\dN[>p|jkgc^õ×p>tN_  PcygÍaY-v3vê_`dNaNz`cedhij¤|cytPauhi{„p³auhiY\j ú í
w3p `m c ‚ zkp|t8auz`cUtup-[^câvêY|du[^p-aÏp\tauz`cU]`dNce¤hiY\_kt8gY\tMa
p-jkn8tNp“¤h¢j`{\t´aup `m cyt€  _ba:aNz`mc p-G—˜©gY m _`[^jkt:nbcj`Y|aNcŸaNzkc
vêdup|_kn ]+cd#gcej\a#p-{\c8h¢jauz`c¤³p m h¢n`p-aNh¢Y|j tMcaeíñw:z`cÏðkdutMa^dNY³§
tMz`Y³§t3auz`cducetN_ m a#t7vêduY|[<g m p\tNtMésgY|[  h¢j`cd7_ktNhijk{ÐaNz`cj‘p³aN_kdup m
nbh¢tMaNduh  _baNh¢Y|jUh¢jâauz`c>¤³p m h¢n`p-aNh¢Y|jètMcaÛõ vêduY|[Dw3p `m c ƒ|ú í^w:zkc
tMcygY|j‘nñdNY³§!zkp|tÛaNz`c m Y³§GcetMa8gY\tMa]‘cedMvêY\dN[>p|jkgcCp|jknñaNzkc
gY|duducetN]‘Y\jknbh¢j`{Uvêdup|_knñ]‘cedugcj„aup|{|ch¢jôaNz`c⤓p m hon`p-aNh¢Y|j tNcaeí
w:z`cgY\tMa:h¢t:[^h¢j`hi[^h¢ýcynÏp-ap-duY|_`jkn -J† õ aNzkcnbh «cducj‘gcÐh¢t
j`c{ m h¢{|h `m cZp-[^Y\j`{nb,h «cducj„a7n`h¢tMaNduh  _baNh¢Y|jkt:õ l h¢{|_kdNc %„úNú €  _ba
h¥ahot:j`Y-a[._‘g#zÏnb,h «cducj„a:vêdNY\[ aNz`cÐ]+cdNvêY|du[>p-jkgcY  aup|hij`cyn
vêdNY\[<auz`cÐjkp³au_`d#p m nbh¢tMaNduh  _baNh¢Y|jxí ¦ Y-aucBauzkp³ap |† ï -† nbh¢tMaNduhié
 _baNh¢Y|j>§:p|t´Y  a#p-h¢j`cen  }raNzkdNY³§h¢j`{p“§:p“} ü|J† Y|v²aNz`cŸn`p³a#p
vêdNY\[ auz`cUjkp³au_`dup mŸƒ|† ï † nbhotMaNduh  _`aNh¢Y|j©h¢j auz`cU¤“p m hon`p-aNh¢Y|j
tMcaeíBw:zkp-ahot€«gY\[^]kp-d#p `m c]+cdNvêY|du[>p-jkgc.gp|j  crp|g#z`h¢c¤\cen
§h¥auz m cytNtrn`p-aupCh¢j auz`c¤³p m hon`p³auhiY\jtNcae€
§zkh¢g#zh¢t(]kp-dNaNhog_`é
m p|d m }  cej`cð+ghop m h¢jJauz`hotnbY|[>p-h¢jJaNzkp-aÐz‘p|t m p-du{|c^p-[^Y|_`j„a#t
Y-v3nkp³aupkí
TJš´Wæ²LMåäBKMTW ‹ ñ‡œ TV7› m‰
w:z`h¢ttMaN_kn`}©nbc[^Y\jktPaudup-aNcytauzkp³aauz`cUaNd#p-h¢j`hijk{ñg m p\tNtÏnbhotPé
aNduh  _`aNh¢Y|jñp «cegÍa#t^aNzkc]‘cedMvêY\dN[>p-j‘gcY-vŸaNz`c m cep|dNjkcen g m p|tMé
tMhiðkcd#tìp-j‘nöauz`c jkp-aN_`d#p m nbhotMaNduh  _`aNh¢Y|j gp|j  c nb,h +cedNcej„a
vêdNY\[Dauz`c8nbcytMh¢ducenUaNd#p-h¢j`h¢j`{Jn`h¢tMaNduh  _baNh¢Y|jìauzkp³ar[>p bhi[^h¢ýcyt
]‘cedMvêY\dN[>p-j‘gc|í ~ Y|ducY³¤\cdy€«Y|_`dce[r]khiduh¢gep m ducetN_ m a#tÐhij‘nbh¢gep³auc
aNzkp-a.Y|_`d([._ m aNhiésg m p|tutMhiðkcd.[rcaup-é m cep|dNj`h¢j`{Cp|]`]`duY\p|g#zU_ktNhijk{
p -† ï -† nbhotMaNduh  _`aNh¢Y|j>h¢j^aNz`cŸn`p³a#ptM_  tMcaut
vêY\d
aNd#p-h¢j`h¢j`{gp|j
tMh¢{|j`hið‘gep-j„a m }ìdNcynb_kgcauz`cCp-[^Y|_kj\a>Y|v m Y\tutrn`_`cÏaNYèh m¢m c{|hiaMé
hi[>p³auc>aNd#p-j‘tNp\gÍaNh¢Y|j‘tíCw:z`cÏtM_  tMcaut(p-ducÛhij‘nbc]+cjkn`cj„arp|jkn
gp-j  c]kdNYbgcytNtNcenhij]kp|dup mim c m í7wxd#p-h¢j`h¢j`{raNh¢[rcgep-j8vê_`dMauz`cd
 cJdNcynb_kgcyn  } p m tMY_ktMh¢j`{ p -† ï |† nbhotPaudNh  _bauhiY\j©h¢j aNzkc
¤“p m hon`p-aNh¢Y|j8tNca§hiaNz`Y\_banbc{\dup\nbh¢j`{auz`cgY„tPa:]‘cedMvêY\dN[>p|jkgc\í
w:zkp³aÐh¢te€«aNzkh¢tÐp-]k]`dNY„p|g#z]`duY³¤h¢n`cetŸp[^cep|jktBvêY|dÐc )Ûgh¢cj„a m }
10
20
30
40
50
60
70
Distribution of minority class (%)
80
 † ……]ˆ€ … „f€Œ „E€PƒR€Nƒm„ }†P € ˆ†F„E€PƒŠ…}U„
90
w:z_kt²v×p|dx§Gczkp“¤\cgY|j‘gcj„audup-aNcenŸY\jaNz`cZg m p|tutxnbhotPaudNh  _bauhiY\jkt
h¢j(audup|hijkhij`{aNzkc  p|tNcg m p|tutMhiðkcd#teí + cGz}]+Y-aNzkcetNhiýecZauzkp³a
auz`c
g m p|tutnbhotPaudNh  _bauhiY\jìhijUauz`cÛ¤³p m h¢nkp³aNh¢Y|jìtNcaõ p-jknèz`cejkgc^auz`c
[^ca#p³é m ce¤|c m audup|hijkhij`{>tNca ú p«cegautGaNzkcY³¤|cedup mim ]+cdNvêY|du[^p|jkgc
Y-v`[^caup³é m cep-duj`h¢j`{kí¾wxYhij¤|cytPauhi{„p³auc
aNzkp-a3z}]+Y-aNzkcetNh¢te€³hijaNz`hot
tNcaZY|v²c b]‘cedNh¢[^cj„aute€„§Zc/ð cyn^aNzkcaNd#p-h¢j`h¢j`{.nbhotMaNduh  _`aNh¢Y|jÛY|v
aNzkc  p|tNcg m p|tutMhiðkcd#tZaNY -† ï |† p|jknϤ“p|dNh¢cenaNzkcÐn`h¢tMaNduh  _baNh¢Y|j
Y-vxaNz`cФ³p m h¢nkp³aNh¢Y|jÏtMcaZvêduY|[ ‚\† ï ¬³† aNY ¬³† ï ‚|† õ×p\tZh¢j8aNz`cŸ]`ducé
10
20
30
40
50
60
70
Distribution of minority class (%)
80
90
w3p `m c ƒ Zï XZY„tPap-j‘n8tup“¤hij`{„tG_ktMh¢j`{>[^ca#p³é m cyp-duj`h¢j`{
N)& % " ((& G " P% !9E:
% " ((& )N# ! $ #'( " " (( /
% &()
2
# B7
3$# 5
33 # 7 3 # B
+ -
.
.0(
.
.
.
11 .
)-
"
4B.
)-
"
31 .
(
7 86
716
6
476
% &(*)
'
3 # 34# 71
34# BB
3B# 5
+,-/.
.0(8
.
17.
.
47.
)- "
4.
)- "
3 .
(
776
416
B6
4 6
% &()
2
3# 5
37 # 3 # 3
4$# 3
F 8
+ -
.
.0( .
1 .
.
4 .
)-
"
43.
)-
"
8B.
(
716
146
186
356
w¾p `m c ‚ ´ï XZY\tMaBp-jknÏtNp“¤h¢j`{\tG_ktNh¢j`{>nbh «cducj„a¤³p m hon`p³auhiY\jÏnbhotMaNduh  _`aNh¢Y|jktõ  p|tNcnbhotPaudNh  _bauhiY\j8hot -† ï |†\ú
N)& % " ((&
)N# % " ((& % &()
2
# B7
# 51
+ -
.
.0(
)-
"
.
.
3.
(
7 86
776
% &(*)
'
3 # B# BB
zkp|jkn m hij`{ m cep|dNjkhij`{Ÿa#p|tNªt7§hiaNzÛtNª|ce§Zcyn(g m p\tNt
n`h¢tMaNduh  _baNh¢Y|jkte€
j`Y\jbé _kj`h¥vêY\dN[ gY\tMaG]+cdcedNduY|dy€p-jkn m p|dN{\cp-[^Y\_`j„autGY-v7n`p³a#p`í
¦ Y|a.Y|j m }Jh¢t.Y|_`d[^cauz`Ybnìc)Ûghicej\ay€¾hia.hot.p m tNYtNgep m p `m c^aNY
m p-du{|cdp|[rY\_`j„aut:Y|v3n`p-aup`í
ò m aNz`Y\_`{|znbY³§jktup-[^] m hij`{©hijktMaup|jkgcytâY|vÛaNzkc[>p PY\dNhiaP}
g m p|tutôhot j`Y|a©j`ce§ vêY\d©zkp|jkn m hijk{ tMª\c§Gcen4nbhotPaudNh  _bauhiY\jkt
Zõ Gduch¢[>p-j & ",# ‡y… %ú €Y\_`dèp-]`]`duY\p\g#z nbYcetJj`Y-aènbh¢tMé
gp|dunp-j} n`p³a#p`€´p mim Y³§t(]kp-d#p m¢m c m hotN[ùvêY\d^]`dNYbgcetutMh¢j`{ m p-du{|c
p-[^Y\_`j„autrY-vÐn`p³a#pJ&c )Ûgh¢cj„a m }|€:p-jkn]+cdu[rhiautrauz`c_ktup-{\c8Y|v
[._ m auhi] m c NY +é auz`céstMzkc m -v m cyp-duj`hijk{^p m {\Y|duh¥auz`[>tGaNY>h¢jkgducep\tMc
nbh¢¤|cedutNh¥aP}p-[^Y|j`{Uauz`c m cyp-duj`cenñg m p\tNtNh¥ð‘cd#tí l _`dMauz`cdu[^Y|duc|€
z`Y³§ auz`c>n`p³a#pp-duc(tup-[^] m cenâh¢t  p\tMcynCY\jaNz`c>gY\tMa[^Ybnbc m €
§z`hog#zÛ[^hi{\z„aZnbhogÍaup-aNcŸnbY³§jktup-[^] m hij`{.hijktMaup|jkgcytY|v+auz`cŸ[rhié
j`Y\dNhiaP}g m p|tutGhij‘tPaucep|nÏY|vxaNzkc[^p PY|duh¥aP}8g m p|tutí
îj`c m h¢[^h¥a#p³aNh¢Y|jrY-v+Y|_`d
p|]`]`duY\p|g#z.h¢t3auz`cj`ccyn.Y|v‘du_`j`j`h¢j`{
]`duc m hi[^h¢jkp-du}C&c ]+cduh¢[rcej„autÐauYCnbcaucdu[rh¢j`c>auz`cÛnbcytMh¢dNcynènbh¢tMé
aNduh  _baNh¢Y|j  p|tNcenâY|jâpÏnbcðkj`cenJgY„tPaÐ[^Yn`c m íw:z`h¢tŸ]`duYbgcytNt
gp|j  cGp-_bauY|[>p³aucen  _ba¾hia¾hotx_kjkp“¤|Y\h¢n`p `m ctMh¢jkgcaNz`cGnbcetNhiducen
nbhotPaudNh  _bauhiY\jhotGz`hi{\z m }Ûnbc]+cjkn`cj„aY|jÛauz`cgY„tPaG[rYbnbc m p-jkn
aNzkc m cyp-duj`hijk{rp m {\Y|duh¥auz`[í
£BtNhij`{vêY|_`d m cep-duj`h¢j`{8p m {\Y|duh¥auz`[>t€+Y|_kdp-]k]`dNY„p|g#z{\cj`cedMé
p³aucet ‡yƒ 8g m p\tNtNhiðkcd#tvêduY|[ùp |† ï -† g m p|tutŸn`h¢tMaNduh  _baNh¢Y|jèp-jkn
ch¢{|z„a[^Y|j„auzktY|v:n`p-aupkí + cÛ[^hi{\z„a.j`Y-ajkccenUauYCª|cec]ìp m¢m
‡yƒ Ûg m p|tutNh¥ðkceduttMh¢jkgcrtNY|[^c.Y|v
aNz`ce[ gY\_ m n  crz`h¢{|z m }gY\dMé
duc m p³aNcynp|jknÛz`cejkgcŸducenb_`j‘n`p-j„aeí
ò m tNYk€[^Y|ducŸg m p\tNtNhiðkcd#tZp|dNc
{|cej`cd#p³aucenì§zkcj auz`cn`p³a#pâtNca^h¢t([^Y|duc8tNª|c§Gcen Y|d^p|n`nbhié
aNh¢Y|j‘p mÐm cyp-duj`h¢j`{p m {\Y|duh¥auz`[>tp-ducâh¢jkgY|du]‘Y\dup-aNcen5í ~ caNduhogt
vêY|dp|jkp m }ýh¢j`{8p|jâcj‘tMce[ `m c(Y|vZg m p|tutNh¥ðkcedutrõêc\í {‘íi€5n`hi¤\cd#tMhiaP}|€
gY\dNduc m p³aucencdudNY\de€:p-j‘nôgY³¤|cedup|{|c ú gep-j  câ_ktNcenñh¢jô]`du_`jbé
h¢j`{C_`j`jkcegcytNtup-du}âg m p\tNtNh¥ð‘cd#tí l _`dNaNz`cedN[^Y\dNc\€xauz`cÛducep m nbh¢tMé
aNduh  _baNh¢Y|j©h¢t8[^Y|ducCtMª\c§Gcen aNz‘p-jôauz`c ƒ|† ï † ]`duY³¤h¢nbcyn aNY
_kteí + cÛh¢j„aNcj‘nUaNYh¢j„¤\cetMaNh¢{\p-aNc>Y|_kd.p-]`]kdNY„p|g#zâ§hiaNzì[^Y\dNc
tNª|c§GcenÐnbhotMaNduh  _`aNh¢Y|jkteí¾òtx§hiaNz.p m p|dN{\c
Y³¤|cduz`cyp|n²€ypz`h¢{|z m }
tNª|c§Gcen(nbhotPaudNh  _bauhiY\jrgep-j.ducj‘nbcd3vêd#p-_knrnbcaucegaNh¢Y|jrcegY\j`Y|[ré
hogp m¢m }r_kjknbcetNh¢dup `m c\í ~ Y|duchi[^]+Y|dNaup|j\a m }\€btMh¢jkgcBaNz`h¢c¤\cetGp m tMY
m cep-dujp-jkn8vêd#p-_knÏ]kp-aMaucdujktc¤\Y m ¤|cŸY³¤|ced:aNh¢[rc\€‘tNY|[^cg m p|tutNh¥é
ðkcedutZp-duc[rY\dNcduc m c¤³p|j\a´aNzkp|j>Y-aNzkcd#tp³aZp]kp-dNaNhog_ m p-daNh¢[rc\í
w:z`cedNcvêY|duc|€\p|jp|nkp-]bauhi¤\cBg m p|tutMhiðkcedZtNc m cegÍauhiY\jÛ[^cauz`Ybn>h¢tZcetMé
tNcj„aNhop m í£j m hiª\cp[^Y|jkY m h¥auz`h¢gp-]`]`duY\p\g#zJY|v m cyp-duj`hijk{Y|j`c
g m p|tutNh¥ðkced²_ktNhij`{BhijkgdNce[^cj„aup m-m cyp-duj`h¢j`{k€eY|_`d5[^Ybnb_ m p-dx[._ m aNhié
g m p|tutNh¥ðkcedp-]`]`duY\p\g#zÛv×p\gh m hiaup-aNcetp\n`p-]`aup³auhiY\j8Y³¤\cdGaNh¢[^cp-jkn
duc[^Y³¤³p m Y-v7Y|_baNé Y|v éÒnkp³aNcŸªj`Y³§ m cenb{\c|í
+,-/.
.0(8
)- "
17.
.
17.
(
776
7B6
% &()
2
3# 5
3# 5
F 8
+ -
.
.0( )-
"
1 .
.
1 .
(
716
76
µ»
«¸y· w:z`h¢t7§GY|duª§:p|t3]kp-dNaNhop m¢m }Ðvê_`jknbcyn
 }({|d#p-j„aut3vêduY|[ ¡ ò™ø²òöõ l7‚\†|ü|†„ƒ é …|ü é ‡ é †\‚`‡|‡“ú € ¦ f l õêqސqÒé
…|ü é ‚\ƒ\ƒ|ƒ ÷ X ¡ òé …|ü é ƒ"|‚„¬%„ú €^p-j‘n ¦ ¨Ðf`f`w l õ %„ƒ-‚k‡|‡4 é
%%\ú í + c:aNz‘p-j`ª ¡ p“¤|c l p|jrp|jkn(òBjknbducep\t3ø´dNYbnbduY|[^honbhot5vêY\d
aNz`cehidnbhotug_ktutMh¢Y|jp-j‘nÛauz`cdNce¤hice§ZcedutZvêY|d:auz`ch¢dBgY|[^[^cj„auteí
ñœ5 #œ5›`œxW櫃œ ‰
C' $ ;# !#"/ $ &%$#$'‡# ! " (
( 9 # ! # !
G )Ž&$%#)%
#8B51 #
*,+.-0/1/2 3546-8792;:0<=-0<?>A@BCD6B6//12;:0<=EFD6B6B6/ #@C' " &)6/% !GH (JI'&*)Ž #
%'
%=# $K
'L& I' $M #;BB# < ON
&8$ & );P
" ((,N
N)Ž &
-
( (6 ,J( N L @+ )-
5
I' )Ž( # < A
Q D6:04RTSVUF79WYXJ<(7.+9R,*:0<0ZLR\[]-)46WR
^ B6-0D1<2.<FC V
_ 7#
%') " N)6) `%
# BB a
#
$- N)Ž & G|! )Ž(*O
) b/ )N# < c
Q D6:40Rd2eCW$79W
XJ<(7.+9Rf]:0D1g#R,[]-)46W)2.<TB ^ B6-0D1<2.<FC BL
7 _$BB #
%'( > # G )& " + )& G # BB4 h
#
N) " + &i
0- " ) (*)Ž)Ž0 P
j
N
" " "@" $# < c
Q D6:40R`kTB146:0<T>lXJ<(7.+9Rif]:0D6g)Rm[An$+e7.2./L79D6-87;BC8o
^ B6-0D1<2.<FC V
_87 #
%'( > # G )& " + )& G #08BB# ! & ON) PN " -
) &S&+&) p
N)0 " &p
N*)Ž )Ž &
0
)$# < i
Q D6:04RE\qB1+ Z17.WOXr< 79+.R*:0<0ZVR
[]-)41W)29<?B ^ B1-0D6<2.<FC /BV
_$B5 #
% " J sF > # =
t
M " N)L) : #8B5B # : u
% MF3 F- N) & " & )$ #
[]-)41W)29<?B ^ B1-0D6<2.<FC 4 G 37 6
_ 35 #
%'&
( H #0BB
# "/(*) 6 v L N) ‡- " P $- N) & # < j
Q DL:040R`S8w)7.W]XJ< 79+9R
*:0<0ZLRu[]-)41W)29<?B ^ B6-0D6<2.<$C 8V
_
34#
"V
IuN)6) : # > &&(6) "'#2BB# ! 8 N$) + -
N)L N) & `
# x -87[y2.<2.<FCl-0<T>{zm<T:0q5+9B6>VC#B x 2./041:0|#B1D6o G 3B 1
_$47 #
"V
IuN)6) : # BB7# }
IU )IJ( s6 I'~
" (( (*)Ž -$)Ž &
( _
($- O P &+J( N &(( `
# (*L) F@& " # )5 M& # 3$#
6 $- L) ~# E€
;) IU G #SBB# ! (( )
Y
-
( &+ " |) ‡(N)( G ( |( " L N)Ž & # < A
Q D6:40RSVUF7.W{XJ<(7.+9Ru*:0<0ZVR
[]-)41W)29<?B ^ B1-0D6<2.<FC V
B _
57#
> 8 L
9 ~# !? r  %=# !T -
J N& P8 > # ! !" 9 60# !?'$- : # !
C'-
$ sF
%=#;8BB1 # 9 $- m
r( " (( )Ž &p
&()( # < ‚
Q D6:04RTS)S879WYXJ<(79+.R,*:0<0ZVR
[]-)41W)29<?B ^ B1-0D6<2.<FC /3 8V
_ 33#
> &&(6) $"@# $ ! & 6( )%
#;8BB7 # G " F$- N $- N) " ƒ
I= )Ž
(( N
" " " J( # []-)46W)2.<TB ^ B6-0D1<2.<FC 34 G 4V4 _17 #
„ -
" T%
# 9 #BB4 # *U R.…#†
‡FDL:CDL-0ˆK/ƒZL:0D{ˆy-)41W)2.<TBK+.B6-0D6<2.<$C # G ! G & 6 -
9+ #
)Ž)& % : `~# 8BB4# %2&(J) ,(( ) " &ƒ
+ " (( ) &]
s L& I " )Ž(U8 N$N " ) &(2 8& /&) ( # []-)41W)2.<TB ^ B6-0D6<2.<$C 4 G #
H & " N/6
) $‰P#2BB3# G )8 1s " ) & # Š B1n$DL-0+ Š BL79q:0D6g0/ G 31$1 _
3B #