On-line Unsupervised Outlier Detection Using Finite Mixtures with

On-line Unsupervised Outlier Detection Using Finite
Mixtures with Discounting Learning Algorithms
Kenji Yamanishi
NEC Corporation
4-1-1,Miyazaki,Miyamae,
Kawasaki,Kanagawa
216-8555,JAPAN
!
Jun-ichi Takeuchi
NEC Corporation
4-1-1,Miyazaki,Miyamae,
Kawasaki,Kanagawa
216-8555,JAPAN
" #$% &'
!
ABSTRACT
798:<;=>@?BA >C:<>D@:<=EGFH=IKJ3LM8FAJONP>F:QJG;R=ISIS8>=FTAJU:QJVNP=F=F W X
ISYZ>CD=4[$D\JO;;4]K=F^L0?QJO8$AKA >C:<>CDC:<=E1F2XF >C:`_!EG?<ab=F:S?<8 IS=EGFBA >C:<>D@:<=EGF2X
F >C:`_!EG?<abNPE1F=4:<EO?<=F W XZ>@:<D1c9dN*JO?S:@d=4L0:<>C?\X$_fe =D@eg_!>JOhh ?<>Ci=JU:<>
JOIjddZX#=I*JGFVE18 :<;=>C?*A>C:<>DC:<=EGFk>F W1=F>lJ1A?S?<>ISIS=FW:<e =ImY ?<EGh n
;>NoL0?<E1No:<e>i=>C_fYZEG=F:pEOLqIr:QJU:<=Ir:<=D\JO;s;>\JU?<F=FWj:<e>EO?S]cutqe=I
YJGYZ>C?lY ?<EUi=A >IbJv:<e>EO?<>C:<=D\JG;RhJGIS=IlL0EG?Kd d,JGFA,>NPY=4?<=D\JG;;4]
A>NPE1F Ir:S?QJO:<>If=4:<If>Cw>DC:<=i&>CF>ISIcqddjA >C:<>D@:<IxEG8 :<;=>C?<Ix=FgJGFgEGF n
;=F>mY ?<ED>CISIR:<e ?<E18 W1e^:<e>uE1Fny;=F >8F IS8YZ>C?<i=IS>\A^;>\JO?<F =FWjEGL!J
Y?<E1hJGh=;=Ir:<=DRNPEA >;z8IS=FWuJR[$F =:<>xNP=4{:<8 ?<>fNPEA >;}|EGL:<e>x=F n
L0EG?<N*JU:<=EGFISEG8 ?<D>1c~JGDQe:<=NP>JbAJU:<8N€=Ip=FY 8 :pdd^>NPY;E\]I
JOFO‚$ƒy„ …M‚†ˆ‡G…M‰@Š<G‹‚Œ…M‚*„†SŽGQ‚…0‚*Ž1„ &GQ…MŒ0‘T:<Eu;>\JO?<Fj:<e>xY ?<EGh n
JOh=;=Ir:<=DˆNPEA>;c’HISDEO?<>u=IfW1=i&>CFb:<E:<e >pAJU:<8N“hJGIS>\AlEGFb:<e >
;>\JU?<F>\AˆNPEA >C;'XU_f=4:<emJxe =WGemISDCEG?<>q=F$A=D\JO:<=FW”Jfe=W1euYZE1ISIS=h=;=4:`]
EOLqhZ>=F WgJ*Ir:QJO:<=Ir:<=D\JG;sE18 :<;=>C?\ctqe>mFEUi&>;L0>\JO:<8?<>IpEGL5ddKJO?<>1•
– |=4:=IJ1AJOY :<=i&>q:<ERF E1Fn—Ir:QJU:<=E1F$JU?S]ISEG8 ?<D>CIsEOL+AJO:QJ˜™1|#JRISDEO?<>
eJGImJlD;>\JU?Ir:QJU:<=Ir:<=D\JO;}šO=F L0EG?<N*JO:<=EGF n':<e>EO?<>C:<=DlNP>\JOF=FW˜›&|p=4:
=IuDE1NPY 8 :QJU:<=EGF$JO;;4]=F >C{YZ>FIS=i&>G˜JGF$Avœ&|R=:mD\JOFe$JGFA ;>PhZEG:<e
DJO:<>WGEG?<=D\JG;qJGF$ABDE1F:<=F8EG8IRiGJO?<=JGh ;>Icj’”FB>C{YZ>C?<=NP>F:QJG;JOY n
Y ;=DJO:<=E1FK:<E*F>C:—_qEG?<ab=F:S?<8 IS=E1FBA >C:<>CDC:<=E1F^ISeE\_fI9:<eJO:Rddb_qJGI
JOh;>ˆ:<EP=}A>F:<=4L0]lAJO:QJ%_f=4:<e^e=WGe^ISDEG?<>Ix:<e$JU:”DCEG?S?<>ISYZEGF$A >A^:<E
JU:S:QJGDQaIXZ_f=:<eK;E\_žDEGNPY8 :QJU:<=E1F$JO;DEGIr:<IcpŸ8?S:<e>C?x>C{YZ>C?<=NP>Fn
:QJO;5JGY Y;=D\JO:<=EGFVeJGIu=A >F:<=4[$>\AJKF8 NhZ>C?ˆEOLfNP>\JGF =F WGL08;s?QJU?<>
DJGIS>Iˆ=FvJODC:<8$JO;se >\JG;4:<e=F IS8 ?QJGF D>%YJO:<eEG;E1WG]AJU:QJjL}?<E1N ’”8 Irn
:S?QJO;=}J¡ I9¢9>JG;4:<eg£`F IS8 ?QJOFD>ˆ¤!EGNPNP=ISIS=EGF2c
1.
tqe >YINTRODUCTION
?<E1h;>NoEGL!E18 :<;=>C?ˆA>C:<>DC:<=EGF=IREGF>EOL!:<e >mNPEGIr:9LM8 F$A JOn
NP>CF:QJO;#=ISIS8>Ip=FBAJU:QJbNP=F=FWcˆ£—:9=IpDC;EGIS>;4]K?<>;JO:<>\A^:<EbL}?QJG8$A
A>C:<>DC:<=EGF2XF>@:`_qEO?<a=F:S?<8IS=E1FvA >C:<>D@:<=EGF2X>C:<DGcXIS=F D>bD@?<=NP=FJG;
EO?fIS8ISY =DC=EG8IfJODC:<=i=4:<=>I5N*J]%EOL0:<>Fb=F$A 8 D>xIr:QJO:<=Ir:<=D\JG;+E18:<;=>C?<Ic
> LMED8 I”EGFg:<e>p=ISIS8>ˆEGL”G‚ƒ—„ …0‚†ˆ‹‚ ‰Q‹U¦ †@Q§\…M‰C†S‡^G‹Œ'„ …y†@m‡†@Œ—†SŠƒ
¥ p
Œ…G‚P=Fl_fe=DQel:<e>”LME1;;E\_f=FW*DE1FA =4:<=E1F I”JU?<>p?<>\¨8=4?<>\A+•
– |©q‹Œ'„ …y†@Q‰^ŽGS†K‡&†@Œ—†<ŠCŒ—†S‡kªQŽO‰†S‡3G‚,‹‚ ‰Q‹U¦ †@Q§\…M‰C†S‡k„†SŽGQ‚…M‚3`«
Œ0 †…M‚\«O@‘%ŽGŒ…'G‚¬‰@G‹SŠQ†\­®£—F¯W1>F >C?QJG;pIr:QJU:<=Ir:<=DJG;uJGY Y ?<E&JOD@e >I
Graham Williams
CSIRO Mathematical and
Information Sciences
GPO Box 664, Canberra ACT
2601, Australia
(*) #+#, -.0/0/#1234 ) 5#6
:<E%EG8 :<;=>C?”A >C:<>D@:<=EGF2XE1F>R[ ?<Ir:f;>\JO?<F I9JOFl8FA >C?<;4]=FWmNPEA >;+EGL
:<e>!NP>D@eJGF =ISNHLMEG?sA JO:QJOnyWG>F>C?QJU:<=E1F%L0?<EGNž>C{ JGNPY ;>CIX&JOF$Au:<e >F
>iGJG;8$JU:<>I!e E\_°;JO?<WG>9JRWG=i&>FP=FY 8 :sAJU:<8N±=I!A>i=}JU:<>\A?<>;JO:<=i&>
:<Ef:<e>!NPEA>;$zIS>>s>1c W cX$² –@³ |@c ¥ >?<>\¨8=4?<>!e >C?<>s:<eJO::<e >!;>\JU?<F=FW
Y ?<EDC>ISI9hZ>ˆ8F IS8YZ>C?<i=IS>\Acf’”;4:<eEG8WGeg:<e>ˆIS8YZ>C?<i=IS>\Ag;>\JU?<F=FW
h$JOIS>\AJOYY?<E&JGDQeB=IpYZEGY8 ;}JU?ˆ=FL0?QJO8$ABA >C:<>CDC:<=E1F´zS² ™ ³ X}² µ ³ X² –1–@³ |@X
:<e>ˆ8 FIS8YZ>@?<i=IS>\Ab;>JO?<F=F WPh$JGIS>AgE1F>ˆ=I9F EG:xE1F ;4]gNPEG?<>R:<>CD@en
F=D\JO;;]%A =4¶PD8 ;4:sh 8 :JO;ISEˆNPEO?<>qY ?QJODC:<=D\JG;;4]%=NPYZEG?S:QJOF:\X&IS=FD>f=F
?<>\JO;IS=4:<8$JU:<=EGFIf;JGhZ>;>\Ag>@{JONPY;>I5NP=W1e:fF EG:fhZ>ˆJ\i1JO=;}JOh;>1c
™1|^·2†u¦S\ŠQ†@‰<‰b…M‰PG‚$ƒy„ …M‚†\­Ktqe$JU:%=IX>i&>@?S]:<=NP>*J^AJU:<8N =I
=FY 8 :\X$=4:”=Ix?<>\¨8 =?<>Al:<EP>i1JO;8$JO:<>ˆe EU_H;JO?<WG>u:<e >ˆAJO:<8 N®=I”A >@n
i=JO:<>\A%?<>;JO:<=i&>x:<EJpF EG?<N*JG;Y$JO:S:<>@?<F2c£`FPDCE1F:S?QJGIr:\XNPE1Ir:!>C{=Ir:Sn
=FW*_qEO?<a^E1FBE18 :<;=>C?ˆA>C:<>DC:<=EGFkz>1c WcX² –C³ X² ¸ ³ X² µ ³ X² –G–C³ |m=FBIr:QJO:<=Irn
:<=DI5JOF$A*AJU:QJˆNP=F =F Wp=IqDE1F D>C?<F >\A%_f=:<e*hJO:<DQe n—A >C:<>CDC:<=E1F*Y ?<EOn
D>ISIS>CIX!=F_fe=DQeVEG8 :<;=>C?<IDJGF3hZ>lA>C:<>DC:<>AvE1F;4]3JUL0:<>C?%IS>>=FW
:<e>f>F:<=4?<>”AJO:QJOIS>C:\ctqe>xE1Fny;=F >xIS>@:S:<=F Wˆ=I!NPEG?<>5?<>\JG;=Ir:<=D”:<eJGF
:<e>9h$JO:<DQelEGF>R_fe >FlEGF>ˆA >JG;I5_f=:<eb:<e>9:S?<>NP>CF$A EG8IfJONPE18F:
EGLA JO:QJu=FlF>C:—_qEG?<ajNPE1F =4:<EG?<=FWX>C:<DGc
¹ OE :<>j:<eJO:u:<e>C?<>*>C{=Ir:<I%EGF;4]JgLM>@_“_qEO?<a,z>1c W ck² › ³ |ˆL0ED8IS=FW
E1F^:<e >mEGF ny;=F >m8 FIS8 YZ>C?<i=IS>Ag;>JO?<F=F WbhJGIS>\AKJGY Y ?<E1JGDQe2cptqe =I
Y$JOYZ>C?#=F:S?<EA 8 D>IdN*JU?S:@d=4L0:<>@?5z'JGh h ?<>i=JO:<>\AuJGI#ddR:<e ?<E18 W1e E18 :
:<e=IfY$JOYZ>C?@|@X_fe=D@ebNP>>C:<Iq:<e >R?<>\¨8=4?<>NP>F:<I – |fJOF$Al™1|@c
tqe>ˆJOYY?<E&JGDQegEOLdN*JU?S:@d=4L0:<>C?f=I”JGI5LMEG;;E\_fI•
£S|xddl8 IS>IRJPY?<E1h$JOh=;=Ir:<=DmNPEA >;JGI9JP?<>CY ?<>IS>F:QJU:<=EGFKEGL!JGF
8FA >C?<;4]=FWˆNP>DQe$JOF=ISNºEOLA JO:QJOnyWG>F>C?QJU:<=E1F2cstqe >9NPEA >C;$:QJGa&>I
Jbe =>C?QJO?<DQe=D\JO;!Ir:S?<8D@:<8 ?<>1X2=FB_fe =DQevJg…M‰<Œy<GSŽO‘»‡&†@‚‰<…MŒ¼_f=4:<e
JPF8NhZ>@?”EOLD>;;IR=IR8IS>\Al:<EP?<>Y?<>IS>F:9JjY?<E1h$JOh=;=4:`]^A>FIS=4:—]
EUi&>C?P:<e >gA EGN*JG=FVEGLpD\JU:<>W1EO?<=D\JG;”i1JU?<=}JOh;>IjJGFA3L0EG?j>\JOD@ekD>;;
JP½‚ …MŒ—†j‘m…¾GŒ‹<†b‘P\‡&†C„2=Iu8IS>\A:<Eg?<>Y?<>IS>F:u:<e>*Y ?<EGh$JGh =;=4:—]
A >CFIS=4:`]jEUi&>C?f:<e>RA E1N*JO=FlEGLDE1F:<=F8E18 Ifi1JU?<=}JOh;>Ic
£S£S|ˆ~i&>C?S]:<=NP>*JKAJU:<8N =I=FY 8 :\Xsd d>NPY;E\]IJOFE1Fn—;=F>
;>\JO?<F =FWˆJG;WGEG?<=4:<eNž:<ER8 YAJO:<>q:<e >qNPEA >C;'c ¥ >5e$J\i&>qA >i&>C;EGYZ>\A
:<e>”¿À”Á2¬Ã'¿†SÄC‹†@‚Œ…'ŽG„M„ ¼RÀp…M‰@Š<G‹‚Œ…M‚RÁŽ@¦$„Ž&ŠQ†!Âq‰QŒ…0‘PŽGŒ…'O‚&ÅsJG;4n
W1EO?<=4:<eNÆLMEO?;>\JU?<F=FW,:<e >e=Ir:<E1WO?QJGN´A >CFIS=4:`]ÇLMEO?:<e >vD\JU:<>Cn
W1EO?<=D\JG;AE1N*JG=Fvzyd>D1c ™c – |@XJGFAb:<e>P¿ÀxÂ!ÈÉÃ'¿†SÄC‹†@‚Œ…'ŽG„M„ ¼%Àp…M‰Qƒ
Š<G‹‚Œ…M‚KÂs¾@¦ †SŠCŒyŽGŒ…'O‚¬ŽG‚Z‡KÈBŽ\¾G…M‘…Ê…0‚CÅ*JG;WGEG?<=4:<eNËzyd>D1c ™c ™G|
LMEO?P;>\JO?<F =FWK:<e>*[$F=4:<>jNP=4{:<8?<>PLMEG?:<e>jDE1F:<=F8E18 I%AE1N*JG=F+c
tqe>C=?uNPEGIr:ˆ=NPYZEO?S:QJGF:RL0>\JO:<8?<>P=Ip:<eJO:p:<e>@]°‡O…M‰@ŠQO‹‚ Œ:<e>%>CL}n
LM>CDC:xEGLY$JOIr:x>C{ JGNPY;>I5=Fj:<e>pE1Fny;=F >RY ?<ED>CISIc
£S£S£S|d dvW1=i&>IPJKISDEO?<>b:<EB>\JGDQe°A JO:<8 N.EGFV:<e >bhJGIS=IPEGLx:<e>
;>\JO?<F >\AbNPEA>;XNP>\JGIS8?<=FWe E\_¯;JO?<W1>R:<e >9NPEA>;Ze$JOI5D@eJGFWG>\A
JOL}:<>C?q;>\JU?<F=FWctqe8IsJRe=W1ePISDEO?<>”=FA =D\JO:<>CIqJpe=W1ePYZEGISIS=h=;=:—]
:<e$JU:5:<e>ˆA JO:<8Nº=IxJOFgE18:<;=>C?\c
tqe >pFEUi&>;LM>JO:<8 ?<>CIxEOLsddjJO?<>pIS8NPN*JU?<=Ì>\AjJGI5LMEG;;E\_fI•
J1|¿¿m…M‰sŽ&‡&Ž@¦Œ…M§G†!Œy9‚ZG‚ƒy‰<ŒyŽGŒ…'O‚ZŽGQ¼ˆ‰CO‹rŠQ†@‰­#£`FpDCE1Fi&>F:<=E1FJG;
Ir:QJU:<=Ir:<=DJG; JGYY?<E&JOD@e >IX&=4:#=I8 IS8$JG;;4]uJGISIS8 NP>\Ap:<e$JO:JGFu8FA >C?<;4]n
=F W%=F LMEO?<N*JO:<=E1FlISE18 ?<DC>ˆL0EG?”AJU:QJOnyW1>CF>C?QJU:<=EGF^=IxIr:QJU:<=E1F$JU?S]² –@³ c
tqe =IR=IXeE\_q>i1>C?\XFEO:9?<>\JO;=Ir:<=Dm_fe >FKE1F >A>\JG;I9_f=4:<eBA?<=4L0:<=F W
ISEG8 ?<D>CI9EG?x:<=NP>CnyIS>C?<=>IxAJU:QJcftqe >ˆA =ISDE18 F:<=F W*JG;W1EO?<=4:<eNÍ>N%n
Y ;EU]&>\Ajh]bd d*;>\JU?<FIq:<e>”ISE18?<D>RLMEO?<W1>C:S:<=FWE18 :SnyEOL0n—AJU:<>9Ir:QJO:<=Irn
:<=DIuEGLxA JO:QJX8IS=FW^J^A>D\J]BLJGD@:<EG?\Xe>CFD>P=Iu>C{YZ>DC:<>\AK:<E^hZ>
JGAJOY :<=i&>R:<E%F E1F nyIr:QJU:<=EGF$JU?S]bISEG8 ?<D>CIc
hZ|fΞ‰CŠ<GS†Š<Ž1„ŠC‹„ŽGŒ—†S‡lªC¼P¿ ¿^ŽG‰ˆŽjŠ„†<ŽOp‰QŒyŽOŒ…M‰<Œ…'Š<Ž1„ Ï
…0‚\«GQ‘PŽOŒ…'G‚$ƒ'Œ0†SGS†@Œ…'Š‘*†SŽG‚ …M‚­T£—F°NPE1Ir:jY?<>i=EG8IP_qEO?<aZXxJ
ISDCEG?<>j=ImD\JG;D8 ;JO:<>\A8IS=F WBe >8 ?<=Ir:<=DIuIS8DQe3JGImDE1Ir:l² œ ³ X}² Ð ³ JGF$A
;JOD@aI%JgIr:QJU:<=Ir:<=DJG;Ñr8 Ir:<=4[$D\JU:<=EGF2X#_fe =;>*:<e>jÒgJOe$JG;JOFE1h =IPA =Irn
:QJOFD>B² –C³ X:<e>j¨8$JGA?QJO:<=DbA =Ir:QJGF D>K² Ð ³ X² ¸ ³ _q>C?<>j8IS>\A:<EKISDEO?<>
EG8 :<;=>C?<I*=FkISEGNP>b_qEO?<aZc,d dA >C[F>IPJBISDEG?<>bLMEG?jJBAJU:<8N.=F
:<>@?<NPIxEOLsJ%Ir:QJO:<=Ir:<=D\JG;A=Ir:QJOFD>ˆNP>\JOIS8 ?<=FWPe E\_T;JO?<WG>u:<e >ˆA =Irn
:S?<=h 8 :<=E1F;>JO?<F>ABL0?<EGN€:<e>AJU:<8N€eJGIpNPEUi&>\AgL}?<E1N€:<e >%E1F >
hZ>@LMEG?<>x;>\JO?<F =FW ctqe8 I=4:=IsFJO:<8?QJG; :<Ep=F:<>C?<Y?<>C:#:<e$JU:qJRA JO:<8 N
EOLe=W1ebISDEG?<>ˆ=IX_f=4:<ege =W1elY?<E1hJGh=;=4:`]XJGFbE18 :<;=>C?\c
DU|p¿¿…0‰uŠQO‘9¦$‹ŒyŽGŒ…'O‚ZŽ1„M„ ¼l…M‚†S¾@¦ †@‚ ‰Q…0§G†\­ˆtqe >DEGNPY8:QJO:<=E1FJG;
DCE1NPY;>C{=4:`]9EGLZdd”LMEO?#D\JO;DC8;JO:<=FW9JxISDCEG?<>sL0EG?>\JOD@euA JO:<8N¬=I;=F n
>JO?q=F:<e >5F8NhZ>@?EGL+Y$JU?QJGNP>C:<>C?<I=F%:<e>5NPEA>; JGF$AP¨8J1A?QJU:<=D
=F¯:<e>KF8NmhZ>C?jEGLmi1JU?<=JGh;>IcºŸEO?g>C{ JGNPY ;>1Xx=:lD\JGFÇY?<ED>ISI
JOhZE18:pµ1ÓX Ó1Ó1ÓbAJU:QJ_f=:<e^L0E18 ?RJO:S:S?<=h8:<>I9=FB™O¸*IS>CDE1FA Iz'Ô>CF n
:<=8 NÕ£S£S£5Ð1ÐOÓ&Òl¢”ÌU|@c
A$|p¿¿3Š<ŽG‚3‡&†<ŽG„Ö…MŒ0ª<GŒ0Š<ŽGŒ—†'&GQ…'Š<Ž1„!ŽG‚Z‡^Š<G‚ Œ…M‚‹ G‹‰§OŽO@…ƒ
Ž1ª„†@‰­tEpEG8 ?aFE\_f;>\A WG>1X ddˆ=I:<e>q[ ?<Ir:E1F ny;=F>f8F IS8YZ>C?<i=IS>\A
EG8 :<;=>C?sA >C:<>CDC:<EG?:<e$JU:#D\JOFPA >\JO;_f=:<ehZEG:<eDJO:<>WGEG?<=D\JG;JGFAmDEGF n
:<=F8EG8IfiGJO?<=JGh ;>CIc
tqe >gA>IS=W1F3EGLRdd_qJGI%=FISY =4?<>\Ah]:<e>P_qEO?<ah]×!8?<W1>bJGF$A
de$J_5n—tJ];EO?P² › ³ cu798?9_qEO?<a^A =4w>C?<I”L0?<E1N.² › ³ =F^:<e>ˆLME1;;E\_f=FW
?<>CW&JO?QAI• – |9d db:S?<>\JO:<I”hZEG:<eKD\JU:<>W1EO?<=DJG;JGFAKDCE1F:<=F8 E18 I”iGJO?<=4n
JOh;>IX&_fe =;>p² › ³ A>\JG;IE1F;4]ˆ_f=4:<eDEGF:<=F8 E18I#EGF>Ics™G| ¥ e=;>p² › ³
8 IS>Iq:`_!ENPEA>;I5=F*:<e>9JG;W1EO?<=4:<eNg•:<e>”;EGFWu:<>C?<N“NPEA >C;JGF$A
:<e >fISeEG?S:s:<>C?<N±E1F >1X ddm8 F=4[$>CIs:<e>CNØ=F:<EpE1F >”NPEA>; _f=4:<e%:<e >
JO=N.EOL9JgDC;>JO?<>C?Ir:QJO:<=Ir:<=D\JG;5NP>\JOF=FWgJGF$AJg;E\_q>@?%DEGNPY8 :QJUn
:<=EGF$JG;DEGIr:\c›&|#ddˆ8IS>I#>C=:<e >C?sJ”YJO?QJGNP>@:S?<=Ds?<>Y ?<>IS>CF:QJU:<=E1FL0EG?
JmY ?<E1hJGh =;=Ir:<=DpNPEA >;EO?xJFEGF nyY$JU?QJGNP>C:S?<=D9EGF>1X_fe=;>pE1F ;4]jJ
F E1Fn—YJO?QJONP>C:S?<=DPE1F>*=Iu8IS>\A=F¯² › ³ c^£—F3d>CD1c ›c – X_q>*DEGNPY$JU?<>
EG8 ?#YJO?QJONP>C:S?<=DsNP>C:<e EAR_f=:<eˆ:<e>FEGF nyY$JU?QJGNP>C:S?<=DE1F >:<ExISeE\_
:<eJO::<e>qL0EG?<NP>C?E18:<YZ>C?SLMEO?<NPI:<e >5;JO:S:<>C?shZEG:<e%=FPJODD8?QJGDC]%JGF$A
DCE1NPY8:QJO:<=E1FbDE1Ir:<Ic
> >NPY=4?<=D\JO;;4]%A >NPEGFIr:S?QJO:<>q:<e >5Y ?QJODC:<=D\JG;$>@w>DC:<=i&>F >ISIEGLdd
¥ 5
8 IS=FWK:<e>lF >C:`_!EG?<av=F:S?<8IS=EGF°A JO:QJGIS>@:^zÙpÚRڀ¤!8Y – µGµ1µ&|l² Û ³ c
’x;4:<eE18 W1e=:9_5JGIˆ8 IS>\A=FK:<e>%DEGF:<>C{:pEGLqJbIS8YZ>@?<i=IS>\AB=F:S?<8n
IS=EGFA>C:<>DC:<EO?R;>\JO?<F =FWjY ?<E1h ;>No=F^ÙpÚRÚܤ!8 Y – µ1µGµX_q>u8IS>\A
=4:*=Fk:<e >gISD>FJO?<=EvEOLpE1Fn—;=F>l8FIS8 YZ>C?<i=IS>\AV=F:S?<8IS=EGF,A >@:<>DCn
:<=EGF2cv£—F3E18 ?>C{YZ>C?<=NP>F:\X#LMEO?PJKF>C:—_qEG?<avJGDD>CISI%;E1WAJO:QJOIS>C:
EOLRIS=Ì>^œ&ÐG¸X Ó1ÛG¸=FDC;8A =FW –\Ý ¸&Û=F:S?<8IS=E1F IXq=4:*A>C:<>DC:<>\AkÐ1ÐGÞ
=F:S?<8IS=EGFIq=F*:<e>f:<E1Y – ÞØAJO:QJpEOLe=WGe>Ir:!ISDEG?<>IXJGFA*¸&™1Þ±=F n
:S?<8 IS=E1FIf=Fl:<e >9:<E1YgÐ1ޓAJU:QJEGLe=W1e >Ir:xISDEG?<>Ic ¥ >RJG;ISEP8IS>\A
Jje>\JO;4:<e=FIS8?QJGF D>YJO:<eEG;E1WG]A JO:QJGIS>@:ˆIS8YY ;=>ABh]g:<e >%’”8 Irn
:S?QJO;=}JOFk¢”>\JG;4:<e£—FIS8 ?QJOFD>b¤!EGNPNP=ISIS=EGF3:<EKA>NPE1F Ir:S?QJO:<>P:<e$JU:
d d*_qJGI”JGh;>R:<E%=A>F:<=L}]jIS>i&>C?QJO;NP>\JOF=FWOLM8;Z?QJU?<>uDJGIS>If=Fg=4:\c
2.
OUTLINE
SMARTSIFTER
áSâ|A>FEO:<>9JˆAOF
JU:<8N±
_fe>C?<>xàKA >CFEG:<>CIqJpi&>DC:<EO?qEOLD\JU:<>Cn
ß >C:Rzà
WGEG?<=D\JO;#i1JU?<=}JOh;>I”JGFAlâ3A >F EG:<>IxJ%i&>CDC:<EG?”EGLDEGF:<=F8 E18IfiGJO?<=4n
JOh;>Ic ¥ >R_5?<=4:<>p:<e>qÑrEG=F:9A =Ir:S?<=h8:<=E1FgEOLfzàáSâ|5JGIãzàá`â#|ä
ãzà|0ãzâ!å à|@æ ß >C:sãzà|qhZ>ˆ?<>CY ?<>IS>F:<>\Agh]lJj…M‰<Œy<GSŽO‘ ‡†@‚‰<…MŒ¼
_f=4:<e^Ju[$F=4:<>RF8 NhZ>C?5EOLA =IMÑ`E1=F:”DC>;;Iuzyd>CD1c ™c – |@X$JGF$A*LMEO?9>\JOD@e
DC>;;'XLMEG?RJG;;à+I5:<e$JO:xLJO;;=F:<EP=4:\X;>@:!ãzâ!å à|qhZ>R?<>Y?<>IS>F:<>\Agh]
JGFl=}A>F:<=D\JG;LMEO?<NÍEOLJR½‚…MŒ—†p‘…¾GŒ‹<†ˆ‘P\‡†C„Zzyd>D1c ™c ™1|@cs¢9>CFD>
_q>^Y?<>Y$JU?<>^JGIjN*JGF]v[F=4:<>gNP=4{:<8 ?<>bNPEA >;IjJGI*D>;;Ij=FV:<e>
e=Ir:<EGWG?QJGN®A>FIS=4:—]c¤!E1F IS=}A>C?f:<e>”IS=:<8JO:<=E1Fj_fe>C?<>RJmIS>\¨8>CFD>
EGL!AJU:QJj=IRWG=i&>F2•ˆzàçáSâç@|@á\zàèOáSâè|éCéé9=FJGFKE1Fny;=F >mY?<ED>ISIc
tqe>”LM8FAJONP>F:QJG;ZIr:<>Y I5EGLdN*JO?S:@d=4L}:<>C?fJO?<>pWG=i&>FbJGI5LMEG;;E\_fI•
– cfê9=i1>F:<e>*ë`:<e3=FY8:PA JO:<8Nìzà2í<áSâ2ír|@X=A >CF:<=4L}]:<e>jD>;;
:<e$JO:jà í LJO;;Ib=F:<EvJGF$Ak8YAJU:<>g:<e>^e =Ir:<EGWG?QJONËA>FIS=4:—]
8IS=FWp:<e>9dÚ ß ~vJO;WGEG?<=4:<eN€zyd>D1c™c – |:<EˆEGh :QJG=Fˆãî íMï zà|@c
tqe>F+XL0EG?%:<eJO:D>;;Xq8YA JO:<>P:<e>*[$F =4:<>bNP=4{:<8 ?<>*NPEA >C;
8IS=FW:<e >ˆdÚR~!Ò^šGdÚpÔðñJO;WGEG?<=4:<eNòzyd>CD1c ™c ™1|!:<E%EGh :QJG=F
ã î íï zâqå à|@cŸEG?xEG:<e >C?xD>;;IX$IS>C:ã î íï zâ!å à|ävã î í—ó ç ï zâ!å à|@æ
™cf¤qJG;D8;JU:<>JBISDEG?<>gL0EG?*:<e>lAJU:<8NôEGFk:<e>bh$JOIS=I*EOLR:<e>
NPEA >;I5hZ>CL0EG?<>uJGFAlJOL}:<>C?”8YAJU:<=FWlzyd>D1c ™c ›1|@c
2.1
Variables
×!>;E\_ñCategorical
_!>mA>ISDC?<=hZ>ueE\_T
:<EP;>\JU?<FK:<e >ˆe=Ir:<E1WO?QJGNoA >F IS=:—]gEUi&>C?
:<e>9D\JO:<>WGEG?<=D\JO;A E1N*JO=F2c ß >@:5:<e>pF8NmhZ>C?qEOLD\JO:<>WGEG?<=D\JO;i1JU?<=4n
JGh ;>I9hZ>ˆõ#c ß >C:x:<e>p?QJOFW1>uEGL:<e >pö':<e^DJO:<>WGEG?<=D\JG;iGJO?<=JGh ;>mhZ>
ï
ï
÷Pîø ï äºù\ú î4ç ø áééé+á<ú ûGîø ü1ý zö!ä – áééCé2á<õ2|@cm¤!;JGISIS=4L0]B:<e>CNÍ:<EjE1hn
ï
ï
:QJG=F3Jl[F=4:<>*F8 NhZ>C?ˆEOL”A =IMÑrEG=F:mIS>C:<I•bùUþ îç ø áé\éCé2á<þ ÿ<îø ü ý zöpä
ï
ï
ï
ï
ÿ ü ç þ îø æ
– á\éCéé2árõ|@áU_fe >C?<>qþ îø þ îø ä uz ä |JOF$A ÷ îø ä
ï
çï
éCéé þ î :<e>mz ç áCééé+á |—:<eBŠQ†C„M„ c ¥ >
¥ >”D\JG;;Z:<e>xD>;;+þ î
e$J\i&> Éä ç
ééé
D>C;;Ix=Fl:<EG:QJO;'cqtqe=Ix=FA 8 D>IfJ%Y$JU?S:<=4n
:<=E1F =F W%EGL#:<e >pA EGN*JG=F2c
ê9=i&>FIS8DQeJlYJO?S:<=4:<=E1F =F WlEOLq:<e>PAE1N*JO=F+X2JK…M‰<Œy<GSŽO‘»‡&†@‚$ƒ
‰<…MŒ¼5LMEO?<NPIqJpY ?<EGh$JOh=;=:—]*A =Ir:S?<=h8:<=E1F2X1_fe=D@eP:QJOa&>IqJRDCE1FIr:QJOF:
iGJG;8>uE1FB>\JGDQeBD>;;cutqe>ue=Ir:<E1WO?QJGN A>FIS=4:`]g=I9ISYZ>D=4[$>\AKh]^J
Y$JU?QJGNP>C:<>@? mäÜz ç áéCéé2á |q_fe>C?<>
ä – á
Ó*JOF$A
ç
A >F EG:<>Im:<e>lY?<E1hJGh=;=4:`]3iGJG;8>jLMEO?P:<e> G:<eVD>;;ck£—Lx:<e>C?<>
JO?<>
Ir] NmhZE1;I=F%:<e > Gny:<ePDC>;;'X:<e >fY ?<E1hJGh =;=4:`]i1JO;8>fEGL+>\JOD@e
Ir]NhZEG;+àB=Fg=4:x=IfWG=i1>Flh]uãzà|#ä
æ
%$
&
#
(' $
! "
> =F:S?<EA 8 D>Pe>@?<>%:<e>jdÚ ß ~TJO;W1EG?<=4:<e Ngcgtqe =Iu=IJgiGJO?<=JOF:
¥ P
EGL:<e> ß JOY;JGDC>%;J\_pX+h]g_fe =DQeKE1F >>Ir:<=N*JO:<>CI”:<e>mY ?<EGh$JGh =;=4:—]
iGJG;8>5EUi&>C?sJRA=ISDC?<>C:<>fA EGN*JG=F_f=4:<e ã2zú|äñz
| z
#|
LMEO?l>JGDQe¯>;>NP>F:*úV_fe >C?<>BÓ
– X €=I*:<e>^IS=Ì>KEGLuJ
AJU:QJjIS>¨8 >FDC>1X *=I”:<e>uF8 NhZ>C?xEOL!EDDC8 ?S?<>F D>IREOLqúg=F^:<e>
IS>\¨8>CFD>1X+JOF$A
=I9:<e>uF8NmhZ>C?xEGLs>;>NP>F:<I9=F^:<e>mA =ISDC?<>C:<>
A EGN*JG=F2c5tqe>dÚ ß ~°JG;WGEG?<=4:<eNo=I”ISYZ>D=4[$>Agh]lJPA =ISDEG8F:<=FW
Y$JU?QJGNP>C:<>@? z °Ó&|!_fe >C?<>uJISN*JG;;>C? P=FA =D\JO:<>CIx:<eJO:9dÚ ß ~
e$JOIgJv;JO?<WG>C?^=F 8>F D>^EGLuYJGIr:g>@{JONPY;>IKzIS>>Ÿ=W c – |@cÜtqe>
òÓ=FKdÚ ß ~fc
ß JOY;JGDC>u;J_¬=Ix?<>\A8D>Aj:<E:<e >RD\JGIS>pEOL
:+.;
%<>= ?
A@
*) ,+.-0/21 ' ,+#/341
657185 9+
%<>=
B<>= C:D
2.2
>!A >ISDC?<=hZ>qe E\_v:<Variables
E”;>\JU?<Fm:<e >sNPEA>;EUi&>C?:<e >!DEGF:<=F8 E18I
¹ >@{:2_qContinuous
A GE N*JG=F2c ¥ >DEGFIS=A >C?9:`_qEbi&>C?<IS=E1F I•9:<e >Y$JU?QJGNP>C:S?<=Dmi&>C?<IS=E1F
JGFAj:<e >pFE1FnyY$JO?QJONP>C:S?<=DRE1F >1c
2.2.1
£`F¯:<e >Y$Parametric
JU?QJGNP>C:S?<=Di&>CVersion
?<IS=E1FÇ_q>v>CNPY;E\]¯JGIKJ[$F =4:<>NP=4{:<8 ?<>
E
ãzâ!å H Já I |@á
ãzâqå &|ä F
ø
ø ø
ø ç:G
_fe>@?<> l=I”JPYZE1IS=4:<=i&>ˆ=F:<>WG>C?\X ø " Óá! ç ø ä – JGFAl>\JOD@e
ø A =G Ir:S?<=h8:<=E1FH_f=4:<e
ãzâ!å H ø áJI ø |l=IKJLK&n—A =NP>F IS=E1F$JOG ;uêRJG8 ISIS=}JOFž
A >CFIS=4:`]jISYZ>D=4[>\Alh]jNP>\JGFMH ø JGFAbDEUiGJO?<=JGF D>pN*JO:S?<=4{MI ø •
NPORQTS U øJVXWøZY0[ OR]_^ Y`_a è \ S W#ø S ç a ècbJd(e fhg ]\ ORQ g U øZYjikW øó ç OlQ g U øXYjm
_fe >C?<>ö!ä – á\ééé+áK
JGFAngK =I9:<e>mA =NP>F IS=EGFKEGLq>JGDQeA JO:<8Ngc
H
çá”
¥ >9IS>C:%ˆäžz çá#
G I çCá\ééé+á G áJH áJI |@c
NPEA >C;1EUi&>C?+:<e>DEGF:<=F8EG8I+A EGN*JG=FˆJ fŽG‹‰<‰<…'ŽG‚%‘m…¾GŒ‹<†!‘P\‡&†C„ •
oPpqsrtuvxwzy|{}_~:
€ = e‚_ƒ„Z… „X…‡†|ˆ‰…‡ˆ‰Š‹†_Œ„Xމb‰†|‘’_…‡ˆh“2”• îç ø ï V––—–AV • ÿ<îø ü:ï ˜ OR™ [ \ V—–––PVš:YV
› VXœ “0Š|… žbˆhŸ
„Xb¡e ¨ \ ŸT¢|£¥¤ˆ‰ç … „Z…_¦‡…‡§¡„X…‡†|ˆ#£|¢
± bJ“ [ „ª© \ O « V–¡––hV « Y0[­¬ O \c® « ø ®°¯ øV ™ [ \ V—––¡–hVš:Y Ÿ
„Xb¡e ] ŸT¢|£¥± ²³_ƒZ_‘´bJ„Zbƒªµ&ex‚„X…‡ˆ‰Š’£|¢
¶ªŽ‰…‡¦‡b ¹ b—® _»© º í O ©¥“³OR¼ ·ç_‘´e(¦‡b¸¼ ·Z…‡§b Y
½ †|ƒBb¡_¾Ž [ O « ç V–¡–¡V–h––¡V «–h V Y,¿ „ZŽ»Y ¾b¡¦‡¦,À
© í O « ç V¡–¡–¡–hV « Y “ [ O \ g í › = Yç © í—ó ç O‡« ç V–¡––hV « YAÁ í O « ç V–—––hV « Y
à î íMï O « ç V¡–¡–¡–hV « Y “ [ O g© O O‡« g V¡–¡› –= –hY V í « YX Ä Yh› = Á3Á°œ ÅÆœ
½ †|ƒªb¡_¾Ž ºMǐ• î Lç ï È •\ Éî è4ï \ ȋ–¡–¡– • î ï À
íï
N î íMï O º Y “ [ S • î ç à ï î S O‡S «• ç î V—è –ï –S –PV « S • Y î ï S
– É –—––
í
ç
¶ªO « މç bƒZb  « O‡« V¡„Z–¡Ž»––h¾b¡V « ¦‡¦, À‚Y_ˆ‰[  \ í O… «Œ&ç „ZŽ(b ± ¿ «„XŽÊ‚„Xˉ‘8†_„XމŒ,b_ƒX¦‡¦‡¶ª·%…‡·X…‡ˆ>bž„XŸ †‹„Xމb
± “ [ V–¡± –¡Á –hV \´ Í9Y,¿ ÎRÏ:гÑ>ÒÔÓPÕ Â V¡––—–AV Y0[̬
oPp»qsrtuvxwzy|{‡}|~:
Ÿ=4?<Ir:\XU_q>?<>i=>C_:<e >s=F DC?<>NP>F:QJG;1~!ÒØJG;W1EO?<=4:<eNز – Ó ³ L0EG?#;>\JU?<F n
=F WlêRJO8ISIS=JGFKNP=4{:<8 ?<>RNPEA>;Ic ß >C:S:<=F WMˆ
Ö hZ>uJGF^=4:<>C?QJU:<=E1FK=F n
ï
A>C{X _!>ˆA >C[F>RIS8¶PD=>F:fIr:QJO:<=Ir:<=DI!× îØ zöä – á\ééé+á
|qh]
ø
Ù ø îØ ï [ ÚÛ øîØ ï VžU Ü øîØ ï V W Ü øîØ ï Ý
ÞÆ[ ßà \ – Ú á í ø îØ ï Olã YJV á í ø îØ ï ORã Y.– Q û V á í ø îØ ï ORã Y:– Q û Q ûi Ý V
± û çžâ û çžâ
û çžâ
_fe >C?<> ä
îØ ó ç ï ãzâ å H î‡Ø ó ç ï áI îØ ó ç ï |
îØ ï z
z– |
å
| Þ>ä ßà
ø
G
ø
ø ç G øîØ ó ç ï ãû zâ û ø å H øîØ ó ç ï ø áJI øîØ ó ç ï | æ
ï
|9zöä ä – áéé\éá¡
|sLMEG?”ä â ÿ h]
¥ >ˆJG;ISE*A >@[$F>´× î‡Ø zä ø
× ø îØ ï z | Þ>ä ßà –ë é.æ ø îØ ï z |@á ø îØ ï z |#éCâ ÿ á ø îØ ï z |éâ ÿ â ÿki ç æ
ä
ä < Ì5ñä <­5
‡Ø Ö ‡Ø Ö Ø ‡Ø Ö Ø Øi
z'×5|u£—F:S?<EA8D>jJKA =ISDEG8F:<=FW^YJO?QJGNP>@:<>C? vz'Ó
– |p:<E
NPEA =4L0]*:<e>98YAJU:<=FW?<8 ;>zy™1|q=F:<Em:<e>9L0E1;;EU_f=F W •
ó çï
ï
ï
ï
î ï • ä±z –
&| î
9é&z î z U|@á î z U|`â á î z U|`â â |@á
ø
ø
ø
ø
ø
tqe=I?<8;>!N*JOa&>I:<e >!Ir:QJU:<=Ir:<=DI>C{YZEGF>F:<=JG;;4]uA >DJ\]p_f=4:<e
JmLJODC:<EG?mz –
1|qJGI5:<e >pIr:QJGW1>pY?<ED>>\AIc
× ‡Ø
CÊ< J× Ø /Ô<
C­<
ò |ó
GŒ—† £—L$:<e >!NPEA =4[D\JO:<=E1F=Ifz'×5|EGF;4]XO_f=:<e E18:”z'’9|@XU_q>qEGh :QJG=F
:<e>fJO;W1EG?<=4:<e NÜY?<E1YZE1IS>A%h] ¹ EG;JGFgzIS>>f>1c Wcf² – Ó ³ |@cstqe>xA >@:QJG=;I
EGL:<e>5dÚp~sÒºJG;W1EO?<=4:<eN±JO?<>5=FmŸ=W c&™c ¹ EG:<=D>!:<eJO:#=F%Ÿ=Wc™X&J
Y$JU?QJGNP>C:<>@? j=I=F:S?<EA 8DC>\AR=FuEO?QA >C?2:<E5=NPY ?<EUi&>#:<e>Ir:QJGh =;=4:—]pEGL
ï
:<e>”>Ir:<=N*JO:<>I5EOL ø X_fe=DQeb=I5IS>C:5:<E – æ Ó Ç™æ Ócð”IS8$JG;;4] î ä
ø
ï
– bJOF$A î IfJO?<>9IS>C:5ISEm:<eJO:q:<e >C]jJO?<>”8F =L0EG?<NP;4]jA =Ir:S?<=h8:<>\A
EUi&>C?”:<e>%A ø JO:QJPISY$JOD>1cutqe >DEGNPY8 :QJU:<=E1Fg:<=NP>uL0EG?p:<e >%dÚp~!Ò
JG;WGEG?<=4:<eNÕJU:5>\JOD@e*?<E18 F$AP=I %z è |#_fe>C?<> %=I!:<e>”A =NP>F IS=E1F
EGL:<e>pA JO:QJJOF$A b=Iq:<e>RF8 NhZ>C?!EGLêRJO8ISIS=JGFKA=Ir:S?<=h 8 :<=E1F Ic
kô
' 2H ö
’õ
G
G
ö
c÷ K %K
‹
oPpr¸øùtuvxwzy|{}_~: Ol› VZúkVZÅ “³Š|… žbˆ Y
„Xbe \ Ÿ’¢|£%ï ¤ˆ(… „Zï …_¦‡…‡§¡ï „X…‡†|ˆ#ï£|¢ ï
bJ„ U øîö VXÛ øîö VžU Ü øîö VW øîö V W Ü øîö Ol™ [ \ V¡û‡û‡û‡VłY Ÿ
±
„Xbe “ [ ] Ÿ’\ ¢|£%²0_ƒZ_‘´b„Xbƒªµ&ex‚„X…‡ˆ‰Š£|¢
¶ªŽ‰¹…‡¦‡b ± ® © í O ©9“ ·_‘´e‰¦‡b¸·Z…‡§b Y
b¡_ Q
Œl†|ƒ ™ íM[ ï \ V ] V¡û‡û‡û‡VÅ
î í—ó ç ï NPOlQ í S U î í—ó ç ï î íyó ç ï
›
Û
î “ O g ›
ø
â îø íï [ \ ú Y î í—ü ó ç ø ï ç Û øî í—ó î íMç ï ï NPOlQ øí S U øî íyó VW ç ï ø VW øî íyó Y ç ï Y Á ú Å
›
“ O g ›
UÛ Ü ø øîî ííïï “ [ [ O \ \ î íg ï › YYî Û íU Ü øï øî í—ó ç ï Á Á › â â ø ø î íï – Q í
U ø î íï “ [U Ü ø Ä_Û ø î í—ó ç ï î íï í
W Ü øî íï “ [ O \ î íg ï › Y î W íÜ ï ø î íÁ ï › î âíï ø – Q Q íi
± “ [ W ø± Á “ [\ W Ü ø Ä_Û ø g U ø U ø i
Í¥ÎlÏ:ÐkўÒÊý0Õ oPpr¸øùtuvxwzy|{}_~:
2.2.2
£`F%:<e >fFE1Non-Parametric
FnyY$JO?QJONP>C:S?<=Dfi&>C?<ISVersion
=E1F%_!>”>NPY ;EU]JGI!JR[$F=4:<>fNP=4{:<8 ?<>
#þ
zâ•( ø |$á
NPEA >C;+EUi&>@?x:<e >RDEGF:<=F8EG8IxA EGN*JG=FgJ &†@@‚Z†C„2‘…¾GŒ‹S†ˆ‘%\‡†C„ •
t e >!=FD@?<>NP>F:QJG;~sÒºJG;WGEG?<=4:<eNTL0EG?sêRJO8ISIS=JGFmNP={:<8?<>NPEA>;I
q
DCE1FIS=Ir:<IxEGL#:<e >9LMEG;;E\_f=FWj~#n—Ir:<>CY^JGFAgÒbnyIr:<>Y² – Ó ³ •
¤!eEE1IS>%JlAJU:<8Noâ û L}?<E1N€:<e >IS>\¨8>CFD>mâ í cê9=i&>F
ó
î ç ï X DEGNPY8 :<>
î ï z Z|ä – é
î ï z |@á î ï z |#éCâ á î ï z Z|#éCâ â
û ø
û û æ
ë
ø
ø
ø
î ï ä
î ó çï
î ó ç ï z |
î ï z |@æ zy™G|
tqe>CF2áfIS>C:
–
z'›&|
ÿ Fø ç _fe>@?<> ÿ =IxW1=i&>CF2X:äžùž ç áééé+áJ ý =I9DJG;;>\AKJ*IS>@:REGL¦$rGŒy1ƒ
Œ¼Q¦ †@‰QX zré+•z ø |x=Ix:<e>ua&>C?<F>C;LM8 FDC:<=E1FBA>C[$F >\AgJGIRJbêRJO8ISIS=JGF
A >CFIS=4:`]”_f=:<epNP>JGF ø JGF$ARiGJO?<=JOFD>N*JO:S?<=4{kä4Kö'úz è áé\éé+á è |
LMEO?qJ”YZE1IS=4:<=i&>fDE1F Ir:QJGF:
X&JGF$A»u
K =I#:<e>fA=NP>FIS=E1FmEGL+JpA JO:<8Ngc
> =F:S?<EA8D>*e >C?<>%:<e>jdÚp~!Ò JG;WGEG?<=4:<eN h]NPEA=4L0]=FWl:<e >
¥ P
=F DC?<>NP>F:QJG;2~sÒ JO;W1EG?<=4:<e NoJOI5LME1;;E\_fI•
> =F:S?<EA8D>se>C?<>:<e>x¿À Ã'¿Z†<ÄC‹†@‚ Œ…'Ž1„M„ ¼9ÀR…M‰@ŠQO‹‚ Œ…M‚ 5r1ƒ
¥ s
ŒyGŒ¼Q¦ † ¦‡&ŽGŒ…M‚CÅpŽ1„ &GQ…MŒ0‘kLMEG?EGF ny;=F>q;>\JU?<F=FW”Y ?<EG:<EO:`]YZ>I#=F
:<e>fa&>@?<F>; NP={:<8?<>1c#tqe =Is=IshJGIS>\APE1Fjê”?QJOhZ>D1¡ I5JO;WGEG?<=4:<eNͲ ÝO³ c
ŸEO?9JmW1=i&>FlAJO:QJmIS>\¨8>F D>pâ í ä,â ç éCééSâ2íQá[?<Ir:xA >@[$F>G•
í
í
zâ!å â |ä
þmzMë@á Z| zâ•1â |@á
ç
_fe>@?<>”þuzMëCárëS| ä XþmzMë@á Z| ä
z – &| íyó ó ç L0EG? 3ë – JOF$A
í
Ó
– =IqJuA=ISDE18 F:<=F WuLMJGDC:<EO?\c ¹ EG:<>f:<e$JU:
ç þmzMë@á $|ä
è9éê_ë Òx츇ØÕ
× Ø å
ä
ä
ä
Ø å
æ Ø å Ø å
si ç
× Ø × Ø ÌC × Ø å 0/× Ø å
í6éê_ë Òxì¸Õ ¤!E1NPY8:<>9:<e>pF >C_Ç>Ir:<=N*JO:<>’îØ ï h]
H øîØ ï äïH î øîØ ï ' G øîØ ï JGFAðI øîØ ï ä I î øîØ ï ' G øîØ ï C­H øîØ ï H øîØ ï i æ
tqe >qYZE1=F:=I:<e$JU:=Fu:<e>!~nyIr:<>Yu:<e>!IS8¶PD=>F:Ir:QJO:<=Ir:<=DI&× îØ ó ç ï
=I8 YAJU:<>\A9?<>;JO:<=i&>:<EfL0EG?JU?<h=4:S?QJO?<=;4]ˆDQeE1IS>CFmâ û c#×s]9?<>YZ>\JO:<=F W
:<e >p=4:<>C?QJO:<=E1FlEGL#:<e>R~°JGFAgÒ Ir:<>Y If_pc ?\c :\c 1Ö X:
î‡Ø ï DEGFi1>C?<W1>Ic
Ø
;Ö
z'’R|P¤!e EE1IS>Kâ û =F°:<=NP>gEO?QA >C?\Xf=c >1cXxD@e EE1IS>^â JO:*:<e> C:<e
?<E18 F$A=Fv:<e >b~#nyIr:<>Y2cKÒgJGa&>*E1F ;4]vE1F >*=:<>@?QJO:<=E1F3EGLf:<e >
~°JOF$AlÒ Ir:<>CYIqLMEO?x>\JGDQe 1ctqe=IfN*JGa&>CIq:<e>RYJO?QJGNP>@:<>C?<I
8YA JO:<>\Aj>i&>C?S]*:<=NP>pJ%A JO:<8 N“=Ix=F Y8 :\c
°Ö
ãzâqå 1|ä
tqe>mA =4w>C?<>CFD>uhZ>C:`_!>>Fg:<e >uYJO?QJONP>C:S?<=DJOF$AgFEGF nyY$JU?QJGNP>C:S?<=D
&i >C?<IS=EGFI=I:<eJO:+:<e>DE>C¶PDC=>CF:i&>DC:<EO?JOF$AR:<e>iGJO?<=JGF D>sN*JU:S?<=4{
LMEO?pJ%[$F =4:<>uNP=4{:<8 ?<>ˆJU?<>miGJO?<=JOh;>m=Fg:<e >ˆL0EG?<NP>C?9NPEA >;X$_fe =;>
:<e>@]lJU?<>R[{>\Aj=Fj:<e>p;JO:S:<>@?”NPEA>;c
5 <»5
ÞÆßà <
Þ>ðßà < C2 < hC
F
e EG;}AIc¢9>F D> zâ!å â í |s=IfJˆ_q>=W1e:<>\AjIS8N“EOL zâ•&â |9z %ä
– – á\ééé+árë<|b_fe >C?<>v:<e>_q>=W1e:BhZ>DEGNP>I^;JO?<WG>3JGI T=FD@?<>\JGIS>Ic
í
¹ >C{:xA >C[F>9:<e >RI<¨8$JU?<>p>C?S?<EG?xEGLãzâqå &|s:<E zâqå â |!h]
í
í è
è
z m•Gâ |ä
ãzâ!å &|
zâ!å â | âsæ
î sC K
¥ ´ /"!
#!» ¥î î /
! » 4
oPp%$'&8tuvxwzy|{}_~: < ÿ
„Zbe \ Ÿ´¢|£%¤ˆ‰… „X…_¦‡…‡§—„X…‡†|ˆ2£|¢
ö
± bJ“ [„ à \ Ol™ [ \ V¡û‡û‡û‡V)#( Y ·Z†%„ZŽ‚„ª„Xމb* _ƒXbcˉˆ‰… Œl†|ƒZ‘´¦ *´(…‡·X„XƒZ…,+‰Ë(„XbhŸ
„Zbe ] ¢|£%²kƒX†_„Z†_„Æ* exb%µªex‚„Z…‡ˆ(Š£|¢
¶ªŽ‰¹…‡¦‡b ± ® © O ©9“ ·Z_‘´e‰¦‡b·Z…‡§b Y
b¡_»º
ŒR†|ƒª_¦‡¦ O‡« V.2- VÅzV0l/ Y
1 32 “ [ › Ú3( – Ol¼ 4 2 g à 32 Y bJd(e O g65 798;< : > 8DB@ =C EÉ<?< A> > 8;8D@ @ 5 É É Y
g ü O,à 2 g à ?:2 Y bJd(e O g 5 BC É A 5 Y Ý
ODF b¡ƒXb à ?2 ‰bˆ‰†_„Xb·¸< „X> މb E/ < „X> Ž ¾†|< ‘´> ex†|Eˆ‰< b> ˆž„¸†_Œ à û Y < > E< > É
G ?H 32 “ [ O  H 2 g AJ8DI @ ü K)8DI @ C4 É AM8;GL @ K.8DL @ ÃY bJdÆe O g 1 5 A 8;@ BC É K 8D@ 5 Y
†|¦ žb„Xމb9¦‡…‡ˆ‰b¡_ƒªbM>N ˂„X…‡†|ˆh“
O Å![ \ V—û‡û‡û‡V)( À z/ [ \ V—û‡û‡û‡V.>Q Y Œl†|ƒ&_¦‡H ¦ O‡« V)?H- 3Y 2PO ?H [ ?2
± “ [ à JH± Á \ “ [ à ?H Á O à JH
Í9ÎRÏ:ÐkўÒS0R Õ oPp%$'8
& t»uvxwAy_{}_~:
Ÿ EG?sJRF>C_V=FY 8 :â2í ç X1:<e >xdÚpÔð,JO;W1EG?<=4:<e NØ8 YAJU:<>IJ9Y ?<EO:<EGn
î íMï h]mD@e EE1IS=FW
î íï ISEp:<eJO: è z î íï
:—]YZ> î íï =F:<E î íï
íî Mï •2â í â í ç<|R=ImNP=F =N*JO;8F$A>C?p:<e>PDCE1F$A=4:<=EGF:<e$JU: è z •
â í |#=I!NP=F=NP=Ì>\Auh] ˆä î íï ætqe>xA >@:QJG=;IqJO?<>xISeE\_fFP=F*Ÿ=W c ›c
z Oá á
ø
•W1=i&>F$|
î ï
í
î íï
î íï
îí ç ï
ò |ó
ÿ
¥<
í ç
ø ç
î íï
ø
î íï
î íï
î íï
ó
î
ó
î íï
è
ü
ïî
ó
î íï
ó
î íï
ï
î íï
ó
î íï
î íï
GŒ—† tqe >KDE1NPY 8 :QJO:<=EGFk:<=NP>lLMEO?b:<e >KdÚRÔð€JG;W1EO?<=:<e NÉJU:
>JGDQe°?<E18 F$Ak=I %z è è |m_fe>@?<> =IP:<e >^A =NP>F IS=EGF°EOLuAJO:QJ
JOF$A
=IR:<e>uF8 NhZ>C?9EGL!Y ?<EG:<EO:`]YZ>Icmtqe>%dÚpÔðØJG;W1EO?<=4:<eN
DCE1=FD=A>IR_f=4:<eê”?QJOhZ>D1¡ IˆJG;WGEG?<=4:<eN.² ÝU³ =F^:<e >mD\JOIS>m_fe >C?<>u_!>
;>C: mhZ>9:<=NP>pA >YZ>CF$A >CF:5JGI pä – ëCc
M÷ K ÿ
nK
¥<
'
tqe >gFEGF nyY$JU?QJGNP>C:S?<=Dji&>C?<IS=E1FVEGLpddvD\JOF°hZ>b:<e E18 W1e:%EOLpJGI%J
iGJO?<=JOF:REGL!×!8 ?<WG>PJGFAdeE\_5n—tJ];EO?\¡ IpY ?<E1WO?QJGNô² › ³ IS=F D>:<e >C]
JU?<>^hZEG:<ekh$JGIS>AkE1F,ê”?QJGhZ>DG¡ IjJO;WGEG?<=4:<eNgcÇÒgJUÑ`EG?lA =4w>C?<>F D>I
hZ>@:`_q>C>Fl:<e>CNÕJO?<> – |5NP>@:<eEA I5EOLA =ISDEG8F:<=FWYJGIr:x>C{ JGNPY ;>I
JOF$A^™G|qNP>C:<eEAIqEGLISDEO?<>pD\JG;D8 ;JO:<=E1F+c
2.3
×s>;EU_¬Score
_q>pWG=i&>ˆCalculation
JNP>C:<e EAjEOL#D\JG;D8 ;JO:<=FW*JISDCEG?<>pLMEO?9JAJO:<8 Ngc
íï
ß >C:”ã î zàá`â#|phZ>*:<e >pÑrE1=F:PA=Ir:S?<=h 8 :<=E1FEGh :QJO=F >\AJO:u:<=NP>PëCX
íï
íï
íï
=c >1cXã î zàáSâ|säã î zà|0ã î zâqå à|@cqê9=i&>CF^JGFg=F Y8 :uzà í árâ í |fJU:
:<=NP>9ë@X _!>ˆA >C[F>R=4:<I ˆ†C„M„ …M‚†@9‰CŠ<GS†”JOI
è
í í
î íï
î í—ó ç ï
è
UT
› \ áMXZY f\[ N
ÙWV O º V Q Y0[
Oº VQ Y g [ N Oº VQ Ym Q Q V
_fe>@?<>#<l=IJ^A=ISDE18 F:<=F WgY$JU?QJGNP>C:<>C?ˆ_fe >C?<>P_q>*IS>C:»< = ä <c
£—F:<8=4:<=i&>;4]X:<e=I%ISDEO?<>lNP>\JOIS8 ?<>I%e E\_Õ;JO?<W1>b:<e>gA=Ir:S?<=h 8 :<=E1F
ã î íï eJGIfNPEUi&>\APL0?<EGNØã î í—ó ç ï JOL}:<>C?9;>\JU?<F=FWmL0?<E1N zà í árâ í |@c
×^]
¥ >ˆJG;ISE*A >@[$F>RJGFEO:<e>C?fISDCEG?<>ˆD\JG;;>\Al:<e >%„<&ŽGQ…MŒ0‘…Šm„G‰<‰!JGI
í—ó ç ï
íyó ç ï
zà2íSáSâí`|ä b;E1W2ã î
zà2ír| ;EGWã î
zâ2íCå à2ír|@æ
C
sC
Ÿ ?<E1N :<e>i=>C_fYZEG=F:uEOL5=F LMEO?<N*JO:<=E1F:<e>EO?S]X2:<e >%;E1W&JU?<=4:<eNP=D
;EGISIxDJGFlhZ>x:<eEG8W1e:5EOLJGIq:<e >9DEA>;>FWO:<el?<>\¨8=4?<>\AP:<E>CFDEA>
zà2íQárâí—|*8 F$A>C?b:<e >BJGISIS8NPY:<=E1F°:<eJO:lJVA JO:<8 Nì=IjW1>F >C?QJO:<>A
íyó ï
JODDEO?QA =FW%:<EPJmY ?<E1hJGh =;=4:`]lA >CFIS=4:`]uã î ç c
3. EXPERIMENTAL RESULTS
3.1
;=>\A3dN*JO?S:@Intrusion
d=L}:<>C?u:<El:<e>jDetection
AJU:QJGIS>C:mÙpÚRÚͤ!8 Y – µGµ1µ3² Û ³
¥ >*JOYY Network
Y ?<>CY$JO?<>AL0EG?PF >C:`_!EG?<av=F:S?<8IS=EGF°A>C:<>DC:<=E1F+ctqe >lY8?<YZE1IS>jEGL
:<e>x>C{YZ>C?<=NP>F:_5JOI!:<EuA >C:<>D@:5JGIsN*JGF]%=F:S?<8IS=EGFIqJOI!YZEGISIS=h ;>
=FBJGFBE1F ny;=F>uIS>C:S:<=FW*_f=4:<eE18:pN*JGa=FWP8 IS>EOLs:<e >m;JGhZ>C;Icu’x;4n
:<eEG8WGe=FÙpÚRÚ¯¤!8Y – µ1µGµ”:<e>5A JO:QJ9;JOhZ>;I_!>C?<>q8IS>Am=F:S?QJG=Fn
=FWxLMEG?IS8 YZ>C?<i=IS>Am=F:S?<8IS=E1FmA >C:<>CDC:<=E1F2XG_q>q8 IS>\Au:<e >NTEGF;4]ˆLMEO?
:<e>”>iGJG;8$JU:<=EGFlEOLddZc¢9>F D>RJOF]*IS8 YZ>C?<i=IS>\AbJOYY?<E&JGDQeb:<Eu:<e>
AJU:QJGIS>C:x=IxFEG:5LMJG=4?<;4]gDEGNPY$JU?QJGh;>R_f=4:<e^d dc
~JGDQe^AJU:<8Nº=FbÙpÚRÚ±¤!8Y – µGµ1µ=IfISYZ>D=4[$>Abh]jœ – JU:S:S?<=h8 :<>CI
z'›GœDE1F:<=F8E18 I5JGFAgۈD\JO:<>WGEG?<=D\JO;0|fJGFAbJm;}JOhZ>;+A >ISD@?<=h =FWPJU:Sn
:QJGDQa,:`]YZ>3zy™1™3a=FA I•VFEO?<N*JG;XRhJGDQaZXRh8w>C? EOi1>C? $E\_pXR>@:<D1c |
_fe>@?<>KJG;;9;JGhZ>C;Ij>C{D>Y: `F EG?<N*JG; =F$A=D\JO:<>KJOF¯JO:S:QJOD@aZc ¥ >
8IS>A°LME18?lEOLˆ:<e>KEG?<=W1=FJG;pœ – JU:S:S?<=h 8 :<>IBzIS>C?<i=D>1X”A 8?QJO:<=E1F+X
Ir?<D h]:<>IX+AIr: h]:<>IQ|5hZ>D\JG8 IS>:<e>CIS>uL0E18 ?9_q>C?<>:<e E18 W1e:REOLqJOI
:<e>”NPE1Ir:!h$JGIS=DpJU:S:S?<=h8 :<>CIcs79F;4] IS>C?<i=D>1¡=I5D\JO:<>WGEG?<=D\JO;'c!tqe>
F8NmhZ>C?ˆEGLfIS>C?<i=D>*a=F$A Iu=Imœ – XJOF$A_!>jDC;}JOISIS=4[$>\Av:<e>CNò=F:<E
ùUe:S:<Y+XISNm:<Y+X1L0:<Y+X&L0:<Y A JO:QJXEO:<e>C?<I ý csd=FDC>f:<e >”DCE1F:<=F8 E18 I!JU:Sn
:S?<=h8:<>uiGJG;8 >I”_!>C?<>mDCE1FDC>F:S?QJO:<>\A^JU?<E18FA^ÓXZ_!>u:S?QJOFIrLMEO?<NP>\A
>\JOD@egiGJG;8 >R=F:<E%Ji1JO;8>9LMJO?xL0?<E1N®ÓX$h] ä¯;EGW+z 3Óæ – |@c
J@
`_ ba
dc
6e
f/
tqe>EO?<=WG=F$JG;A JO:QJOIS>C:DEGF:QJG=FI2œ X ¸1µG¸X œ&› – AJU:QJXO=FD;8A =FWf›X µ1™1ÐX Ý Ð –
JO:S:QJOD@aIbz'¸1Óc – Þ%|@ctqe =Iu?QJO:<>bEGL”JO:S:QJOD@aI=Iu:<EE;JO?<WG>bL0EG?%Ir:QJUn
:<=Ir:<=D\JG;pEG8 :<;=>C?KA >@:<>DC:<=E1F+c“tqe >C?<>CLMEO?<>1X9_!>Y?<EA 8 D>\A¯JIS8hn
AJU:QJGIS>C:*d ŸHDCE1FIS=Ir:<=FWBEGL9µ&Û Ý X – ÐGÛAJU:QJX=FD;8A =FW›X ›&ÛGÛJU:Sn
:QJGDQaIsz'Óc ›&Ð1Þ|2h]9Y =DQa=FW58Y”:<e>AJU:QJ!_feE1IS>sJO:S:S?<=h 8 :<>f„<\†S‡ …M‚
=IqYZE1IS=4:<=i&>1cs’q:S:QJGDQaIs:<eJO:qIS8 DD>ISIrL08;;4]B„<\†<‡ …M‚JO?<>9DJG;;>\AB…M‚ƒ
ŒQ‹‰<…'O‚‰<c ¥ >#LM8?S:<e>C?2Y ?<EA8D>ApL}?<E1NTd Ÿ*:`_qEfa=F$AI2EOL$A JO:QJGIS>@:<I
d ŸÐOÓ^JGFAvd Ÿ – Ógh]B?QJOF$AE1N I<JGNPY ;=F W X2_fe>C?<>bd ŸÐOÓlDEGFIS=Ir:<I
EGLpÐGÓ1ÞòEGLRd Ÿ!XJOF$AVd Ÿ – ÓDEGFIS=Ir:<I%EOL – Ó1ÞòEOLˆd Ÿ!c#ŸEG?jdŸ – Ó
JGFAPd ŸÐOÓX&:<e >5[?<Ir:s¸X Ó1ÓGӈAJO:QJpJOF$Am:<e >q[?<Ir:s›1ÓX Ó1Ó1ÓuAJU:QJ9_q>C?<>
?<>ISYZ>D@:<=i1>;4]vFEO:ISDCEG?<>\Ah8:u8IS>\AvEGF;4]L0EG?u:S?QJG=F=FWKhZ>DJG8IS>
:<e>9NPEA >;_qEG8;AlFEO:fhZ>R_q>;;4n':S?QJG=F>Al=Fl:<e>R>JO?<;4]lIr:QJOW1>Ic
> W1>CF>C?QJU:<>\Ag:`_qEld Ÿ – ÓGI”h]lN*JGa=FWjA =4w>C?<>CF:x?QJGFA EGNoI<JON%n
¥ u
Y;=FWGIc5ŸEO?x>\JGDQegEGL#:<e >NgX_q>R?QJGFlhZEG:<egYJO?QJGNP>@:S?<=DˆJOF$AlF E1Fn
Y$JU?QJGNP>C:S?<=Dji&>C?<IS=E1F I%EGL9d dv_fe >C?<>*:<e>*LMEG?<NP>@?%=I%A>FEO:<>\Ah]
ddK_fe=;>*:<e >*;}JU:S:<>C?mh]d d c^tqe>PY$JU?QJGNP>C:<>@?<ImEOL”ddJU?<>jIS>@:
:<E KäÕÓæ ÓGÓ1Ó&™á Kä®Óæ Ó1ÓGÓ1›á väo™á Häo™æ ÓX_fe=;>j:<e E1IS>*EGL
dd gJO?<>gIS>C:m:<E ä€Óæ ÓGÓ1Ó1™á ä€Óæ ÓGÓ1Ó1›á
ä – Óá Hä€Óæ ™c
ddgY?<ED>ISIS>\ABµ&ÛX Ý ™ – AJO:QJP=F™G¸c ™PIS>DEGF$A IX_fe =;>%dd %A=}A^=F
™OœGœ c ¸RIS>DEGF$AIctJGh ;> – ISeE\_fI#:<e>sF8NhZ>@?EGL$=F:S?<8 IS=EGFId d+z G|
A >@:<>DC:<>\Aˆ_fe>C?<>q:<e >q¢9>;;=FWG>C?!ISDCEG?<>q_5JOIs8 IS>\AJOIJ9ISDEG?<>Gc¢9>C?<>
Š<G§G†@SŽ†5=I!:<e >x?QJU:<=EEGL+:<e>xF8NmhZ>C?!EOLA>C:<>DC:<>A*=F:S?<8IS=EGFI!:<E
:<e$JU:!EOL=F:S?<8IS=EGFI=FP:<e >”A JO:QJOIS>C:!:<eJO:qdd+z O|ISDCEG?<>\Acsdd=I!IS8n
YZ>C?<=EG?5:<Edd 9hZEG:<e*=FlJODD8 ?QJODC]jJGFAjDCE1NPY8:QJO:<=E1FP:<=NP>1ctqe =I
=NPY;=>I5:<e$JU:x:<e >ˆdÚR~!Ò JG;WGEG?<=4:<eNÕ_f=4:<eKJPêRJG8 ISIS=JGF^NP=4{:<8 ?<>
_qEO?<aIhZ>C:S:<>C?u:<e$JOFkê”?QJGhZ>D1¡ IJG;W1EO?<=:<e N»8 IS=F WBJKa1>C?<F>;sNP=4{n
:<8 ?<>GX _fe =DQel=I”JG;ISE*JhJGIS=IfEGL#:<e>9Y ?<E1WO?QJGN®=F² › ³ c
n<
<>=
Ê<
=g
Eg ¡<>=
Jô
ME g
)g
ÿ
)g
=g
hc
> JG;ISEgW1>CF>C?QJU:<>\ABL0E18 ?mdŸÐGÓOIuh]KN*JOa=F WlA=w>@?<>F:R?QJGFA E1N
¥ %
I<JGNPY ;=F W1I2EG?28IS=FWfJOFmJGAA=:<=EGF$JG;1D\JO:<>WGEG?<=D\JO;i1JU?<=}JOh;> Y?<EG:<EDEG;4n
:`]YZ>1¡UEOL ?QJOFWG>xùq:<DCY2XO8$AY*XG=NPDY ý ctJGh ;>5™fISe EU_fI:<e >!F8NmhZ>C?
EGL+=F:S?<8IS=E1F Iqd dA >@:<>DC:<>\A=F%:<e >qLME18?fdŸÐGÓGIc x>N*JU?<a1JOh;4]X1dd
_5JOIlJOh;>^:<EA >@:<>DC:b¸&™GÞ =F:S?<8IS=EGFIj=Fk:<e>g:<E1Y¯Ð1ÞôAJU:QJvEGL
e=WGe>Ir:xISDEO?<>Ic
ji
3.2
Pathology
’”8 Ir:S?QJGOutliers
;=J¡ I#¢9>JG;4:<emin
£—FISMedical
8?QJGFDC>q¤!EGNP
NP=ISIS=EGFbz¢”£S¤5Data
|2JGA NP=F=Ir:<>C?<I
0i
:<e>8F=i&>@?<I<JG;e>\JO;4:<ev=FIS8 ?QJOFD>ISD@e >NP>aFE\_fFJGImÒl>\A =D\JU?<>1X
=FEGYZ>C?QJO:<=E1FIS=F D> – µ1Û1Ðcb¤5d£ x7ܒ”8Ir:S?QJO;=}Jb=Ip_!EG?<a=FWb_f=4:<e
:<e>9¢9£S¤°:<E%>@{ Y ;EG?<>9:<e >p8 :<=;=ÌJO:<=E1F^EOL#Y$JU:<eE1;EGWG]bIS>C?<i=DC>Ic
ƒ „Z†|„Xe …‡†
qt\?ll
\ ¬ll
ƒ „Z†|„Xe …‡†
qt?\ ll
\ ¬ll
ks†_Œ0 ‰ …‡ˆ>„XƒZˉ·X…‡†|ˆ‰·B…‡ˆ‰¾¦‡Ë‰‰b O ¾†—žb (ƒ _£Š|b Y
]|]9\ ]9]9t mu OoODODnrr9¬¬r ll YY ]|]9\ ]|ts]pn]»r O;O;ODu9qsrptur ll YY nsup\ nq r OO OD\ t qm l l Y Y trp] v\ \ OO,O;]9\ u tq l l Y Y
q \ m\ O;m9v ll YY q9q \ O;m9v ll YY ] ¬ u»OD\ u|] l l Y Y \ q|]»O;q9m l l Y Y
whxWy{z ÒÌÓPÕ p}ž| }3|_~ }3|€‚M‚ƒ }_y9„E—… {wWƒE´… {o°ƒ oE†'‡ˆ
sk bƒ†_(Œ0…‡¾…‡ˆ>b „XƒZˉ·X…‡†|ˆ‰·B…‡ˆ‰¾¦‡Ë‰‰·Zbbƒ (…‡O ¾¾b'†—žL‰ bƒe(_ƒZŠ|†_b „XY †Æ¾†|¦ „(* exb
Z
·
m|]9]|v|] ]»ODODt9rpt u l Y Y m9]9u9u »v ¬ O;ODtsrpr t l Y Y q9t t \ ¬ OROD] u9\?v l Y Y qpnsu9u t O,O;] u9\?m l Y Y
\\ q9m \ O;|v ] ll Y \\ ]9vpn ODrpu ll Y \|\ q\ \ ¬ Orpv ll Y \|\ q\ ¬ n ODr9r ll Y
\ u \ r O;m9Ò;u l ý0Y Õ \ tsrpu O;mpn l Y \ u9q9»q ODmsr l Y \ u9q9u O;msr l Y
whxWy{z p}|ž}3|~_}3|€‚Mƒ‚}_y9„E…—{wWƒE…´{oƒ°oE†Šˆ
’ºAJO:QJOIS>C:mDEUi&>C?<=FWK™b]&>\JO?<Ip_f=4:<eEUi&>C?m›&™lNP=;;=EGFvY$JU:<eEG;EGWG]
:S?QJOFI<JODC:<=E1FIK=I^:<e>h$JGIS=IKEGLm:<e>vIr:<8A]co~JGDQeH:S?QJGF I<JGDC:<=EGF
?<>CDEG?QAI*:<e >l:`]YZ>bEGLpNP>\A=D\JG;5:<>Ir:*YZ>C?SL0EG?<NP>\AX5JOF°>F DC?S]Y :<>\A
=A>F:<=[>C?9L0EG?R:<e >u?<>CF$A >@?<=F WjA EDC:<EO?\XZ:<e>u;}JOhZEG?QJU:<EG?S]KYZ>C?SL0EG?<N%n
=F W:<e>g:<>Ir:\X5JGF$AV:<e>^AEDC:<EG?*_feE?<>\¨8>Ir:<>\A3:<e>g:<>Ir:\X5JGF$A
EO:<e>C?=F L0EG?<N*JU:<=EGF%?<>;JO:<=FWR:<ER:<e >!:`]YZ>qEOL+A EDC:<EO?qJOF$AYJO:<=>F:\c
dN*JO?S:@d=L}:<>C?ue$JOIuhZ>C>F8 IS>\AE1F:<e=IˆAJU:QJGIS>C:uLMEO?u:—_qEKA=Ir:<=F DC:
L08F DC:<=E1FIctqe>m[?<Ir:p8 IS>\Ad d^:<Ej=A >F:<=4L0]B>C?S?<EO?<Ip=FB:<e >%AJU:QJc
’xFH=F =:<=JO;JOYY;=D\JU:<=EGFT:<Ek:<e >vEG?<=WG=FJG;ˆ:S?QJGF I<JGDC:<=E1FñAJO:QJOIS>C:
=A>F:<=[>\Av:S?QJGF I<JGDC:<=E1F I:<e$JU:_!>C?<>l8 F8 IS8$JO; °E18:<;=>@?<IcVÒgJGF]
EOLR:<e>j:S?QJGF I<JGDC:<=E1F I*=}A>F:<=4[$>\A3e$JGAV=Fi1JO;=}AVAJU:QJ=4:<>NPIgz'AE1;4n
;JU?%JONPE18F:<IReJ1A>@{:S?QJjÌ>C?<EGIXJGW1>CIuEOLfY$JU:<=>CF:<Ip_!>C?<>PWG?<>\JU:<>C?
:<eJGF – ÓGÓ*]&>\JO?<IX>C:<DGc |@c9tqe>mAJU:QJGIS>C:9LMEG?pJGF$JO;4] IS=IRDJGF^:<e8IxhZ>
DC;>JGFIS>AgEGL:<e >IS>R?<>DEO?QA Ic
,‹
tqe >fY ?<=N*JO?S]mY8?<YZE1IS>5EGL2d dm=I:<Ep>@{ Y ;EG?<>fi1JU?<=E18I:S?QJGF IrLMEO?<N*JOn
:<=EGFIxEGL:<e>R:S?QJOFI<JGD@:<=EGFBAJO:QJOIS>C:\cftqe >IS>ˆ=F D;8$A>ˆJGW1WO?<>W&JU:<=FW
AEDC:<EG?<Ijzy™GÓX Ó1Ó1Ó^>F:<=4:<=>IQ|@XYJO:<=>F:<I*zœ X Ó1ÓGÓX Ó1ÓGÓB>CF:<=4:<=>IQ|@XJGF$A
;JOhZEG?QJO:<EO?<=>I”z – ÐGÓf>F:<=4:<=>CIQ|@cdd9_5JOIJGh ;>:<E”=A>F:<=L}]XULMEG?>@{JON%n
Y ;>1X;JGhZEG?QJU:<EG?<=>Iq:<eJO:se$J\i&>fY$JU:S:<>C?<FIsEGL+hZ>e$J\i=EG?s:<e$JO:!JO?<>xE18:
EOLq:<e>mEG?QA=FJO?S]c%79F>PA JO:QJOIS>C:ˆ8IS>\AKDEGFIS=Ir:<>\AEOLÑr8 Ir:mÛjiGJO?<=4n
JOh;>ILMEG?!>\JGDQeP;JGhZEO?QJO:<EG?S]X=F D;8$A =F WpYZ>C?<D>F:QJGWG>xA =Ir:S?<=h8 :<=EGFI
EUi&>@?9[$i1>ˆ:<>CIr:RD\JU:<>W1EO?<=>CIPz>1c W cX¤!e>NP=D\JO;:<>Ir:<IXÒl=DC?<E1h =EG;E1WG]
:<>CIr:<IX#£`NPNm8FEG;E1WG]l:<>Ir:<IX#>C:<D1c |@X2:<e>%F8NmhZ>C?pEOLfA =4w>C?<>F:ˆYJOn
:<=>F:<IjA >JG;4:*_f=:<e°h]3:<e >g;JGhZEG?QJU:<EG?S]XxJOF$Ak:<e >lL0?<>\¨8 >FDC]VEOL
:<>CIr:<IPYZ>C?SLMEO?<NP>\A¬z'tJGh;>l›&|@c,ddv=A >F:<=4[$>\A3;JGhZEO?QJO:<EG?<=>I – Ó1µX
– ™ Ý X$JOF$A –1– œm_f=:<ejDEGFIS=Ir:<>F:<;4]be =W1ebA =Ir:QJGF D>RISDEO?<>Icqt!_!EEOL
:<e >IS>ˆ;JGhZEG?QJU:<EG?<=>IRISYZ>CD=JG;=Ì>\A^=F^tq=ISIS8>uÔ#JO:<e E1;E1WO]z – ÓGµPJGF$A
–G– œ&|!JGFAP:<e >”EO:<e>C?qA E>IsFEmÒl=DC?<E1h =E1;E1WO]bF EG?qtq=ISIS8 >RÔ#JU:<eE1;4n
EGWG]lz – ™ Ý |@cstqe> `F EG?<N*JG; pIS=4:<8$JU:<=E1FPLMEO?!:<e=IsAJU:QJGIS>C:s=F$A =D\JU:<>I
:<eJO:#YJO:<e E1;E1WO]mY?<EUi=A>C?<IW1>CF>C?QJO;;4]uYZ>C?SL0EG?<NžJxISY ?<>\JGAuEOL:<>Ir:<Ic
Ÿ8 ?S:<e >C?9JGF$JO;4] IS>CI9_f=4:<eB:<e >m¢”;0¤HJO?<>=FKY ?<EGWG?<>ISIX2>NPY ;E\]=FW
6_ ba
¨ p+
‡\ ¬ˆv¬ 
\|‡\|\\|‡•\ ’
\|‡˜\|\\—um –
\ ]sr
© è ©WŒ
¬ˆ Ÿ \ m ¬ˆ Ÿ \ ¬
¬¬ ŸŸ ¬|¬q ¬¬ Ÿ ¬ ]
ˆ¬ Ÿ ¬\ t ˆ¬ Ÿ ¬ t
¬ˆ ¬ˆE‘,““
¬ Ÿ\ v ¬ Ÿ¬ \
whx=y{z ҙR0#Õ š xE› ì z Ò
©ç
¬ˆ Ÿ upn
¬¬ Ÿ 9] m
ˆ¬ Ÿ n
¬ˆE‘,“\ “
¬ Ÿ q9q
©= Ž ç
¬ˆ Ÿ ¬ \ ¬‡ Ÿ q|]
¬¬ ŸŸ nžns]m ¬¬ ŸŸ v9q|m]
ˆ¬ Ÿ nsu ˆE¬ Ÿ‘ ns”u –
¬ˆEŸ ‘ t “”“ ¬‡ Ÿ t
¬ Ÿ nst ¬ Ÿ q9q
z;xWy
œ Ñ x ë œ Ñ âž x ë x Ÿ
©B
¬‡ Ÿ ¬ n
¬¬ ŸŸ ts¬ tr
‡
¬¬ ŸŸ ¬t \
ˆ¬ Ÿ ¬
\
ެ Ÿ ¬ q
ˆ¬ Ÿ‘ ¬ ’”m “
¬ˆŸ ‘ ¬ “\ ˆ
¬¬ ŸŸ qt \
‡¬ Ÿ ¬
è
\
Jg_f=A >bi1JU?<=>C:`]EGLf:<>DQeF=¨8>CIA?QJ\_fFL}?<E1N.AJO:QJ^NP=F=F WKJGF$A
Ir:QJU:<=Ir:<=DCIP=F3WG>F>C?QJO;cVtqe>l8 IS>bEOLpd dvY ?<EUi=}A>I=F IS=WGe:<I%=F:<E
:<e>uA JO:QJX$hZEG:<eg:<e ?<EG8WGeg:<e>ˆ=A >F:<=4[$D\JU:<=E1FKEGL>C?S?<EGF>EG8IRA JO:QJ
JGFAB:<e?<E18WGe:<e >%=A >F:<=4[$D\JU:<=E1FvEOL5>F:<=4:<=>CIˆ:<eJO:ˆN*J]^?<>\¨8=4?<>
LM8?S:<e>C?x=Fi&>Ir:<=W&JU:<=E1F2c
4.
tqe=IpCONCLUSION
YJGYZ>C?ˆeJGIpY ?<EGYZE1IS>\AdN*JU?S:@d=4L0:<>C?pJGIˆJbY?<E1WO?QJGN LMEO?ˆE1Fn
;=F>^8F IS8YZ>C?<i=IS>\A3E18:<;=>C?bA>C:<>DC:<=E1F+c ¥ >lW&J\i&>^JIr:QJU:<=Ir:<=DJG;
:<e>CEG?S]LMEO?ldd3JGF$AVA >CNPE1FIr:S?QJU:<>\A3=:<IP>@w>DC:<=i&>F >ISIP=FV:<>C?<NPI
EGL5JGDD8?QJGDC]JGFADEGNPY8:QJO:<=E1FB:<=NP>m:<e ?<E18 W1eB:<e>:—_qEl>@{ YZ>@?Sn
=NP>F:<I•TF >C:`_!EG?<a¬=F:S?<8 IS=E1F±A >@:<>DC:<=E1FñL0EG?vÙpÚ9Úì¤!8Y – µ1µ1µ
JGFA*?QJU?<>p>i&>F:fA>C:<>DC:<=EGFjL0EG?f:<e>”e>\JO;:<eb=FIS8 ?QJOFD>9Y$JO:<e E1;E1WO]
AJU:QJGIS>C:uY?<EOi=A >ABh]B’”8 Ir:S?QJG;=JGF¢9>\JO;:<e£`F IS8 ?QJGF D>*¤!EGNPNP=Irn
IS=E1F+cf£—:”=I”>C{YZ>DC:<>\Aj:<e$JO:x:<e>RL}?QJGNP>C_!EG?<agEOLE1F ny;=F>ˆ8F IS8YZ>C?Sn
i=IS>\A°E18:<;=>@?lA>C:<>DC:<=EGF,8IS=FWdd3_!E18 ;}AVhZ>gLM8?S:<e>C?jJOYY;=>\A
=F:<E^Jb_f=A >PiGJO?<=>C:—]EOLfAJU:QJlNP=F=FWb=ISIS8>IuEG:<e >C?p:<e$JOFL0?QJO8$A
A >@:<>DC:<=E1F+XIS8 D@elJGIf:S?<>F$AbA >C:<>D@:<=EGF2X:<E1Y =Dp=A>F:<=[D\JO:<=EGF2c
¡¢£^¤ œ”¥¦z Ò  ÏPÒ › § Ò ¤ ë Ÿ j§
5. ADDITIONAL AUTHORS
€ (‰… „Z…‡†|ˆ‰_¦‚_Ë(„Xމ†|ƒ—“.².bJ„Zbƒ¡Ÿ ¨ …‡¦‡ˆ‰b O© ¤ ¹jª ¨#„Xމb‘’„X…‡¾—_¦‰_ˆ‰¤ˆ(Œl†|ƒ ¿
‘’„X…‡†|ˆ ¾…‡bˆ‰¾b·—À=«¸² ª­¬ †¡d u9upn À © _ˆ•+zbƒXƒ € ©¯®]9u ¬ \ À € ˉ·X„Xƒ_¦‡…(À
b‘’_…‡¦,“\°s±p²s±p³\´;µ¶?·?¸•±9¹•º»W¶3¼=´.º9¼•¶M³•½E´¾p¿ Y Ÿ
6.À REFERENCES
\ÁÃÕ Ÿ …‡¦‡¬ b*#_ƒX‰ˆ‰bJ„X „¸†|ˆ(_ˆ‰·—À ® m9mpŸ n ¨ Ÿ bJ¶ª…‡·—ÀÅÄ{ÆÇDÈ ÉoÊ?ËÌÍÉoÎϔÇÐ9ÇDÉÑÌÇDÉoÒÐ9ÈWÓÃÐ9Ç|Ð À|Ô †|މˆ
À ] Á ½¾¡¦Ÿ_·X¬ ·Z†|… ‚Ù ˆ‰¾¡¾Ž‰„X…,…‡À †|½ˆ Ÿ‚+ ¸« _\ ·X…_bˆ‰ˆ‰‘´†_„bJ„Z„Z…,މÀW†>%« ‰ŸÖ†|#¨¦‡†|Šp_* …‡ˆ‰ŒRbJ†|„XƒT„X†‰e(Àz¦__ˆ‰ˆ‰ˆ‰Ø…‡ˆ‰%× Š’Ÿ‰_².ˉb(‰… b„ ·Z¾Ž(…,À €
·X„Xƒ„Xb¡Š|…‡b·&…‡ˆ¿ Œlƒ_ˉ‰bJ„Xb¡¾J„X…‡†|ˆhÀz…‡ˆÚ{Ë.Û?Ò3ÜÅÛ)ÝhÞ'ÓhÓàß.ás|á À
À q Á e‰²0_‚ehŸ _“¬ \e(rpˉ„Xt?ƒZ… žâŠ|b¥bc\ vpe(_n ƒZˆ(À†_Ø„X\ †_m9‰Ô „m9Ÿ(* m exŸ Ž‚b·—¡¶Àx…‡¿ ˆ® MÚj(* Ë.¦‡Û?†|Ò3ƒ¡Ü ÀÛ)¸× ÝÍbJã„Xb¡ä;J„Xã{…‡ˆ‰å•Š´åË.¾ÛJbЕ¦‡¦‡Òˉ昦Ê?_ÌÃsŒRǃZہ_ç=ˉ’Ë.Ð9ˉÆÖ·Zè …‡ˆ(Š
À n Á ²0ˆ‰ÓÆ|Ÿ Ê?ˆ ©ÇÊ0Ž‰Ë‰Ò?_ˆ(ÇDÉoˆ#… Û9ŒR†|Î6_ƒXˆ‰‘Ðs Îè¾ ¦Ÿ_é
·Z ÉÑ·&„XÌ)†|ê_¦ ˆ‰ŒR놉»À Ð9¾¡® ΐ†|†—Ð?·¶B아 ÊJ_‰íƒX…‡·XÊ?„X΃Z·Z…,ÇR¾¡‰+À‰_ËÆe‰¦p„Zeh…‡‰+ †|“ ¦‡m?ˆ‰bcâ ·¡\¦‡“ b¡q _€ À ƒXˆ‰\ ¾¡m9…‡_ˆ‰ms·ZŠ%r bcŸ ¶ª·„Z… „XË(Ž ˜* …‡ˆ
¾¡€¸ƒX€¸b‰€ ¿ … „ª¾—_ƒX»Œlƒ_ˉ‰bJ„Xb¡¾J„X…‡†|ˆh¿Àz…‡ˆÚ{Ë.Û?Ò3ÜÅÛ)ÝhÞ'ÓhÓàß.ásî|À
À t Á ®…‡ˆ>Ÿ„Xb½ ƒZ¡b¤ ¶T·X¿ „X²k¾…‡bJˆ‰ƒX„bŠ´„c·Z·—¾_ÀƎ‚ˆ‰e‰_ ˆ(ehŠ|½“ \ b¡Ÿ(up·&n3²k…‡â ˆ#ƒX\†—u9+xžv†|bŽ‚·XO„¡\ À (m9€ …‡m9†|v¾ƒ¡„XY À‚… Ÿ Æ…‡ˆ… „»* Ú{Ë.‘´Û?Ò3†|Üň(…Û)„ZÝh†|ƒXÞ'…‡ˆ‰ÓhЉÓà“0ß.ˆ‰ás†_á|„ZÀ …‡¾…‡ˆ‰Š
À u Á e‰¤‘’Ÿ”eh¸« “ d(t9ƒ…‡q?‘%pâx+ |uˉb] ‘ ¾|À À \ b m9ˆ>bm9„X¦ ŒmƒZ¿ †|Ÿ †|esƒZ*Šž_e(ˆ‰ƒZ…‡…‡§¡ˆ‰¾„X…‡…‡e‰†|¦‡ˆ b|À”†_ð
Œ^Éo&ï Û9bÈ Û0ˉìsƒXÉo†|҈‰Ð9Èj·ªñ^‰bò•·Zó)¾Ê?ƒZ˅,ΐx+ Ê?bÇ;ØÉ ÒJ+s0Ì ’* ž†|„Zމ¦,Ÿ b u9q À
¿m À m9m Ÿ
n
?
q
•
â
n
‰
e
h
e
“
¬
¬
ÀÀ vr Á Ž>„Ÿ„ZeA3¨ “ ¢|ŸÖ¢3ö Æô ˆ‰‰†|AƒZŸ …‡ƒª¾¡\ ·¡_Ÿˆ‰Ë‰ ¾¬ …,¹Ÿ b‰Ÿ Ëx® ¢Ÿ‚&ï „ZЉpÀ ‚+ € _·Z¦‡Š|b†|·¢3ƒZ…Æô „X‰Ž‰(‘´¾¡·sË(eŒl†|m9ƒTm ¢p‘´Æô …‡‰ˆ‰(…‡ˆ‰¾—ŠË‰e m9m Ÿ Žž„X‘´¦
Áõ‰÷3ø…‡·X„Z_ˆ‰¾b ¿ +‚_·Zb†|ËÆ„Z¦‡…‡bƒZ·ª…‡ˆ¦_ƒZŠ|bc‚„Z_·ZbJ„X·—Àx…‡ˆØÚjË.Û?Ò3ÜÅÛ)Ý'ÇÑæÖÊ
À m Á Õb¡ˆžÆÇoŸ 晅‡¨ ƒZ†|b¡ùEˆ‰b|úÀ‘´Óh bŸðûˆž‰Ô„—“³Ÿ ñ^ bJÛ9d(„XÎ?†|exݦ Ê?bŒl†‰Ë.ƒZÊ?…‡Àxbΐ_ˆ‰Òˆ‰¾¡Ê b9À‰e‰…‡!ö ˆ»eAŸ “ ˆ(q9Õ b|m „]?¶sŸÖ═¨†|n ƒ0¬ †9ô q zô À …‡Àֈ>\ ¨„Xm9ƒZm9ˉ…‡ˆ‰v ·X…‡Ÿ…‡ˆ‰†|Š%ˆ»…‡(ˆb„X%b¾J‰„Z…‡†|„ˆh¿DÀxü …‡†—ˆ ¶
À \ ¬ Á „Z¹ÚjŽ‚Ë.ŸÖÛ?3¨„ Ò3ÜÅý ŸË‰Û)&ï ·XÝh„Xb¡…Þ'_‚Ù ¦:bÓh·&_Ó'ˆ(…‡ˆ(ß)¦ás¾¡ƒXá|%« bÀ‰‘´Ÿ e(õ ehb¡ˆžŸ“ \|„ZF \_n3…‡¦,ˆ>À‰â „X·Z\ †|e‰]pˆh_n À ƒZÀ ·Z€ \b|m9À‰(m9_…‡m ˆ‰bJŸ¶Ô †_†_„XŒ.މ„Xbމƒªb _õ _ƒZï¨ …_ˆž_„Z¦‡Š|·¡À‰†|ƒZŒ„Z… „Xehމ“ ‘¢|¢
Œl„XehŸ ¾·—Ÿ „X†|ƒZ†|ˆž„Z†‰Ÿ b‰Ë‚¢e‰ËÖ+x¢ƒZ_(ŒR†|ƒXx¢—¶B¶B¶¢e(ËÖ+‰¦‡…‡¾¡„Z…‡†|ˆ(·—Ÿ Žž„Z‘´¦
À \|\Á ׸ \ m9Ÿ …‡m9·Z¹ ¾q †—†|Ÿ ž·Z·ZbbJƒ.„¡*»À‚†_µ9Œ.ŸŒlƒ¨ _ˉˉƒZ_ƒZhË(À ¦‡õb¡·TŸŒl&ï †|ƒTbˉ„Z‘’b¦‡b_¾ˆ(†|ˆh‘´À˜‘!%þ ˉŸ‰ˆ‰¤‚…‡¾¡_ˆh„XÀz…‡†|_ˆ‰ˆ(· ¦¾%«Ž‚_Ÿ‰¦‡²³¦‡b…‡ˆ‰ˆÖŠ|_ô b_· ·¡À
_ˆ‰ ·X†|¦‡Ë(„Z…‡†|ˆ(·—À‚…‡ˆØÚjË.ÛJÒpÜÅÛ)ÝhÞ'ÓÍÓàß.á•|á ÀÆe‰eh“ n ¬ m?â•n \ q À ¿ \ m9m9m Ÿ
tqe >^JG8:<eEO?<I%IS=FD>C?<>C;]3>@{ Y?<>ISI%:<e>C=?
WG?QJU:<=4:<8$A >%:<ElÚ9?\c !EGISe=4LM8 NP= !JGN*JONPEG:<EbEGL ¹ ~s¤ñ£`FLMEG?<N*JU:<=E1F
d]Ir:<>NPIsLMEG?x_5?<=4:<=FW%:<e>9DEA >I5L0EG?RdN*JO?S:@d=4L0:<>C?\c