SPT: Hierarchical Agent Control: A Framework For
Defining Agent Behavior
!#"$%'&(*)+,.-&/)0%123))546%
Marc S. Atkin
Gary W. King
David L. Westbrook
University of Massachusetts
140 Governor’s Lane
Amherst, MA 01003
University of Massachusetts
140 Governor’s Lane
Amherst, MA 01003
University of Massachusetts
140 Governor’s Lane
Amherst, MA 01003
[email protected]
[email protected]
[email protected]
7980:<;>=':?@?+A83=!AB@/CEDGF:$H5IKJMLH5I.?+LCEDN?+A80=!I+:%A%I+O0?+:QP;RDGJNS=!TU@
F/:$H3:?@/CEI+L5LC!VW=!IYXZL/?[T.\:$A$=]XZ^=!H3F_@/H`@F:$H5IBa TYb:$8@BcW=!L/?Bde;RDGJ
T.O0\3\L?.I+T@/A%I+=!LH@/b0TfI.?@/A%I+=!LHgM?+:$T.L/O0?+A$:Kh@H@F:$hi:$H5IBgjT.:$H0T.L/?
=!H5I+:$F?@I+=!LHgk@HlK=!Tnm9:$C!CoT.O3=]I+:BlpI+LqA$LH5I.?+L/C'C!=!H3FC'@?+F:*HO0h*b:%?+T
LXr@F:$H5I+Tn=!Hsl^H@hi=!At:%HcW=]?+LH0hi:$H5I+T$dnuvIn?+:$C!=!:$TRL/H[I+8?+:$:t83=!:%?.w
@x?+A80=!:$T$yz@A%I+=!LHg{T.:$H3T.L?Bgo@/H3lsA$L/H5I+:%|WIBdU7980:@/A%I+=!L/H
83=!:%?@x?+A85^
A%LH5I.?+LC!TRI+83:*@/F/:$H5IBa T}b:%8@BcW='L?BdEu2I}=!T}L?+F@/H0=!~$:Bl<@x?+LO0HlpI@/T.VWT
I+Lb:i@/A%A$Lhi\0C'=!T.80:BlgH3LI}I+83:z@F:$H5I+T}I+83:%hiT.:$C!c:$T$d*7983=!T}X@/A%='C]w
=]I@xI+:$TiI+83:U=!H5I+:$F?@I+=!LH_LXRh€O3C]I+=]w@F:$H5I@A%I+=!LH0T@/HlQ\3C'@/H0H3=!H3F
=!H5I+L€I+80:}@?+A83=]I+:$AI+O0?+:d‚7983:nT.:$H3T.L?>80=!:%?@?+A85^\0?+LxcW=#l:$TN@*\?+='Hw
A%='\0C!:BlKhi:B@/H0TGXZL/?RTfI.?+O0A%I+O0?+=!H0FzI+83:EA$Lhi\0C!:%|=!I2^ULXo?+:B@l='H0Fq@/Hl
I.?@H3TfXZL/?+hi=!H3FRT.:%H3T.L/?j=!H0XZL/?+h@xI+='L/Hdoƒj@/A8*C!:$c:$C0LX3I+80:983=!:%?@x?+A85^
=!H5I+:$F?@I+:$T„I+80:jl3@I@rA$L/hi=!H3Fr=!HRXZ?+L/h…I+83:o:$HWcW=]?+LH0hi:$H5I=!H5I+LrA$L/H0w
A%:$\0I+O3@/C{A8O0H3VWT>@/\3\?+L\?+=#@xI+:tXZL/?}O0T.:*b5^K@A%I+=!LH0T}@IRI+80=!TnC!:$c:$Cd
DGA%I+=!LH0T}@/H3l[T.:$H0T.L/?+TE@x?+:*mr?+=]I.I+:$HsO0T.=!H3FI+83:*T+@hi:tXZL/?+h@C'=!T.hpd
7980:>A%LH5I+:%|WIM80=!:%?@?+A85^i=!T9@}83=!:%?@x?+A85^iLXF/L@C'T$d‚uH@/l3l=!I+=!L/HI+L
I+80:$=]?G\0?+=!h@?.^qFL@/C!T$ghiL/TfIG@/A%I+=!LH0Tn@x?+:}T.=!h*O3C]I@H3:$L/O3T.C]^I.?.^=!H3F
I+Lt@A80=':%c:n@}T.:%I9L/X=!hi\3C!=!A$=]Ir@/T.T.O0hi\0I+=!LH0T$do7983:%T.:R@/T.T.O0hi\0I+=!LH0T
@x?+:Nh@l0:‚:%|\3C!=!A$=]I‚I+8?+LO0F8€I+80:9A$L/HWI+:|Io80=!:%?@?+A85^z@Hl€\?+Lxc='l:
I+80:NA$LH5I+:%|WIjO3H3l0:%?omN83=!A8zI+83:G@/F/:$H5IML/\:%?@I+:%T$dj†<:r8@Bc:Gl0:%c:$C]w
L/\:Bl<@\3C'@/H0H3:%?Bgk‡nˆnDn‰0Škg‹=!hi\3C!:$hi:$H5I+:BlpmN=]I+83=!Hs;RDGJ>g‹mN83=!A8
=!TGAB@/\3@/b0C':}LXk?+:$T.L/C'cW=!H3Fih€O3C]I+=!\3C!:RF/L@/C!TG=!HU?+:B@/C‹I+=!hi:d
;nDGJ…mr@/TE=!H5I+:$Hl:BlKI+LU8@Bc:€mN=#l:i@/\0\3C!=!AB@/b0=!C'=]I2^5diu2IE83@/T}b:$:$H
O0T.:Bl[I+LUA$LH5I.?+LC‚@/F/:$H5I+T}=!H
A$Lhihi:?+A$='@/CoA$Lhi\0O0I+:%?RF@/hi:%TE@/Hl
\085^0T.=!AB@Ck?+LbLI+T$dtŒnO0?n\0?+=!h@?.^Y@\3\0C'=!AB@xI+=!LHsl0Lh@=!H[=!T}@T.=!hzw
O0C'@I+L/?ELX9C'@/H3lwvb@T.:Blshi=!C!=]I@?.^Y:$H0F@F:$hi:$H5I+TRA$@/C!C!:BlsJ9@/\0I+O?+:
I+80:NŽkC'@/Fdj;RDGJ>aTjT.=!h€O3C'@I+=!LH*T.O3b3TfI.?@xI+:rhiLWl0:$C!To\385^T.=!A$Tj@I‚@/H
@b3TfI.?@A%I}C!:$c:$CdE;nD>JT.O3\0\L/?.I+TR@H5^Yl0L/h@/=!HY='HKmN80='A8[b:$8@Bc5w
=!L?+T9AB@/Hqb:N?+:Bl0O0A$:Bl*[email protected]@C!CT.:%I9LX„\?+=!hi=!I+=!c:N:%‹:%A%I+L/?+T9T.O0A8
@TK‘N’3“”_@/H3l•––0—+˜™fš’›3œ3”‹dD9II+80='TI+=!hi:[l0:%ž3H3=!H3FŸ@F:$H5I
b:%8@BcW='L?*?+:B 5O0=!?+:%Tz¡=!T.\¢\?+LF/?@hihi=!H3FKT.VW=!C'C!T$£9mM:U@x?+:hiLxcW=!H3F
I+LBm9@?l0TGhiL/?+:nF/?@/\083=!AB@C„\0?+L/F/?@hihi='H0F*C'@/H0FO3@/F:%T$d
ABSTRACT
1.
INTRODUCTION
N¤ ¥,¦§„¨xª©¬«€­¯®t°3±k²$§„¨x¯²B­e¤N³,°3¦e´„
°3¥µ¬¶®t²$¤n·B¸
«t­„W¨¹°0¨x¹²ºt²$W°3¢»*W°¼­½­„°
°…µ§„soW¨
¾q
0¿‹À
°3k³,¢§kµk¥,²B°µk´Á{°3¦p²%±k¨x²$¼²/¸Ÿ«€­¹3±jW¨x°3²%¢µ°
°3±½ºi­k¥¼­½­„°
´„¥ZÃMW¨xµ²[²Â±o<¾²$W¨x¨°3¥µ‚¸Ä«9W¨x¨x°¥µ
¥µÁo§0µ„¼z
0¿
µ‹²E$±jW´Å°3µk´¾v¨¢zk°3¨x¨¥,W¨»o²$W¨xÀ
¨x°¥µ¢°³$K°ÃM¼²$t§„µk¥,²E¿„¥B¥,{¥³¥,²Â¸NÆDz$W°Èºi¥µk}ºi­„µ¢¥,²
¼°0±k²B§„¨xz°³³9¥,²$*±k±oµ„µ‹²É'*Á{°0¦¸
ˆG:$F@x?l0C!:$T.TKL/XtI+83:<l0L/h@/=!Hgn@/F/:$H5IYl0:$T.=!F/H3:%?+TKh€O3TfIqX@/A%:<I+83:
T+@/hi:tVW=!Hl0T>L/X‚\0?+L/b3C!:$hiT$yN\0?+L5A%:$T.T.=!H3FUT.:%H3T.L/?R='HX,L?+h@I+=!LHg?+:w
@/AI+='H0FKI+Ls@pA8@H3F/='H0FY:$HWc=]?+L/H3hi:$H5It=!HŸ@UI+='hi:%C!^<h@/H0H3:%?Bg{=!Hw
I+:$F?@I+=!H3Fz?+:B@A%I+=!c:}@HlUA$L/FH0=!I+=!c:}\?+L5A$:$T.T.:$TrI+Li@A80=!:$c:E@/HU@/bw
TfI.?@/AIMF/L@/CgW=!H5I+:%?+C!:B@BcW='H0FE\3C'@/H0H3=!H3F}@Hlz:%|:$A%O0I+=!LHg5l0=!TfI.?+=!b3OI+:Bl
A$L/HWI.?+L/Cg@/C!C!LxmN=!H0F€A$LWl:G?+:%O3T.:NmN=!I+80=!H@/Hli@A%?+LT.T9l0Lh@=!H3T$gW@Hl
O3T.=!H0F*A$L/hi\3O0I@xI+=!LH@C?+:$T.LO?+A$:$TN:%ÊiA%=':%HWI+C]^5dk†<:n83@xc:nb:$:$Hl0:w
c:$C!L/\3=!H3FQ@/H…@/F/:$H5IK@x?+A80=!I+:%A%I+O0?+:YI+8@xIpC!:%I+TpO0Tp@l0l?+:$T.TqI+83:$T.:
2.
AFS: THE ABSTRACT FORCE SIMULATOR
7980:}\3O?+\LT.:RLXjDnŽo‰i='TG@C'C!LBm…O3TrI+L*T.=!h*O0C'@I+:}@*c/@?+=!:%I2^qL/XolL/w
h @=!H3T>I+83@InAB@/HYb:tA83@?@/AI+:%?+=!~$:BlYbW^p@/F/:$H5I+TRhiLxc=!H0F@/HlY@\0w
\0C]^0=!H0FqXZL/?+A$:dtD>Žo‰?+:$\0?+:%T.:$H5I+T}@/F/:$H5I+T}@/b0TfI.?@/A%I+C]^5g@/T%+b3C!L/b3T$g 
mN80=!A8p83@Bc:}@zT.h@/C!CT.:%IGL/X{\085^0T.=!AB@CXZ:B@I+O?+:$T$g=!H3A%C'O3l0=!H3F*h@/T.T$g
c:$C!L5A$=]I^5gXZ?+=!A%I+=!L/Hg‹?@l='O0T$g@I.I@/AVpTfI.?+:$H0F/I+8g@/HlpT.LqLHd &MC!L/b3T
A$@/H_:$=]I+80:%?b:KhiLWl0:$C!:BlQ@/T83@xcW=!H3F
@sO3H0=]X,L/?+hÈ[email protected]:$H0T.=!I2^5g
L?rm9:>AB@/HqO3T.:n@t\3@?.I+=!A$C!:%wvT.\0?+=!H3F€hiLWl0:$CI+LE?+:$\?+:$T.:$H5IN@?+b0=]I.?@?.^
T.83@/\:$T€mN83=!A8QAB@Hl:%X,L?+h @/H3l
?+:Bl0=!TfI.?+=!b3OI+:qI+80:$=]?ih@/T.TPT.:$:
@C!T.LD>\3\:%Hl0=]|qDEd Sd
D¹b0C'L/b='T9@/Hq@/b0TfI.?@/A%IrO0H3=]IB£W=]I9A$L/O3C'lb:n@H@x?+h€^5gW@}T.L/C#l=!:%?BgL/?
@}\L/C'=]I+=!AB@C:$H5I+=]I^5d{ƒoc:%?.^€b3C!L/bi8@/[email protected]@/C!C3T.:IMLX\?+=!hi=!I+=!c:N@A%w
I+=!L/H3T*=]I*AB@/HŸ\:%?.XZL/?+hpgj–(› 'Z)‘ '+*('!“”™‘G’3“”g{•–0–—˜™š’›3œ”g‚@/Hl
-œ ,‹• .0/„”W™ 1
,‹•–”‹d…DGC'CGL/I+80:%?qb:$8@BcW=!L/?+Tq@?+:Yb0O3=!C]IqX#?+LhÈI+83:%T.:
\?+=!hi=!I+=!c:%T$dj†<:RAB@HUI.?@/H0TfX,L/?+hÇD>Žo‰XZ?+L/h @*b3=!C!C!='@?lpb@C!C„T.=!hzw
O0C'@I+L/?=!H5I+L
@[l0=!cW=!T.=!LHC!:$c:$CNhi='C!=]I@?.^Ÿ:%H3F@F:$hi:%HWIzT.='h€O3C'@I+L?
T.=!hi\0C!^Ub5^pA8@/H0F=!H3FiI+80:tO0Hl:%?+C]^0=!H0Fi\385^T.='A%T$dn7980=!T>m9L/O3C'lK=!H0w
cLC!c:EA83@/H0F=!H3Fi80Lxmh@/T.TG=!Tn@x‹:$A%I+:BlKb5^UA%LC!C!='T.=!L/H3T$g‹mN8@xI>I+80:
X#?+=!A%I+=!LHK=!TrX,L/?n@*b0C'L/bphiLxcW='H0F€Lxc:?GI+:?.?@/=!Hg3@/H3lT.LiLHd
D>Žo‰<=!Tz@pT.=!h*O0C#@xI+L/?€L/XG\385^T.=!AB@/CM\0?+L5A$:$T.T.:%T$d<uvI€=!TtI+='AV5wvb@/T.:$lg
b0O0IkI+80:MI+=!AVWTo@x?+:9T.h@/C!C:$H3L/O3F8EI+L}@A$A$O0?@xI+:$C]^thiLWl0:$C5I+83:‚\385^Tfw
=!AB@Ck=!H5I+:%?@/A%I+=!L/H3Tnb:Im9:%:$Hpb3C!L/b3T$dNDGC!I+80LO0F8Kb3C!L/b3TNI+83:$hiT.:$C!c:%T
hiLxc:GA$L/HWI+=!HWO3L/O3T.C]^i=!2H 43…T.\@/A%:gWX,L/?M?+:B@/T.L/H3TrL/X:%ÊiA%=':%H3A%^5g5I+80:
\?+L\:%?.I+=!:$T{LXI+83=!TkT.\3@/A$:/gT.O3A8€@/TkI+:%?.?@='H*@I.I.?+=!b3OI+:$T$g@?+:M?+:$\?+:%w
T.:%HWI+:$lU@/TG@zl=!T.A%?+:%I+:}F/?+='lULXk?+:$A%I@H3F/O3C'@?>A$:$C!C!T$dM‰O3A8@*F/?+='lULX
A%:$C!C'Tn='TR@/C!T.LO0T.:BlK=!HWI+:?+H@/C!C]^pI+Lb3=!HYT.\@xI+='@/C!C]^Y\0?+LB|='h@C„b0C'L/b3T$g
h@VW='H0FzI+83:}I+=!hi:EA$Lhi\0C':|0=]I2^ULX‚A%LC!C!='T.=!L/H
l0:I+:$A%I+=!LH[@/H3lpb3C!Lb
T.:%H3T.L/?9hiLWl0:$C!=!H3FEH3LEF?+:B@I+:%?MI+8@/HC!=!H3:B@x?r=!HiI+:%?+hiT‚LXI+80:>HWO0hzw
b:?EL/Xrb0C'L/b3TE=!HsI+80:zT.=!h*O3C'@xI+L/?BdD>Žo‰Ymr@Ttl0:$T.=!FH0:Bl[X#?+Lh I+80:
L/O0I+T.:%IMI+Ltb:>@/b0C!:>I+LET.=!h*O3C'@xI+:>C'@?+F/:nHWO3h€b:%?+TGPLHiI+83:GL/?l:%?9LX
8WO0Hl?+:$l0TrL/?NI+80LO3T+@HlTS‚L/X{b0C'L/b3T$d
3.
HAC: HIERARCHICAL AGENT CONTROL
DGH='hi\L?.I@/H5IU@/T.\:$A%IpL/X*@/H5^@/F/:$H5IY@?+A83=]I+:$AI+O0?+:[='TU83LBmª=]I
h@H@F:$TRI+80:5LBm LX9=!H0XZL/?+h@I+=!L/H<b:%I2m9:$:$Hs@/F/:$H5I+TE@/H3ls\@x?.I+T
Domainspecific
actions
Primitive
Actions
Harass
control, context
Physical
Schemas
Mobile Offense
errors, messages
\?+Lb0C':%hiT$g3AB@C!C':$l%1f)1""+)5
3,1MP;RDGJNSd
;nDGJŸAB@Hzb:NcW=':m9:Bli@TM@RT.:%I‚L/XC'@/H0FO3@/F:GA$L/[email protected]\w
\L?.IGhi:$A83@/H0='T.hiT9XZL/?nl0:$T.A?+='b0=!H3Fi@F:$H5IGb:$8@BcW=!L/?Bdj;RDGJI@/V:$T
A$@?+:nLX‹I+83:Nhi:$A8@/H0=!A$T‚LX„:|0:%A$O0I+=!H3FRI+80:NA$LWl0:NI+8@xIMA$L/H5I.?+LC!Tr@/H
@F:$H5IBg0\@T.T.='H0F*hi:$T.T+@F:$Trb:Im9:%:$Hp@A%I+=!LH3T$g0A$L5L?l0=!H@xI+='H0F*h€O3C]w
I+=!\0C':@/F/:$H5I+T$g‚@?+b3=]I.?@xI+='H0FK?+:$T.LO?+A$:UA$L/H 3='AI+T*b:%I2m9:$:$HŸ@F:$H5I+T$g
@HlqO3\‹l3@xI+=!H3FtT.:$H3T.L?>c/@/C!O0:$T$djD>C]I+83L/O3F/8L/O0?N\0?+=!h@x?.^@/\0\3C!=!AB@w
I+=!L/Hp8@T>b:$:%Hp@zhi=!C!=!I@x?.^qT.='h€O3C'@I+=!L/HpTf^TfI+:$hÄAB@/C!C!:Bl J9@/\0I+O?+:
I+80:UŽkC'@F €PT.:%:pŽk=!FO?+: U@/HlŸDG\3\:$H3l0=]|¢DEd xSgM;nDGJ 83@/T
@C!T.LÅb:$:%H@/\3\0C!=':$lI+L¢T.O3A8l0Lh@=!H3T@/TqA$Lhihi:%?+A%=#@CnF@/hi:$T$g
h€O3C]I+=]w2@/F:%HWInT.=!h*O3C'@xI+='L/H3T$g@/H3ls@A%I+O@C{\385^T.=!AB@/Ck?+L/bL/I+T$d p@/H5^
LXI+83:rlLh@='H0T{;RDGJ<8@Tob:$:$H*O0T.:BltmN=]I+8*mM:%?+:rhiLWl0:%C':$l€O3T.=!H0F
@qT.=!h*O3C'@xI+='L/HsT.O0b3TfI.?@xI+:€m9:€8@Bc:tA%?+:B@xI+:BlgI+83: %,1f)"B! 1f"
" ,(*&])# /1P D>Žo‰Sd
u2H<I+83=!T}\3@/\:%?BgkmM:zmN=!C'C9l0:$T.A%?+=!b:zI+80:zh@ $fL/?tX,:B@xI+O0?+:$TtL/X9;RDGJ
@HlYDnŽo‰g‹O3T.=!H3FiI+80:zJ9@\0I+O0?+:tI+83:€ŽkC'@/F<PvJ‚IŽjSNl0L/h@/=!HKX,L/?E=!C]w
C!O0TfI.?@I+=!LHdM;n@xcW=!H3F*l0L/H3:nI+80='T$gm9:E@C!T.Lil0=!T.A$O0T.TGI+80:RC!:$T.T.LH0TNmM:
C!:B@x?+H3:BlYl:$c:$C!L\0=!H3Fi;RDGJ>g@/HlUXZO0I+O?+:t\0C'@/H3TNX,L?nI+80:€@x?+A80=]I+:$A%w
I+O?+:d7980:K@/\0\:$Hl=!|¢I+L[I+83:p\3@/\:%?C!=!TfI+TiI+83:LH3C!=!H3:KhiLxcW=!:$T$g
mN80=!A8p80=!F83C!=!F85IGV:%^XZ:B@I+O?+:$TNL/X{I+83:n;RDGJ_@/\0\3C!=!AB@I+=!LHd
Follow
Attack
Move-to-Point
Move Move ...
...
Apply-Force
¤N¥,¦§„¨x76‹nÆq¼²B¥,µkG¾v¨ °­„¥,¨x°0¨/¼­‹Âj»‹¼/µ²%¨³„¥µ„¾v¨
°0À
²B¥,µ ¥p±„°B$´`´„ºiµ98n
B$°3¦°0¨xűk°3B$´`§„±M¸«€­
³,º€$²r³,W¿³0°0¨t°3¦30µ‹²r5ÃM¼²%¨»²B­„*¢¥´k´k³,}³,°WÂW¨G¼µÀ
B¥$²B<3¾U
¨x¼
±{³,:;8}ÂW²<´„
°¥µÀ.¦µ„W¨x°³€°3¼²B¥,µ„
¼°3³³,0=
´ <?>0@BADCFEGIHJA4EK>LNMOGIAx¸ Æo0¿²B­k¥
³,W¿³}º€¹­°¿
´„
°3¥µÀ+$±o¼Q¥ Po¼q°¼²B¥,µk¸
L/X>@F:$H5I+T$dKu2H
;RDGJ>gm9:ql0=!TfI+=!H3F/O3=!T.8Ÿb:%ImM:$:$H<I+8?+:$:V=!H3l0TEL/X
=!H0XZL/?+h@I+=!L/HyKA$L/H5I.?+LCN=!H0X,L?+h@I+=!LHgrT.:$H0T.L/?=!H0XZL/?+h@I+=!L/HgN@Hl
A$L/HWI+:|IBdkƒ‚@A8zI2^\:9L/X=!HX,L/?+h@xI+=!LHiA$L?.?+:$T.\LH3l0T{I+L}@RT.:$\3@?@I+:
83=!:%?@x?+A85^q=!Hp;RDGJ>dW†
:RmN=!C!C„H0LBml=!T.A$O3T.TN:B@A8p=!HqI+O0?+Hd
;RDGJ…L?+F@H3=!~$:$T}I+83:z@/F:%HWIBa TE@A%I+=!LH3TE=!Hs@83=!:%?@x?+A85^ŸPT.:$:zŽk='Fw
O0?+: Sdj7983:nc:%?.^iC!LBm9:$TfIGC!:$c:%C'TN@x?+:RI+83:n@/F:%HWIBa Tr:%‹:%A%I+L/?+T$d‚7983:
T.:%IiLXn:‹:$A%I+L/?+T€mN='C!CNl:$\:$Hl¢L/HŸI+80:U@F:$H5Iz@/Hl
I+80:UlLh@/=!Hg
b3OII^\3=!AB@C'C]^='H0A$C!Ol:sb:$=!H0FŸ@/b3C!:YI+L¢hiLxc:pI+83:[@/F/:$H5IBgNI+O0?+H
=]IBgML?iO3T.:@YT.\:$A$='@/CG@/b0=!C'=]I2^¢T.O3A8Q@/T*ž0?+='H0F<@pmM:B@/\L/HRd UL/?+:
A$L/hi\3C!:%|i@A%I+=!LH0T9@?+:Gb3O0=!C!IjXZ?+L/h½I+80:$T.:G\0?+=!hi=]I+='c:rLH3:%T$djD>Hz• *™
*•-œ SÅ@A%I+=!LHgX,L?E:%|0@/hi\0C':/gh@$^KhiLxc:EI+L@qI@?+F/:%IBaT}C!L5AB@I+=!LH
@/H3lž0?+:R@xIr=]IBdjD>T9L/H3:nF/L5:$TrO3\iI+80:n83=!:%?@x?+A85^5g@A%I+=!LH3Trb:%A$Lhi:
=!H3A%?+:$@/T.=!H3F/C!^
@/b0TfI.?@/A%I*@/H3l<\LBm9:%?.XZO3CdK7980:%^<T.L/C!c:ihiL/?+:l=!Ê*w
A$O0C!Iz\0?+Lb0C!:$hiT$gMT.O0A8Å@/Ti\3@I+8Q\3C'@/H0H3=!H3Fgr@HlŸAB@/HŸ?+:B@/AIiI+L<@
mN='l0:R?@H3F:ELX{:$c:$H5I+O3@/C!=]I+=':%T$d
;RDGJ:%|:$A%O0I+:$TG@/AI+='L/H3TGb5^T.A83:$l0O3C!=!H3F€I+83:$hÄL/HK@z 5O3:$O0:dj7983:
5O3:$O0:r=!TMT.L/?.I+:$lzbW^tI+83:9I+=!hi:N@xI‚mN80='A8zI+83:G@A%I+=!LHzmN=!C!C:%|:$A$O0I+:/d
D>AI+='L/H3TqF:%II@V:$H_L I+80:Y 5O3:$O0:K@/H3l:%|:$A$OI+:BlO3H5I+=!CNI+83:%?+:
@?+:€H3LqhiL/?+:€@/A%I+=!L/H3TRI+8@xIE@?+:€T.A80:Bl0O0C!:BlpI+Lq?+O0Hs@xIRI+83=!TnI+=!hi:
TfI+:$\djD>A%I+=!LH0TNAB@/Hq?+:$T.A80:Bl0O0C!:nI+83:$hiT.:%C'c:$T$gb3O0I9='HhiLTfINAB@T.:$T$g
I+83:^pmN=!C'Cob:E?+:$T.A83:BlO3C!:BlpmN83:$HYm9L/V:$HYO3\Yb5^phi:%T.T+@/F:%TRXZ?+Lh
I+83:%=!?nA80=!C#lW?+:$Hd}D>HY@/AI+='L/Hs=!TR:|0:%A$O0I+:BlKb5^pA$@/C!C!='H0FU=]I+TR¨xW°³U¥ T
hi:%I+80LWld€7983:z¨xW°³U¥ TKhi:%I+83LWl[l0L5:$T}H0L/I}F/:$H3:?@/C!C]^<A$L/hi\3C!:%I+:
I+83:U@/A%I+=!L/HÅL/HÅ=]I+Tzž3?+TfIz='HWcL5A$@I+=!LH£N=!VI $.O3TfIil0L5:$T*mN83@IH0:$:Bl0T
I+Lqb:*lLH3:€LHKI+83=!TnI+=!AVd}uHYhiLTfInAB@/T.:%T$gk@H<@A%I+=!LHa T}¨xW°³U¥ T
hi:%I+80LWlKmN=!C!Cjb:*AB@C'C!:Blsh@/H5^UI+=!hi:$TRb:X,L/?+:zI+80:z@A%I+=!LHsI+:?+hi=!w
H@xI+:$T$d
;RDGJ =!Tz@
+&x0%X1 W
-
€@?+A83=]I+:$A%I+O?+: YZD d
u2I*@/b0='l0:$T€bW^sI+83:
\0?+=!H0A$=!\3C!:rI+8@Io80=!F83:?MC!:$c:%C'TjT.83L/O3C'l*\?+LcW='l0:MFL@C!T9@/H3l*A$L/HWI+:|I
X,L?9I+83:GC!LBm9:%?rC!:$c:$C!T$g@/HliC!LBm9:%?9C':%c:$C!T9\0?+LxcW='l0:GT.:$H3T.L?.^z?+:$\L?.I+T
@/H3lKhi:$T.T+@/F/:$TnI+LI+83:E83=!F80:%?}C!:$c:%C'T*[P +FL@/C!TEl0LBmNHg‹VH0LBmNC':$l0F:
O3\0WSdpD83=!F80:%?tC!:$c:$C‚AB@/H0H3L/ItLxc:%?.?+O0C!:I+80:iT.:$H3T.L?.^
=!H0XZL/?+h@xw
I+=!LH
\?+Lxc='l:Bl[b5^[@UC!LBm9:?*C!:$c:%C g„H3L?EAB@/H<@UC!LxmM:%?tC!:$c:$Cj=!HWI+:?.w
X,:?+:RmN=!I+8qI+83:RA%LH5I.?+LC‹L/X{@€83=!F/83:%?GC!:$c:$Cd‚‰WO3\:%?+c:%H3=!:$H3A%:nTfI.?+O3Aw
I+O0?+:%TqI+80:s@b3TfI.?@A%I+=!LH\0?+L5A$:%T.T$£€=]IU@/C!C!LBmNTpO3TqI+L¢b3O3=!C'l_hiLWlw
O3C'@x?Bgk?+:$O3T+@b3C!:@/AI+='L/H3T$dq;RDGJT.=!hi\3C!=]ž:%TEI+80=!T}\0?+L5A$:$T.TEX,O?.I+83:%?
b5^t:$H0XZL/?+A$=!H3F}I+83@Ij:$c:%?.^€@A%I+=!LHaT‚='hi\0C!:$hi:$H5I@I+=!LHP=]I+T‚¨xW°³U¥ T
3.1 The Control Hierarchy
!"
#
$%&
$'(("
)
$
*
+,
,-.-
/&
$0*$
/,
$
/,
&1
2"
3#4,
$5/6
*.$
7,
5
8
$8*/+,
$&
,-.-
/&
$0*$
/,
$
/,
&1
2"
3#4,
$
//,7,
$&
!96
2$
/,
:*/.,
$&
*.$
7,
5
8
$8*/+,
$&
,-8*$
/,
$
/,
&1
5
;<
$&
!
-&#
.$
/,
8=46
> $
$
> $/?4
"@
$/A*
/
$/BC
+
,
> &
$$
D=!/6#
'6$"/",&
> "6'
> E
F5&
,-2-"@&
$
/,
$G$
/,
.$
7,
&1
("
3HF6I*JI=!76
*
9%&
5/6
,-
K:$
/,
.$
7,
&H
2"
3
-:*
5
,
!8*
.
L&
6
$5"8
$'
M
*.$
/,
(
$,
N¤ ¥,¦§„¨x $
±{³,
µ²%°3²B¥,µ
3¾>°s<§k³,²$¥ZÀ.°3¦µ‹² W$ºt°3¨ <o­„°W¿„¥,3¨¥µ pÆq®¸
hi:I+83LWlSjI@V:nI+80:nX,L/C'C!LBmN=!H3FX,L?+hpy
@?+:rA%C#@T.T.:$T$£W:B@A8*@/A%I+=!LHzl0:%ž3H3:$To@GT.:%IjL/Xhi:%I+80LWl0T„I+83@Ij@/l3l?+:%T.T
I+83:%T.:RI@/T.VWT$d
/drˆG:B@/A%INI+Lzhi:%T.T+@/F:%TGA%Lhi=!H3Fz=!HqXZ?+Lh A83=!C'l?+:$Hd
Žk=!FO?+: T.83LBmNTrI+83:R=!hi\0C':%hi:$H5I@I+=!LHqL/Xo@€h*O3C]I+=]w2@/F/:$H5IG@/A%I+=!LHg
1 N•›‘Rdou2Ij=!T9@RT.=!hi\3C!:G@/AI+='L/HiI+8@IjAB@O3T.:$TM@RHWO3h*b:?oL/X@/F/:$H5I+T
5d n\‹l0@I+:RTfI@xI+:d
+
I
LihiLxc:E@?+L/O3H3lU?@/HlLhiC]^qmN=!I+80=!Hs@zA%=!?+A%O3C'@?>?+:$F=!LHdN†
:EO3T.:
dG‰A83:$l0O3C!:RH0:%m A80=!C#l@/A%I+=!L/H3TG=!XoH0:$A$:$T.T+@x?.^5d
I+83:tT.=!hi\3C!:%?E@A%I+=!LHs‘N’3“„”WF™ *’™–0’ 'Q.(*sI+Lq=!hi\3C!:$hi:$H5IGI+83=!T$£=]I}=!T
dG‰:%Hlhi:%T.T+@/F:%TGO0\I+Lz\3@?+:$H5IBd
=!HWcLV:$lmN=!I+8I+83:[A$L/H3TfI.?+O3AIY$²$°3¨x²%À.µ„Wº*À+¼­k¥³´‚d †¹80:$H¹I+83:
@/F/:$H5I+Tnb0O3hi\pL?nF/:%IRTfI+O0AVgI+80:%^UA8@H3F/:*l=!?+:%A%I+=!LHd>Žk=]?+TfIBgm9:
Žk=!F/O0?+: [T.80LxmNT@<T.h@C'CG\@x?.IL/XE@H¹@/AI+='L/H_83=!:%?@x?+A85^5d 7980: =]l0Ir:=!žT9H3H3:GL/I+H083wv: \0?+1 =!Nhi•=]I+›=!c‘ :N@/@/AH3I+lq='L/h€HO3I+LzTfI‚b8:R@H@€l0C!:$C!:Gc:$hiC]wv:$H0T.w2T+@@/A%F/I+:$=!LTMHX#?+djL79h 80=!bTG:$hiC!LBm:$@/H3@TT
š/’—/—’ @/A%I+=!L/Hg5X,L?r:%|0@/hi\0C!:g?+:$C!=!:$T9L/H@E‘G’3“”WF™ *’‹™f–’ 'Q.(*U@A%w
I+=!L/H*I+Ln?+:B@A8i@RT.\:%A$=]ž:Bl*C!L5AB@xI+=!LHd s’3“„”WF™ *’™–0’ 'Q.(*imN=!C'C0T.:$Hl m9hi:%:$C'T.C9T+@@/FTt:$\TG@/XZT.?+TtLh hi:$AT.83T+=!@C'lF?+:$:$TtHKO3O0\T.dU=!H3†
Fz:I+83l:E:%ž­H0°:iµk´k83³,LB5m À+
m9:iBmN$°0=!C!¦CM?+n:B@/hiA:%I€I+I+80L w
TfI@xI+O3Tt?+:$\L/?.I+TEI+L[š’——’ =]XGH3:$A%:$T.T+@?.^‹£M@I*I+80:ic:%?.^sC!:B@/TfIz@ LWl0T$=
A%Lhi\3C!:%I+=!L/Hphi:$T.T+@/F/:iP,X@='C!O?+:}L/?GT.O3A$A%:$T.TSd‚7983:}LH0C]^q?+:%T.\LH3T.=]w I+8@xId @<UA:$80T.=!T+C#@/lÅF/:shi='83F/@/85H3Il0T.C!:%:$?+HTl‹T.d\:$uA$H='@/I+C!80=!~$:p:s:%L|0H@/hiI+80\0:pC':/Ig9^m9\:p:p?+L/:BXElhi=]?+:$:%A%T.IUT+@/@/FH :
b0=!C'=]I2^L/XI+83:>š’——’ @/A%I+=!L/H=!TMI+Lt=!T.T.O3:R@EH3:mI@?+F/:%IrC!L5AB@xI+='L/H @/F/:$H5IiI+L¢@sH0:%m C!L5AB@I+=!L/H_mN83:$HQI+83:K‘N’3“”™ *’‹™f–’?'+.0*@A%I+=!LH
=]XjI+83:t@/F/:$H5IRb:$=!H0FXZLC!C!LBm9:Bl[hiLc:$T$dN;RDGJ¹='TR@/HY@?+A83=]I+:$AI+O0?+:£ A$L/HWI.?+L/C!C'=!H0Fz=]INA$Lhi\0C':I+:$T$dou2XI+83:}‘N’3“”WF™ *’‹™f–?’ '+.(*U?+:$\L/?.I+TN@H5^
LI+83:%?EI+83@/H<:%H0X,L?+A$=!H3FK@F:$H0:%?@/CoX,L?+hpgk=]Itl0L5:$TEH0L/IE\3C'@A$:@/H5^ VW=!HliL/X:%?.?+L/?RP @/C!C‹:%?.?+L/?+TM?+:%C#@xI+=!H3F€I+LthiLxc:$hi:$H5I‚@?+:>T.O3bA$C'@T.T.:$T
A%LH3TfI.?@=!HWI+TEL/Hs80Lxm½@A%I+=!LH0T€@x?+:z=!hi\3C!:$hi:$H5I+:Bl‹dtƒjc:%?.^[@/A%I+=!L/H L/X°3¾2%À+
¿
0µ‹²%À+
B$°0¦3SgxT.O3A8@T9A$L/HWI@A%I9mN=]I+8q@/H0L/I+83:?
A$@/HYA80L5LT.:EmN8@xIRhi:$T.T+@F:$T>=!I>mN=!C'Ck?+:%T.\LHlUI+Ld>D>C]I+83L/O3F8Y@A%w
I+=!L/H3TtC'LBmM:%?*=!H<I+80:i83=!:%?@x?+A85^YmN=!C'C‚I+:$HlYI+Lpb:ihiL/?+:z?+:B@A%I+=!c:g mN@/F/83:$:H5?+IB:}g„:$mMC!T.:z:d T.=!hi\3C]^Y=!HWI+:?.?+O3\0IR=!It@HlK?+:Bl0=]?+:$AItI+80:z@F:$H5IET.Lhi:w
mN80:%?+:B@TtI+80LT.:i83=!F/83:%?tO3\YI+:$H3l[I+Lpb:zhiL?+:il0:%C'=!b:%?@xI+=!c:gkI+80:
I.?@H3T.=]I+=!LHb:%I2m9:$:$HÅI+83:$hÈ=!TqT.hiL5L/I+8¹@HlA$L/hi\3C!:%I+:$C]^ÅO3\I+L 7983:%T.:i­„°µ„´k³,5À+
B$°3¦}hi:%I+83LWlTR@x?+:z=!HcLV:BlpmN80:$H3:$c:%?}@
I+80:il0:%T.='F/H3:%?Bd >H3C!=!V:*LI+83:%?€@x?+A80=!I+:%A%I+O0?+:$T7Y g vgm9:lLUH3LI hi:$T.T+@F:tL/XjI+83:ET.\:$A$=]ž:$lKI2^\:}='TnT.:$H5I>I+L 1 N•›‘Rd>†_83:$HUI+80=!T
\?+:$T.A%?+=!b:t@*\0?+:%T.:%InHWO0h*b:%?rLXob:$8@BcW=!L/?@C„C!:$c:$C!T$dMŠ{@?+:$H5I+TGAB@/H
?+O0HÅ=!HŸ\@x?@/C!C!:$CNmN=!I+8ŸI+83:%=!?zA80='C'lW?+:$HÅL?iLH0C]^¢mN83:$H¢I+83:A80=!C#l 8\3C!@:\3g\I+:$83H0:€T$gk¨xI+83°3:³¥UT¨xpW°hi³U¥ :%TI+[80LWhilK:%='I+T}80LWL/lsH3C]^[email protected]':$T.l[LYABX,L@?EC!C':$=!H3l=]dYI+='@/uH<C!=!~BL@O0I+=!?€LH:%|0y}@/I+hz83: w
A%Lhi\3C!:%I+:%T$d
ž3?+TfI}I+=!hi:t=]IE='T}A$@/C!C!:Blg„=!IET.:%Hl0TE@C!CoI+80:i@/F/:$H5I+T}L/¢I+L?@/H3l0Lh
C!L5AB@I+=!L/H3T$d
3.2
7980=!T}T.:$An
A%I+=!LHYExample
mN=!C'Co:$C!O0A$='l3Action
@I+:tI+83:*@/Definition
A%I+=!LHw mr?+=!I+=!H0FU\0?+L5A%:$T.TRO3T.=!H0F 7983:tT.:%InL/XM¼/­„¼ Àf°µk´Àf¦µ„W¨°0²$Uhi:I+83LWl0T>l0:žH3:}I+80:€T.:%InL/X
@tA$LH0A%?+:%I+:R:|3@hi\3C!:d{;nDGJQ\0?+LxcW='l0:$TN@EHWO3h€b:%?MLXkhi:%I+80LWl0TMI+L I+hi83:$:ŸT.T+¨x@WF°:$Tr³U¥ TI+8 @xI9hiI+:$83T.=!T+TN@F@:QA%I+=!='LT[HpABAB@@C'C!HU:Bl‹T.:$gzH3I+l83:QO0\q¼­„I+L€¼ =!I+‹TrÀ.\3°3@µk?+´:$À.H5¦I+T$d{µ„†¹W¨x80°3:$²%H
h@V:oI+83:j\0?+L5A$:$T.T{LX0mr?+=]I+=!H3Fn@/A%I+=!L/H3Tk:B@T.=!:%?BdjD>A%?+L/T.T{@/AI+='L/H3T„mM: hi:%I+80LWl0T9@x?+:R=!HWcLV:$ldo7980:nTfmr@x?+h :%|0@/hi\0C!:>H0:$c:%?MA$Lhi\0C':I+:$T$g
h€O3TfIG\:%?.XZL/?+h I+83:ET+@/hi:ET.L/?.I+T>L/XoI@/T.VWT$yNF/:$H3:%?@xI+=!H3Fhi:$T.T+@/F/:$T
XZL/?}I+80:€\3@?+:$H5IBg@lc@H3A$=!H3FiI+80:z@/AI+='L/Hg:%I+AdEu2HY;RDGJ>g@/A%I+=!L/H3T @/H3l[=]IRl0L5:$T.Ha I}?+:%\L/?.I}L/H[=]I+T}TfI@xI+O3T$gT.L=]I}F/:$H3:?@I+:$T}H0Lhi:$Tfw
)N PO
RQ
LS
'T
W
_Y
VU
W
X
!Y
,Y
[Z
,Y
,Y
\U
W ^]
_Y
`
`
vulnerable
position
enemy
presence
High-level
goals
constriction
sub-goals
sensor integration
and re-interpretation
Abstract
Sensors
(other
factors)
Primitive
Sensors
Specific
goals
positions
velocities
¤N¥,¦§¨ i°º $µk$3¨*´„°0²$°Y¥R²$¨x°µ„$¾2¨
´¢¥µ‹²$Y
¨x
¼/
±{³,:¢¼µ„¼W±k²Bz¿¥,°[²$­„K°3{$²%¨°3¼²i$µk$¨­„¥,¨x°0¨/¼­‹Â¸
T+@F:$T$d
7980:zT.:$H0T.L/?}80=':?@?+A8W^Y\?+Lxc='l:$T}@\0?+=!H3A$=!\0C':$l[hi:B@H3T>L/X9TfI.?+O0A%w
I+O?+=!H3F<I+80:pA$Lhi\0C!:%|=!I2^ŸL/XR?+:$@l0=!H0F¢@/H3lQI.?@/H0TfX,L?+hi='H0F
T.:$H0T.L/?
=!HX,L/?+h@xI+=!LH_=!HÅDnŽo‰‹djuvI+TzX,O3H0A%I+=!LHÅ='T@H@C'L/FL/O3TI+L<83LBmÄI+80:
;nDGJ @A%I+=!LH¹80=':?@?+A8W^_@/hi:$C!=!L/?@xI+:$TI+83:YA$Lhi\0C!:%|=!I2^QL/XEA$L/H0w
I.?+L/C!C'=!H0F€@F:$H5I+T$dj7980:GT.:%H3T.L/?‚83=!:%?@x?+A85^€=!T‚F?+LO3H3l0:Bl€bW^tI+83:rC!LBm
C!:$c:$C9\0?+=!hi=]I+=!c:$T€@Bc@='C'@b3C!:qX#?+Lh I+83:\385^T.=!A$TtT.='h€O3C'@I+=!L/HyzI+80:
C!L5AB@xI+=!LH<LXMI+:%?.?@=!H[XZ:B@I+O?+:$T$g‹I+83:*A%O0?.?+:$H5I>T.\:$:Bl[@/HlKC!L5AB@xI+='L/H
LXj@/F/:$H5I+TGL/HUI+83:nh@/\[email protected]*X,L?.I+8d
ƒj@/A8KC!:$c:$C=!HUI+83:}80=':?@?+A8W^=!H5I+:$F/?@xI+:$Tn@HlU:|I+:%Hl0TrI+80:RC!:$c:$C
b:%C'LBme=!IUb5^A$L/hi\3=!C!=!H3F
I+83:[@Bc/@/=!C'@/b3C!:[=!H0X,L?+h@I+=!LH@Hl_\?+L/w
cW='l0=!H0F@/l3l=!I+=!L/H@/CoTfI.?+O0A%I+O0?+:d>†
:tAB@/C!CkI+80:$T.:*80='F/83:%?nC!:$c:$C!Tz) ,1)"B
3X 1+gT.=!H3A%:jI+80:%^}lLGH0L/I„T.:$H3T.:‚@/H5^WI+83=!H3FNl=]?+:$A%I+C]^RXZ?+L/h
I+80:>mML/?+C'ld‚Ž3L?N:%|0@/hi\3C!:gW:%H3:$ht^iC!L5AB@I+=!LHU='HX,L?+h@I+=!LHAB@/Hb:
A%Lh*b0=!H3:Bl}=!H5I+Ln@NT.:$H3T.L?{I+8@xI{T.\:$A$=]ž:%TkLxc:%?@/C!CW:$H0:$h€^n\0?+:$T.:$H0A$:£
I+:?.?@/=!Hz=!H0XZL/?+h@I+=!L/H*AB@H*b:9A$L/h*b0='H0:BlE='H5I+Ln@>T.:$H0T.L/?oI+8@xIoT.\:$A%w
=]ž3:$Tk\@T.T.:$To@/H3l}hiLc:$hi:$H5IA$L/?.?+='l0L?+T$djŽ3O0?.I+80:%?+hiL/?+:/gBI+83:$T.:oImML
T.:%H3T.L/?+TtAB@H
b:zA$L/h*b3=!H0:Bl[I+LpT.80LBm :%H3:$ht^YcO0C!H3:%?@b3=!C!=!I2^‹yt@?.w
:$@/T*mN80:%?+::$H3:$ht^<O0H3=]I+T€@?+:qA$LH0A$:$H5I.?@I+:Bl¢@Hl¢AB@H3H3LI*hiLxc:
5O0='AVWC]^sPT.:%:EŽk='F/O0?+: 5Sd
7980:T.:$H3T.L?*80=':?@?+A8W^sT.8@x?+:$TEI+83:zA$L/H5I.?+LCM80=!:%?@?+A85^aTtTf^HWI@x|
@Hl[TfI.?+O3A%I+O?+:dqƒ‚@A8sT.:$H3T.L?t='Tt@H@/C!L/FLO0T€I+LU@U;RDGJ`@/AI+='L/Hd
uvINT.:$HlTG@/Hl?+:$A$:$=!c:%TGhi:%T.T+@/F:%T>@Hlq\:%?.X,L?+hiTrT.:$H3T.L?>A%Lhi\3Ow
I@xI+=!LH¹lO0?+=!H3Fs=!I+T¨xW°³U¥ T¢hi:I+83LWld¹ŒnH3:U@l0c/@/H5I@F:KL/XnI+83=!T
=!T9I+83@I9I+80:nT+@/hi:>\0?+=!H3A%='\0C!:$TrC!:B@?+H0:Blq=!Hqb3O0='C'l='H0F*@A%I+=!LH0TGA$@?.?.^
Lxc:?Ml=]?+:$A%I+C]^€mN80:$Hzb0O3=!C'l0=!H3F>T.:$H3T.L?+T$dj7983=!T‚C!=!H3V/@/F/:N@/C!T.LEh@/V:%T
=]I:B@/Tf^QX,L?p@A%I+=!LH0TqI+L¢O0T.:KT.:$H3T.L?+TU@T\3@?.IqL/X}I+80:$=]?A%LH5I.?+LC
hi:%A83@/H3=!T.hpdjDGHp@/AI+='L/HKAB@/H?+:B@/A%IGI+Li@*T.:%H3T.L/?>O3T.=!H0Fi­„°µ„´k³,5À
B$°0¦hi:%I+83LWlT$g0I+80:}T+@/hi:Rmr@$^U=!IG?+:B@A%I+TGI+LiA83=!C'lp@A%I+=!LH3T$d
ƒj@/A8zT.:$H0T.L/?o=!Tj@/T.T.L5A$='@xI+:Bl*mN=]I+8€I+83:MT.:%IoL/X‹@A%I+=!LH0ToI+83@I{?+:B 5O0:$TfI
=]I>@/H3lA$L/hi\3C!:%I+:$TrmN80:$HUI+83=!TrT.:%IGb:$A%Lhi:$TN:$hi\I^5d
¡=!V:p@A%I+=!LH3T$g‚T.:$H0T.L/?+T@/C!T.L<@/b3='l:Ub5^<I+80:\?+='H0A$=!\3C!:ULXnT.O0\:%?.w
c:$H3=!:$H0A$:d‚;n=!F80:%?GC':%c:$CT.:$H3T.L?+Tn=!H5I+:$F/?@xI+:E@/Hl='H5I+:%?+\?+:%IGC!LxmM:%?
C!:$c:$CLH0:$T„b0O0I‹I+83:^RlLGH0L/IA83@/H0F:{I+83:oC!LBm9:%?„C':%c:$C=!H0XZL/?+h@xI+='L/Hd
¡LBm9:%?EC!:$c:%CjT.:%H3T.L/?+T}\?+Lxc='l:*=!H0XZL/?+h@I+=!L/HsI+LI+83:*80=!F83:?}C!:$c:$C
L/H3:$TNb0O0I9I+80:%^l0L*H0L/IrI+:$C!C‹I+83:$h½mN8@xIGI+L€T+@$^5d‚ŒnH3:}@/l0c/@/H5I@/F/:
LX‚I+80=!T>=!T>I+83@In:B@/A8KC!:$c:$CkLXoI+83:E83=!:%?@x?+A85^KAB@HKb:€cW=!:%mM:Blp=!H0w
l:$\:$H3l0:$H5I+C]^mN=!I+80LOIGmML/?.?.^=!H3Fi@bLOIGI+80:}C!:$c:$C!TNA$Lhi=!H0Fz=!HWI+L
=]IGL/?NI+80:RC!:$c:$C!TNI+8@IG@x?+:}O3T.=!H3F*=!IBd
3.3 The Sensor Hierarchy
X
Stay alive
Avoid traps
Check for
enemies
Prevent
mass loss
Check
terrain
...
Maintain
supply
...
¤N¥,¦§„¨x <Æ ¦3°³}²$¨xWžv¨[²B­„Å­k¥,¦­À+³,W¿³>¦3°³ W$²$°WÂ
°³¥,¿ k»n
°µ‹Â…B§„¼/­`¦3°³p:„¥$²/»RW°¼­`:±k°3µk´kK¥µ‹²$¹°
²$¨xWi¾‚B§„k¦°3³¸R«t­„i$W²>¾jB§„„À.¦3°³R°3±„±k¨x±k¨¥,°3²$²$
°µQ°¼²$¥,µ_´„ Poµ„U²B­„ E
L}§kµ„´„W¨iºi­k¥¼­Å²B­„K°3¼²B¥,µ
±oW¨x°3²$¸
\Q
S
D>b0TfI.?@/A%IpT.:$H3T.L?+TY@/C!T.L_\3C'@$^¹=!hi\L/?.I@H5IY@/H3lA%Lhi\3C!=!hi:$H5I@?.^
?+LC!:$T€=!H¢:%|WI+:$H3T.=!LH0T€I+LYD>Žo‰‹d{Ž0L/?€:%|0@/hi\3C!:gk='HQJ‚IŽMg„m9:8@Bc:
=!H3A$L?+\L/?@xI+:BlU@thiLWl0:$CLXol0:%XZ:B@IrI+83@IrT.=!h€O3C'@I+:$Tr\0Tf^A80LC!LF/='A$@/C
X@A%I+L/?+TET.O0A8s@/T}hiL?@/C!:i@/H3l[A%LO0?@F: Y 4 di7983:%T.:*X@A%I+L/?+Tt@?+:
T.=!FH0=!ž3AB@/H5I+C]^*@‹:$A%I+:$l*b5^E\:%?+A$:$\I+='L/Hd{uvX‹@[email protected]@/C!=!LH*b:$C!=':%c:$To=]I
=!Tk=!T.LC'@I+:$lg=]I+TkhiL?@/C!:MmN=!C!Cl0:$A%?+:$@/T.:9@HlE\0?+L/b@/b0=!C'=]I2^EL/X0T.O0?.?+:$Hw
l0:?„mN=!C!C5='H0A%?+:B@T.:d{uH0TfI+:B@lRLX3A?+:B@I+=!H3FG@N\:%?+A$:$\I+O@CTf^TfI+:$hpgBm9:
O3T.:n@/b0TfI.?@/A%IrT.:%H3T.L/?+T9I+L€@/A$ WO0=]?+:>\:%?+A%:$=!c:Bl='HX,L?+h@I+=!LHqL/X„LO0?
:$H0:$h€^5dR7983=!TRhi:$C'l0TGm9:$C!C{mN=]I+8[I+80:*hi=!C!=]I@?.^K=!H5I+:$C!C!='F/:$H3A%:zcW=':m
L/X‚@b3TfI.?@/AI}T.:$H3T.L?+T$dRŽ0O0?.I+83:?+hiL/?+:g3T.='H0A$:€@/b3TfI.?@A%IRT.:%H3T.L/?+TRl0L
H3LINH3:$A%:$T.T+@?+=!C]^p\?+LcW='l0:n\:%?.X,:$AI>=!HX,L/?+h@xI+=!LHgI+83:nb:$8@BcW=!L/?GL/X
LO?>l0:%XZ:B@IGhiLWl0:%C=!TGhiL/?+:Rb:%C'=!:$c/@/b0C!:d
/X
ƒoc:$HY=]XM=]IR=!TRH0L/In:%|\3C!=!A$=]I+C!^p:%|\0?+:$T.T.:Bl‹g:$c:%?.^p@/A%I+=!LH[=!TnI.?.^=!H3F
I+Lp@A80=!:$c:@F/L@C d7980:i‘N’3“„”W™F*’™–0’'Q.(*Ÿ@/AI+='L/H
=!TRI.?.^='H0FI+L
T+@I+=!TfX#^zI+83:rF/L@/C3L/XF:%I.I+=!H0FE@/Hi@F:$H5IjI+LE@RT.\:$A$=]ž:Blz\L/T.=]I+='L/HLH
I+83:th@/\g3I+80:€• *I*•Iœ SŸ@/A%I+=!LHY=!T>I.?.^=!H3FiI+LT+@I+=!TfX#^KI+83:EFL@/CoL/X
l3@h@/F/='H0Fq@/H3LI+83:%?>O3H0=]IBdN;R@BcW='H0F@/A%I+=!L/H3T>XZL5A$O3T>LH0C!^ULHKI+83:%=!?
\0?+=!h@x?.^pFL@/C{[email protected]:%I+=!hi:$T>C':$@lpI+LO3H3=!H5I+:$C!C!=!F:$H5IRb:%8@BcW='L?Bd
Ž3L?>:|3@hi\3C!:g0@/Hp@/A%I+=!LHI+8@IGb0C'L5AVWT9I+83:E@\3\0?+L@/A8U?+LOI+:nI+Li@
@FK=!TEI.?.^=!H3FI+LY@/A83=!:$c:zI+80:zFL@/JC .C':I*H0L/wvLH0:i\@/T.T$d ÄuvX9I+83:
:$H0:$h€^q=!TR@b3C!:tI+LiT.H0:B@/VU@?+L/O3HlT.Lhi:EL/I+80:%?>m9@$^5gI+83=!T 3—’Iœ S
@/AI+='L/H€H0LNC'L/H3F/:%?oh@/V:%TT.:$H0T.:doDGH3L/I+80:%?:%|0@/hi\3C!:j=!TI+83:‚‘N’3“”™
*’‹™f–?’ '+.(*U@A%I+=!LHdouvX@/H@/F/:$H5I9=!TMhiLxcW=!H3FRI+LE@El0:%TfI+='H3@I+=!LHq@Hl
[email protected]@/AV:Bl‹g=]I{mN=!C!C3A$L/H5I+='HWO0:MI+LnhiLxc:g/:$c:%H€=]I{m9L/O3C'l*b:MI+LI@/C!C]^
l0:%TfI.?+Lx^:Blb5^l0L/='H0FzT.L0d
7983:s\0?+L/b3C!:$h AB@/H b:[?+:%A%I+=]ž:Bl¹b5^¹=!H5I.?+LWl0O3A%='H0FQ@QH0L/I+=!LH L/X
" iI+L
I+80:Y@/A%I+=!LHd Š{@?.IL/X}I+80:KA$LH5I+:%|WIqL/XEI+80: 3—’Iœ S
@/AI+='L/HÅ=!TzI+80:U@b3T.:$H0A$:ULXn:$H0:$hi=!:$Tz=!H¢I+83:@?+:B@[LH0:U=!T*I.?.^=!H3F
I+LŸ\0?+LI+:$A%IBgR\3@?.IL/XtI+83:YA$L/HWI+:|IUL/X€‘N’3“”™ *’™–0’ 'Q.(*…='TUH3L/I
I+L
b:Yl:$TfI.?+LB^5:Bldu2H3TfI+:B@/lÅLXE@l0l0=!H3F
HWO0hi:%?+LO0TzA$LH3l0=]I+=!LH3@/C
TfI@I+:%hi:$H5I+T‚I+LE:$c:%?.^z@/A%I+=!L/HqI+83@I9T.\:%A$=]XZ^@C'CI+80:>:|0A%:$\0I+=!LH0T‚I+L
H3L?+h@/CWb:$83@xcW=!L/?Bg/m9:r83@/HlC!:9A$LH5I+:%|WI{b5^t8@BcW=!H3Fn@/F:%HWI+T{T+@xI+=!TfXZ^
H3LIGT.='H0FC!:g3b3O0I}$,}LX{FL@/C!T$d
†¹80:$H¢@/AI+='L/H3T€@?+:=!H3=]I+='@I+:Bl‹go@pT.:%I€L/XNF/L@/C!T€AB@/H
b:iT.\:%A$=]ž:Bl
X,L?‚I+80:r@/F/:$H5IGPL/?jF/?+L/O3\zLX‹@/F/:$H5I+TSk:|0:%A$O0I+=!H3F>I+83:r@A%I+=!LHdj7980=!T
FL@/CET.:%Ipl0:%ž3H3:$TqI+83:[A$LH5I+:%|WIqX,L/?UI+83:s@/A%I+=!LHd 7983:[T.:%IUAB@/H
b:zcW=!:%m9:$l
@/T}I+83:*T.:%ItL/XrA$L/hihiLH[T.:$H3T.:iL?t='hi\0C!='A%=!I€@T.T.O3hi\0w
I+=!LH0T>@Hp@F:$H5IGT.83L/O3C'lp@/C]m9@B^TNb:RA$L/H3T.='l0:?+='H0FzmN83:$HqI.?.^='H0F€I+L
@/A83=!:$c:RI+83:[email protected]@xI>83@/H3ld
3.4 The Context Hierarchy and Planner
¡=!V:E@/A%I+=!L/H3T>@/HlqT.:$H3T.L?+T$gFL@/C!T>@?+:E\@x?.INL/Xj@*80=':?@?+A8W^5d‚7980:
80=!F80wvC!:$c:%CGF/L@C>LX +TfI@$^=!H3F¢@C!='c:$<AB@Hb:Kl:$A$L/hi\LT.:BlŸ=!HWI+L
hiL?+:sT.\:%A$=]žA[FL@C!T$gEl0:$\:%Hl0=!H0FQL/H¹I+83:YT.=]I+O@I+=!L/H PT.:$:sŽk=!F/w
O?+: SdMD…80=':?@?+A8W^:%|=!TfI+TrX,L/?>:$c:?.^T.O0A8U83=!F8w2C!:$c:$CF/L@C d‚uH
I+80:*F/:$H3:%?@C{AB@/T.:/gk@F:$H5I+TnmN=!C!Cob:[email protected]+:%hi\0I+=!H3FzI+LqT+@I+=!TfXZ^[F/L@/C!T
X#?+Lh½T.:$c:%?@C3F/L@/C383=!:%?@?+A83=!:$TjT.=!h*O0C!I@H3:$L/O3T.C]^5do7980='Tj=!H5I+:%?+C!L5AV5w
=!H0FH0:%ImML/?+VULXMF/L@C'TE@HlK@A%I+=!LH3Tn='T>mN8@I>m9:t?+:%X,:%?>I+LU@T>I+80:
" 3 ‚ %1)1f" d
D hi:$A8@H3=!T.hÇ='T>?+:B 5O3=]?+:BlpI+Li?+:$T.LC!c:€h*O3C]I+=!\3C!: _@/H3lp\LT.T.=!b3C]^
A%LH 3=!A%I+=!H3F FL@/C!T$dY†
:8@Bc:l:$c:$C!L/\:Bl
@p\3C'@H3H3:?Bg‚‡nˆnDn‰0Š
Pv‡n:%H3:%?@Cˆ>:[email protected]='H0F€O0T.=!H3F€D>b‰5I.?@/A%IMŠo8W^T.=!A$TSgWI+8@xIrlL5:$?T $.O0TfI
I+83@IrPT.:%: WX,L?jl0:%I@='C!TSdj‡nˆ>DR‰ŠK='To@NC!:B@/TfI.wvA$L/hihi=]I+hi:$H5I„\3@?.w
I+='@C83=!:%?@?+A83=!AB@C\3C'@H3H3:? YDvd‚‰WO3A8i\3C'@/H0H3:%?+T‚@?+:G\@x?.I+=!A$O3C'@?+C]^
mM:$C!CrT.O3=]I+:Bl
I+LYA$LH5I+=!HWO3L/O3T€@/Hl
O0H3\?+:Bl0=!A%I@b3C!:UlLh@='H0T€T.O0A8
@TzJ‚IŽMgmN83:?+:zI+83:z\0C#@H3H0='H0FpT.\@A$:ib0?@H3A83=!H3FqX@A%I+L/?€AB@/H<b:
c:%?.^U80=!F8dGŠ{@x?.I+='@/Ck80=':?@?+A83=!AB@/C„\3C'@/H0H3:%?+TG?+:$C]^pLHp@C!=!b0?@x?.^pLX
\0C'@/H
T.V:%C':I+LH3T$dqŠoC'@/H
T.V:$C!:%I+LH0T€@x?+:i\3C'@/H0TRI+8@xIt@?+:iH3LIEX,O3C!C]^
:%C#@bL/?@xI+:BlykI+80:%^Eh@$^}A$L/HWI@=!H€O0HbL/O3H3lEc/@?+='@b3C!:$ToL/?{T.O0b3F/L@/C!T
mN80=!A8@?+:pH0L/Izž3C'C!:BlŸ=!HO0HWI+=!C9?+O0H0w I+=!hi:dŸŠoC#@HT.V:%C':I+LH3T@x?+:
=!hi\0C':%hi:$H5I+:Bli@/Tr@A%I+=!LH0T9=!H;nD>J>dW‡nˆnDn‰0Š
:%|WI+:$H3l0T‚I+80:GI.?@/l0=]w
I+=!L/H@/Cr\3@?.I+='@/CM83=!:%?@?+A83=!AB@C9\3C'@H3H3=!H0FYX#?@/hi:%mML/?+VsbW^
@/C!C!LBmN='H0F
h€O3C]I+=!\3C!:}FL@/C!T>I+L*b:E@/T.T.L5A$='@I+:$lKmN=]I+8Y@€?+:%T.LO0?+A%:tL?nT.:I>LX{?+:%w
T.L/O0?+A$:%T$d¹7983:%T.:K@?+:pH0L/IiT.=!hi\0C!^
A$LDH $.O3H0A%I+=!c:UF/L@C'T$£>=!H3TfI+:B@/lg
F/L@C'Tn@?+:}\?+='L?+=]I+='~%:Bld
‡nˆ>DR‰Š =!TQ=!HcLV:Bl mN83:%H3:$c:?Ÿh*O3C]I+=!\3C!:_F/L@C'TÅ8@Bc:I+Lb:
@A80=!:$c:Bl bW^_LH3:s?+:$T.LO?+A$:gEL/?KmN80:$Hh@H5^@/A%I+=!L/H3TŸP\3C'@/H0TS
A%LO3C'lQb:UO3T.:$lŸI+Ls@/A83=!:$c:LH0:pFL@/Cd_ƒoc:%?.^ŸF/L@CG83@/T@Y\0?+=]w
L?+=]I^@/T.T.L5A$='@xI+:BlpmN=!I+8=]IB£380='F/83:%?N\?+=!L/?+=]I^qFL@/C!TNmN='C!C„@/C]mr@$^TNb:
A%LH3T.='l:%?+:Blqž0?+TfIBdoŠoC#@H3TN@x?+:>X,L/O3H3lI+L€@/A83=!:$c:G:B@A8qFL@/C‹=!HqI+80:
F/L@C0T.:%IBgL/?l:%?+:Bl€b5^}\?+=!L/?+=]I^5doŠ{?+=!h@?+=!C]^tO3T.=!H3FGI+83:M80:$O0?+=!TfI+=!A9LX
hi=!H0='hi=!~$=!H0FE?+:%T.LO0?+A%:nO3T.:/[email protected]@C'CT.:I9L/X„\3C'@/HA$L/h*b0='H3@I+=!LH0TM=!T
F/:$H3:?@I+:Bl‹dj7983:n\0C'@/H3TM@?+:>:$c@C!O@I+:$lb5^*T.='h€O3C'@I+=!H0FEI+80:$h @/Hl
I+80:nL/H3:>?+:%T.O3C]I+=!H3F*=!HI+83:>hiLTfI9X,@xcL/?@/b0C!:nX,OI+O0?+:>mML/?+C'lTfI@xI+:n=!T
A83L/T.:$H Y
dGu2Xo\0?+L/b3C!:$hiT>@?+=!T.:€l0O0?+=!H0F@\0C'@/Ha TG:%|:$A$OI+='L/H¢Pb:%w
A$@/O3T.:n@E?+:%T.LO0?+A%:>mr@Trl0:%TfI.?+Lx^:Bl@/HlzI+80:>\0C#@HO3T.=!H3FE=]IrAB@H3H3LI
T.O0A$A$:$:$l<mN=!I+80LOI*=]IBg{X,L?z:%|0@hi\3C!:Sgo@H¢:%?.?+L/?€hi:$T.T+@/F/:=!TtT.:$H5I
I+LiI+80:t\0C'@/HY=!H3=]I+='@I+L/?RO3T.=!H3FzI+80:€;nD>J¹hi:$T.T+@F=!H3Fhi:$A8@H3=!T.hpg
\L/T.T.=!b3C]^
AB@O3T.=!H3Fp?+:%T.LO0?+A%:$T€I+Lpb:i?+:%[email protected].='F/H3:Bl
L?€@pA$Lhi\0C':I+:
?+:%\3C'@/HUI+L€I@/V:R\0C'@/A$:d
>L/I‚@/C!CFL@/C!TjmN=!C!C3b:9@/\3\0C!='A$@/b3C!:N=!Hz@nF/=!c:$H*T.=]I+O3@I+=!LHp[P .TfI@$^0=!H0F
@C!='c:$s=!TzL/H3C]^
?+:$C!:$c/@/H5ItmN83:$HQ@pI+80?+:$@I*I+LKI+80:U@F:$H5Iz:|0=!TfI+TSd
7980:$T.:R]) 3- NB) M@x?+:ML/H3C]^t@l0l0:BlRI+L>@/Ht@/F/:$H5IBa T{F/L@CT.:IkmN83:$H
I+80:$=]?*I.?+=!FF/:%?+=!H3FsA$LH3l0=]I+=!LHQ='T€hi:%IBgjT.=!hi\3C!=]XZ^=!H3FKI+83:q\3C'@/H0H3=!H3F
\?+L5A$:$T.T$d D ?+:$\3C'@H¹='TI.?+=!FF/:%?+:BlmN83:%H3:$c:?U@H¹@/F/:$H5IBa TF/L@/C!T
A8@H3F/:dou2X@RC'@I+:%HWI‚FL@/CT.80LO0C#lzb:N@A80=!:$c:Bli@xI9@HW^€A$L/TfIBg5:$c:$H
I+LEI+83:N:%|A$C!O0T.='L/HLX„LI+83:%?MFL@/C!T$g0I+80:NC#@xI+:$H5I9F/L@/Ca TN\0?+=!L/?+=]I2^iAB@/H
b:}T.:IGI+Lz@*c@C!O3:R80='F/83:%?NI+83@/HI+83@INLXj@/H5^qL/I+83:?>F/L@C d
]
W
DnŽo‰¢=!Tq@/\3\?+L\?+=#@xI+:UX,L?@/H5^Q@/F/:$H5I.w2b3@/T.:BlQT.=!h*O3C'@xI+='L/HLXRI+83:
3\ 85^T.=!AB@/C‹m9L?+C'lUI+8@IGAB@Hpb:}hiLWl0:%C':$lU@/b0TfI.?@/A%I+C]^O3T.=!H3Fi\?+=!hi=!w
I+=!c:$TGT.O3A8Y@/Tn‘G’3“”p@HlU•––0—+˜™fš’›3œ3”‹dG;RDGJ_=!TR@\3\0?+L/\0?+='@I+:
X,L?R@H5^U@\3\0C'=!AB@xI+=!LHUmN80:%?+:R^5LOqmr@HWINI+Lil:%žH0:R=!H5I+:$C!C'=!F/:$H5I>b:w
8@BcW=!L/?GX,L?R@HK@/F/:$H5In=!HK@z80=':?@?+A83=!AB@/Ch@/H0H3:%?Bd‚uH\@?.I+=!A$O0C'@?Bg
m9:*8@Bc:*O0T.:BlKI+83:zT+@hi:€XZ?@hi:%m9L?+VKI+LUhiLWl0:%Co@hi=!C!=!I@x?.^[@lWw
c:%?+T+@x?+='@/C3\0C'@/H3H0:%?Bg5@nŠj=!LH0:$:%? 9?+LbLIjT.='h€O3C'@I+L?‚@/HlEI+LRA$L/HWI.?+L/C
@/H3li\3C'@/H=!HA%Lhihi:%?+A$='@CF@hi:$TMT.O0A8q@/T &[email protected]+C!:$~$L/H3:}@H7l 3}@x?+V
ˆG:$=!FHdo;nDGJ='TNc:?.^C':$@/H£m9:}:%TfI+='h@xI+:nI+8@xIN=!HULO? J9@\0I+O0?+:
I+83:qŽkC'@/F/[@/\3\0C!='A$@I+=!LHg‚;nDGJ =]I+T.:$C]X€P,mN83=!A8¢l0L5:$T€H3LI*=!H3A%C'O3l0:
I+83:z@/A%I+=!LH0TtI+80:il0:%T.='F/H3:%?t83@/T}mr?+=]I.I+:$Hg{L/H3C]^YI+83:i@x?+A80=]I+:$A%I+O0?+:
Lxc:%?+80:B@lS‚O3T.:$TNC!:$T.TNI+8@/H LX{I+83:EJ9Š I+=!hi:}@/H3lhi:$hiL?.^5d
;RDGJ>aT*=!H5I+:%?.X,@/A$:qI+L<@Yl0L/h@/=!HŸA$LH0T.=!TfI+TzL/Xn@KT.:%IiL/X>C!LBmrw2C!:$c:$C
T.:$H0T.L/?+Tt@/H3ls:%‹:$AI+L/?+T}X,L?*:$c:%?.^[@/F/:$H5IBdqŽ0?+LheI+80:$T.:ib@T.=!Ai:$C]w
:$hi:$H5I+T$g‹I+83:*@/A%I+=!L/Hsmr?+=]I+:%?EAB@H<b3O0=!C#lKO0\<@x?+b3=]I.?@?+=!C]^[A$Lhi\0C':|
b:$83@xcW=!L/?BdUJMO?.?+:$H5I+C!^[mr?+=]I+=!H3FK@A%I+=!LH3TE?+:B 5O3=]?+:$TE\?+LF/?@hihi=!H3F
T.VW=!C'C!T$g‹b0O0IGLH0:tLXjLO0?>FL@/C!TR=!TNI+Lq:|0\0C!L/?+:E83LBm…T.='hi\0C!:EmM:EAB@/H
h@/V:nI+83=!Tr\0?+L5A%:$T.T$d
U
7983:‚l0:%c:$C!L\0hi:$H5ILX;RDGJ[=!Tk@HELH3F/L=!H3FN\?+L5A$:$T.T$do7980='T„T.:$A%I+=!LH
T.O3hih@x?+=!~$:$T*I+80:UC!:$T.T.LH0Tim9:UC!:B@x?+H3:BlŸmN83=!C!:Yl0:$c:$C!L\3=!H0Fs;nD>J
@/H3lT.L/hi:}L/X{L/O0?G\3C'@/H0TrX,L/?NXZO0I+O0?+:RmML/?+Vd
N"BU # %- U(* Œnc:%?ŸI+83:A$L/O0?+T.:L/X[;nD>J>aTÅl0:$c:$C]w
L\3hi:%HWIBg>m9:
83@Bc:smr?+=]I.I+:$H…h@/H5^@/AI+='L/H3T$d 7980:$T.:Ÿ@/Aw
I+='L/H3T€8@Bc:b:$:$H¢=!hi\0?+Lxc:$l
@/H3lŸO0\‹l3@xI+:Bl
@/TtI+83:@/\0\3C!=]w
AB@I+=!LH lLh@='H…A83@/H0F:Bl‹d DGA%I+=!LH3TYT.83@?+:Ÿh@/H5^ A$Lhzw
hiLH:%C':%hi:$H5I+T$gK@/H3l=!HI+83:¹=!H5I+:%?+:$TfIÅL/XYTfI.?+:$@/hiC!=!H3=!H3F
I+83:s@/A%I+=!LHl0:$T.=!F/H…\?+L5A$:$T.T$gRmM:
8@Bc:[h@l:shiL?+:<@Hl
hiL/?+:<LX*I+80:$T.:_)"BU #K - #/(*[\@x?.IKL/X€I+83:
;nD>J T.O3\w
\L/?.Ihi:$A8@H3=!T.hiT$d_Ž0L/?:%|0@/hi\0C!:g9:$c:%?.^Q@/A%I+=!L/H_A80:$AVT
X,L/?Qhi:$T.T+@F:$TŸXZ?+L/h =!I+TŸA83=!C'l?+:$H@/H3lF:$H0:%?@I+:%TÅhi:$Tfw
T+@/F:%TI+Ls=]I+Tq\3@?+:$H5I+T$d_7983:$T.:UXZO3H0A%I+=!LH3Tq@x?+:p\:%?.X,L?+hi:Bl
bW^I+80:
hi:%I+83LWlTY­„°µ„´k³,5À+
B$°3¦¹@Hl…¼/­„¼ Àf°µk´À
¦µ„W¨°0²$5À+
B$°3¦gN?+:$T.\:$AI+='c:$C]^5g>mN80='A8…@?+:<T.\:%A$='@/C]w
='~%:BlULHqI+83:nI2^\:RL/X{:%c:$H5IrI+L*b:}\?+L5A$:$T.T.:Bl‹dMƒoc:$H5I+O3@/C!C]^5g
m9:‚mMLO0C#lEC!=!V:‚mr?+=]I+=!H3Fn@/A%I+=!LH0T{=!H€;nD>JKI+L>b:‚C!='V:M\3OI.I+=!H3F
I+LF:I+83:%?M@RTfI.?+O3A%I+O?+:9XZ?+L/h b0O3=!C'l0=!H3F}b0C'L5AVWT$d{ufl:B@/C!C]^5gI+80=!T
m9LO0C'l€b:rlLH3:MO3T.=!H3Fn@>F/?@\380='A$@/CO3T.:%?o=!H5I+:%?.X@A$:gh@/VW=!H3F
I+83:R\?+L5A$:$T.TGhiL/?+:}@A$A$:$T.T.=!b3C!:EI+Lz@*H0LHw2\?+LF?@/hihi:%?Bd
B-&])1i)"BU U3*) -p
3X 1 3n:$T.=!FH3=!H0FUhiLWl0O0C'@?t@/Aw
I+='L/H3To?+:B 5O3=]?+:$T‚@RA$:%?.I@='Hl:$F/?+:%:>LXl0=!T.A$=!\3C!=!H3:GLH*I+80:N\@?.I
L/X{I+83:t@A%I+=!LHYl0:%T.='F/H3:%?BdN;nDGJ¹80:$C!\3TGb5^p@/l083:?+='H0FzI+LzI+83:
\0?+=!H3A$=!\0C':€L/XMT.O3\:%?+c:%H3=!:$H3A%:z@/H3lKbW^pF=!cW='H0FUA$L/hihiLH[@/Aw
I+='L/Hs='l='L/hiT>I+LI+83:€l0:$T.=!F/H3:%?Bd &‚:$=!H3Fp@b3C!:€I+LL iL@/l<@/Aw
I+='L/HA$LH5I+=!H3F/:$H3A$=!:$TjI+L}I+83:N\3C'@/H0H3:%?‚I+80?+L/O3F8zI+80:Nh*O3C]I+=!\3C!:
FL@C?+:$T.L/C!O0I+=!LHKhi:$A8@H3=!T.hÄ@C'T.LzX,@/A$=!C!=]I@I+:$T>hiLWl0O0C#@x?+=]I^5d
‚! K U )"BU U ,(G‹!%(i
3)U # 7983=!T\0?+=!H3A$=!\0C':
h@/H3=]XZ:$TfI+T}=]I+T.:$C]XN='Hsh@/H5^K\0C#@A$:$T$dŒnH0:*:%|0@/hi\0C!:*=!T}I+8@I
@/C]I+83L/O3F8 ;nDGJ lL5:$T<:%H0X,L?+A$:Å@/H @A%I+=!LH 83=!:%?@x?+A85^5gt=]I
\3C'@/A$:%TRc:%?.^X,:%m LI+83:%?>A$L/H3TfI.?@/=!H5I+TRL/HYI+80:tl0:$T.=!FH[L/XM@/Aw
I+='L/H3T$9d UL/TfIG@/H5^iA$L/HWI.?+L/C‹T.A80:$hi:>A%LO3C'lb:n=!hi\3C!:$hi:%HWI+:$l
='HQ;RDGJ>djŽ3L?i:%|0@/hi\0C!:g‚mM:U83@xc:UO3T.:$lQ;nD>J I+L<=!hi\3C!:%w
hi:$H5Iq@ŸT.O0b3T.O0hi\0I+=!LH@?+A83=]I+:$A%I+O?+:[=!H¹L/O0?UDnŽo‰Åb3@/T.:Bl
?+LbL/IGT.=!h*O0C'@I+L/?Bd
0)"BU U I>#0) 5
3 ,*"
3,1f)!&j^<83@xcW=!H3FULO0?
A$LH5I.?+LCM83=!:%?@?+A85^¢b:LH0:LX*)fq#)nK) WU# +p)" X" /(>‹ ,f0.-g/=]Ikmr@T{c:%?.^}:$@/Tf^}I+Ln=!H0A$L/?+\L?@I+:9h€O3C]I+=]w@F:$H5I
@/A%I+=!LH0Tn@Hlq\3C'@/H0H3=!H3Fz=!H5I+L*L/O0?>@?+A83=]I+:$AI+O0?+:d
5. LESSONS LEARNED
`
;nDGJ>aTHE
T[A$L?+:¢HAC
T.='h€O3C'@APPLICATION
I+L?
@Hl\0C'@/H3H0:%?Ym9:%?+:Ql:$c:$C!L\:$l…O3T.=!H0F
D }‰WuRJML/hihiLH
¡=!T.\ 4 £{I+80:zF/?@\383=!AB@CMO0T.:%?t='H5I+:%?.X,@/A$:iO0T.:$T
¡=!T.\i:%|WI+:$H3T.=!LH0T‚T.\:%A$=]žArI+L p@/A%='H5I+L/T.8UJML/hihiLH*¡=!T.\KP KJ9¡{Sd
7980:nTf^TfI+:$h ?+O3H0TMO3H3l0:%? p@/ABŒ}‰ ZWd|zL/? Wd |i@/Hlz?+:B 5O0=!?+:%Tr@t‡
L?ib:%I.I+:%%? p@/A$=!H5I+LT.8ŸmN=]I+8@xIiC!:B@/TfI U:$F@/b5^WI+:$TiL/X>ˆ>D sd
p@\Kl0=!T.\0C#@$^TN@/H3lcW=!T.O@C'=!~B@xI+=!LH3Tr?+:B 5O0=!?+:Rl0=!T.\3C'@$^T9mN=!I+8I+83LOw
T+@HlT*L/?€hi=!C!C'=!L/H3TtL/XGA$LC!L?+Ti@I*@U?+:$T.LC!OI+='L/HŸL/X>@I€C!:B@/Tf2I N
| Zd‚;RDGJT.O0\3\L/?.I+TG@€I+:|INb3@/T.:BlH3:%I2m9L/?+VT.L5AV:%IG=!H5I+:%?.X@A$:
I+83@IMAB@/Hb:GO3T.:BlibL/I+8iXZL/?rH0:%ImML/?+V*\0C'@B^i@/HlzI+LEA$L/HWI.?+L/CL/I+80:%?
T.=!h€O3C'@[email protected]\0\L/?.IrI+80:RT+@/hi:}=!H5I+:%?.X@A$:d
4.
X
W
X
N%[ /&1"%E)1. j1‚"B])+ B."B,97980:R=!T.T.O3:}L/X„?+:$T.LO?+A$:
h@/H3@/F/:$hi:$H5Ir 5O3=!AVWC!^b:%AB@/hi:>\@?@hiLO0HWIM=!HI+83:nl0:$T.=!F/H
L/Xq=!H5I+:$C!C!='F/:$H5I¢@A%I+=!LH3T$d¬‰WLhi:
?+:$T.L/O0?+A$:%T<AB@H LH3C]^b:
O3T.:$lUb5^LH3:E@F:$H5In@I>@€I+=!hi:gT.Lhi:E@x?+:}A$LH0T.O3hi:Bl‹g0@/Hl
T.Lhi:E:$hi:?+F:}LH0C]^p=!HUI+83:E\?+L5A$:$T.TnLXo\:%?.X,L?+hi=!H3F@/HY@A%w
I+=!LHdEuH3=]I+='@/C!C]^YLxc:%?+C!L5LVW=!H3FI+83:t=!hi\L/?.I@H3A$:€L/Xj?+:$T.LO?+A$:
h@/H3@/F/:$hi:$H5IMm9@/TN\0?+L/b@/b0C]^LH3:nL/XkI+80:nh@/=!HqC!:$T.T.LH0TNmM:
C!:B@?+H0:Bldp‰=!H0A$:iLO?€80=!:%?@?+A85^<=!TtL/?+F@H3=!~$:Bl¢@x?+LO0Hl)" U #0+gM?+:$T.L/O0?+A$:$Tib:%A$Lhi:I+83:@/F/:$H5I+T*I+8@xIi\:%?.X,L?+h I+80:
@/AI+='L/H3T$dn7983:%?+:€@?+:tH3LBmh@/H5^Uhi:%A83@/H3=!T.hiTN=!HY;RDGJ¹I+L
\@T.Ti?+:$T.LO?+A$:$TiI+L<A83=!C'l?+:$HgMI+LsT.:$C!:$A%IqA$:%?.I@='HV=!H3l0TzLX
?+:$T.L/O0?+A$:$T$g3@/H3lzI+Lt?+:B@A%IrI+LE?+:$T.LO?+A$:$Trb:$A$L/hi=!H3FEO3H3@xc/@/=!C]w
@/b0C!:d uHÅX@/AIBg>:%c:$H_T.:$H0T.L/?pl3@I@sAB@/H¹b:YcW=!:%m9:Bl@/T@
?+:$T.L/O0?+A$:y>@b3TfI.?@/AI}T.:$H3T.L?+TRh@/H0=!\3O3C'@xI+:€l0@I@z?+:$T.L/O0?+A$:$T$g
mN83:?+:B@/TG\3C'@/H0TG@/Hl@/A%I+=!L/H3TGh@/H3=!\0O3C'@I+:}@F:$H5I+T$d
W1fz2)1) € %1f)/1f" %R†
:}XZLO3H3lUI+8@xIRT.:$\3@?@I+=!H0F
T.:$H0T.='H0FtX#?+Lh A$LH5I.?+LC3A$LH0A$:$\0I+O3@/C!C]^5g5mN83=!C!:nTfI+=!C!CO3T.=!H3F}I+80:
T+@/hi:NO0H3=]X,L?+h C'@/H0FO3@/F:GI+L}=!hi\3C!:$hi:$H5I{I+83:NT.:$H0T.L/?+T$gT.=!hzw
\3C!=]ž:$lULO?NA$LWl0:}:$H0L/?+hiL/O3T.C]^5djD>b0TfI.?@/A%INT.:$H0T.L/?+TGb:$AB@hi:
@Kc:%?.^<F:$H0:%?@/CrI+L5LC9XZL/?*L/?+F@H3=!~$=!H3F<l3@xI@[@Hl
X,L?iT.LC!c5w
=!H3Ft@/H5^*\0?+Lb0C!:$h½I+83@I‚=!HcLC!c:Blz83@xcW=!H3FRI+L}?+:B@A%IMI+LET.L/hi:
:$c:%HWI9='HI+83:Gm9L?+C#l‹;d 3R:B@/C!=!H3F€mN=!I+8qh*O0C]I+='\0C!:nFL@/C!TG@IrI+80:
@/F/:$H5I{C!:$c:$C/mr@/To@rH3@I+O0?@C5:%|WI+:$H3T.=!L/HtLX383@Bc=!H0FNI+L>@/A83=!:$c:
h*O0C]I+='\0C!:RT.=!h*O3C]I@H3:$L/O3TrFL@/C!Tn=!HqI+83:El0L/h@/=!Hd
ŒnH0:*LX‚I+80:*hiL/?+:t:%|A$=]I+=!H3Fl0=]?+:$A%I+=!L/H3TnmM:i@?+:€hiLcW=!H3F=!HYmN=!I+8
;nDGJ =!TzF/:$H3:%?@C!='~%='H0Fs=]I*T.L[=]I*AB@/HŸb:O3T.:Bl
I+LYA$L/HWI.?+L/C9\385^T.=]w
A$@/C9?+LbLI+T$dY†
:im9L/O3C'l¢C'=!V:I+LKhiLWl0:%C‚?+:$T.L/O0?+A$:$Tz@ItI+83:C!:$c:$C
LX>@/F:%HWI€:%‹:$AI+L/?+T$g‚@/C!C!LBmN='H0FsO0TtI+L[@T.T.='F/HŸ\@?.I+TtL/X>@F:$H5I+T€I+L
l=]‹:%?+:$H5I€[email protected]$dYu2It=!T*=!H5I+:%?+:$TfI+=!H3FpI+83@It?+LbL/I+=!A$T*@/H3l
hiLWl0:%?+H
?+:$@/C]w I+='hi:*T.='h€O3C'@I+L?+T}\3C'@/A%:zT.=!hi='C'@x?tl0:$h@Hl0TnLHs@/H
@x?+A80=]I+:$A%w
I+O?+:dj7983:>A$O0?.?+:%HWIM;RDGJÅ:$H0F=!H3:>O3T.:$T9@tA$:%HWI.?@C!='~%:BlU 5O3:%O3:>@/Hl
=!hi\L/T.:$TrH3LtA$LH0TfI.?@/=!H5I+TrLHI+83:RJ9Š I+='hi:GO3T.:$lqb5^@Hp@/AI+='L/Hd
Ž0O0I+O0?+:i:%H3F=!H0:$T€mN=!C!C9b:L\:%?@xI+=!H3FK=!HŸ@U?+:B@/C]w I+=!hi:gjl0:%A$:$H5I.?@/C]w
=!~$:$lq:$HWcW=]?+LH0hi:$H5IBg5@/H3lzmN='C!CH0:$:BlzI+Ltl0:B@CmN=!I+8mN='l0:$C]^ic/@?.^=!H3F
I+=!hi:NT.AB@C':%T$gX#?+Lh½hi=!A%?+LT.:$A%LHlT‚I+Ltl3@$^T$do7980:>A$O?.?+:$H5I+C]^zO3T.:$lg
A%:$H5I.?@/C!=!~$:BlK@/AI+='L/HK 5O3:$O0:nmN=!C!C„b:R?+:$\0C#@A$:BlUb5^@*hiL?+:}F:$H0:%?@/C
hi:%A83@/H3=!T.hÇI+8@IRT.='hi\0C]^pX,L?.mr@?lTE:$c:$H5I+TnI+LI+83:*@/\3\?+L\?+=#@xI+:
@A%I+=!LHgmN83:I+83:%?{=]Io=!To@>C!L5AB@C3@A%I+=!LHt?+O3H3H0=!H3FGLHEI+83:MT+@hi:M\0=':%A$:
LXo8@x?lmr@x?+:}L/?>@/Hp@/A%I+=!LH?+O3H3H0=!H3F€?+:%hiL/I+:$C]^5d
^U
97 80=!TnSUMMARY
\@\:%?>8@/TG=!H5I.?+LWl0AND
O3A%:BlU;RRELATED
DGJ¹@/T>@l0L/h@/=!WORK
H0wvF:%H3:%?@C„@F:$H5I
l:$T.=!FHUI+L5L/Cd97980:$T.:E@?+:}I+83:n='T.T.O0:$TNm9:}b:$C!=!:$c:};nD>J_@/l3lW?+:$T.T.:$T
mM:$C!Cy
D>F/:$H5IjA$LH5I.?+LCg@A%I+=!LHi:%|:$A$OI+=!LHg\3C'@/H0H3=!H3FgW@/H3l*T.:$H3T.=!H0F
@?+:E@C!C„\@x?.IGL/XkI+80:RT+@/hi:RX#?@/hi:%mML/?+Vd
ˆG:$T.LO?+A$:$TG@?+:E:%|\3C!=!A$=]I+C]^qhiLWl0:$C!:Bl‹d
D>AI+='L/H3TN@x?+:RH3LINhiLH3L/C!=!I+80=!AR:$H5I+=]I+=':%T9I+8@IG@C]mr@$^TN?+O0HqI+L
A$L/hi\3C!:%I+=!LHdD>A%I+=!L/H3TiT.:$H3lÅhi:$T.T+@F:$Tq@/bL/O0IiI+80:$=]?TfI@w
I+O3T$g‹A%Lhi\3C!:%I+=!L/HÅP:$=]I+80:%?RT.O0A$A$:$T.TfXZO3CoL/?}O0H3T.O0A$A$:$T.TfXZO3CZSgL/?
\0?+L/b3C!:$hiT$dp7983:%^sAB@/H¢b:@Hl
LXZI+:$HŸ@x?+:q=!H5I+:%?.?+O0\0I+:Bl[L/?
?+:$T.A83:BlO3C!:Bl‹d
;RDGJ ='Tz@[hiLWlO3C'@?€Tf^TfI+:$hp£9T.O0\:%?+c:$H0=':%H3A$:q:$H@b3C!:$TzO0T
b3O0=!C#l?+:%wvO3T+@b3C!:E@/A%I+=!L/HKhiLWl0O3C!:$T$d
¡„@xI+:$H5IGFL@C!Tn@C'C!LBm…O3H0XZL/?+:$T.:%:$HK:$c:$H5I+T9I+L€b:}:%|\3C!L=]I+:Bl‹d
;RDGJ =!TL/?+F@H3=!~$:Bl¹@x?+LO0HlÅ[email protected]+83@Iq8@Bc:pI+L
b:Y@A%w
A$L/hi\3C!=!T.83:Bl‹d
ˆG:$T.LO?+A$:$T*I+80:$HŸb:$A$Lhi:I+83:@/F/:$H5I+T*I+8@xI
=!hi\3C!:$hi:$H5IN@A%I+=!LH0T$d
6.
7983:p‡nˆnDn‰0Š\0C'@/H3H0:%?z=!H5I+:$F?@I+:$T@KHWO3h€b:%?*LXnH0:%mÄ@Hl¢LC'l
'= l0:B@TiI+L¢l0:B@CGmN=]I+8_A%LH5I+=!HO0LO0T@/HlÅ@lc:%?+T+@?+='@CRl0L/h@/=!H3T=!H
?+:B@C!w I+=!hi:douvI9b3O0=!C#lT9O3\L/HqI+80:>:%TfI@/b3C!=!T.83:$lH3LI+=!LHqL/X{@EA$L/HWI.?+L/C
83=!:%?@x?+A85^5gO3T.:Bl*=!Hzh@H5^*@F:$H5I‚@?+A83=]I+:$AI+O0?+:$T‚@/H3l*83=!:%?@x?+A80='A$@/C
I@/T.VUH3:%I2m9L/?+V\3C'@/H0H3:%?+T€P:d F0d!g /g 4,SdR7980:€='l:B@iL/Xo?+:B@/T.L/H3=!H3F
O3T.=!H0F[\?+L5A$:BlO0?@/CMVH0LBmNC':$l0F:8@Tz@/C!T.L[b:$:$HŸO3T.:$l
='HQ@KHWO3hzw
b:%?‚L/XL/I+80:%?‚Tf^0TfI+:%hiT$g5=!H3A$C!Ol=!H3FEŠoˆR2‰ YK
g0Šjˆn‰Ww2¡=]I+: Y g3›”W™
10. K g5B– ,‹’B” .0' D gI+80:rl3@xI@n@H@/C]^T.=!ToTf^0TfI+:%h`• '
” 4 gW@Hl
=!HC#@H3F/O@/F/:$TMXZL/?9?+:B@A%I+=!c:GA$LH5I.?+LC3T.O3A8@TMˆ>DnŠ vg š5›‘ Y 4
@/H3l
–›3’–0”— Y D dY7980:•–” Å@x?+A80=]I+:$A%I+O0?+:q@C'T.L[@xI.I+:$hi\0I+TRI+L
h@/H3@/F/:Rh*O0C!I+=!\0C':NI@/T.VWTr=!HUA%Lhi\3C!:%|‹gWO0H3A$:%?.I@=!HU:$HWcW=]?+LH3hi:%HWI+T$g
\3C'@A$=!H3Fi\@x?.I+=!A$O3C'@?n:$hi\383@/T.=!TNLHUI+80:}\0?+L/b3C!:$h L/X{?+:$T.L/C!c=!H0F?+:w
T.LO?+A$:$TGA$LBH =!A%I+T Y Dvd
D>C]I+80LO3F/8¢h@/H5^
Tf^TfI+:$hiTE?+:[email protected]@/bL/O0Izh€O3C]I+=!\3C!:A$LH0A$O0?.?+:%HWI
FL@/C!T$gE‡nˆ>DR‰Š½=!TqO3H0=# 5O0:Y@/hiLH0F
\@x?.I+='@/CR80=':?@?+A83=!AB@/Cn\3C'@/Hw
H3:?+TG=!HUI+83@IG=]IG\3C'@/A$:%T>h€O3A8LX{I+83:}b3O?l0:$HL/Xk?+:%T.LC!cW='H0FzI+83:$T.:
FL@/C!T*L/H<I+83:i\0C'@/H3H0:%?Bg{O0T.='H0FUI+83:@Bc/@/=!C'@/b0='C!=]I^<L/Xr?+:$T.L/O0?+A$:%T*@T
=]I+T€\?+=!h@?.^s83:$O?+='TfI+=!Ad >H3C!=!V:ŠoˆR‰
@Hl<ˆ>DnŠkgX,L/?*:%|0@/hi\0C':/g
‡nˆ>DR‰0Š¹lL5:$TRH0L/IR?+:B 5O0=!?+:EI+83:€l0:%T.='F/H3:%?ELX9@A%I+=!LH0TiP,I@/T.VWTSrI+L
@/H5I+=!A$=!\@xI+:n:$c:%?.^z\L/T.T.='b0C!:n:$c:%HWI‚=!H5I+:%?@/A%I+=!L/HdjŠoC#@H3TjI+8@I‚?+:B@/AI
I+L}O3HX,L?+:$T.:$:$Hi:$c:$H5I+T{AB@/Hib:rV:%\0IjA$LH0A$:$\I+O@/C!C]^€T.:$\@x?@I+:NXZ?+Lh
I+83L/T.:RI+8@xIG@?+:E=!hi\3C!:$hi:$H5I+=!H3FtC!LH3F/:%?NI+:%?+hÄFL@/C!T$d
¡=!V:EŠoˆn‰‹g;RDGJ_@/C!C!LBmNT>XZL/?NI+83:}T.\:$A%=!ž3AB@I+=!L/HpL/Xob0C'L5AVW=!H3Fi@Hl
H3L/H0wvb3C!L5AVW='H0F¢A80=!C#lW?+:$H PA83=!C'l¹@/A%I+=!LH0TI+83@I?+O3H¹=!H¹T.:B 5O3:%H3A$:
mN=]I+8[I+80:$=]?}\@x?+:$H5I+TRL/?R='HY\3@?@/C!C!:$CZSg{@HlKC!=!V:*C'@I+:?}c:%?+T.=!LH0T}L/X
ˆ>DnŠ Z4 g3T.O0A$A$:$T.TG@HliX@/=!C!O0?+:t@x?+:nI.?+:B@I+:$lC!=!V:}@/H5^LI+83:%?Nhi:$Tfw
T+@/F/:g>@/H3l_l0L
H0L/I=!hi\3C!=!A$=]I+C!^Ål:%I+:%?+hi=!H3:pI+80: LBm¯L/XEA$L/HWI.?+L/C
b:%I2m9:$:$Hp@/A%I+=!LH0T$d
;RDGJ`@Hl¢‡nˆ>DR‰Š O0T.:zI+83:iT+@/hi:€?+:$\0?+:$T.:%HWI@xI+=!LH
X,L?z@A%I+=!LH0T
@I@C'C>C!:$c:$C!TL/X}I+80:p83=!:%?@x?+A85^5gN@Hl@C!T.L
X,L/?\3C'@H3Tq@/H3lÅT.:$Hw
T.L/?+T$dnJML/HWI.?@TfInI+80='TNmN=]I+8KI+83:Eh@ $fL/?+=]I^UL/XjA$O?.?+:$H5In@F:$H5InA$LHw
I.?+LC>@?+A83=]I+:$AI+O0?+:$T$gr:/d Fd…œ0˜–0›B” 1 1 KD}@HlQˆnD>Š 4 grmN80='A8
l0=!TfI+=!H3F/O3=!T.8qb:%ImM:$:$H\0?+L5A$:$l0O0?@C‹C'LBmrwvC!:$c:$9C .T.VW='C!C!T.*L5? +b:%8@Bc5w
=!L/?+T.€@/H3lz83=!F80:%?9C!:$c:%CTf^h*bLC!=!Ar?+:B@/T.L/H3=!H3F;d 3R=]‹:%?+:$H5IMTf^TfI+:$hiT
@?+:*L/XZI+:%HsO0T.:BlYI+L=!hi\3C!:$hi:$H5I>:B@/A8sC!:$c:$CrP œ0˜–0›B” 1 1tA$Lh€b3=!H3:$T
‰uŠ‚ƒ{Fw }@/HliŠoˆn‰‹gXZL/?r:|3@hi\3C!:Sd„;RDGJÅlL5:$TMH0L/I‚A$LH0A$:$\0I+O3@/C!C]^
l0=]‹:%?+:%HWI+='@xI+:pb:%ImM:$:$Hl0=!T.A%?+:%I+:Y@A%I+=!LH3Tq@HlŸA$LH5I+=!HWO3LO0Ti\0?+Lw
A$:$T.T.:%T$goH3L/?€lL5:$T€=]I€C!='hi=]IEI+83:€I+83:iC'@/H0FO@F:qO3T.:Bl[I+LKl0:$T.A?+='b:
I+83:%hpdkDGC!I+80LO0F8Em9:9\?+LcW='l0:‚h@/A%?+L/T{@/H3lEXZO3H0A%I+=!LH3TkI+LGTfI.?+:B@hzw
C!=!H3:EI+83:tb:$8@BcW=!L/?nmr?+=]I+=!H3Fq\0?+L5A%:$T.T$g@/C!CkI+83:t\LBm9:%?nL/XjI+83:t¡=!T.\
\0?+L/F/?@hihi='H0F*C'@/H0FO3@/F:EAB@Hpb:RO0T.:BlU=!Hp@HW^@A%I+=!LHKL/?G\0C#@Hd
X
]
]
U
7983=!Ti?+:$T.:B@x?+A8¹=!TT.O3\0\L/?.I+:BlQb5^R3>D>ˆ>Š‹D }‰0D>Ž…O0Hl0:?A$LHw
I.?@/AI
HWO3h€b:%?+T %w xwfJ‚w Z gpŽ Nxw xw %w N4Z Wgp@Hl
Ž xw BXw w N d7983: €d ‰‹dj‡nLxc:?+H3hi:$H5I€='Tz@/O0I+80L/?+=!~$:Bl
I+L
?+:$\?+LWl0O3A%:r@/H3l*l0=!TfI.?+=!b3OI+:M?+:$\?+='H5I+TkXZL/?jFLxc:%?+H0hi:$H5I@/C5\0O0?+\LT.:%T
H3LImN=]I+83TfI@Hl='H0Fq@/H5^pA$L/\5^?+=!F/8WI>H3LI@I+=!LHY80:%?+:$LHdG7983:tcW=':mNT
@/H3l¢A$LH0A$C!O3T.=!LH0TiA$LH5I@/=!H0:Bl¢83:%?+:$=!HÅ@?+:I+83L/T.:UL/XGI+83:@/OI+83L?+T
@/H3ltT.80LO0C#l}H0L/I{b:‚='H5I+:%?+\?+:%I+:BlE@/T{H0:$A$:$T.T+@x?+=!C!^E?+:$\?+:$T.:$H5I+=!H3FNI+83:
L/ÊzA$='@/C‹\LC!=!A$=!:$T9L?r:$HlL/?+T.:$hi:%HWI+Tj:$=]I+83:?9:%|\0?+:%T.T.:BliL/?r=!hi\3C!=!:Bl‹g
L/XUI+83: 3n:%X,:$H0T.:¹Dnlc@H3A$:$l ˆG:$T.:B@x?+A8Šo?+L $.:%A%I+TDGF:$H0A%^ /DG=!?
Ž3L?+A$J: p@I+:%?+=!:$CkJMLhih@HlL?NI+83: td ‰d3‡nLc:%?+H3hi:$H5IBd
Acknowledgments
W ]
U
]X
W U
PU
Dnl0l0=]I+=!LH3@/C @O0I+80L/?+T$y ‚?+:$H5I ;n:$:%?+=!H0F@ P nH0=!c:%?+T.=]I^ L/X
Sg D>H0w
p@/T.T+@A8WO0T.:%I.I+T$g :$h@/=!Cy
l?+:m ;R@H3H3L/H P nH3=!c:?+T.=!I2^ L/X p@/T.T+@A8WO0T.:%I.I+T$g :$h@/=!Cy
SgN@/H3l¢Š{@/O0CMˆEdoJML80:$H¹P nH0=!c:%?+T.=]I^sL/X
p@/T.T+@A8WO0T.:%I.I+T$g:$h@=!C y Sd
7. ADDITIONAL &AUTHORS
U
-$
49
9
-
U
9
9
U
- 9
9
sd‰‹d3DrI+VW=!H@/HlUŠ{d0ˆEdJML/83:$Hd >T.=!H3FzT.=!h*O0C'@I+=!LHK@Hl
A%?+=]I+=!AB@/C\L=!H5I+TrI+Lil0:%ž3H3:RTfI@xI+:$TN=!HpA$LH5I+=!HWO3L/O3TrT.:B@x?+A8
T.\@A$:$T$d3uH91B"+.-UN5E#W444 U %1 " ,(*&])UU
$%1.
3"%0g d
Jsd‰‹d3DrI+VW=!HBg 3*d0¡od0†<:$TfI+b0?+L5L/V‹g3@/H3lpŠkdˆtdJML80:$Hd
J9@/\I+O0?+:nI+80:RŽkC'@/Fy U='C!=]I@?.^T.=!h*O0C#@xI+=!LHUhi:%:%I+T9A$L/hi\3O0I+:?
F@hi:$T$d0uH 21.4 U % }#0 V " X1 U " (>B /X Z&( EK) O
- (>& %1 r)/(i%+g\3@/F:%JT Wg
Wd
Jsd‰‹d3DrI+VW=!HBg 3*d0¡od0†<:$TfI+b0?+L5L/V‹g3@/H3lpŠkdˆtdJML80:$Hd
3RL/h@/=!H0wvF:%H3:%?@CT.=!h*O0C'@I+=!LHU@/Hlq\3C'@/H0H3=!H3F€mN=!I+8U\385^T.='A$@/C
T.A83:$h@T$d3u2H 91B"++K- U J }#0 W444 2Q %1
" Z(*&])U # K$%1f
"%g Wd
4 €dJ9@?+c:%?>@/Hl €d3¡:$T.T.:?BdD\0C'@/H3H0:%?rX,L?>I+80:RA$L/HWI.?+L/CLX
\0?+L/b3C!:$hÄT.L/C'cW=!H3FiTf^TfI+:$hiT$d 1f) 0)"BU #05 K
" %(* ) M) 3- +%[1 $U "$ r0." )? Z+&05 K
r]) -U " "+-/&0 Q 9) O- ,F1 0g P Sy I g
nLxc:%h*b:%? d
EŠkd3ˆEd3JML80:$H(g sd¡od‡>?+:$:%Hb:?+F0g 3*(d sd0;R@x?.IBg@HlDtd3ƒNd
;nLBmM:d7?+=#@C„b5^ž3?+:y >Hl:%?+TfI@/H3l0=!H3FtI+83:}l:$T.=!FH
?+:B 5O3=]?+:$hi:%HWI+T‚X,L/?n@/F/:$H5I+TN='HUA$Lhi\0C':|:%HcW=]?+LH0hi:$H5I+T$d-
) ) Q%g 0P Sy NZgŽ3@/C!;C Z d‹@C'T.L7:$A80H3=!AB@C
ˆG:$\L/?.IBgJrŒnu R‰ 3R:$\IBg nH3=!c:?+T.=!I2^qL/;X [email protected]+@/A8O0T.:%I.I+T$d
DzdJMO0?.?+=!:E@/H3lUDtd37k@xI+:dŒ>w2ŠoC'@/Hy‚7980:}L\:$H\3C'@/H0H3=!H3F
@?+A83=]I+:$AI+O0?+:(d G1%U ‚" ) [ $, Y5
"%g KWy Z g B/d
}ˆEd 3d3Žk=]?+b5^5d3DGHU=!HWc:$TfI+=!F@xI+=!LHp=!H5I+L*?+:B@A%I+=!c:}\3C'@/H0H3=!H3F*='H
A$L/hi\3C!:%|l0L/h@/=!H3T$d0uH r1FB"+.- UN E#0 " # })U #K)
$%1.
3"5 G1%U j" ) [ $, Y5
"%g\3@/F:%T NB g
‰:[email protected]+C!:g3†
@/T.80='H0F/I+L/Hg Z Wd
ZD}ˆEd 3d3Žk=]?+b5^5d37„@/T.VqH3:%I2m9L/?+VWTrX,L?GA$LH5I.?+LC!C!=!H3FiA$L/H5I+='HWO0LO3T
\0?+L5A%:$T.T.:$T$du2H 91B"++K- U E#0 " ." - [ %X1 )U #K)
$%1.
3"5 G1%U j" ) [ $, Y5
" r]) -U " %(*+g\3@/F:%T 0g 0d
D}ˆEd 3d3Žk=]?+b5^5Id ULWlO3C'@?+=]I2^U=!T.T.O3:%T>=!H?+:$@/A%I+=!c:E\3C'@H3H3=!H0F0d0uH
91B"++K- U J }#0 ,1f- [ %X1 )U #) %%1.
" K
G1U ‚" ) [ $Z 5
" r]) -UN " %(*+g\3@/F/:$T KZ Z 5g
Wd
Y 45sd3Ž0?+:$:Bl‹(d p@H@/F/=!H3Fih*O0C]I+='\0C!:nI@/T.VWTN=!HpA$Lhi\0C!:%|‹g
l^H3@/hi=!An:$HWcW=]?+LH0hi:$H5I+T$d0u2H 91B"+.- U J }#0 ; % +
#
})U #3)9 $%1.
3" G1%U ‚" ) [ $Z 5
"%g\3@/F/:$T
N ! N 5?g p@l='T.L/Hg0†¹u0g ZWd
YK
5sd3Š{d‡n:$L?+F:%<@/H3lUŽMd3ŽMd3u2H3F/?@Hl‹-d 3R:%A$=!T.='L/H0wvh@/VW=!H3F€=!H
@/HU:$h*b:Bl0l0:Bli?+:[email protected]=!H0FzTf^TfI+:$hpd3u2H 91B"+.- U E#
r!
W
# [3 %[1 3)U #3)# "QV K$%1f
" G1U ‚" ,)
[ $Z 5
"%g\3@/F/:$T KZ0g 3n:%I.?+L=]IBIg U='A83=!F@/H?g KZ d
DnD>D>u‚Šo?+:%T.T$0g U:$H0C'LŠ{@x?+VgJ9DEd
YD5sd3Š{d‡n:$L?+F:%<@/H3lUDtd3¡jd3¡„@H3T.V5^5d0Šo?+L5A%:Bl0O?@/C
VWH3LBmNC!:Bl0F/:$d 91B"+.- UN t# " 0." ) ++&05 %J-'&N!.- 5 N21.%
)U #3g 3P 5Sy Z I ZWg KZ Wd
Y 5sd3Š{d‡n:$L?+F:%<@/H3lUDtd3¡jd3¡„@H3T.V5^5dˆ>:$@/A%I+=!c:n?+:$@/T.LH0=!H3F
@/H3l\0C#@H3H0='H0F0d3u(H r1FB"+.- UNJ }#0 " # })U #3)
$%1.
3"5 G1%U j" ) [ $, Y5
"%g\3@/F:%T ZWd
Uuf7Š{?+:$T.T$g Z Wd
8. [J REFERENCES
,U
]
W
X
W
"]
"] W W
]
U
W
W
X
U
X E]
X ]X
X
]
X
W
W
W W
Y/X4J&>d3;>:$:%?+=!H3F@i@/H3lUŠkd3ˆEd3JML80:$Hd3D>HO3Hl:%?+C]^='H0F*hiLWl:$C
X,L/?>l:%X,:B@xInhi:%A83@/H3=!T.hiT$dWu2H91B "++-KU J} #0)5 444
2U3 %1 " , (€&])U# $ %1.
3 "%g0 Wd
Y ]E ˆtd0¡:%c=!H0T.LHd3DF/:$H3:%?@C\?+LF?@/hihi=!H3F€C#@H3F/O@/F/:}X,L/?
O3H3=]ž3:Bl\0C#@H3H0='H0Fz@HlUA$L/H5I.?+LCd0G 1U j" ) [3 $, 5 3 "%g
0P wF
Sy W W ]5g; ]Wd
Y D *3 d(U A
R3 :%?+hiL/I.IBd07?@H3TfXZL/?+h@I+=!L/H@/C\3C'@/H0H3=!H3F*L/Xk?+L/bL/I
b:$8@BcW=!L/?Bd37„:$A83H3=!AB@CˆG:$\L?.I+M* Dn¡ƒ^UJr‰3 ˆGˆ, XBg
9* @C': U>H3=!c:%?+T.=]I2^5g n:%m ;R@Bc:%Hg3J97ngIR3 :%Ad? W d
Y z d¡odI ^:%?+T$dD \0?+L5A$:BlO0?@CVWH3LBmNC!:BlF:E@/\0\0?+L@/A8UI+L
I@/T.V5wvC':%c:$CA$LH5I.?+LCd0uHr1FB "+.-UN J} #0 , 1[
%1X )U#K ) K$ %1f
" G 1U ‚" , ) [3 $, 5 "
N])-UN " %(€g\@/F/:$T ]4ZI ]5g d
YZDt ¡jd‰\:$A%I+L?G@/H3l(3 d0;n:$H3l0C!:%?Bd37983:}O3T.:nL/XoT.O3\:?+c:$H3=!:$H0A$:
='Hpl^H@hi='AwvmML/?+C'l\3C'@/H0H3=!H3Fd3u2H(z d0;R@/hihiL/Hl‹g5:Bl0=]I+L?Bg
r1FB "+.-UN J 0 " +" 3 - [3 %1[3 )U#3 )9$ %1.
3 "
G 1%U j" ) [ $, Y5 " r])-U " %(*+g\3@/F:%T
]KZI W g X0d
Y DE ˆtd3‰WIBd3D>h@H5IBd- .- [- U )UUW r])-U ‚ 1B )"
#- ‹Y 1)# 1 ))7 3 ) XZ d3Šo8-`
3 I+83:%T.='T$g&UnH0=!c:%?+T.=]I^
L/X;p @T.T+@/A8O0T.:%.I.I+T$g‹DGhi83:%?+TfIBg( Wd‹D>C!T.Li@Bc/@/=!C'@/b0C':t@T
I+:$A80H3=!AB@C?+:$\L?.InJ!p ŠM‰0JMu2w xw WW d
D€ ‡€d¡od‰5I+:$:$C!: ?Bd; (*(/ , / )N &)5 %dIR3 =!F/=!I@C
Šo?+:$T.T$g3T.:$A$L/HlU:Bl=]I+='L/Hg d
[ *3 dƒrd†¹=!C'VW=!H3T$d091f)"BU "+)1N])-UN5 2 -Q U #0
o ])+X, ")( 3r])-UN-r)1f)-K (*dIU L/?+F@/HE @/OX,h@H3Hg
ZKZ d
*3 dƒrd†¹=!C'VW=!H3T$g4z d3¡jdI ^5:%?+T$g43 d-€3 d¡Lxmr?@H3A$:/g@/H3lU¡odŠkd
†
:$T.C!:%^5d0ŠoC#@H3H0='H0F@/H3lq?+:B@A%I+=!H3Fi=!HUO0H3A$:%?.I@=!HK@/H3l
l^H@hi='A>:$HWcW=!?+L/H3hi:$H5I+T$d$" &W1X )?+ 0%1X, (i
3 )k)3 1.$U "+)0 g Px Sy BK Wg ]5d
0 ¤N¥,¦§„¨x }«€­„Y®t²B¤ B¥<§k³,°0²$¨*¼¢
°µ„´Q±k°3³,W²$²$
APPENDIX
A. ONLINE DEMOS
†<:¹8@Bc:_\?+:$\@x?+:Bl ž3c:_T.83L?.IQhiLcW=!:$TŸT.83LBmMAB@/T.=!H3F c/@?+=!L/O3T
@T.\:$A%I+T¢LXU;nD>J @/H3l DnŽo‰‹gn?+O3H3H0=!H3F=!H I+80:_J‚IŽel0Lh@=!Hd
7980:$T.:hiLxcW=!:$T
@x?+:_@Bc/@/=!C'@/b3C!:ÅLH I+83:Ÿ†
L/?+C'l`†¹='l0:Ÿ†
:%b @xI
W !Z"$#&W(*)+%Z+-/&/)0%1v))546/dDÄT.80L/?.Iil:$T.A%?+=!\0I+=!L/H
LXo:B@/A8UXZLC!C!LxmNT$d
†
@?jF@hiThe
:$T{=!H‘Capture
J9@/\I+O0?+:MI+80:rthe
ŽkC'@/FEFlag’
@x?+:r\3C'@$Interface
^5:Bl€=!H*@ncW=!?.I+O3@/C5m9L?+C'l
LX .H3:B@x?+C!^¢I+8?+:$:pl=!hi:$H3T.=!LH0T.0yuHQ@l0l0=]I+=!LHŸI+LsC'@xI+=!I+O3l0:U@/Hl
C!L/H3F=]I+O3l0:}m9:E8@Bc:n:$C!:$c@xI+=!LHg@/C]I+83L/O3F/8Y@/C!C„80='C!C!T>@?+:}I+83:}T+@hi:
80:$=!F85IBdjŒn\0\LT.=!H3FGC'@/Hlt@/H3l€@=]?oO3H3=]I+T„@I.I+:$hi\I„I+LnA$@/\0I+O?+:M:B@A8
LI+83:%?BaT@/FT$d7983:^ŸAB@/HQ:%|\3C!L=]IL?b:U83=!H3l0:%?+:Bl¢b5^
I+:%?.?@=!H
XZ:B@I+O?+:$TMT.O0A8z@/TM80=!C'C!T$g5?+=!c:%?+T$g5@/HltI+:%?.?@/=!HiI^\:$ToT.O3A8i@T‚X,L?+:$TfI
@HlETfmr@hi\d{7980:9lW^0H3@/hi=!A$TL/X:%H3F@F:$hi:%HWI+Tk@?+:9=!H 3O3:$H0A$:Bl}b5^
hiLWl:$C!TzL/XR\3Tf^A80LC!LF/=!AB@/CNX@A%I+L/?+T ÅX,:B@x?BgNhiL/?@C':/gMX@xI+=!FO3:p@/Hl
I+80:}C!='V:d
Œn\0\LT.=!H3F O3H0=]I+TsAB@H b:ÅA$L/H5I.?+LC!C!:Bl½b5^8O0h@/H0TsL?
b5^I+80:
‡nˆ>DR‰Š[\0C'@/H3H0:%?Bg5@Hl€@nA$LhihiL/H€A%LH0ž3FO?@I+=!LHz=!T{X,L?j8O0h@/H0T
I+LU\3C'@$^<@F@='H0TfI*‡nˆnDn‰0ŠkdD½H3@I+O0?@C‚=!H5I+:%?.X,@/A$:@C'C!LBmNT*8WO0h@/H
\0C'@B^:%?+T‚I+L€l0=]?+:$A%I‚I+83:$=]?MO3H3=]I+T‚LHiI+83:[email protected]+C':ž:$C'lg@Hl*I+80:>O0H3=]I+T
I+80:$hiT.:$C!c:$TU@?+:sAB@/\3@/b3C!:sL/X€='H5I+:$C!C!=!F:$H5Ip?+:$@/A%I+=!c:[b:$8@BcW=!L/?pI+L
A$@?.?.^pL/O0Inl0=]?+:$A%I+=!c:%T>mN=]I+83L/O0I>A$LH0TfI@/H5InT.O0\:%?+cW=!T.='L/HŸP:dF0d!g‹LH0:
A$@/H_l=]?+:$A%Iq@<O0H3=]IzI+L
@xI.I@/AVQ@/H3LI+83:%?q@HlQ=!IimN=!C!CNžFO?+:pLOI
80LBm b:$TfI€I+L[F/:%IzI+80:%?+:g{mN83=!A8¢X,L/?+h@xI+=!LH3T€I+Ls@/l0L/\0IBg‚@/H3l
T.L
L/H‹Sd‚D>AI+='L/H3TN@Bc/@/=!C'@/b3C!:}I+LzO0H3=]I+Tr=!H3A$C!Ol:y ULxc:nI+Li@*C!L5AB@xI+=!LHg
L5A%A$O3\5^¢P l:%X,:$H3lS>@C!L5AB@I+=!L/Hg?+:%I@/=!Hs%@ @/F0gb0C'L5AVg‹X,LC!C!LBm @/Hl
@T.T.O3hi:gXZLC!C!LBm@HlKT.O3\0\L/?.IBgXZL/?.mr@x?l[\3@/T.T+@F:zLXMC!=!H3:gl=!?+:%A%I
@xI.I@/AVg3=!Hl=]?+:$A%I>@I.I@AV[P:dF0d!gb5^q@x?.I+='C!C!:%?.^Sd
J9@\0I+O?+:nI+83:}ŽkC'@Fz\0?+LxcW='l0:$T9C'@HlU@Hl@/=]?NA$Lh€b@xIrO3H0=!I+TrLX„I+80:
XZLC!C!LBmN='H0FzI^\:$T$yj7k@H3Vg U:$A8@H3=!~$:BlquH0X,@/H5I.?.^5g¡=!F/8WINu2H0X,@/H5I.?.^5g
J9@Bc/@/C]?.^5gWDN?.I+='C!C!:%?.^5gW@HliDGc='@xI+='L/Hdo7980:NT.h@/C!C!:$TfI9O0H3=]I+T‚=!HqJ9@\0w
I+O?+:I+80:pŽkC'@/F<@?+:[email protected]@C'=!L/H3T$g9I+80:UC'@?+F/:$TfIBgNl0=!cW=!T.=!LH3T$d >H3=]I+T
83@Bc:iC!='hi=]I+:Bl
T.:%H3T.L/?+T$gj@Hl
C!=!hi=]I+:Bl<VWH3LBmNC!:Bl0F/:L/XNI+83:[email protected]+C!:%w
ž3:$C'ld‚7„:%?.?@=!Hp=!H O0:$H3A%:$TrcW='T.=!b0='C!=]I^5d
A.1
%U
7980:YJ9@/\I+O0?+:UI+80:pŽkC'@/FsF@hi:p=!TiA$LH5I.?+LC!C!:BlQc='@[@s\3@/C!:%I.I+:pLX
fT I@Hl0@?l¢A$Lhih@HlTqP Žk=!F/O0?+: 5Sds7983:$T.:q=!H3A$C!O3l0:A$Lhih@HlT
I+L}hiLxc:9I+80:NT.='h€O3C'@I+=!L/HzX,L/?.m9@?liLH0:rI+='AVz@xI9@nI+=!hi:gI+L}C':I‚I+80:
T.=!h€O3C'@I+L?„?+O3H}A%LH5I+=!HO0LO0T.C!^5g@HlnI+LNTfI+L\RI+80:oT.='h€O3C'@I+L?Bd{7980:%?+:
@x?+:q@/C!T.LKA$LH5I.?+L/C'T}I+83@I€@/C!C!LBm I+80:z\3C'@$^5:%?EI+LpT+@Bc:*I+80:iTfI@I+:iLX
A.1.1 Game Control
¤N¥,¦§„¨x‹€®tµ²$:²z$µkB¥,²B¥,¿p
0µ§k
I+83:>F@hi:n@xIN@/H5^zI+=!hi:>@/HliI+83:%H?+:I+O0?+HiI+L*@E\0?+:%c=!L/O3T.C]^T+@Bc:Bl
TfI@I+:/dKŽ3O?.I+83:%?+hiL?+:g„I+80:%?+:@?+:iT.:$c:%?@/C‚hi:$HWO<A$L/hih@/HlTRX,L?
cW=!:%mN=!H3FicW=!T.O@/C!=!~B@xI+='L/H3T>@/H3lA$L/HWI.?+L/C!C'=!H0FiH3:%I2m9L/?+Vq\3C'@$^5d
uHt=!H5I+:%?@/A%I+=!c:rhiLWl:gJ9@/\0I+O?+:MI+83:MŽkC'@/F}C!:%I+TkI+83:M\3C'@$^5:%?oA$L/HWI.?+L/C
83:?UO0H3=]I+TcW='@¢@¢T.=!hi\3C!:Y='H5I+:%?.X,@/A$:Y?+:$T.:$h€b3C!=!H3F
I+80LT.:[O3T.:Bl_=!H
A$L/hi\3O0I+:?MF@/hi:$T$do7LEI+:%C'C‹@H@/F/:$H5IMI+Ltl0LET.Lhi:I+83=!H3FgI+83:NO3T.:?
ž3?+TfIoA%C'=!AVWT{LHEI+83:r@F:$H5Ij@/H3lEI+80:$HtA$C!='AVWTo@/F@/=!HzT.Lhi:mN83:%?+:9:%C'T.:
LHYI+83:€bL@x?ld*J9@/\I+O0?+:€I+80:zŽkC'@/FU@/OI+Lh@I+=!AB@C!C!^[A83L5L/T.:$TRI+83:
hiLTfIMI^\3=!AB@C@A%I+=!LHKl:$\:$H3l0=!H3FtLHqI+83:}@F:$H5INb:$=!H3F€F=!c:$HqI+83:
A$L/hih@/Hli@HlimN8@xIr=!T9O3H3l0:%?‚I+83:GhiLO3T.:>LHiI+83:>T.:$A$L/HlA$C!='AVd
Ž3L?*:%|0@hi\3C!:gk=]XNI+83:i\0C'@B^:%?tA$C!='AVWT€L/H¢L\:$HsI+:%?.?@/=!Hg{I+80:iO3H0=!I
mN=!C!C9hiLxc:zI+LK=]IB£‚=]XNI+83:i\0C'@B^:%?*A%C'=!AVWT€L/HŸ@/H¢:$H0:$h€^[O3H0=]IBgkI+83:
O3H0=]I‚[email protected]@AV€=]IB£W@/H3lz=!X‹I+80:r\3C'@$^5:%?‚A$C!='AVWT‚L/H@RXZ?+=!:$HlC]^zO3H0=]IBg
I+83:O3H0=!I€mN=!C'CG\0?+LxcW='l0:q=]IimN=!I+8QT.O3\0\L/?.IBdŸuvXnI+83:q\3C'@$^5:%?z83LC'lT
l0LBmNH[I+83:*A%LH5I.?+LCoV:%^KmN80=!C':iA%C'=!AVW='H0F0gkJ9@/\I+O0?+:*I+80:zŽkC'@/FUmN=!C!C
l0=!T.\0C#@$^Y@ihi:$HWOUmN=]I+8[@/C!C{LX‚I+80:€@Bc/@/=!C'@/b0C':*@/A%I+=!L/H3TzP Žk=!FO?+: Sd
7983=!TA$LHWc:$H5I+=!LH@C!C'LBmNTUXZL/?UbL/I+8¹T.=!hi\3C!:[@/H3l_T.L\380=!TfI+='A$@I+:Bl
\3C'@$^zO0T.=!H3F}I+83:NT+@/hi:GF:%H3:%?@C=!HWI+:?.X@/A%:d‚¡„@/TfI+C]^5g5h€O3C]I+=!\3C!:NO3H0=!I+T
AB@Htb:oF/='c:$Ht@NA%Lhih@/H3lnT.=!h*O0C!I@H3:$L/O3T.C]^Rb5^nT.:$C!:$A%I+=!H3FNI+83:{ž3?+TfI
O3H0=]I9@Hl*I+83:%Hi83LC'l='H0FEl0LBmNHiI+83:NT.83=]X#I9V:%^tmN83=!C!:GT.:$C!:$A%I+=!H3FEI+83:
L/I+80:%?+T$d
A.1.2 Agent Control
7983=!T A$C!=!\ =!C'C!O0TfI.?@I+:$T LO?…\3@?.I+=!A$C!:%wvT.\0?+=!H0FÄhiLWl0:$CYX,L?…H0LHw
3O H0=]X,L/?+h…b3C!Lb0T$doŽ3L/O0?kXZ:B@I+O?+:$TkL/X0I+83:jhiLWl0:$CW@x?+:9l:$hiLH0TfI.?@I+:Bl‹d
7983:tž3?+TfIRXZ:B@I+O?+:z=!TRI+83:*@/b3=!C!=]I^KI+LA83@/H3F/:z@b3C!Lba T}T.8@/\:*bW^
?+:$A$L/H3H0:$A%I+=!H3FT.\0?+=!H3F/T$di7983:*b3C!Lb0TRTfI@?.IEL/O0IE=!H[I+80:zl:$C]I@qX,L?.w
h@I+=!L/Hg3@/HlqI+83:$H $.O3TfIGb5^@/C]I+:%?+=!H3FiI+80:RA$LHžF/O0?@I+=!L/HKL/X{I+83:%=!?
T.\0?+=!H0FT$g5I+83:^tXZL/?+h½H3:%mÅT.8@\:$T$d nLI+=!A$:rI+8@IoI+80:rL/?+=!F=!H@C\@x?.w
I+=!A$C!:$T{hiLxc:oI+LGI+80:MA$C!LT.:%TfI‚T.\LI{=!HtI+80:MH0:%m
X,L?+h@I+=!LH*@/H3l}I+80:$H
I+83:Gh@/T.T‚=!T9l0=!TfI.?+=!b3OI+:Bli:$c:$H0C]^i@/hiL/H3Ft@/C!CI+80:>\3@?.I+=!A$C!:$T9=!HiI+83:
b3C!L/bd
7983:iT.:%A$LH3l[X,:$@I+O0?+:=!T}I+83:z:‹:$A%I}I+:%?.?@='H<8@/TEL/H<b3C!L/b3T$d *‚LO
mN=!C!CH0L/I+=!A$:E@€C'@x?+F:}b3C!L/bU=!HI+80:nA$=]?+A$C!:RX,L?+h@I+=!LH\@T.TNI+8?+LO0F8
@nT.h@C'C0L\:$H0=!H3F0gl0=!TfI+L/?.I+=!H0FE@/Hl€T.C'LBmN=!H3FtlLxmNH*='H€I+83:9\?+L5A$:$T.T$d
A.2 Particle-Spring Model for Blobs
7980:¹H3:%|WIŸl:$hiLH0TfI.?@I+=!LH½=!TŸL/XpXZL/?+A$:@\3\3C!=!AB@xI+='L/H b:%I2m9:$:$H
0b C!Lb3T$d nL/I+=!A$:pI+80:I2m9L
b0C'L/b3T@x?+:p=!H_l0:%C!I@[X,L/?+h@xI+=!LH3T$gr@/Hl
I+83@I€I+83:%^<C'L/T.:[email protected]@I€I+83:q\L=!H5IzLXnLxc:%?+C'@\d<D>T€I+80:[email protected]
=!T€C'L/TfI*=!H
I+80:zIm9LK\3@?.I+=!A$C!:$T$gjh@/T.Tt=!Tt?+:$l0=!TfI.?+=!b3O0I+:$l<XZ?+LhªI+80:
LI+83:%?G\3@?.I+=!A$C!:$TG='HqI+83:R?+:$T.\:%A%I+=!c:}b3C!Lb0TrI+L*A$L/hi\:$H3T+@xI+:d
Žk=!H3@/C!C]^5g0b0C!Lb3T9@?+:nT.\0C!=!Ir@/HlzI+80:$Hhi:%?+F:Gb@AV*I+L/F:%I+80:%?Bd‚ŒnH3A%:
@F@='Hgjh@/T.T€l0=!TfI.?+=!b3O0I+=!L/H¢='TEI+83:iV:%^sI+LY@A$A$L/hi\3C!=!T.83=!H3FKI+83:%T.:
I2m9L*[email protected]$d U:?+F=!H3Fi=!TNh*O0A8C!=!V:E@/\0\3C]^='H0F€XZL/?+A$:g3b3OIr=!H3TfI+:B@/l
LXkC!LT.=!H0F*h@/T.T‚mN83:$HImML€\3@?.I+=!A$C!:$TrLxc:%?+C'@/\gLH3:>\@x?.I+='A%C':R@l3lT
=]I+T}[email protected]+LqI+80:*LI+83:%?}\3@?.I+=!A$C!:gk@/[email protected] LBmNTRXZ?+L/heI+83:t?+:%w
h@=!Hl0:?NL/X{I+83:nb3C!LbUI+LtI+83:}\L/='H5INLXoLc:%?+C'@/\d
97 80:ED>b0Abstract
TfI.?@/A%In‰:%H3T.L/Sensors
?G80=':?@?+A8W^\0?+LxcW='l0:$TN@z\?+=!H3A$=!\3C!:Blqhi:B@/H0T
LXGTfI.?+O3A%I+O?+='H0FpI+83:A$L/hi\3C!:%|=]I^sL/XN?+:B@l=!H3F[@/H3lsI.?@/H0TfX,L/?+hi=!H0F
T.:%H3T.L/?o=!HX,L/?+h@xI+=!LH*=!H€DnŽo‰dD>b3TfI.?@A%I{T.:$H0T.L/?+T{AB@Ht?+:$@/C!=!TfI+='A$@/C!C]^
@Hl_:%‹:%A%I+=!c:$C]^\0C'@B^QI+83:K?+L/C':YLXEhi='C!=]I@?.^=!HWI+:%C'C!=!F:%H3A$:d 3R:%w
\0=!A%I+:Bl€[email protected]$:$H@x?+=!LnmN83:%?+:rVWH0LxmNC!:BlF:9LX:$H0:$h€^}C!L5AB@xI+=!LHzC!:B@/l0T
I+L*@*T.O3A%A$:$T.TfX,O0C„l:%X,:%H3T.:}L/Xk@€XZ?+=!:$H3l0C]%^ @F0d‚‰\:%A$=]žAB@C'C]^5g3@/HU@?.w
I+=!C!C!:%?.^_O0H3=]IO3T.:%T=!H0XZL/?+h@xI+='L/H_\0?+LxcW='l0:BlÅbW^Å@sX#?+=!:$HlC!^ÅT.A$L/O0I
O0H3=]IBgMI+8?+LO0F8Å@/b3TfI.?@A%IT.:$H0T.L/?+T$g9I+Lsl0:$TfI.?+LB^¢I+8?+:$:[email protected]@/AV=!H0F
=!HX@/H5I.?.^[email protected]@/C!=!LH3T$d
A.3
n; DGJYb0C'Reactive
O?+TI+80:jl0=!TfI+=!and
H3A%I+=!LHEDeliberative
b:%I2m9:$:%HEl0:$C!=!b:%?Behavior
@I+=!c:j\3C'@H3H3=!H0FN@/Hl
?+:$@/A%I+=!c:E@A%I+=!LHd‚7980='TrhiLxcW=!:nT.80LxmNTrI+80:Rš’——/’ Ç@/A%I+=!L/HUO3T.=!H0F
\0C'@/H3H0=!H3FNI+L>hiLxc:{I+LBmr@x?l0T{@HlRI+83:$HE:$H0F@F:r@r?+:Bl}:$H3:%h€^RO0H3=]IBd
†_83=!C!:GhiLxcW=!H3Fgš/’—/—’ ½h*O0TfI{A$LH5I+=!HWO@C'C]^t?+:B@/AIjI+LnA83@/H3F/:$Tj='H
I+80:M?+:BlEO3H0=!IBaT{\L/T.=!I+=!L/Hi@/H3l€=]I+T{LBmNH*\0?+L/F/?+:$T.T$do;nDGJ<@/C!C!LBmNTjI+80:
A%LH5I.?+LCI+)L LBm
:$@/T.=!C]^€b:Im9:%:$HEhiLc:$hi:$H5IBg$\3@I+8E\3C'@/H0H3=!H3Fg/@/Hl
?+:$@/A%I+=!LHYI+LiI+83:E:%|WI+:%?+H3@/Ck:$HWcW=]?+LH0hi:$H5IGmN=]I+80LO0IG?+:B 5O3=]?+=!H3FiI+80:
@x?+A80=]I+:$A%I+O0?+:RI+L*8@Bc:}@*\?+:$T.:%IGHWO3h€b:%?rL/XkA$LF/H3=]I+=!c:}C!:$c:$C!T$d
A.4
,Y
,Y
u2H}I+83:MJ9Planning
@/\0I+O?+:jI+80:MŽkC'@FRl0L/h@/=!HgBmN=!H0H3=!H3FG=!HcLC!c:$TA$L5L/?l='[email protected]
=!H0Fih*O3C]I+=!\3C!:RT.O0b3F/L@/C!T$y‚\0?+LI+:$A%I+=!H3Fz^5L/O0?NLBmNH @/FT$g0I+85mr@?.I+=!H0F
:%H3:$ht^KL/‹:$H0T.=!c:$T$gA80L5LT.=!H3FUI+80:*hiL/TfI}cWO3C!H3:%?@b3C!:z:$H0:$h€2^ @F
XZL/?p@
A$LO0HWI+:?.w@xI.I@/[email protected]ŸL/Hd ƒj@/A8¹?+:B 5O3=]?+:$T?+:$T.LO?+A$:$T
PO0H3=]I+TSjI+Lzb:}@A$A$L/hi\3C!=!T.83:Bl‹d9‰WLhi:%I+=!hi:$TMLH3:>?+:$T.LO?+A$:}AB@/HUb:
O0T.:BlpI+Lq@/A83=!:$c:tT.:$c:%?@CkI@/T.VWT$dnŽ3L/?n='H0TfI@/H0A$:g=]XjI2m9%L @FTR@x?+:
A%C'L/T.:€I+L/F:%I+80:%?BgLH0:EO3H3=]IGhi=!F85IG\0?+LI+:$A%I>bL/I+8d>Œ>?Bg@lc@H3A$=!H3F
I+LBm9@?l0TM@/HiL/\3\LH0:$H5IBa 9T @F}hi=!F85I‚@/C!T.LtXZL/?+A$:NI+83:NL/\3\LH0:$H5I‚I+L
?+:I.?+:B@IBg0I+8O0T9?+:$C!=!:$cW='H0FzT.Lhi:}\?+:$T.T.O0?+:}L/HUL/H3:a TGLxmN2H @/F/T$d
‡nˆ>DR‰Š[=!To@G\@?.I+='@C080=':?@?+A83=!AB@/C0\3C'@/H0H3:%?Bg/:%|WI+:$H3l0:Bl}I+Ln83@/HlC!:
h€O3C]I+=!\3C!:nT.=!h€O3C]I@/H0:$LO0T9FL@/C!T$dr‡nˆ>DR‰Š¢F:$H0:%?@I+:$TN@HU@\3\?+Lx|=]w
h@xI+:>\0C'@/Hq 5O3=!AVWC]^5gž3C'C!=!H3Ft=!Hql0:%I@='C!Tr@T9=]Ir=!TM:%|:$A%O0I+:Bl‹doŠ{@?.I+='@/C
80=!:%?@?+A83=!AB@Cr\3C'@/H0H3:%?+TEI^\3=!AB@C!C!^
l0:$A%=#l:b:%ImM:$:$H¢\3C'@H3T*b3@/T.:Bl
L/H83:$O?+='TfI+=!ANA%?+=]I+:%?+='@dM‡nˆ>DR‰Šs=!H3TfI+:B@/li\:%?.X,L?+hiTM@E 5O@C'=]I@xI+='c:
T.=!h€O3C'@I+=!LHsLHs:B@/A8<AB@Hl=#l0@I+:z\0C'@/HQPL/?E\3C'@H<T.:%I%SdzŠkL/I+:$H5I+='@/C
\0C'@/H3TR@?+:zT.=!h*O0C'@I+:BlpX,L?.mr@x?lgI+83:$H[@TfI@I+=!Az:$c/@/C!O@xI+=!LHYX,O3H0A%w
I+=!L/H=!T9@\3\0C'=!:BliI+LET.:$C!:$A%I9I+80:>b:%TfI9\3C'@Hdj7983:GTfI@I+=!A>:$c@C!O@I+=!L/H
XZO3H0A%I+=!LH
=!H3A%L/?+\L/?@xI+:$TtT.O3A8<X@A%I+L/?+T€@/T}?+:$C'@I+=!c:TfI.?+:$H0F/I+8<@/Hl
I+80:RHWO3h€b:%?rL/XkAB@/\I+O0?+:Bl@/HlI+80?+:B@xI+:$H3:$l @FTGL/X{bLI+8I+:B@hiT
I+Ll:$T.A%?+=!b:E83LBml0:$T.=]?@/b0C!:EI+80:R?+:$T.O3C]I+=!H3FzmML/?+C'lpTfI@I+:E=!T$!d 3RO?.w
=!H0Fs\0C#@H¢:$c/@/C!O@xI+='L/HgjI+83:L\0\LH0:$H5IBa T*@/A%I+=!L/H3TpP @Hl¢\3C'@/H0H3=!H3F
\?+L5A$:$T.TSR=!T*@C'T.LYT.=!h*O0C'@I+:Bl‹g„?+:$T.O0C!I+=!H0FK='H<hi='H0=!h@|YT.:B@x?+A8
XZL/?
I+80:}b:$TfIN\3C'@Hd
A.5