Pseudo-convergent Q-Learning by Competitive Pricebots Jeffrey O

!
"#%$&(')*,+-./"0/"12!"13$45
687:9!;<7:=?>
@A
7:B/CEDF;HG
IJLKLMONQP:RESTQUWVYX[Z]\V_^]È\
a 7:;<DLbdce6/@fg7ihjDLkE;<l
ROJmU#NOT8Pn`/S5opNFROUqÈr!VYX[Z]\V_^]È\
sut.vxw.yLzW{|W}.~mL|<}zWj}j|yj:#qLF|Hv
_QW#O_m3|H.yLzWLWF¡ j:¢:£¤pF¥
?¦ §3¨W©FªL«¬]©
4}®mF¯°mz<#|W}±]j1²}-z³´{®Lµ¶|·#:¹¸µ
q|²Lm·_|{zFFjº{|²»#_¼yL½y¾ugz
_Fj:½#|¿H1z{±]1²L·´À±L²_##Á]z}Â.}|<j·½#|_¯
±L½1¡|Ã#z{{ziLYu¯W w.gzÄ³Å®mmL|{jW|_¯
FYÆn#²#:}zW®F²zWm}Ç|zWÁm}#²j8ÈÉ|°#ÊF|W0q
}u|<_z|²¯¼}z_®F²zWËyÃÌ#jz)tj_{|Í#µ
zW#zm}_}_L·Íz³Î}¯i{{#²_¾±]z__#q}#¹|m
|ÏLzLµ¶}²|_zm|¯WÁL²z»W#FµÐ}¯:{{1²¯Î±m}#®mFzµ
}zW®F²zW85yÑ}{|_ÁL®F-LzLµ¿Ìj#²z?tgj_{|
#²zWjw.ym_}ÎÀ±m}#®FzµÐ1zW:W#²·jWÂ|}¯:{{1µ
½Î}z_®F²zWym|W}Lz|m|_z·Ò)zF_m|²¯¸µ
q|²Lm·m-#|½1®m_||m|_¯:½#|__¯Ó²yL5³ÅzW{
z³Á]zyÎ}zW®F²zWm}j|mÏ{|±ÏzW®Fi®L{#²½#|__¯
yL1zFY²zWm}®mmF#3yL½y
j|y
zFj1®L}#.-
}®L·W·q}u²ym|<²yL½}zÁ}jWjÓÁjym|HizW_E|_}z
ÁÓ³Åz®LÏ{z²º·jL#|_¯-_z²yL#}u²®mF_j}z³
{®Lµ¶|·jW ¸µ¿_j|L_L·]|mÇF½}#®m}²}_{±m½#|µ
_zm}|mF²j1_zm}g³ÅzW.³Å®F®m ²j}j|²y8
!Ô ÕpÖ:× ©iªmØ.Ù3Ú¬]©LÛuØ ×
ymÜyLL1Êi³Åj°¯j|²}jmg5#Êi±]j13jq0²zm_5#z{µ
{j²#!z3Á.|{±]z²|:/{®LµÐ|·j:EFz{|5_ym_y
²#_F³ÅzW²##{#:q|²L_L·¾__
ÝmmÍi®L{#²z®m}?|±L±L__j|<µ
²zWm}jßÞ3m}®myà|±L±m½#|_zÉ½}
|®Lz{|jF¯im|{½
±m½1_L·Á:¯¾}z³[ug|e|·j:²}?ádâp²#j:.|½ãåä#±Ly|j
qææWæWç0èF®L±L±]zW}ym|j|y
}#_j|·W#:mLi½F®m|__¯|µ
²#{±F} z
{|Êi_{Ìj±L²zÝL}pyL²z®L·Wyéu®mF½1_z®m}5}1_L·
z³±L½1q}|mz²yL#±LzFF®0±m|²|{1j²}jê!jÏY³²yL
}#__#|·j:²}FzÎmz
1z{{®LL½#|<²4yÒzL|mzym#
L²j1_¯/{|²»1³Åz1j}{|H¯-}²zL·W¯1zW®L±L_ym#_|W0µ
²zWm}j²j}®L_L·Ç_¹|
yL_·ym¯F¯im|{½{®mY²YµÐ|·W#:}¯i}µ
²#{èi_m1Fq1½}_zÓ{|»iL·Ó{|²»1}|mºq1zWLz{_j}
Á]#m1ÝL}/·²j|<²¯³Å²z{zLWë }/|Ám_Yu¯²zp³Åz²j#|W}u/j#zLzW{_
²jmL}.|z±L±]zm#:²}jëF}u²²|#·Wq}#WjL³Åz1#{jWgq|²Fµ
_L·½}_»j¯
²z
Á|-q}}#:²_|/#z{±]zLjW z³.Fq1½}_z
{|»:_L·Ái¯ºj#zLzW{_j|_¯:µ¶{z_<|<q´}z³[u.|²p|·jW}#
¤F³Åz®mm|<²#_¯E³ÅzW{ì|ÓyLjz²1²_j|!±]#}±]j1_W8ymº_}µ
}®Lpz³Qy|<.ym|±L±]#}.yL#Ó{®L_±L_p_:j²|W0_L·|·j:²}
}_{®L²|L#zW®m}_¯Ç|m|±Fq8®m}L·
íezW zym# |±L±mz:|yLq}#
½}_|·W#_¯-|z±]#eîW®mj}_z8w.yL½}}²|mL}Î1z:²²|W}u
²z
ym´#|W}z³}_L·_1µÐ|·W#:5í!ÈE}²|_zm|¯ÜvÜ|²»z<
ï3j#_}_z¹ðèzWÁLj{}#/|Ç}z__²yL#zW#½#|è®LmL#}u|mF_L·
y|}Á]##±L²z<i_LjÇÁi¯4q}q|yÇz|_·zWyL{} }®my|}
ï3¯im|{½ð!²z·|{{_L·º|mÏ¸µ¶q|²Lm·m ñ!|²_z®m}yL#µ
zWj{}j}²|Ám½}yÎy|<º·_zÁ|1zWi#²·jm1´z|-®LL½î:®L
zW±F_{|8<|®Lp³Å®L0_z
|mz±F²{|O±]z_½1¯´__Q|_g|H¯F}
Á]zWÁF²|mjO/z<g#W#q<yLq}yLjz²#{}!FzLz.|±L±L_¯
²yL{®Lµ¶|·#:j|}:|}è|WL|±L_L·|·W#:²}!±Lz<i½F1Ænj1µ
²W#_¯ºLzWFµ¶}²|_zm|¯ji:_²zL{#:}è³ÅzWz²yL#|·#:}#
Fz{¹±L²z·Wq}}y|}4Áj#Ñ{|L¹_|m|¯iÌjL·Ò1#²|
}±]j1½|µÐ#|}{®Lµ¶|·jW±L²zÁL_#{}jeòmz#ÊF|{±LW#zµ
zW±j²|_²j|{}¹z³Ü|·#:}¹}ym|²m·Ñ|1zW{{zW·z:|
zW®F²_Yu¯)³Å®L0_zy|HÁ]##¡}®Fq_ßád:²zLÉã
ñjz:}zE qææWæWç0]|{zm·ºz²yL#}#3w.yL±L®mj¯
1zW{±#_
j|}5z³!Ìj#²zµÐ}®m{Ë®F²_Yu¯³Å®L0_z}ym|W}Á]#j4}®mF_jÇ
ádí8²{|8m qææó:ç0HyLj.||_·zWym{àj|_qÜÀ{L_{|<Êiµ
¸pÂºg|W}±L²z±]zW}j³Åzuzµ¿±m_|H¯W#Ì#jzµ¶}®L{Ä·W|{q}#]|m
}yLz<Üz
1zW:W#²·zyLzW±F_{|<|_®L³Å®Lm1_z|m
±]z_½1_j}³ÅzWÁ]z²y
±L_|H¯W#}#i_{®L²|L#zW®m}p¸µ¶_j|²L_L·Ái¯
ugz±L_|H¯W#}_4yLs¶j²|qÜð!²½}zWL#që }pï3_#{{|·W|{
.|}è}u²®mF_j#{±L_²_j|_¯Çá¿F|mLyLz_{)ã°²Y²j}j qææW¢Wç0
ymz³Åz®Lm²ym|<²yL_j|L_L·±L²zF1jL®L.³Å²jî:®Lj:_¯1zWFµ
W#²·qz }²|<²zWm|²¯ }zW®L_zm}j¥_{±zW|:Ým²}!}u²#±
_Î|m|_¯iÌ#_L·-¸µ¶q|²L_L·³Åz|²ÁL|²¯WµÐ}®L{ßugzµ¶±L½|H¯#
·:|{j}g|W}²j##:_¯Ó²|»W#Ç_åád®-ã¼4j_{|8 qææô:ç0
w.ym_}5|·Wz²Y²yL{õ|W}}®L{j}p²ym|< ²yL±L½|H¯#}3³Åz_z<)|W}y
qî:®L__ÁL_®L{±]z__#q}#/su}²}®mj}j{|mL·zÁ|mFq}}j
_m#®mL
yLÀjî:®L__ÁL²®m{ö1zizW²F_m|_zmÂ-±L²zÁL_#{÷áÅ¿ W
ymz<Ë²yLÜ|·W#:²}ýLzizW}Ó³Å²z{2|{zm·W}º{®L_±L_Ü|W}y
qî:®L__ÁL½|Wç´|mø#²Ý#|_z?y|<yL4±zW½1_j}Ó{±L__j
Ái¯yL3q|²Ljº¸µ¿³Å®Lm1_zm}|²1zWm}½}#:!y²yL_Lµ
²_|_¯´|W}}®L{j|W}y±]z__#q}#
sÐ-z®mp±mj:_z®}gz²»ÏáùwEj}²|®L²zÓãÄä#±Lym|q/ jææWæWç1]g
}®FqÏ}_{®mY|Ljz®m}¸µ¶_j|²L_L·Ái¯Üugz
±L²_#1µÐ}#_L·
|·jW}8_ ymj}{±L_è{zFF#½}j}yLz<_L·²ym|<|_:j|}j}
¸µ¶_j|²L_L·ÇÁi¯zLÓzÁzyÎz³ym|·#:}5|½}qÏÁzy
z³²yL#_Ç±L²zÝL}}®LÁ}u|:½|_¯ø³ÅzW{úym|<²yL#¯ÒzW®L_
zWÁF²|Î®m}L·-{¯Wz±L½ºÁ]j}µ¶²j}±zWm}±L²_#m·m¹i_{®L²|µ
m#z®}#zij·W#m#ºz³pÁzy?}j_#}z}u|<²zWm|²¯±zWµ
#q}g|W}5³ÅzW®Lm_Î}z{ÁL®FLz|_#|W}q}#!Fj±jmF_L·
zWÏymÓ{zFF#¿ë }±|H¯zÆe³Å®Lm1_zm}|mÏzyLF½}#z®L:
±||{1²#û/°sÐøz²yL##|W}q}#.gÇzÁm}#²q)À±m}#®mLzµ
#zij·W#m# Âd ÜLj|µÐ1zW:W#²·jm1z-|Ç}__·y:_¯4®mFµ
}²|ÁL_Ü}zW®L_zyÉmzFµ¶Ì#jztg#__{|#²zWuüø|e_Fµ
²_·®mL·¼±Lym#LzW{jLzÍ²ym|<øym|W}Lz¡|m|_z·)ÃzW²Fµ
|²¯Ç}_L·_1µÐ|·W#:¸µ¿_j|L_L·v
zWjz<#qn4ymº}yLzW±Fµ
Á]z5{zFFjdQyL±m}#®mLzµÐ1ziW#²·#:p±zW½1_j}z³èymuz
|·jW}g#²-ý<þ0ÿ #W#Ï²yLz®m·y²yLÓuz-|·j:²}
g#²._L#:½#|Lj#²¯5²j}±q0q_m1_®mF_L·ym#_!±m|H¯zÆn}j
sÐ-²yL_}5±m|±]#q8gL#__W²zyLm|®L²|m4Á]#ym|Hi_z
z³!}_{®L²|L#zW®m}¸µ¶q|²Lm·Ái¯Óuz_:#|1_L·º|·W#:²}j
¥3}|¹W#yL½1_Ç³ÅzWzW®L}u²®mF¯pgÇ³ÅzF1®m}zWøymÒÀ²}yLzW±Fµ
Á]zÂà{ziL#´zW_·_m|_¯°:²zFF®m#j)_ßádâp²##i.|½¾ã
äj±Lym|qm jæWææ:ç0sÐº|i¯·WW#²²|L_L· ²®L8:ym|zWÁFµ
}#²qÎádwQq}|®L²zãÍä#±Ly|j! qæææ:ç²ym|<5jY²yL#z³guz
}z_®F²zWm}Ó#z®L½øÁ]-zÁF|_LjOÈe}¯i{{1²½Ü|mÉ}²|ÁLW
zW|}¯i{{#²_|´±m}#®FzµÐ1zW:W#²·jWqE-5|½}z³ÅzW®Lm
²ym|<gymp|W}¯i{{1²½}z_®F_zÓg|W}è_m1²j|W}_L·W¯³ù|HzWq
|W}8²yLF½}#z®L:E±||{1²#Eû.|}E1²j|}j8E|Hi_L·zWÁFµ
}#²qÇ±m}#®FzµÐ1zW:W#²·jm15®mmF#5|½F²|L·z³g1Êiµ
±]#²_{j:²|L#zmLY²zWm}Ðü#W##:_²#_¯FÆ]jjW!|·#:
{zFFj_}uü?g 1zW<éuj1®L²pym|.½}}zW{jyLz<øjmF#{½3z
²yLÜ±mzWÁLj{ z³ ±L²_#L·¹Ò{®Lµ¶|·jWFz{|_m}jÑtg¯
}®F¯iL·²yLj}3±myL#LzW{#m|_´²yL 1z:²1Êigz³Q²yL }yLzW±Fµ
Á]zº{zFFjd.g
yLz±]zFjjzW±Î{z²ÁL²zW|L¯®}#³Å®L
|m|_¯:½|m1ÊF±]#²{jW|n²z:zW_}|mÓ}_·y:²}ym|_
Ám_L·ø®m}ÇzÉ|øÁLz:|Fj
®LmFj²}²|mF_L·øz³²yL¹|<®m
z³8{®LµÐ|·j:.¸µ¿_j|mL·±m|²_#®L_|_¯´#z{±]1_W
mzFµ¶Ì#jzµ¶}®L{¡}1²m·W}._»Wp{|»W1²}|mÓj1zWLz{_j}j
w.ym q}uz³EyL½}±m|±j½}.z²·W|mÌjj´|W}g³Åz_z<}j!ij1_z
£±L²z<:½Fq}Q}z{èÁm|W»i·²z®LmpzW yL.}yLz±LÁ]z{ziL#i|m
zW®L.±L²#izW®m}gzW»zW}_{®L²|L#zW®m}¸µ¿_j|L_L·y|<
#z:#ÊijFj0²zW±Lq}j:²}º|?|m|_¯F}½}z³Á]zy?²yL
}¯i{{#²_|m|}¯:{{1²½!}z_®F_z}#|mymF¯im|{½
Á]#y|H:_zz³ètg#_{|Ç#²zWF}#²{
²yL_|j3j|}
Fj0²zWó |m|_¯iÌ#j}E²yL1zWmF_zm}/®LF#yL½yj|Wy}zµ
_®F²zWº_}gyLz:}j8:|m²yLÝm|n}q0²zWº·_q}è1zWm1_®mF_L·
²#{|»F}.|m}®L··Wj}jF_q0²zWm}g³Åz.³Å®F²®L² zW»n
Õ «¬ èªLØèÚ × Ù
¥Ò}_{±L_p}yLz±mÁzè{ziL#]g|W}Ým}ug±L²z±]zW}j_Üádâp²#jFµ
.|½ÜãËä#±Lym|q jæWææWçz}u²®mF¯Ç±m½1F¯im|{½#}3y|<
{|H¯Îzij1®LýL#ø|½|²·³Å|1_z?z³51zWm}®L{#}ym|H
²j|WF¯ |j1j}²}Ezp±L²_#_F³Åz²{|<²zW8Qs¶½}E±]zW}®m_|jy|<
_m#q|}j5±m½1|H.|²#Lq}}EzyL.±m|z³ÁL®L¯W#}/_F_Fµ
L®m1}#_j²}²z Á{zW.²j}±zWm}_._yLj!±m½1_L·mW|m
²ym|<yL½}_Eq|Ózº_m#q|}jÓj½|m#zÇ|®Lz{|j
±m½1#µ¶}1_L·|·j:²}j3zWÀ±L²_##Á]z}ÂmÍs¶Ç½}²yL#²1³ÅzW
z³_W²#²j}Ó²zÎFjjzW±Ò|®Lz{|jø±L½1_L·e|_·z²yL{}
²ym|<¯ij_yL_·y¹±LzÝL²} ³Åz}#__#}#|-zÇ#Êi±mzW²yL
±m½1F¯im|{½#}ym|pjm}®myLjÜ<|²zW®m}±m½1_L·Ó|·Wzµ
²yL{}5á¿âpj#ig|_´1|d_O jæWææWç|²#{±L_z<¯qO
tg² m¯!yL{zFF#}®L±L±]zW}j}ym||-1zW{{zFFu¯Ï½}z³[µ
³Åjq3³ÅzQ}²|_Ái¯}#_j²}jQtg®L¯j²}n·W#Lj²|/±L®Lym|W}/zµ
L#}|<|Fz{Ë_{q}#Èym#¯_Fj:³Å¯Ó²yL5_z<q}uµ¿±m½1q
}#__#³Å²z{Í|{zL·º|}®LÁm}13z³³ÅzW{ì ²z e±L½1q}#|m
²yL#¯Ó±L®Lym|}p³ÅzW{¡²ym|<}#_j³E²yL5±L²_#_}_j}²}.²ym|
²yL!ÁL®m¯#që }nH|®|<_zQEw.yLÁL®m¯#Q±zW±L®L½|<_z j|ym#²1µ
³ÅzW´ÁFj}²1²Á]j_j{}z³.ymÓF½}u²_ÁL®F²zWÏz³<|µ
®|<_z}#8|m
²yLF_}²_ÁL®F_z4z³.}q|yÇ}u²²|#·Wq}#OF#µ
mzq
ym#² ²#±L²j}#:}²yL³Å|0²zWÎz³3ÁL®m¯#}
²ym|<´#z {±m|ymÇ ±L²_#j}z³ |Fz{_¯¹}jq0²j?}jµ
j²}j¥gg|Fz{¼_W²#²<|½}#:Fi½F®m|n}#__#}è_OFq1½F
®mL½|<²#|_¯ºzji_}pyLj±L²½1j}|W}gyLj¯´½}yQ
s¶³]ym.}#__#}|²±]#³Åj1_¯5L³Åz²{q|ÁzW®Fym.L_}²Ám®Fµ
²zWm}z³Ám®L¯j<|_®m|<²zWm}|
}q|y}|<²#·_j}jm|mY³
²yL#¯»iLz<yLjp1zW{±]1²Y²z}#ë1®L²j:±L½1q}#myLj¯j|
j{±Lz<¯
|Ó{¯Wz±L½5Á]j}µ¶q}±]z}}u²²|#·W¯5w.yL½}p#:²|½}
ymz:z:}_L·ÓyL±m½1y|<5_{|<ÊF_{Ìj²yLº}#_jjë }1Êiµ
±]j1q±L²zÝmj|W}}®L{m·Lzp³Å®LyLjym|L·Wj}Qzpymg±m½1
Wj1zqÇá¿Þ³#z®L}WOym_}|}²}®L{±F²zW4½} i_z½|<q-yL#
zyLj}j_#}.ym|L·W²yL#_±L²_#j}j çs¶³|8}#_j²}®m}pyL½}
À{¯Wz±F²{|½Â }|<j·¯W²yL{|²»#è1ÊF±]#²jm1q}#¯F1__j|
±m½1.|}#w.yL±L²½1.|!1¯F#Á]#·W}Y²yj|Wy}#__#
y|²·_L· !/yL±L²_#º²ym|<|Ç±L²zÝLµ¿{|Êi_{Ìjm·Ç{zµ
mz±]z__}pgz®m_Çy|²·pêè|WyÜ}j_#3ym#4#z{±]1q}3³Åz
{|»W1}ym|² Ái¯´_z<j_L·²}±m½1W|´²yL±m½1q}.³ù|_
__Lj|_¯®L:²m| #½#|Fymq}yLzW_ #".½}q|yLqOE¥gèyL½}
±]z_:jH²yL±m½1q}Q_{{qF½|<j¯.éu®m{±Ám|»®L±$z !|m
²yL#¯i# Á]#·W}|m# .w.yL ®L±ig|²éu®L{±
_
±L²_#5zF0µ
#®L} yL#Ïz<m#}yL_±-z³|_|·W{|»W15}ym|²³ù|__} z
#z{±]#m}²|<²³Åzym3W#²¯_z<?±L²zÝL.{|²·_8EsÐ}u²j|8:
½}Á]1j³Åz3|Ç|·W#:z·WW ®L±
z
{|»W1}ym|² |m
}_{±m¯¹j|<²#z4yL{®mye}{|_j}#·W{#:z³3ÁL®m¯#}
²ym|<zWL_¯ýLj»Ó|}_L·_±L½1W
ï3j}±L²}ÜzÁiizW®m%} |H}jyL¹{¯zW±F_{|5|·Wz²Y²yL{
²#mm}zà±]#³Åz²{ j_¼yLj|Wiµd²zµ¶yLj|W#z{±#_z
|·W|m}zyLj}_{±Lp±L²_#m·|·Wz²Y²yL{}#:1_®mF_L·zWL
Á|}jzW¹|4zL#µ¶}yLz·W|{#µd²yL#zW#½´|m|_¯F}½}#' &Ëz<.µ
jjjWyLj3_}g1_j|_¯ziz{¾³Åzg_{±mz<W#{#:jEs¶³E|}#__#
#z®L½´³Åz²j}#3ym|.®mmF#1®L_L·gz®L½º_i: î:®L½»º²1µ
|__|_zÁi¯²}E1z{±]1²Y²z}#qYE{_·y:8Á]!_j}²}8»j#pz®mFµ
L#1®FqEs¶³8|_L}#_j²}/g#²gz ²j|}z²yL_}!{|LLjjzWL
gz®m_#ÊF±q0ym·WyL#g|H#|·W±L²_#j}è|m±L²zÝm²}j/ðèjiYµ
zW®m}¯Wgym|HW#²YÝjy|<|¸µ¶_j|²L_L·5|±m±Lz:|(y ý )
|½}Ó|Hj²|·º±mzÝL²}_e|Üuzµ¶}#__#{|»W1q!Lzpéu®m}
³ÅzW²yL}yLzW±LÁz3{zFF#¿nÁL®F|½}z³ÅzWugzºzyLj{zFF#½}
z³|·W#:µ¶{jF½|<²j {|»W1²}E_yL½y{¯z±L_{|i±L½1_L·
_j|WL}gz±L²½1 .|1¯F1_j} ádwQq}|®L²zã)ä#±Ly|jn jæWææWç1
wEze®LmFj²}²|møyLz<ßyL½}{±L²z<j{j:1zW{j}|Á]z®Fq
*,+$-.-0/'1'2
34,1'576859:5760;=<>@?054BAC3DE;=<F4,?0;G5H,;=4,1'2I36J37/LKM>@1'>N1'>
;
OP01'QR3/';G64S4,5T37>@>@P.DE1U6.AT4,?034!4,?0;V>@;G/'/U;WH,>V?03
QC;X6.5T372G2G;=>@>Y4,5[Z\5H
1UA7605H,;]5R6.;E376.574,?0;WH
^ >-MH,1'2G;G>G_S4,?.1'>`1'>àb?cKd54,?0;=H37/'AR5H,1'4,?.DE>
4,?J34feRg`P0>@;>@P02h?i1'6M9j57H,Dk34,1'5R6l2
36iKM1';G/Umi?01'AR?.;=HT-.H,5n04,>Go
½}5ym#_±F³Å®Lgz
Ý²}1zWm}_Fj{¯z±L_{|è±L²½1_L·mÇòmz
}_{±m½1u¯/gº|}²}®L{²ym|<5²yL#²´|éu®m}i qpÄ£
}jµ
j²}á r¼|mt sç0Oj|WyÜy4±LzFF®0_z-1z:}uE ukpmO|m
²ym|<5|!#zm}®L{#}pym|HyL}²|{<|_®m|<²zWw vxpÄ jWL
w.ym#8±L²z<i_LjÎym| Sy¡Fzij}mz´#ÊF##qN vf s´ë }´1Êiµ
±]j1qÓ±mzÝL±j}| }¯F}u²#{½F½}}_{±L¯nÈ
~ á
# Fç !y S³ SyNtS{

S³ SypS{ á qç
ç p & !y
z yp'á S{$|}!ygb
# Sy

³ SyNtS{
S

100
(p*,v)

Myopic Best–Response
80
60
pB

40
20
(p*+1,p*)
0

100
p A
Y'0RW[7 H,5R>@>T-0/'5459D[K57-01'2H,;G>@-5760>@;9jP.602=4,1'5R6.>TZLY]
376JmE ZL ]Wo#?01'6EG1'AR
3A2GPMH,QC;H,;G-MH,;G>@;G64,> -MH,1U2=;T4@Hh3
¡¢;G2W4,57H@K
>¢4h3H@4,1'60A9£H,5RDq4,?0;1U6.1L4,1£3/S2G576JmM1'4,1'576¤ZF¥Mo ¦C¥c§ ¥Mo ¨R©R]Wo
w.ym{¯zW±F_{|Ï±L²½1_L· ±zW½1¯ìz³}j_#ª s _}°zWÁFµ
|_LjÁi¯ìymz:z:}_L·Íym¡±L²_#q!y÷y|<{|<ÊF_{Ìjj}
yUá !{`|Syèç0w.yL½}#|ÉÁ-j±L²j}#:q|}´|¹q}±]z}
³Åz ®mm0²zW¤ « y Uá { ç0È
«yUá !{b
ç pÉ|²·{¬7| Ê z yUá !{|Syç
á¿£ç
w.ym5{¯Wz±F²{|Eq}±]z}³Å®L0_zw «[y3'á !{ç.½}pF#±L½0²j
_ò_·mi /w.yL.|m|zW·zW®m}Q|m}¯i{{#²_{¯Wz±F²{|:²1µ
±]z}³Å®Lm1_z® «{'á !ygçp_}²z|<²j-|m-}®m±j_{±z:}qO
i²|_L·Ü³ÅzW{x|i¯-·WW#Ï_L½|.±L²_#´q0²zqzWLÓj|
}®mj1j}²}W#_¯|±L±L_¯²yLpq}±]zm}³Å®L0_z} «ye|md «{g
âp|±myL_j|_¯Wè²yL½}_}ºj±Lq}j:jÎÁi¯¹{|»i_L·Ï|jm|
W#½#|8|myLzW_Ì#zWW|n{z<j{j:²}gz²yLk « y |m¤ « {
#®L²j}j/¥}_®}u²²|jºòE_·m] Wym_}g_j|m}!²z5ymp#¯i#µ
j|±L½1Óg|F½}²1®m}²}qÏ|Á]z<WÜj´|m²yLzW®L·ymz®F
²yLè²#{|mL#8z³FyL±m|±]#qHè}ym|:|}²}®L{²ym|<±L²_#j}
| î:®m|W²Ìjj´z_W²#·W#}#
z< #|}j_#}Ç_:²zFF®m1¹³Åz²j}·Wy:Ü:²zøym#_4±L²½0µ
_L·Fq1½}_z=} ¯2Þ3L
{1ymzi8g_:²zFF®m1qe°áùwEj}²|®mz
ã ä#±Ly|j jæWææ:ç0¼z±F²{_Ì#q} 1®L{®L_|_³Å®F²®L#µ
L_}²1zW®L:jÇ±LzÝL3_m}q|
z³!{{jF½|<²±L²zÝmjÞ3mz³
²yL}j_#}#}²|H:¯ s´!²#·W|²m}5|i¯-±L½1ým|{|H¯Ï}1
±m®m} rë }|W²_#±|<q5²j}±zWm}!zp/|W}|p}L·Wè_{j}#±Q
|m-|LL}p²yL1ÊF±]j0²j-±L²zÝL}3³ÅzW{ßY}{z<|m:r5ë }
#z®L:²#²{z<W°ð!²zéuq0²L·³Å®m²yL#:²zymÇ³Å®F²®LWf s
#z{±L®F²j}Y}5#Êi±]j1qÏ³Å®F²®L#µ¶L_}²1zW®L:j±mzÝL|}|
_FÝmmY²eg#_·y:²j}®L{ z³Ó1ÊF±]j1j±L²zÝL}4_¾³Å®F®L²
²{q}u²#±m}j!v
z² 1zW{±|0²¯WF F#ÝmL
° y Uá { | y ±
ç p z y Uá { |} y Vç ² z y á « { 'á y ç |} y ç#ádWç
²û ° y á « { Uá y ç |=« y 'á { çç
ym#²3ûÇ½}|F½}#z®L:±m|²|{#jji|L·WL·³Å²z{Ë²z W
|m% « y Lz<ø²#±mq}jW}!²yL ±]z__#¯ym|.zW±F_{Ìjj} ° y È
«yp'á !{b
ç pÉ|²·{¬7|< Ê ° y'á S{|!ygç
áùó:ç
s¶ ½}j/q}u|ÁL__}yLq
y|<jEY`³ « { j±Lq}j:²}ý )mÿÝLÊFj
±]z_½1¯áÅ{¯z±L_{|WzWQzyLj½}Hç0qym#|q|}zm|ÁL®m±Fµ
m|<_L·e±L²zi#jF®m4_ ¯ij_Ò|¹®Lm_î:®LWp}²|ÁL4³Å®F²®L#µ
L_}²1zW®L:jà±mzÝLÜ½|mL}²#|± ° y'á S{|!ygçÇ|m°|}²}zF#Yµ
|qq}±]zm}³Å®L0_z³ «[y3'á !{!ç1Üz<g#W#qQf³ rË}{µ
½|²_¯51z{±L®Lj`} \dþ ° {g'á Syf|}!{/ç/|m|}²}zi#_|q q}±]z}
«{.'á Syç0LyLj|®mL_î:®LpÝLÊFqÓ±]z_:_}.mz·®||:jjO
sÐ±mj:_z®}zW»áùwEj}²|®L²z ãàä#±Lym|qm qæææ:çE³ÅzW®Lm
j{±L²½#|__¯ºy|<ym#²5|²3ugzÁm|W}½}zW®F²zWm}jÈè|}¯i{µ
{#²_}z_®F_zyL½y « { 'á y ç|´ « y Uá { çÓym|H
²yL}|{³Å®mm0²zWm|i³ÅzW{|||±m±LzHÊF_{|<gÁL²z»W#Fµ
}¯i{{#²¯º}zW®L_z´_ým_¤y « { |m « y |²3î:®L F³[µ
³Åjj:3³Å²z{ zWL|Lz²yL# |Ü}_·y:_¯®Lm}²|ÁLW5w.yLj}
g#²ÏF½}#z<#²jÉÁi¯É|}u|mm|à¸µ¶q|²L_L·Î®m±]L|_L·
±mzF1qF®L²_ýL½y8i}u|_L·5³Å²z{)mY²_|³Å®mm0²zWm} ° {
|m ° y!|
|mFzW{}#__#|m|Ü²|mFz{±L²_#ºq0²z
g#²ºyLz:}j8yLº²_·y:µ¶ym|Ï}½Fºz³êî]E
.|}#<|_®Fµ
|q
³Åzp²ym|< }j_# |mÇ±L²½1j1zW3®m}_L·êî]ó8|m
²yL¸µ¶<|_®L³ÅzW!y|<g}#__#|m±L²½1Wj0²z!.|}è{z<j
²z<g|²4²yL_}1zW{±L®FqÏ<|_®L´Ái¯|
³Å|1_z¶ µÉym|Fµ
{_L½}yLq·|F®m|_¯y_{
#·W|²Lq}}z³²yL
F1|__}z³ymÁm®L¯j<|®m|_ze|m
}j|²yLµ¶}|<²#·¯ F½}²ÁL®L_zm}jW|mj·W|F_j}²}z³]yLF#µ
|__}gz³8yLp_LY²_|81zWmF_zm}z.®L±nL|<²m·±L²zF1qF®L²z³
²yL¸µ¶q|²L_L·±LzF#jF®L²gºym|H³ÅzW®Lm-²zÇz®L}®Lµ
±m½}ym|3zWL¯²yLj}5ugzÓ}z_®F_z}|²5j#pzÁ}jWjO
|m-y|<5²yL#¯-|_g|H¯F}ym|HW1ÊL|1_¯Çym´}|{ºîW®|_Y|<µ
²W
³Åz²{w.yL½}ºym|W}º{z²<|jÉ|F#j±jÓ|m|_¯F}½}z³
²yL#_³ÅzW{Ë|mÓm|<²®LWFyL½ygLz<É±mq}jWq
·¹
Õ ¸º¼»½»½¾ ©FªmÛ¬?« × ÙÃ«¨ º»¿»½¾ ©FªmÛ¬¨W$Ø ÀÚ©LÛØ × ¨
= Ä¶Ä7:GjC; Å}Æ´hqlbdkQRG ÅùSl Ç
Á @ Â³Ã8
òmz5|<|_®Lq}z³gû-ym²|L·t ÑÈû ¡ W8²yLº}¯i{µ
{#²_Áq}uµ¿²j}±zWm}±zW½1¯ «'á nç/_}zÁ}jWjz5y|H|
³Å®mm0²zWm|³Åz²{Ãy|< F#±]#mm}zºéu®}upuz±m|²|{#j²}
ÊLÈ
É |mË
~ v
YY³ (ÍÊ
« { Ì y 'á nb
ç p Ê Y³ Êlw( É
á¿¢ç
e Y³ É Í:
100
(θ,v)
Q vs. Q ( γ=0.20)
Symmetric
Î Solution
80
60
pB

(η,η–1)
40
20
(θ+1,θ)
0

20
(η–1,θ)

100
p A
H
,
R
5
@
>
¼
>
.
U
/
5
4
7
5

9
>¢K.DEDE;W4@H,1U2¼H,;G>@-5760>@;9ÐP0602W4,1U576%>@57/UPM<
Y'0RW`Ïc
4,1U5760>Ñ9j5HÒ$</';
3H,601'60Aab1L4,?¹ÓlÔ®¥cÕ Öo
ò _·®L²
£Ç__®m}|<²j}yL
}¯i{{#²_%«á']ç³ÅzW²yL
#|W}
& pØ× £¢|mûtpàØ× £Fw.yL½}FÆn#}³Å²z{ÄyL{¯zW±Fµ
{|L±zW½1¯z³nòE_·mm y|<!®LmL#1®F_L·5Fzij}mzè1zWFµ
²i®L5|n²yL .|H¯´Fz<ÓEz " sÐm}q|OLym#ÓyL5±m½1
·W1}3Fz<²z É ]yL|·W#:3|··²j}²}W#_¯´F²z±m}Y}3±m½1
|LyL.|H¯Fz<z5|p<|_®L ÊLw.yLzW±L±zWL#:që }Á]j}!²1µ
}±]zm}¹z Ê _}!z}1èyL±m½1Á|»®m±kz v]/yL_yL½}
|··Wq}}W ±L²_#_z<j_L·´Lj1²j|W}q}²yL|·j:jë }_{{#µ
L_|±L²zÝmj:Yè±mz<Wj}|LH|:²|·W#zW®m}/ºyL_zm·5®m³Åz
|_j|W}uEuz3q|}zm}jQò_²}j<Á]z²y|·W#:²}E|HzW_²yLgz<g#
±]z_zz³yL.±L²_#1µ¶g|#¯F1_|m}z²yL|Hj²|·!±m½1
z<W#yL1zW®L²}z³|´#¯F1_½}3_m#q|}jO ij#zm8OyL#
²yL1z{±]1²Y²z²j}±]zmL}y±L²½1 v]²yLÓ|·#:j|
²yL#
®mmF#1®L3|<²yL5±L²½1E v¹? Wm¯ij_LL·º|²#½|<²W#_¯
ym·WyÓ±L²zÝmj
wEz3j|½1®L½|<²!²yL±||{1²#} É |mk ÊL1zWm}½FjQÝm}Qy|<
Ê½}gyL ±m½1 Á]#_z<ÉyL½yLzº|·W#:g__8±L²_#pÁ]jj|®m}
²yL|WF<|:²|·.z³n1²j|}j{|²»#!}ym|½}zW®Fuj·WyLj
Ái¯ÜyLºW#²¯4}{|_!±L²zÝL5{|²·_8w.yL±L²_#d Ê
#|ÏÁ]
L1j{_LjÁi¯ Lz²L·ym|/yL.F½}#z®L:q5²#.|{®m}
Á]3éu®m}u{|²·_m|__¯ym·WyL#3ym|Ç²ym|<z³èyLziz:}_L·´±m½1
v] wE|»iL·´±L½1î:®m|:_Ìj|_zÇ_:z|##z®L:q!
ÊÓ{®m}pÁ]
²yL}{|_j}:j·j/}®myym| ° Fá Ê²M |WÊWç ° Fá Ê²M |Wviç1
òmz/_z<z{zFF#|<²<|®Lq}/z³û<W#²¯5|##®L|<.|±m±LzHÊiµ
_{|<²zWm}zÁ]zy ° <|_®Lj}j|¹Á]Ç1zW{±L®FqOò}uq
#zm}½F# ° yFá Ê²). |hÊWç1¥}´ymÜ®LmL#1®F#qf s´ë }Ó1Êiµ
±]j1qÓ±mzÝL.|W##zFm·5zêîO p½} áu` &Ù £,ç ÊL!#Ê:q
¥·jW r_O²j}±zWmº¤y «[{.á ÊWTç pÚvèi_m# s¾½}}u²_
²yL®mmF#1®LjjWY}è±mzÝLè_Áp|LzyLjáu &Ù £,ç ÊL
s_LyLj²j}±zWmÁ:¯®LmFj²#®F_LE
· reY²y±m½1` vb
w.ym#²1³Åz²i®m}_L·ºêèî]LL
° yFá Ê[²øM
|WÊWbç pád£ & @ç Ê[²Ïû ° yFá vS|hvie qç }á ÛWç
z<ø1zWm}½Fj ° y3Fá Ê²¹. |hvFç0èi_m1 s¾_}®LmFj²#®F.Á:d¯ r
²}.#ÊF±q0qjg|²½}5á & Ù £Wç@v]ÑrÉ²yL#²j}±zWmL}.y
vf4.
ÜW²yL½}!²z:z®LmFj²#®F²} sºF|yi®m}s|·W|_²j1jWj}
á &7Ù £@ç v].¥gY}L#Ê:3z±L±]z®LmYu¯W!s®LF#1®F}¥·W#:
rày±L²½1
v¹Ï£Fw.yi®m}.²yL¸µ¿<|®Lp_Ó²yL½}#|W}½}
° yFá Ê[²ÉM
|WviÑç pá & ,ç v²Ïû ° yFá vÎ. |hvk£ç ¢á Ýç
wEz
1zW{±m®F ° y Fá vS|hvÉ Hçp|m ° y á vøM |Wvle£ç18Lz
²ym|< ²yLj}º±L²½1q0zW²} ||5z Lq| ²yLÁj·_LL_L·
z³yL±L²_#.|1¯F1_¤:²ym±L²½1LzW±m}Fz<Çz
s _g|jm|j¯4Á²yLº®LF#1®Fj|m-²yL
É É WX
®mmF#1®Ljàw.yi®m}#.yLjÚ s }#²}²}´±L²_#xz E²yL
#ÊF±q0q±L²zÝm²} ³Å²z{ ²}{z<´|m rë }1zW®L:j{z<
__]}{±L_¯Ááu £\ç f²á £\ç p®Q¥g s´ë }èL1Êi
²®L²8!_m}1!²}±m ½&1Ù .²z ¼º £F&Ù |}zz8/w.yLj#³Åz²
£ß`àá ¬âSãäå Wæ
ç
° y 'á i²øM
|}]Þ
ç p
'á dÏ
£ uçÐû ádôWç
Ðß#è
£Hû

é
ê `
-û áu¼ 4ûOç ë
ym#²yme|±L±L²zHÊi_{|<²zWÑ1z{q}4|ÁzW®F4Á]jj|®m}¹²yL
ÝLY²Î|yL{#½1zµ¶·jz{1²½Ï}#²q}Ç½}ÜÁ]#_L·Ò|±L±L²zHÊFYµ
{|jÎÁi¯|ÎFÝLY²zL. Üè²yL_}½}<|__¹z4yL#Ê:²#:
²ym|<û á ¬âYãäå EÍ ü ¿ W|W}}®L{j}²ym|<l s ±L½|#j}
m#·__·_ÁLj·WyWzW
#W#:²}|³[jym#z³/yL±L²_#1µ
.|#¯i#W
z²L·4y|< ÊÜ{®m}uÁ]´²yL:²#·jpéu®m}u·²j|j²ym|
²yL.<|_®LzWÁF²|mj5Ái¯ qîW®|<_L·êèîi}jC Ûp|i Ýi|m5®}_L·
êî]LôLFg zÁF|_
v & í
â í
Ê éì &
ádæWç
£ &±
î
ym#²
yL|±m±LzHÊF_{|<_z?½}´î:®L|j1®L|<²
±Lz<i½Fj
²ym|<²yL³Åz__z<L·1zWmF_z½}}|½}uÝmqOÈ
û á£ï âSãä}å EÒM ×
áu qWç
F{__|_¯ É {®m}?ÁÒyL}{|_j}Î±L²½1ø³ÅzWÎym_y
° { á | Ò q
ç ° { á |WÊWç0/¿ Wº²yL±zW:|yL½y4²yL
³Å®L®L²É É F½}#z®L:²jjgÉ |²z³/}_·y:²¯Ó®LmFj²#®F²L· É ½}
éu®}uÁm|j¯´yL·WyL#g²ym|y|<z³/|·Wq}}W®LF#1®F_L·
²Ëz Êm sÐÜ²yLÝ²}}²1jm|²_zmyL±L²_#}jî:®Ljm1q|F_L·
_:zpymgÁ]#·WmLm·3z³mymg±m½1#µ¿.|/1¯F1_._}.á É | É ´ Hbç ð
á ÊØ| É ø q
ç ð Fá Ê|hvFkç ð á vdø. |hvFç ð á vdøM |WvÎ£ç1Q¿ W
s´ë }_{{qF_|p±L²zÝLg_Á]pyL·WyL#gÁL®F._]ym#´Á]
®mmF#1®Lgu½1_|²z<øÁid¯ r5sÐÓyL }j1zWm}##m|_zm
²yL±L²½1}jî:®L#1.q|F_L· _:zym±L²_#1µ¶g|/#¯F1__
Á]¹á É |WÊW(ç ð á v!|WÊW(ç ð Fá vS|hv¤Ñ qç1¿ ´ s´ë }´{{jL_|
±mzÝL _Á_z<g#ÁL®F5 _!®LmL#1®Fk r)u½1|
²z< w.yL´¸)³Å®Lm1_zm} ³ÅzpyLq}ugz}##m|_zW}#|4Á]
#z{±L®F²jOÈ
° yá É | É
qb
ç p É
# ²´û & vb²´û ° yFá v
M |Wv$´£Wç
áu W qç
|m
° yá É |WÊWçTp ° yáÊ[² .|hÊWçbpÑád£ ç@Ê[²Ïû ° yáv!|Wv¹e qç
&
áu H£ç
|mÓjî:®m|<²jÓz¯i_#½
£ & ,ç Ê[² 4û & v²ÏûwóØvke Üû û`ôõ
É éòñ ád
áu qWç
ym_y
½}3|W##®L²| ±L²z<i_Ljy|<3êîE jymz½L}#¥¾}_{µ
±mjÓÁL®L_j}²}Ó|W##®L²|Ç#ÊF±Lq}}_zø#|øÁ]-Fj_q?Ái¯
}®LÁm}®L_L·eêî]æL·WLz²m·ÏyL4:²#·j´²j}²_1_zm}j
|mÓL#·Wq0_L·j{}z³ öá qç0È

Üû8ç & ²Ï!û ø7v
áu jó:ç
É éq÷ áuf
ò_·®L²±L_z²} yL<|_®Lq} z³ É |m: ÊÇ|} |³Å®Lm1_zz³ Y'0RW c H,5R>@> -0/'574Ñ59Y3 >¢KMDEDE;=4@H,1'2H,;G>@-5R6.>@;$9jP.602=4,1'576>@57/UPM<
û-³Åz & p° × £W¢Fw.yL}z_½Ç1_²#q}²#±mq}jW3{q|}®L²1µ 4,1U5760>T34bÓÔ®¥MÕ Öo
{jW}²|»jÎÁi¯²®LLL_L·²yL4¸ |·Wz²Y²yL{ zÏ#zijµ
·W#m#yL__´²yL#®L²j}²#±L²j}#:²yLÓyLjz²1½#|g|±Fµ dá zE|_z³:²yLj}±m|²|{#j²}O|_mFj±jmF#:qÈXsºë }8±m½1
±mzHÊF_{|_zm}zWÁF²|mj4³ÅzW{ìêî:}j j
|mæ®L±-z
²yL °½ } éu®}uºÁ]#_z< rë }´±L²_#1µ¶g|²yL²j}yLz½!F.d "¿p
±]z_:yL#² êèî]O jÁ]j#z{j}}#²zW®m}¯i_z½|<qO
[ÏW ç-j|F#²W3|±L±L²zHÊi_{|<²zWm}!²z²yL<|_®Lj}gz³
E# è$|m3ym|è|²|##®L|<g³ÅzW!}®&%º#jW²¯}{|iû/
ò_²}j:1zWm}½Fj/yLL1j{_m|<²zWz³'FWyL_z<q}u!±m½1
²ym|< rÏ_}8__L·²z®LmFj²#®Fj¥g8ym_}QH|®m rÏ½}iéu®m}Qz
²yL.j·Wèz³]±L²1³Å#²²L·zpz±FzW®Fz³]|3±L²_#.||}1
²}±L²_# ®L±dz v]w.yL#²1³ÅzWWFj{±zW²|_¯ÓF_}²#·W|²LL·
²yL³ù|W0!²ym|< {®m}èÁ3|:²#·jjW}#j(» }®myy|<
° {gá |
¹É q[
ç p ° {.á |hvFç0w.yLq}ugz
¸µ¶<|_®Lj}p#|4Á]
û
η
#z{±L®F²j´Á:¯³ÅzW_z<m· yL3±L²_#|<éuq0²z²q}!®L±´z5²yL
±]z_:yL#²pyLj¯5éuzWÓyL ±m½1#µ¿.|g|<éuq0²z²¯]È
θ
° {.á Ø|)e q±
ç p e$ ²û & vE²û ° {.Fá vÎ. |hvkÏáu £Ýç
° {gá |Wviç p
|WvkÏ£ç
& vE²û ° {gFá v¹eM
ù
ú
êî:®m|<²L·Óym²_·y:µ¶ym|Ç}½Fq}3z³è²yLj}qî:®m|<²zWm}|m
²

z®mmF_L·®L±zyL mj|²j}:²#·jjFgzÁF|_
Y'0RWüý KMDEDE;=4@H,1'2f>@5R/'P.4,1'576!þ¼4,?0;G5H,;=4,1'2
37/ 3760mË5Rÿ.>@;=H,QC;
m
376Jmk3>`39jP.602=4,1'5R6d59VÓSo®1'A7AR/';G>`1'64,?0;G5H,;=4,1'2
37/S2GP.H,QC;f3H,;
m.P0;$4,51'6c4,;=AR;=HT2G;G1'/'1'60A9ÐP0602W4,1U5760>b1'6VOo.©36Jm
Mo
é ñ áu 4ûOç & vE²û ó v¹Ï£ £<4û û$ô ²ø õ áu qôWç
= ÄÄ7:G#; ÅÆÓhjl]bùkE7G Åd!l Ç
Á @ Óh#
w.ym±||{1²#?_}²yL<|_®LÓz³$S{°|<yL½yÎ¥·W#:
Fj#_Lj}´zÎ}1Y}´±m½1Ü|··Wq}}W#_¯_z< w.yL½}´½}
w.ym|W}¯i{{1²½´}z_®F_ze½}zWÁm}#²jÏzÏ|_g|H¯F}ym|H sö
²yL!³ÅzW{__®m}|<qòE_·®m!ó8s¶j| Á]Fq}#_Á]j®m}µ °ád|y±L±má XzH|*ÊF_ç0{|òmjz_¯Lz<ç_yLLÜ·
±²yLzW:´±L|<½Ó1´yL|<_éuy q0° zWy3_ájX}|)®L:±²zÜ qËç ²yLp
_L·5zWL±m|²|{#já ç³Åz!zWLz³]²yL|·#:}áù}²|H¯¥·W#:
rpç|mÜymj±m||{1²#}á E
E| .ç3³Åzymzym# ±]z_:yLj´yLj¯éuz_ymÓ}²|L|±L²_#1µ¶g| |<éuq0µ
|·jWáù}²|H¯¥·#:[ sç0pw.yL ³Å®Lm1_zm|Q³ÅzW{}z³ym²1µ ²z²¯FgpÝmmOÈ
}±]zm} 1®L²q}|²pFq}#_Á]jÓÁ:¯nÈ
° yáX|
de qç±p
de $²Ïû/á¿£ & ç+%²Ïû ° yáv¹e M|hv¹á jæ:£Wç
v
Y

³
Y
(
«[{.'á nb
ç p e Y³ iÍ:
áu H¢ç
° yá X|*ç p
ád£ & +ç Ë²û ° yá v!|Wv¹e qç
³Å²z{ËyL_ygzÁF|_
~ Y³ (
« y Uá ]T
ç p e ³³ Ú®wÍt((Í
áuR ÛWç Ëp ñ ád£ & ç#áu¼ 4û8ç ²$ ²Ïû ó v¹Î £HÜû `û ôõ
ád£Wç
e
³ xÍ:
100
Q vs. Q ( γ=0.20)
Asymmetric Solution
80
(φ,φ–1)
pB
(ζ–1,v)
(ψ–1,χ)
40
(ζ,ζ–1)
60
(χ+1,χ)
(φ–1,χ)
(ψ,ψ–1)
20
0
0
20
40
60
pA
100
thresholds
80
60
40
20
0
0.0
0.1
0.2
0.3
0.4
0.5 0.6 0.7 0.8 0.9
γ
Symmetric solution thresholds η and θ vs. γ
1.0
80
100
F{__|_¯<gj|#z{±L®F²-Ái¯5}#²L· ° y á,f|*¹ qçbp
° y-á [|./ç0È
° y,á f|*¶Î HÞ
ç p á¿£ & /ç :²Ïû ° yáFvS|hvÎ Hç[ád£L qç
° y-á [|./±
ç p Ë²Ïû ° yFá vS|hvÎ Hç
³Å²z{ËyL_ygzÁF|_
³p ñ £ õ
ád£W£ç
&
100
φ
80
0
threshold
60
ζ
40
χ
20
ψ
0.1
0.2
100
Q vs. Q ( γ=0.10)
80
0.3
0.4
0.5 0.6 0.7 0.8
ùγ
Asymmetric thresholds vs. γ
0.9
1.0
1
32
4 #5 $6 (7
60
pB
0
0.0
Á]}j#ò·W®L²ÛmyL½y±L_z}yLtg#__{|j²z.á[²yL
L_}²1²#±m|m1¯Á]1ug#j´²yL _1³[y|m|mÓ²·WyW²ym|´}_Fq}
z³êèî]E:ç |}|³Å®Lm1_zz³g²²|mL·Ç_{´³Åz}#__#¹} r
|m sºw.yLètg#_{|pj²zqjL1ÝmLq|}n²yLè|Hj²|·/vÜ
j²zpg#_·y:qÜqîW®|_¯
z<W# |_±L²_#±|_²}j81zW{q}1Êiµ
²j{#_¯1_zW}è²zÌ##²zm<Ám®Fè}®LF#m¯}yLziz}/®L±F²|{|<µ
j|_¯Ww.ym#²²zè}zizºFq1²j|}j}jW|·W|F²z±L±mL·Lj|_¯
²z Ì#jz ÁL®L}ymz:z_L·®L±º|·:|_8|m}z²yL1¯F##z:_Fµ
®mj}/®Lm#j|W}_L·_¯òLzW1ÊL|{±L_|_{g0ó Ûó<yL.±]z__#q}
y|HgyLj|LzWL½#|i±m}#®FzµÐ}zW®L_z5³ÅzW{:|myLtgjµ
{|º#²zW!½}Qéu®}u.L J Ý³Åz` rÒ|mºm WL q£3³ÅzW s´z<.µ
jjjQ|_{0ó ÛW¢LOyL²j}±]zm}#®L²³Åzk r}®mLFjL_¯
}yL³[²}³ÅzW8
{ « { 'á y p°£W$ç p¾ q²z « { Uá y pà£Wç p¾ jæ
|W}gzLp½F·W3_ ° { |<Ñ { pà qæéu®m}½}j}.|Á]z<|²½F·
|¼ { pÃ jmºw.yL½}_} {|LY³Åq}u²j|}|Ó_zm·ÓÝL·j51Êiµ
²#mLL·º|W1²zW}²}!²yL51²zW}²}±Lzg__®m}|<²j_ò_·®L²¹ Ýi
Y'0RW R +$>¢KMDEDE;=4@H,1'2¹>@5R/'P.4,1'576!þ4,?0;G5H,;=4,1'2
37/376Jmt5Rÿ.>@;=H,QC;
m
§ X§ T§J36Jm E3>T3[9jP.602=4,1'5R6i579#ÓYo
40
DFEHGIG+JLKIM
ò _·®L²¢±L_z}Q²yL.<|_®Lj}Ez³8Q$è9W|m(|W}|³Å®Lm1_z
z³.û¹³Åz & pÄØ× £¢Lw.ym´}zW½Ï1_1_j}5²#±mq}jW5{q|<µ

}®L²#{#:}.²|»#Ái¯´²®LLL_L·²yL¸µ¶q|²Lm·|·Wz²Y²yL{

®mW²èyLºtgj_{|#²zW _}5{_L_{ÌjjOyL_²yLº}z__
#®L²j}j±Lq}j:yLyLjz²1½#|Q|±m±LzHÊF_{|<_z}.·_# Y'0RWBN
AO 5R/'1'2=K(2WH,5R>@>@-0/'54E34[4,1'DE;QP[Ôq¦C¨SRmMP.H,1'60Al4,?.;Ò$<
Ái¯êèîi}j8 jôm]£m|mÇ££LmyL½yÇ|² <|__
±mz<i½FjÓy|< /U;G3H,601'6.AH,P06i59'TY1'A.o:¨Mo
û á£ï â8:Cäå EÉ L|zWL·Y²yyL ²#½|<²zW wp;Î W
.w ymºzFj|<_zÏz³.yLÝL·j}®L··Wj}²}²ym|<5²yL´±mzWÁLj{
__j}_|e±m|
z³l«[{.áU!yçÓ²ym|<
½}zL_¯ø²#_#<|:ÇF®Lµ
_L·|m}_#:²}gÁ]1³Åz²3yL±L²_#1µ¶g|g#¯F1_3ym|W}gÁj·®L´ü
}z{jyL#²4|zW®Lm Sy Uè¼sÐÉ³ù|0q3F#²|_j
|m|_¯F}½}Ójj|_}´y|<j_É²yL½}j·_z8 ° {.'á !yf|.q¾ qç
W

#²¯Ï}_·Wy:_¯-#ÊL1#qL} ° {.'á !yf|hvFçY³3|.zyLj ° <|®Lq}
>
|º²|»W#Ï|}Fj}²1²_ÁqÏêîi}# q¢
|m?7 ÛmÇ¥}yL¸
³Å®mm0²zW·|F®m|_¯Á]j#z{j}{zWÇ}#³[µ¶#zm}½}u²#:º|m
|W##®L²|WOY Ým|_¯Ç²j|WyLj}3²yL±zW:5yLjWO³Åz5}z{
<|®L4z¼³ y _øym41²½#|p|L·W¼ r5ë }ÓÁq}uq}±]z}
}yL³[²}³Å²z{ v(z tÏ W/¥m|_z·Wz®m}èÝmL·W#}è{|H¯Fj#_z±
³ÅzWzyLjf y ²yL½}|L·Wº|}j¿t sß}zizF½}#z<j²}
<
<
<
<
<
<
²ym|<qL}_{±L_¯Á:¯º}yL³[_L·Y}gyL²j}yLz½³Å²zV
{ e(z tÏ W
=

L
®
m

F
®

T
5
r
/

Ð
s
:

u
}
²

W
·

W
¯

|
_

i
¯

}
½

}
|mzÁm}#²<|<µ
Y'0RW3?RA@ ;G/'/'Dk376 ;=H@H,5H(9j57Ht>@1'DP./L4h3760;=5RP0>(Ò$<}/';
3H,601'60A³ÿK
²

W
z

{

u
}
²

m
y

r
#

|
L

|
_

i
Á
¯51ÊijmF_L·
37AR;=6c4,>B¹36Jm¤Ö§Yab1L4,?%ÓtÔ¥cÕCRo(X32W?%4,1'DE;EP.601L4H,;G-.H,;=>@;G64,>
²}gÝL·j|__³Å®LyLj.zym #³[7 ÜL_m}j|W´#²j|²}
3[6cP0D[ÿ;=HÑ579SHh376JmM5RDIP.-Øm034,;G>Ñ;
OPJ3/Ø4,5f4,?0;4,54h37/6cP0Dÿ;WH579
-.H,1'2G;-J31LH,>Go
Á|»5²z5±L½|H¯iLE· v]¥³[²#|5yL_J sÑ}yL³[²}!²}èymq}yLzW_
Á|»Ü®m±ÏWz 3|m-²yL XZY9['#:ÿ #Mÿ \[£_}q|F¯ÜzÇÁ]#·W
sÐ:²#²j}_L·_¯F²yL½}}z_®F_zéu®m}Ám|j¯´³ù|__}zÁ]5³Å®L__¯ |L# w.yLL²|{|½|m4#¯F1__j|/}yL³[ 4ym±]z__#q}
}#³[µÐ1z}½}u²#:j.¥Ñ#q|}¯i{±Lz{Äz³_m1zWm}½}#1¯Ój| ²²|m}_|j}._:z½|²· 1¯F1_½#|8}±L_»q}.ym5tj_{|#µ
20
0
0
20
40
60
pA
RMS Bellman error
0.08
0.06
0.04
0.02
0.00
0
200
400
600
time
800
1000
80
100
²zE³ÅzÁ]zy±L½|H¯j²}jQw.yLg²²#·®m_|u¯3_|{±L_Y²®mF.|m
³Å²jî:®Ljm1¯½}EL®L!²zymè|mFzW{Lj}²}8z³FyL¸e|_·z²yL{
|myL.·|L®m|i_#L·yLjLm·pz³m²yL.±j_zF½}F®L.²z3²yL
#ziz_L·z³Qymk µÏ±m||{##q
]_Õ â` Û¬ ` ¨:TØ ÀÚ©LÛuØ c
× b WÛ ÀhÀØ.¬O¬OÚeª d
#²!gè1ÊF±L_z²/ym1zWmF_zm}8ym|F#j{_LèyL#yLj
²yLø}¯:{{1²½?zÏ|W}¯i{{1²½e}z_®F²zW)½}zÁL²|_LqO
ò_²}jè}u|Ái¯|LLL·4·W|®m}}½|ÏLzW_}yÎ{q|
|mÓ|{±L_Y²®mFg f/izyL5¸É³Å®Lm1_zm}gz³8yL}¯:{{1µ
²½
}zW®F²zW8à4ÇyLjø|_z<ß¸µ¿_j|mL·-²z®m8|m
zWÁm}#²
yL#yLjºymÜ}¯i{{1²½
zÓ|}¯:{{1²½Ç}z_®Fµ
²zWÎ½}zÁF|_Lj8Î¥e1ÊL|{±m__®m}u²²|_L·4yL_LY²_|
±]#®mÁ]j±]z__#q}|<h ftpÒØ£ × |mÓxû pÒ × £½}}yLz<
ò_·mØô ÜEyL½} ±m|²_#®L_|L½|1zFY²zW4y|±L±]#Lq4z
jzWW²zyL5}¯i{{#²_}z_®F_z8
100
80
60
p2
t
40
20
q krl.l*l.l*l
0i
i 40i
0
20
j/γk.lnm o*p σk.onm l
i 80i
60
i
ps
8
0
w
3
E
D
0
'
/
;
'
1
0
6
L
1
,
4
U
1
37/$-;=H@4,P.H,ÿ;
mw-5R/'1'2G1';G>i57ÿ.4h371'6.;
mÿK
Y'0RWvu
>¢4h3H@4,1'60AT9ÐH,5RD4,?0;X>¢K.DEDE;W4@H,1U2>@57/UPM4,1'5R634YÓÔ®¥MÕ Ö$36Jmf3Rm.m.1'60A
605R1'>@;iab1L4,?:37DE-0/'1L4,PJmM;(N
x Ô ÖÕ ¥MoyYT 1'6J3/ÑH,;G>@-5R6.>@;l9jP06.2=4,1'5R6.>
100
1
3H,;i>¢KMDEDE;=4@H,1'2R_XDE5R>¢4574,?.;=H4@H,1U37/'>k344,?01'>60571'>@;l37DE-./'1'4,P0m.;
H,;
372h?0;
m¹4,?0;3>¢K.DEDE;W4@H,1U2$>@5R/'P.4,1'576!o
¥3}²yLLzW_}|{±L_Y²®mF½}_m1²j|W}qO²yL_LY²_|m±]z__#q}
²#m-²zÇÁ]º³Å®LyLj5³Å²z{õyL´}¯i{{#²_´}zW®F²zW8/|m
²yL¸É³Å®mm0²zWm}!²#mzjzWW{zWz³[jz<.|L}/²yL
|W}¯i{{1²½5}z_®F_z8òmzR ÛºFÆ]jj:3yLz½1q}z³!mz½}
|{±L®F|L·Wm·³ÅzW{Ím m z¢L m8 jW²_|_}j
#zmL®m0²jO?¥g fªpõ × m ²yLLz½}½}}z-}_·y:y|<
²yL±zW½1_j}|®m}®m|_¯
®mmym|m·j8¥gQ fp)¢Ø × Ln²yL
_L½|8²j}±]zm}³Å®mm0²zWm}|²j}²}j:½|_¯|mLz{
w.ym±]#1jW|·W!z³L²½|½}O²ym|</¯ij_Lj ²yL.}¯i{{1²½è}zµ
_®F²zWÓ|}g|³Å®Lm0²zW´z³8yLLzW_}3|{±L®F³ÅzWg%û pø × £
|mÓ(û pÒØ × ¢½}·_jÓÁi¯Óò_·m]æmáù|:ç0èw.ym}|{5L|<|j|
Á]ijq|LYÆn#²#:.g|H¯W:Ái¯±L_z_L·yLp±L²zÁm|ÁLµ
u¯Çz³èzÁF|_L_L·´²yL}¯i{{1²½}z_®F²zW4|}|Ó³Å®Lm1_z
z³Lymè²z²|:vÜ|Lym||L_}²|m1z³L²yLèugzmz½}¯_LY²_|
²j}±]zm}è1®mWj}O³Å²z{²yL½Fq|:Lz½}#µd³Å²#}¯i{{1²½è}zµ
_®F²zW8!w.yL½}½}.}ymz<´_ò_·mFæmáùÁç0ádw.yL±LzWÁm|Ám_Yu¯½}
zWÁF²|mjÓÁ:¯º|HW#|·WL·z<#p jW5²½|½}.1jW²#²jÓ|²z®Lm
q|yF½}u|m# ç
sÐ|LF_z5z²yLè|Fz{Lq}}Oz³FyLg}u|_L·}²|H²yL
|Fz{)1ÊF±L_z|<²zWF¯im|{_j}!z³¸µ¶_j|²L_L·5|½}z ®Fµ
jm1q}yLpq}®mY²L·Ýmm|n}²|W-pym|H3±j³ÅzW{j´1Êiµ
±]#²_{j:²}.}u|_L·5{|i¯²½|½}!³Å²z{|}±]j#YÝ3|mFzW{
}²|²m·}²|W|m³Åz®mmym|è}zW{²½|½}1ziW#²·j z
²yL}¯i{{1²½}z_®F_zÜyL_z²yL#3²_|_}3g#:3²z´²yL
|W}¯i{{1²½}zW®F²zW8
ò_·meæ}®L±L±]z²}g²yL 1z1#±L®m|O:j±m#²|<²zW´z³Qugzµ
±m_|H¯W#p¸µ¶q|²L_L·ºF¯im|{½#}3Ç#²{}z³è|Ám|}_Çz³è|µ
²²|W0²zWº|²z®LmyLp}¯i{{1²½}z_®F_z8iFj_Lj|qÁi¯
|4F½}u|m#´±m|²|{#j_¹#ym#±zW½1¯}±m|#ºz_?¸µ
³Å®mm0²zW}±m|#/sÐ´Á]z²y}±m|W1j}jWyLjp_}|}{|n²#·_z
|zW®Lmym}¯i{{1²½}z_®F_z}®myym|èi®|_¯|i¯
}²|²m·Î}²|<²ÜyL_ÒyL-j·_z__iH|½|Ám¯1zWFµ
W#²·²zºym}¯:{{1²½5}z_®F_zQòLzW_z<Òû/yL}¯i{µ
{#²_3}zW®F²zWº#|ºÁ3q|yLq#W#yLjºym3}²|_L·
}²|g_}g#_iz®F}½FyL½}j·_ziüzW®L·ym¯|WL zym|m1
ym#º(û pø × £Lòmz.{ziL#|<zyL_·yºû/:yL}¯:{{1²½
}z_®F²zWj|LmzÁq|yLq³²yL}²|²L· }²|_q}Á#µ
¯Wzmým_}²#·WzW8/w.yL_}1ÊF±L½|_m}gy:¯ÓzWL¯´zÁm}#²q
²yL3|W}¯i{{1²½}z_®F_z³ÅzWè{zFF#|<²zyL_·yûºzW®L
q|²_#}®mLq}5áùwEj}²|®L²zãä#±mym|jO qæææ:ç0
{}Õ | Ø × #¬ ÀÚïÛuØ × ¨
sÐ²yL_}Ç±m|±]#Ç|màz®m
j|²_jgz²» áùwEj}²|®L²zeã
äj±Lym|q- qææWæWç0gÒym|HWÉzWÁm}jWj¼_:#²j}_L·)|m
®mL1ÊF±]j0²je±LyLjLz{jm|yL#?®m}_L·Ï}_{®L²|L#zW®m}´¸µ
_j|mL·²zº|<²#{±F²zºzÁL²|_z±F²{|8±L²_#L·±]z__#q}
³ÅzW1zW{±]1²m·±L½1jÁz²}jw.yLj}pÝmmF_L·W}m#®FÈ
á qçèsÐº²yLp}yLzW±LÁz{zFF#O}®mLqýLjW:|mº_º²yL3uz
|WLF_zm| {ziL#½}
}u²®mF_j áùwEj}²|®L²zeãöä#±Ly|j
qææWæWç0!yLjÇFz#Êi½}#ÊL|0zW±F_{|3¸µ¶q|²Lm·-}z_®Fµ
²zWm}jym_yÏ²yLºugzÜ±m_|H¯W#}#ë8±]z_½1_j}|²´}_{®mY|<µ
m#z®}_¯z±F²{|/F}jpq|y
zyLjj òL®m²yL#²{z²]yLº¸µ
_j|mL·±L²zF1qF®L²½}5|Ám²zÓÝm4yLq}º}z_®F_z}#sÐ
·W#Lj²|dW³Åz.|²ÁL|²¯±m|H¯WzÆ³Å®Lm1_zm}j:yLjp_}Lzq|<µ
}z´ý XY
,Y
<²z1ÊF±]j0Eym|8ym#²!_i|_g|H¯F}n1ÊF½}u|±m|_
z³²j}±zWm}g#®LWj}/}®my5²ym|<T « { ½}/z±F²{|iF}j « y |m
i½1 W#}|mèw.yL ³ù|W0y|<3}®my
}zW®L_zm}#ÊF_}_Ó²yL²#
LYÆn#²#:q1zWLz{½#|__¯{z²<|<²j{zFFj_}}®L·W·q}u}y|<
²yL}²®m1®L²!z³i²yLè±m|H¯WzÆ5³Å®mm0²zWm}Qz³Lm|<²®L|_¯3zij1®Lµ
_L·²j|µ¶zW½±L²zÁL_#{}p{|H¯
Á}&® %º1_#:_¯øÀm_#jÂ´z
_j|Wº²z}®myÓ1ÊL|1}zW®F²zWm}j:jj´²yLz®L·Wyº²yL#¯#|mLz
Á] 1ÊF±]j1jÓ³ÅzW|²ÁLY²²|¯±mzWÁLj{}#
á¿£ç´sÐÒ|WLF_zø²z¹²yL1ÊL|1}z_®F_z}#3|½}z¹Ýmm
_4yLº}yLz±mÁzp{zFF#¿E|mÇ_-yLsÐF³ÅzW{|_z4ò_Y²#µ
_L·ø{zFFj}®mLq° áùwEj}²|®L²zøã ä#±Ly|jº qæææ:ç0
|ÉLzLµ¶}²|_zm|¯ÍÀ±m}#®FzµÐ1zW:W#²·jWÂ?}zW®F²zWy
Prob. (symmetric solution)

1.1
1.0
0.9
0.8
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0.0
10–2
Prob. (symmetric solution)
~

1.1
1.0
0.9
0.8
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0.0
100
~
Y'0RW3RAO
γ=0.5
γ=0.2
~
~
10–1
100
Noise amplitude
~
γ=0.2
~
~
102
~
γ=0.5
101
102
103
Manhattan Distance (combined)

~
101
~
104
H,5RÿJ3ÿ01'/'1L4K579#57ÿ.4h371'6.1U6.A4,?0;>¢K.DEDE;W4@H,1U2$>@5R/'P.4,1'576!§
¢> 4h3H@4,1'60A9ÐH,5RD8Hh376JmM5RDE/LK¤-;WH@4,P.H,ÿ;
mx1'601L4,1U37/$Ò$<F9jP06.2=4,1'5R6.>G§34
ÓÔN¥MÕ Ök376JmlÓÔN¥cÕ co¼3R]$+$>39jP06.2=4,1'5R6d579X60571'>@;37DE-./'1'4,P0m.;
VobÿJ]b+T>`39ÐP0602W4,1U576579V4,574h3/ [email protected]'>¢4h376.2G;f579V1'601L4,1U37/
-5R/'1'2G1';G>T9£H,5RDq4,?0;1£mM;
37/!>¢KMDEDE;=4@H,1'2>@5R/'PM4,1U576!o
x
R
'
}{|_LzWFµ¶Ì##²ztg#_{|ø#²zWjàw.yL½}´½}|ÏLz<j±LyL#µ
mz{#LzW´²ym|<Fziq}.LzzF##®LzF_m|²¯º}L·W#µ¶|·jW
¸µ¶_j|²L_L·mjºg³Åz®mmy|<5²yLºLzWFµ¶}²|_zm|u¯
½}!_LyLjj:_¯#¯i#½_m|<²®L²M ÜWyL½}èy|±L²#i_z®m}¯Áj#
{|W}»Wj4Á:¯ÇyL|mLz{ 1ÊF±L_z|<²zWÜz³²yLÓ¸µ¿_j|mL·
|·Wz²Y²yL{w.yL ±m}#®mFzµ¶}z_®F²zWÓ_yL5}yLz±mÁz{zFFj
½}ºz³3³Å®m²yL#Ó:jq}uºÁ]jj|®m}
´_}Ó|ÁL²z»je}¯i{{#µ
²¯}z_®F_z8]yLjq|}²yL±|H¯zÆÜ³Å®Lm0²zWm}3³ÅzyLuz
±m_|H¯W#}|²}¯i{{#²_sÐÇym#z²1²_j|E±Lyi¯i}½#}j]ÁmzW»#
}¯i{{#²¯5}zW®L_zm}Qz}¯i{{1²½èqî:®m|<²zWm}Qz³[j_mFµ
j|<²_W²#²j}_L·5®LF#²¯i_L·5±Lyi¯F}_j}#/tgzW»#º}¯i{{#²¯
}z_®F²zWm}p{|H¯
Á]z³.}_{½|_:#²j} -®LmL#}u|mF_L·
²yL5F¯im|{½#}.z³{®Lµ¶|·#:¸µ¿_j|mL·
ádWç54ÓÝmmym|²yL´#ÊF|W0}zW®F²zW¹|yL±m}#®mLzµ
}z_®F²zWj|à1zµ¶1ÊF½}uqp|mÒym|yLyLzW_#z³ym_y
}z_®F²zW4½} zÁL²|_Lq4Ái¯-¸µ¶_j|²L_L·F#±]#mm} z_LY²_|
#zmLY²zWm}#ymÇF_}²1zW®L:º±m||{##q|màá[²z|4_j}²}#
#Êi#:0çgzÓyL |mLz{Lj}²}gz³/1ÊF±L_z|<²zW8
w.ym_}è±m|±]#!y|}±L²j}#:²j|m|¯:½|:®m{j½#|iqyFµ
m_î:®Lq} ³Åz#|½1®m_|_L·yLº³Åz²{}z³.ym´}zW®L_zm}jQ²yL
L¯:|{_j}-z³º²yLÎ_j|mL·Ò±L²zi#jF®máÅyLz< ²yLe±zWµ
#q}|mÎtg#_{|e#²²z}Á]#ym|HWÓyÎ_{qç1g|m¹®mFµ
L#}u|mF_L·à²yLÉ1zWmF_zm}®LmFjyL½yj|y}z_®Fµ
²zWÏ_}yLzW}#Q¥¡_|·W1µ¿û¹|±L±L²zHÊF{|_z4³Åz5²yLº<|µ
_z®}ymq}yLzW_m}ÓFq}#_ÁL_L·Ï²yLÜ±]z__#q}´gz®m_?Á]4F#µ
}_²|ÁLW|}zW®L_Ï|Ü{z²´F1|_q¹ym|²|W0²#²Ìq|<_z-z³
²yLÁ|}m}z³è||1_z8v
zWÁLz:|F_¯zW®L___»
²zÇF#W#_z±Ï|
Fj#±]#|m-{z²·#m#|®LmL#}u|mF_L·
z³±m}#®mLzµÐ1ziW#²·#:5}z_®F_zm}|ÏymÓ|L·Wºz³p}#1µ
|²z:}p|mÜ#zmLY²zWm}®LmFj yL½yÜ²yL#¯ÇzFj1®LqòmzW{
zW®L#ÊF±j_#m#z-L|<²/º}®m}±q0ym|ym#¯-_Á]
³ÅzW®Lm·#m#|_¯)|®F²z{|<²j°±m½1#µ¶}1_L·Ò|±L±L__j|<µ
²zWm}jpym#²Ïm}²|ÁL__j}
·W#Lj²|qøÁi¯É®LF#1®F_L·
{|H¯Á]î:®L#F#{½tg®FzL_¯Ï|<³[j1zF®m0²m·4|
Ámz:|Fjº|m|¯:½#||me#Êi±]#²_{j:²|3}u²®mF¯ez³{®Lµ
|·jW¸µ¿_j|L_L·Ç_<|²_z®m}|±L±L_½#|<²zWm}´áù{zW}_»W#_¯
|_LjÁ:¯5jymL_î:®Lq}E³ÅzW{ÑLzm_Lj|F¯im|{½#|L}¯F}u²#{}
²yL#zW¯Lç_.Ó»iLz<¡yL#yLj±m}#®FzµÐ1zW:W#²·jm1½}
|4±LyLjLz{jLze1zLÝmLjÎm|²z<¯4z-LzWFµ¶#ziz±]#|<_
mzFµ¶Ì#jzµ¶}®L{·W|{j}.Á]1ug##ugz±L½|H¯#}j:zW|³Å®LmL|µ
{jW|8ym|²|W0²#²_}½z³{®Lµ¶|·#:¸µ¿_j|mL·
¾'G¾ ª ¾Q× ¬ ¾ ¨
âp²#jig|_O.¥5_ãìäj±Lym|q~gÞáu qææWæWç0ÉFyLz±LÁ]z}
|°±L²_##Á]z²}j
`*Y7GG
\)A<þ Y.SM@G)!
)!¢
)]ý
,Y)]
ý [&Y\)!3Y)S=)Y=HYc)[
} ùý [F)@[['0)SG
âp²#jig|_O¥ _!ä#±mym|j~Þ_!ã wQq}|®L²zmâ~
áu qææWæWç0:|<²#·½±m½1jÁz.F¯im|{_j}#r `*Y7GG
\)A<Qþ Y+
-ØT\
þ Yc)IW)SGQY)¡¢[Ð=*Y)!( YcWG
¥gvxð!²j}²}#
®8.~m_gãõ4j_{|8.vÏèð/á jæWæôWç1evÇ®LY²_|·jW²#_Fµ
³Åz1j{#:ºq|²L_L·mÈ²yL#zW#½#|³Å²|{jzW»|m?|
|_·zWym{£ )Y7GG
\)L}þ Y+3r¤ +¥$¦
íQY{|QWvÏLá jææó:ç1LvÇ|²»z<·W|{j}/|}|³Å²|{#gz²»³Åz
{®mY²YµÐ|·W#:²#_F³Åz1j{j:5q|²Lm·m *YRG=
c\)Lþ Y+
-Ø¡¢[£\§C)-¨
)!¢
)]c
ý },Yc)]9ý [_Y)IW)SG©Y)ÜMý J\)S
¤X²cý )\)AáÅ±L±Q8 q0¢ ÝIª]R Û:ç0EvÇz²·W|ä |®F³Å{|L8
L|mFymz_{Own°_8ãÄq}#O O/á jæWæW¢ç1Þ34{®Lµ
|·W#:¸µ¶q|²Lm·5|}#{µ¶#z{±]1_Fz{|_8¬«\Ø-

)!¢
)]cý },Yc)]ý [_&Y\)!Y)SW)SGYc)[
$ù9ý [¢)@[
['0)YG¯®-F°±+¥L²
³n´´¶µ©Yc*·H*þ ZY)X¸Yc)y_
ý XSÐý ,Y)øý )e
¤X²cý )\)A%\)¶¹&['ù\ý 0)! ÿH
þ @þ
´Y)W9ý [C´h!ý )n$ý Wý
áÅ±m±8S Ýi ªØÝ.Ýç0
izm3ð/_3ã ñ#_zW}zmvÏ á jææWæWç1)wEj|{2±|_zLqO
z±|î:®L|m}_zjL³Åz1#{jW _j|L_L·*YR=G
9
\)LQ
þ Y+-Øg#G)Yc)F
)@
)]ý ,Y)n9ý [ Y)S=)Y=(Y)©_¹&
/Y)FYcHY¹i_
þ £0)!ùþ
wEj}²|®mzâ_/ãÃäj±Lym|j/~èáu qæææ:ç0ð!²_#m·
|·#:
j#zLzW{q}®m}_L·{®LY²YµÐ|·W#:ÇîWµ¿_j|L_L·º*YR=G
9
\)L_
þ Y+µ©Yc*·H*þ ZY)X»Y)¨¼ý I½eØ
YcW5cý )Fg¾G½
þ ,Y)Z
½eØ
Y=B£0)!ùþ

Download Report

Pseudo-convergent Q-Learning by Competitive Pricebots Jeffrey O

Paperzz.com

Your Paperzz