Outline Why Machine Learning? What is a well

|~}€‚„ƒE…O} M
‡†ˆ
ƒE‰ Š‹
!"#$%&
')(*,+-/.02114365798"5:1"#$%<;#>=?12@&
*A-B9C7@<;1DE1")#>%F($=/;1,GB"IH)2#+
')(-JLK"+M($=N++M=NK1,5:.0 N+>H<?O=K(*PN
!"#$,%&
Œ*"92(-;#$=N%N#$"+>+€1%N=#>(M@<+)'5(M2=#>
Ž#$=).%=‘=5:=’“=N1”5($
•E=N@F;K($(M=N')1–;O=G.02#,+b—))1,?1,
˜€K557%F5K+M($#$
™ #$2 ,"+’s=N#*@šN>Š1"#$,%D
›Š(>@<%BDœK'+M%/,+$(M=N#$X2)15($($=/@<;#>=G—N
57"9,+$='+
ž @F"5,21–#$"9=N#>5+-Ÿ„@<"57,21!HL=).1"57%N
‘=’s(6.€#$¡;;1,2(M=N+.0 2£¢ (;#>=%N#)@¤?7<')'5
ž )K(M=N=N@<=K'+57#>—‘%
ž +M;O2":#$"9=N%N($=
‘214’¥9K+M($=N@F¦2%F;#$=N%N#>@<+
ž/§ 2.-+M#>"52#*(M')(*1")#>+-K+$2#(M2#>"+M(>+
Q
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
¨
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
© ª …£ƒ /« ƒ ƒE¬ Š‹ © ƒE­7®
« ƒ ƒE¬ Š‹»º¼
­ Šy
› )(>D
› )(>D
Patient103 time=1
Patient103 time=2
...
Patient103 time=n
Patient103 time=1
Patient103 time=2
...
Patient103 time=n
Age: 23
Age: 23
Age: 23
Age: 23
Age: 23
Age: 23
FirstPregnancy: no
Anemia: no
Diabetes: no
PreviousPrematureBirth: no
Ultrasound: ?
FirstPregnancy: no
Anemia: no
Diabetes: YES
PreviousPrematureBirth: no
Ultrasound: abnormal
FirstPregnancy: no
Anemia: no
Diabetes: no
PreviousPrematureBirth: no
Ultrasound: ?
FirstPregnancy: no
Anemia: no
Diabetes: no
PreviousPrematureBirth: no
Ultrasound: ?
FirstPregnancy: no
Anemia: no
Diabetes: YES
PreviousPrematureBirth: no
Ultrasound: abnormal
FirstPregnancy: no
Anemia: no
Diabetes: no
PreviousPrematureBirth: no
Ultrasound: ?
Elective C−Section: ?
Emergency C−Section: ?
...
Elective C−Section: no
Emergency C−Section: ?
...
Elective C−Section: no
Emergency C−Section: Yes
Elective C−Section: ?
Emergency C−Section: ?
...
Elective C−Section: no
Emergency C−Section: ?
...
Emergency C−Section: Yes
...
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
...
½ = ’0±b¾1"#>"5B#>K1"+2D
¿)À 7Á ÂÃ7ÄÅNÆÇLÂ)È'ÉÆ7ÊNËÇGÌÊÍÏΑÅÍÇ)Æ7ÅLÄLÐEÑÊÌ7Î
ÒLӑÌÂNÄGÔOÊÍÏÕÌ7Î×ÖÄÇ2ÔOÅÉ)Ø7ÅLÄ×ÙÍØÄÊ7ÉLÂ)ȑÌ7Î¥ÑÊÌ7Î
Ú7ÊÍ)Ã7ÄÅ7ÉNÅ̑Ø7ÊNØÇLÂ)ÌÛÊNØÜÊLÎbԣǑɑɑÇLÂ)Ì
ÖLÝÅÌßÞÄ7Â)ÓÊÓ'ÇLÍÇGؑЇÂNÀ×à)ÔOÅNÄLË7ÅÌ'á)ÐÜâ7ãLä‘Å7á)ØÇLÂ)ÌÛÇ‘Éæå¥çè
é Æ7ÅLÄרÄÊ7ÇGÌ'ÇGÌËÜÎÊNØ7Ê¥êÕ‘è‘ëì£íïîðçè‘ñœÑ
é Æ7ÅLÄר7Å7É)ØßÎÊNØ7Ê¥êòíbÕëNՑåßîóç6è‘å
Ž—N2£D
*¯L°‘±"²/;')($2(*#>"9=N#>5+2³"5"+$9#>?%<
;#>2%')'9)'5?#>(M
´0B;(M,2(*#$b9=#5:9=N($+µ‘±G¶”’·"(MK#>"+
!"#$B($=F;#$"5,9(9D
•E1,N+$+$"+*=’¸’·K(MK#$ ;(M"($+-(%P#$,+>HF’s=N#
´E@F2#>%2'9B•E"+$#$" "9(M=N
¹
Elective C−Section: no
ô
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
‰ Šyæºæ ­7® ƒ ­ ­
ï } ‰ ‰ Š … !0
‰ #"
¬ ­
•EK'+M(M=N@<2#;K#>N+$?O2G—‘=#"D
› )(>D
...
Customer103: (time=t0)
Customer103: (time=t0)
Customer103: (time=t1)
Years of credit: 9
Loan balance: $2,400
Years of credit: 9
Loan balance: $3,250
Years of credit: 9
Loan balance: $4,500
Income: $52k
Own House: Yes
Income: ?
Income: ?
Own House: Yes
Own House: Yes
Other delinquent accts: 2
Other delinquent accts: 2
Other delinquent accts: 3
Max billing cycles late: 3
Max billing cycles late: 4
Max billing cycles late: 6
Profitable customer?: ?
Profitable customer?: ?
Profitable customer?: No
...
...
...
Customer103: (time=tn)
Customer103: (time=tn)
Sex: M
Age: 53
Income: $50k
Own House: Yes
Sex: M
Age: 53
Income: $50k
Own House: Yes
MS Products: Word
Computer: 386 PC
MS Products: Word
Computer: Pentium
MS Products: Word
Computer: Pentium
Purchase Excel?: ?
Purchase Excel?: ?
Purchase Excel?: Yes
...
...
...
Customer103: (time=t0)
Sex: M
Age: 53
Income: $50k
Own House: Yes
Checking: $5k
Customer103: (time=t1)
...
Customer103: (time=tn)
Sex: M
Age: 53
Income: $50k
Own House: Yes
Sex: M
Age: 53
Income: $50k
Own House: Yes
Checking: $20k
Checking: $0
Savings: $15k
Savings: $0
Savings: $0
Current−customer?:
...
yes
Current−customer?:
yes
...
Current−customer?: No
#$=9"+>+=N;($@F¦"(M=N£D
$
Product72:
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
...
Customer103: (time=t1)
Sex: M
Age: 53
Income: $50k
Own House: Yes
•EK'+M(M=N@<2##$"(M2(M=N£D
Œ*K1"+*1"#$"5B’·#$=N@ +$‘(M"+$¦2"55)(>D
¿)À é ØLÝÅLÄ7ã 7Å͑ÇGÌNÈÅÌØãÒ'á‘áLÂ)ȑÌ7ØÉ
×՜эÊÌ7Î
ÁNÈÔÓÅLÄ7ã 7őÍÇGÌ NÈÅÌØã ÇL͑ÍÇ)ÌËãNâLÐ'áLÍLÅ7
É í
ÖLÝÅÌßÞÄ7ÂNÀÇ)Ø7ÊÓÍNÅãNâNÈ'É)ØÂ"ÔOÅ‘Ä ÏîßÁÂ
7ÅÌÐßâ‘ÄÅLÎÇ)ØÜâÊLđÎßÊÑÃÍǑáNÊNØÇLÂ)Ì ¿)À é ØLÝÅLÄ7ã 7Å͑ÇGÌ NÈÅÌØãÒ'á‘áLÂ)ȑÌ7ØÉ×îßåœÑÊÌ7Î
¿bÌ'áLÂ"ÔO
Å Lñ‘å é őÊLÄÉLã‘ÂNÀ7ãNâ‘ÄÅLÎÇ)Øæñ
ÖLÝÅÌßÞÄ7ÂNÀÇ)Ø7ÊÓÍNÅãNâNÈ'É)ØÂ"ÔOÅ‘Ä Ïî Å7É
Òá‘áNÅÃØÜâ‘ÄÅLÎÇ)ØßâÊLÄLÎÜÊ)ÑÃÍǑáNÊNØÇLÂ)Ì $
(time=t0)
Product72:
(time=t1)
...
Product72:
(time=tn)
Stage: mix
Stage: cook
Stage: cool
Mixing−speed: 60rpm
Viscosity: 1.3
Temperature: 325
Viscosity: 3.2
Fan−speed: medium
Viscosity: 1.3
Fat content: 15%
Fat content: 12%
Fat content: 12%
Density: 2.8
Spectral peak: 2800
Density: 1.1
Spectral peak: 3200
Density: 1.2
Spectral peak: 3100
Product underweight?: ??
Product underweight?: ??
Product underweight?: Yes
...
...
...
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
%
12435
#>=?12@<+ ™ =‘=/›Š'&š9K1(*($= $ ># =%N#)@ ?)(Š5
ƒE‰ }ƒ ò ­ ¬ !6–
­ 87 ­ ‰
A*,+ §§.- $ =@<2#$1,")K/–5#$—N"+°0/@F;=:%N.€b+
Sharp
Left
Straight
Ahead
Sharp
Right
30 Output
Units
4 Hidden
Units
30x32 Sensor
Input Retina
{
($(M;£D:99G...<; .,+$2.,#$;u9=@
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
=
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
|~} ‰ ­ } ­ ƒ º¼
¸6
ƒ €æ«Ï ­7… ª $
­
™ = 5b'D¥($;:=’(M ,92?'2#>%
“#+M(M3 %N2"#>(M=N1%N=#>(M@<+2D¥2K#>1£2(>+9³
57"9,+$=P(M#>2"+9³'#>2%N#$"+>+M=N ; ; ;
*A-;;1"5:($=/.021143 ’·=#>@š)($"55($?N+$
˜€K557%F5K+M($#$
½ ;;O=N#$(MK(6š’·=#-(M=N@F=N#>#$=G. D2=N#$@<=NK+0@<;N9(
!"#$:N9#$=L+>+€’sK11!@<4C"53y@F"5,5)(>
!"#$:N9#$=L+>+@K1(M;1,¡(M2#>1!5($?N+M"+2³;1K'+
(M .02?P)'52.*+M’s2"5+
!"#$B?N9(M—N¡9C;'2#>@<2($(M=N
!"#$:5"9,+M=N+#>(M2#*(M'):;#$"5,9(M=N+
•EK@/K1,(M—N³14’s21X=%<1,")#>%
$ #$=N%#@F@F%ˆ1X)%K')%N"+*.*(M1"#>%
2@?O"55"5'&
*A-#>(M48O9,)1¸(M211,%N29
˜bN"+MX):@<2(M=5+
•E=N@F;K($(M=N')1!9=N@<;19C(6B($2=N#$
•E=N(M#>=1£($2=N#$
+67’·=#>@š)($=:($2=N#$
$ 1=L+M=N;
$ +M=N1=N%B52K#$=N?=1=N%N
‘($($,+M(M,"+
z
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
|~}ƒ ­ } †
ƒE‰ Š‹
Q
‰ #"Š6
¬ †
ƒE‰ Š‹ !"#$%
+6@<;#>=G—‘%.($9C;'2#>29/)(-+M=N@F($N+>H
+6@<;#$=)—=)—2#(>+>H г
.(MP#$"+$;'"9(-(M=F;'2#$’s=N#$@š9Š@<"+$K#> ˆ³
?N+M"5=N:9C;O2#$2'9 ;
´ ; % ;,³!"#$B($=F;1,b"IH)2#+
ŠD $ 1,bBbH2#>+
ˆD =’“%L@F"+0.0=N::.0=N#$1X5B(M=NK#>@F2(
/D=N;;O=#>(MK(6B(M=F;1,G)%L+$(-+M214’
QQ
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
ƒ!
} …O® ‰­
ŠD $ 1,bBbH2#>+
ˆD $ 2#92(=’“%L@F"+0.0=N::.0=N#>1,5B(M=NK#>@F2(
')(*9C;'2#>29G&
')(*9C79($1+M=K1,5B?O 1")#>"5O&
(=).Ï+M')11–(-?'¡#>2;#>"+M2($"5'&
')(-+M;O"948'”1%N=#>(M@»($=/1"#$P(&
Qu¨
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
© ª 3
© ‰ƒ MM‹ ª ‰ 6
¸ … }
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
­­ "Š6
ð«×
#"¡6!0
E 3
‰ © ƒ¥‰ ‹¥
!$ …&%
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
;;;
Qô
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
}
2
­ º¼
ªŠ‰ ­ ¸€ ƒ !0
Š … 0
4’('-,+-8')1£?O=N#5:+M(>)($ (M(*,+-.0=–³(M2
*)+'-, ܱ 00
4(’ '-,+-8')1£?O=N#5:+M(>)($ (M(*,+-1=L+M(9³O(M2
*)+'-, . ± 00
4(’ '-,+-8')1£?O=N#5:+M(>)($ (M(*,+57#b.–³($2
*)+'-, 0
4(’ '-,+-/=N(*”8'1!+M(>)($¡:(M %N@<³(M2
*)+'-, /*)+'102,>³.2#$ '107,+-(M ?O"+M(*81£?O=N#5
+M(>)($¡(M(*2:?O¡,2—"5P+M($#>(M%F’·#$=N
@ ')'5
;1,G‘%<=;(M@š)11:K(M1–($¡25B=)’(M¡%L@F;
™ ,+*%N—b+-9=N#$#>"9(—G1K"+2³'?K(,+*=(*=;O2#)($=')1
Q
­ } © ƒE‰ ‹E
–Š … !0
D
/Ÿ
&G&
D F
Ÿ ! &G&
›,#$"9(*=N#'57#>"9(&
™ "N2#=N#*=N(I&
Aß;#$=N?12@Dœ,+*(M#>,%š9C;'2#>29”#>2;#>"+M2(>)($—N¡=)’
;O2#M’·=#>@<9Š%N=L)1i&
Qu¹
2
3
‰ © ƒE‰ ‹E
–
*9=1,1"9(M,=NP=’“#>K1"+I&
2K#1£2(6.0=N#>HB&
;'=N1‘=N@<,)1!’sK'9(M=N=’“?O=L)#5š’s"(MK#$"+I&
Q%
;;;
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
º¼
ª‰ ­ ¸ ƒ !0
E
' ) '-,
)+'-,
3
‰ †ˆ
ƒ¥‰ …&%
' )',
)+'-,
' )',
"
)+'-,
>D¥K@?O2#€=’“?1,NIHš;"9"+-=B?O=L)#5
D¥K@/?'2#€=’“#>"5B;"2"+*=N
DœK@/?'2#€=’“?1,IHHL%L+-=
>DEK@?O2#0=’“#$"5HL%L+*=N
>DEK@/?'2#0=’“#>"5B;"9"+-(M#>"(M2"5?<?1,NH
' ) '-,
'
)+'-,
'
' )+'-,
'
#)+'-,
'
' )+'-,
s) ; ;X³'.,2:?O ($NH)2P=B?1,NH¢ +-9C(-(MK#>&,
) '->, D¥K@?O2#€=)’?1,NIHš;"9"+*($#>")($2"5B?š#>"5
Qu{
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
}
2
ƒ Š‹ © ‰ƒ Š‹ ƒ¥¬ ª 6
­
*)+'-,D¥(MŠ($#$K ($#$%N2(’·K9($=
* )+'-,D¥(M 1"#>"5B’·K9($=N
!#"%$'&)+'-,D¥(M¡(M#>%<—G1K
½ #>K1Š’s=N#*"+$(M@š(M%<(M#%š—G1K"+9D
!#"%$'& )+'-,)( )#*,+.-- )+'-, ,
Q=
­ | ¸‹ } © ŠM‹¤ºæŠ6
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
«×
­ 6‹0
/1032543687:9.;=<?>A@CBED<F6HG>AI:6KJ
Determine Type
of Training Experience
›Š=#$2;O"(M"51'D
‘21"9((M#%š9C7@<;1')(#57=N@
± ;N•E=N@F;K(M ) '-,>D
Games against
experts
)+'-, / '#"$ & )+'-, .L )+'-,
) '-,
-,+-+$=@<Š+M@š11!9='+M(>)(2³'+$G 0;,±N³(M=F@F=52#>(M
#>($Š=’“1"#>%
Games against
self
...
Table of correct
moves
Determine
Target Function
µ ; =N#*"NB?'=L#>5B’s"(MK#>NM $ ³K;O5)($ .02%(O $ D
$=(P$8Q-1RMS$T
} 0 … ­
Board
➝ move
...
Board
➝ value
Determine Representation
of Learned Function
($
Polynomial
...
Linear function
of six features
Artificial neural
network
Determine
Learning Algorithm
Gradient
descent
Linear
programming
...
Completed Design
Quz
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
¨
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{
12
¬ ­­ ­ „ƒE…O} M
‡†ˆ
ƒE‰ ‹
')(-)1%N=N#$($@š+-2;;#>=bC@š(M’sK9(M=N+-.0211
)·5B.*2& ,$&
(=).Ï57=‘"+K@?O2#€=’“(M#)%<9C7@F;1"+7'K29
22K#>N9&
(=).Ï57=‘"+*9=N@<;19C(6B=’“‘;O=N(M"+$,+
#$2;#$"+$2($(M=N@<;N9((I&
(=).Ï57=‘"+=,+$B5($/7'K29”N29K#N9&
')(-)#> (M ($2=N#$2($,2)1“1@F(>+-=’“1"#>?1(&
(=).Ï2);#$=N#HN=G.1b57%N¡=)’1")#>2#-21;O&
')(-91K"+2):.0 %N2(€’·#$=N@ ?=1=N%N,2)1“1")#>%
+M+$(M2@š+&
(=).Ï2)P+M+$(M2@š+1(M2#-($2#=G.
#$2;#$"+$2($(M=N+I&
¨XQ
R S T U VXW S9Y R Z [XS YM\ ],WU S ^XU _X]X],`ba)cd e,f gihIjkh cl gif g,mn,o>piq)Z U T r,S R nsq)TutIW vuwx$Z R nyQuzz{