7ZR*UHDW6RUWLQJ$OJRULWKPV
/HFWXUH4XLFNVRUW0HUJHVRUW
7ZRJUHDWVRUWLQJDOJRULWKPV
■
■
■
)XOOVFLHQWLILFXQGHUVWDQGLQJRIWKHLUSURSHUWLHVKDVHQDEOHGXV WR
KDPPHUWKHPLQWRSUDFWLFDOV\VWHPVRUWV
2FFXSLHVDSURPLQHQWSODFHLQZRUOG
VFRPSXWDWLRQDOLQIUDVWUXFWXUH
² GDWDEDVHVHDUFK
² FRPSXWDWLRQDOJHRPHWU\
² ILQGLQJUHSHWLWLRQLQ'1$VHTXHQFHV
² %XUURZV:KHHOHUWUDQVIRUP
0HUJHVRUW
■
-DYDV\VWHPVRUW
4XLFNVRUW
■
■
8QL[V\VWHPVRUW
&VWDQGDUGOLEUDU\IXQFWLRQLVHYHQQDPHGTVRUW
(VWLPDWLQJWKH5XQQLQJ7LPH
(VWLPDWLQJWKH5XQQLQJ7LPH
7RWDOUXQQLQJWLPHLVVXPRIFRVWIUHTXHQF\IRUDOORIWKHEDVLFRSV
■
■
$QHDVLHUDOWHUQDWLYH
&RVWGHSHQGVRQPDFKLQHFRPSLOHU
L$QDO\]HDV\PSWRWLFJURZWKDVDIXQFWLRQRILQSXWVL]H1
)UHTXHQF\GHSHQGVRQDOJRULWKPLQSXW
LL)RUPHGLXP1UXQDQGPHDVXUHWLPH
LLL)RUODUJH1XVHLDQGLLWRSUHGLFWWLPH
)RUVRUWLQJ
■
■
■
■
$ UHFXUVLYHFDOOV
$V\PSWRWLFJURZWKUDWHV
% H[FKDQJHV
■
& FRPSDULVRQV
(VWLPDWHDVDIXQFWLRQRILQSXWVL]H1
² 11ORJ11 1 1
&RVWRQDW\SLFDOPDFKLQH $%&
■
1
,JQRUHORZHURUGHUWHUPVDQGOHDGLQJFRHIILFLHQWV
² ([1 1 LVDV\PSWRWLFDOO\SURSRUWLRQDOWR1
,QVHUWLRQVRUWLVTXDGUDWLF2QDUL]RQDVHFRQGIRU1 ■
■
'RQDOG.QXWK
■
■
+RZORQJIRU1 "
VHFRQGVWLPHVDVORQJ
1 PLOOLRQ"
KRXUVDQRWKHUIDFWRURI
1 ELOOLRQ"
\HDUVDQRWKHUIDFWRURI 1 WULOOLRQ"
:K\'RHV,W0DWWHU"
6HFRQGV
(TXLYDOHQW
1
VHFRQG
PVHF
PVHF
VHFRQGV
VHFRQG
PVHF
PVHF
PLQXWHV
GD\V
PLQXWHV
PVHF
PVHF
PLQXWHV
PLOOLRQ
\HDUV
KRXUV
VHFRQGV
PVHF
KRXUV
PLOOLRQ
PLOOHQQLD
ZHHNV
VHFRQGV
VHFRQGV
GD\V
VHFRQG
PLOOLRQ
PLOOLRQ
PLQXWH
PLOOLRQ
ELOOLRQ
KRXU
WULOOLRQ
WULOOLRQ
GD\
PLOOLRQ
WULOOLRQ
WULOOLRQ
5XQWLPHLQ
QDQRVHFRQGV!
7LPHWR
VROYHD
SUREOHP
RIVL]H
0D[VL]H
SUREOHP
VROYHG
LQRQH
2UGHUVRI0DJQLWXGH
1
1
1ORJ1
VHFRQGV
PVHF
PLQXWHV
1PXOWLSOLHGE\
WLPHPXOWLSOLHGE\
ZHHNV
PRQWKV
\HDUV
GHFDGHV
FHQWXULHV
IRUHYHU
DJHRI
XQLYHUVH
,PSHULDO
8QLWV
([DPSOH
LQGHFDGH
&RQWLQHQWDOGULIW
IW\HDU
+DLUJURZLQJ
LQGD\
*ODFLHU
IWKRXU
*DVWURLQWHVWLQDOWUDFW
IWPLQXWH
$QW
PLKRXU
+XPDQZDON
PLKRXU
3URSHOOHUDLUSODQH
PLPLQ
6SDFHVKXWWOH
PLVHF
(DUWKLQJDODFWLFRUELW
PLVHF
VSHHGRIOLJKW
0HWHUV3HU
6HFRQG
3RZHUV
RI
ELOOLRQ
'LYLGHDUUD\LQWRWZRKDOYHV
Θ1 PHDQV^1 1 1 1 1`
² LJQRUHORZHURUGHUWHUPVDQGOHDGLQJFRHIILFLHQWV
21 PHDQV^1 1 1 1
² Θ1 DQGIDVWHU
² XVHIRUXSSHUERXQGV
11 1`
Ω1 PHDQV^1 1 1 1
² Θ1 DQGVORZHU
² XVHIRUORZHUERXQGV
11 1 `
-RQYRQ1HXPDQQ
■
0HUJHVRUWGLYLGHDQGFRQTXHU
■
■
PLOOLRQ
0HUJHVRUW
Θ2DQGΩ QRWDWLRQ
■
WKRXVDQG
%LJ2K1RWDWLRQ
A
L
G
O
R
I
T
H
M
S
A
L
G
O
R
I
T
H
M
S
GLYLGH
0HUJHVRUW
0HUJHVRUW
0HUJHVRUWGLYLGHDQGFRQTXHU
■
■
0HUJHVRUWGLYLGHDQGFRQTXHU
'LYLGHDUUD\LQWRWZRKDOYHV
■
5HFXUVLYHO\VRUWHDFKKDOI
■
■
A
L
G
O
R
I
T
H
M
'LYLGHDUUD\LQWRWZRKDOYHV
5HFXUVLYHO\VRUWHDFKKDOI
0HUJHWZRKDOYHVWRPDNHVRUWHGZKROH
S
A
L
G
O
R
I
T
H
M
S
A
L
G
O
R
I
T
H
M
S
GLYLGH
A
L
G
O
R
I
T
H
M
S
GLYLGH
A
G
L
O
R
H
I
M
S
T
VRUW
A
G
L
O
R
H
I
M
S
T
VRUW
A
G
H
I
L
M
O
R
S
PHUJH
T
0HUJHVRUW$QDO\VLV
3URRIE\3LFWXUHRI5HFXUVLRQ7UHH
0
if N = 1


T( N ) =  2T ( N / 2) + {
otherwise
N
1424
3
sorting
both halves merging
+RZORQJGRHVPHUJHVRUWWDNH"
■
■
%RWWOHQHFN PHUJLQJDQGFRS\LQJ
² PHUJLQJWZRILOHVRIVL]H1UHTXLUHV1FRPSDULVRQV
71 FRPSDULVRQVWRPHUJHVRUW1HOHPHQWV
² WRPDNHDQDO\VLVFOHDQHUDVVXPH1LVDSRZHURI
1
71
0
if N = 1


T( N ) =  2T ( N / 2) + {
otherwise
N
1424
3
sorting
both halves merging
71
1
71
71
71
71
71
ORJ1
&ODLP 71 1ORJ 1
■
■
N
1
1 N
71 1RWHVDPHQXPEHURIFRPSDULVRQVIRU$1<ILOH
² HYHQDOUHDG\VRUWHG
N
:H
OOJLYHVHYHUDOSURRIVWRLOOXVWUDWHVWDQGDUGWHFKQLTXHV
7
7
7
7
7
7
7
7
1 1 ORJ 1
3URRIE\7HOHVFRSLQJ
0DWKHPDWLFDO,QGXFWLRQ
&ODLP 71 1ORJ 1ZKHQ1LVDSRZHURI
0DWKHPDWLFDOLQGXFWLRQ
■
0
if N = 1


T( N ) =  2T ( N / 2) + {
N
otherwise
1424
3
sorting
both halves merging
3URRI)RU1!
T(N )
=
N
2T ( N / 2)
N
+ 1
=
T ( N / 2)
N /2
+ 1
=
T ( N / 4)
N /4
+ 1 + 1
=
T(N / N )
N/N
+ 1 +L+ 1
14243
=
log 2 N
L
■
3RZHUIXODQGJHQHUDOSURRIWHFKQLTXHLQGLVFUHWHPDWKHPDWLFV
7RSURYHDWKHRUHPWUXHIRUDOOLQWHJHUVN≥ ² %DVHFDVHSURYHLWWREHWUXHIRU1 ² ,QGXFWLRQK\SRWKHVLVDVVXPLQJLWLVWUXHIRUDUELWUDU\1
² ,QGXFWLRQVWHSVKRZLWLVWUXHIRU1
&ODLP 1 11IRUDOO1≥ 3URRI E\PDWKHPDWLFDOLQGXFWLRQ
■
■
■
%DVHFDVH1 ² ,QGXFWLRQK\SRWKHVLVDVVXPH1 11 ,QGXFWLRQVWHS11
11
111
11
log 2 N
3URRIE\,QGXFWLRQ
3URRIE\,QGXFWLRQ
&ODLP 71 1ORJ 1DVVXPLQJ1LVDSRZHURI
:KDWLI1LVQRWDSRZHURI"
0
if N = 1


T( N ) =  2T ( N / 2) + {
N
otherwise
1424
3
sorting
both halves merging
■
71VDWLVILHVIROORZLQJUHFXUUHQFH
if N = 1
0

T( N ) =  T (  N / 2  ) + T (  N / 2 ) + N
otherwise
{
4243 14243
 1
merging
solve left half
solve right half
3URRI E\LQGXFWLRQRQ1
■
%DVHFDVH1 ■
,QGXFWLYHK\SRWKHVLV71 1ORJ 1
■
*RDOVKRZWKDW71 1ORJ 1
&ODLP
3URRI
71≤ 1 ORJ 1
6HHVXSSOHPHQWDOVOLGHV
T ( 2 N ) = 2T ( N ) + 2 N
= 2 N log 2 N + 2 N
= 2 N (log 2 ( 2 N ) − 1) + 2 N
= 2 N log 2 ( 2 N )
&RPSXWDWLRQDO&RPSOH[LW\
'HFLVLRQ7UHH
)UDPHZRUNWRVWXG\HIILFLHQF\RIDOJRULWKPV([DPSOH VRUWLQJ
■
D D
<(6
0$&+,1(02'(/ FRXQWIXQGDPHQWDORSHUDWLRQV
² FRXQWQXPEHURIFRPSDULVRQV
12
D D
■
■
■
833(5%281' DOJRULWKPWRVROYHWKHSUREOHPZRUVWFDVH
² 1ORJ 1IURPPHUJHVRUW
D D
<(6
12
SULQW
DDD
/2:(5%281' SURRIWKDWQRDOJRULWKPFDQGREHWWHU
² 1ORJ 1 1ORJ H
<(6
SULQW
DDD
D D
<(6
237,0$/$/*25,7+0ORZHUERXQGaXSSHUERXQG
² PHUJHVRUW
12
D D
12
SULQW
DDD
<(6
SULQW
DDD
12
SULQW
DDD
SULQW
DDD
&RPSDULVRQ%DVHG6RUWLQJ/RZHU%RXQG
6RUWLQJ$QDO\VLV6XPPDU\
7KHRUHP $Q\FRPSDULVRQEDVHGVRUWLQJDOJRULWKPPXVWXVH
Ω1ORJ1FRPSDULVRQV
5XQQLQJWLPHHVWLPDWHV
■
■
3URRI :RUVWFDVHGLFWDWHGE\WUHHKHLJKWK
■
■
■
+RPHSFH[HFXWHV FRPSDULVRQVVHFRQG
6XSHUFRPSXWHUH[HFXWHV FRPSDULVRQVVHFRQG
1GLIIHUHQWRUGHULQJV
,QVHUWLRQ6RUW1 2QHRUPRUHOHDYHVFRUUHVSRQGLQJWRHDFKRUGHULQJ
%LQDU\WUHHZLWK1OHDYHVPXVWKDYHKHLJKW
h
≥ log 2 ( N ! )
≥ log 2 ( N / e ) N
= N log
2
N − N log
0HUJHVRUW1ORJ1
FRPSXWHU
WKRXVDQG
PLOOLRQ
ELOOLRQ
WKRXVDQG
PLOOLRQ
ELOOLRQ
KRPH
LQVWDQW
KRXUV
\HDUV
LQVWDQW
VHF
PLQ
VXSHU
LQVWDQW
VHFRQG
ZHHNV
LQVWDQW
LQVWDQW
LQVWDQW
6WLUOLQJ
VIRUPXOD
2
e
/HVVRQ JRRGDOJRULWKPVDUHEHWWHUWKDQVXSHUFRPSXWHUV
+RZGRHVTXLFNVRUWILWLQWRWKHSLFWXUH"
)RRGIRUWKRXJKW :KDWLIZHGRQ
WXVHFRPSDULVRQV"
! 6WD\WXQHGIRUUDGL[VRUW
4XLFNVRUW
4XLFNVRUW
4XLFNVRUW
■
4XLFNVRUW
3DUWLWLRQDUUD\VRWKDW
² VRPHSDUWLWLRQLQJHOHPHQWa[m] LVLQLWVILQDOSRVLWLRQ
² QRODUJHUHOHPHQWWRWKHOHIWRIm
² QRVPDOOHUHOHPHQWWRWKHULJKWRIm
■
&$5+RDUH
SDUWLWLRQLQJ
HOHPHQW
■
3DUWLWLRQDUUD\VRWKDW
² VRPHSDUWLWLRQLQJHOHPHQWa[m] LVLQLWVILQDOSRVLWLRQ
² QRODUJHUHOHPHQWWRWKHOHIWRIm
² QRVPDOOHUHOHPHQWWRWKHULJKWRIm
6RUWHDFKKDOIUHFXUVLYHO\
SDUWLWLRQLQJ
HOHPHQW
Q
U
I
C
K
S
O
R
T
I
S
C
O
O
L
Q
U
I
C
K
S
O
R
T
I
S
C
O
O
L
I
C
K
I
C
L
Q
U
S
O
R
T
S
O
O
I
C
C
K
I
I
C
K
L
Q
O
U
O
S
O
O
Q
R
T
S
S
O
T
O
U
≤ /
≥ /
6RUWHDFKKDOI
SDUWLWLRQHGDUUD\
4XLFNVRUW:RUVW&DVH
4XLFNVRUW$YHUDJH&DVH
1XPEHURIFRPSDULVRQVLQZRUVWFDVHLVTXDGUDWLF
■
3UHFRQGLWLRQILOHLVUDQGRPO\VKXIIOHGEHIRUHKDQG
111 11
■
([SHFWHGQXPEHURIFRPSDULVRQV
:RUVWFDVHLQSXWV
■
■
■
$OUHDG\VRUWHG
■
5HYHUVHVRUWHG
$OOHTXDO6WD\WXQHG
■
)L[
■
■
2USDUWLWLRQRQ5$1'20HOHPHQW
■
3LFNSDUWLWLRQLQJHOHPHQWDWUDQGRP
5RXJKO\1OQ 1≈ 1ORJ1
² VHHQH[WVOLGHIRUSURRI
PRUHWKDQPHUJHVRUWEXWIDVWHULQSUDFWLFH
² ORZHUFRVWRIRWKHUKLJKIUHTXHQF\LQVWUXFWLRQV
:RUVWFDVHVWLOOSURSRUWLRQDOWR1
² PRUHOLNHO\WKDWPDFKLQHVWUXFNE\OLJKWQLQJ
*XDUDQWHHVJRRGSHUIRUPDQFH
4XLFNVRUW$YHUDJH&DVH
4XLFNVRUW$YHUDJH&DVH
7KHRUHP 7KHDYHUDJHQXPEHURIFRPSDULVRQV&1 WRTXLFNVRUWD
UDQGRPILOHRI1HOHPHQWVLVDERXW1OQ 1
'LYLGHERWKVLGHVE\11WR\LHOGDWHOHVFRSLQJVXP
CN
N +1
7KHSUHFLVHUHFXUUHQFHVDWLVILHV& & DQGIRU1≥ CN
=
N +1+
1
N
=
N +1+
2
N
N
=
k =1
N
=
∑ (C k + C N − k )
∑ C k −1
k =1
0XOWLSO\ERWKVLGHVE\1DQGVXEWUDFWWKHVDPHIRUPXODIRU1
NC
N
− ( N − 1 )C N − 1 = N ( N + 1 ) − ( N − 1 ) N + 2 C N − 1
N
=
M
=
C2
+
3
N
∑
k=3
2
k +1
$SSUR[LPDWHWKHH[DFWDQVZHUE\DQLQWHJUDO
6LPSOLI\WR
NC
C N −1
2
+
N
N +1
C N −2
2
2
+
+
N −1
N
N +1
C N −3
2
2
2
+
+
+
N −2
N −1
N
N +1
=
N
C N +1
≈ ∑
N
k =1
= ( N + 1 ) C N −1 + 2 N
2
k
≈
N
∫
k =1
2
k
= 2 ln N ≈ 1 . 39 log
2
N
4XLFNVRUW,PSURYHPHQWV
6RUWLQJ$QDO\VLV6XPPDU\
0HGLDQRIVDPSOH
■
■
■
■
■
5XQQLQJWLPHHVWLPDWHV
%HVWFKRLFHRISDUWLWLRQLQJHOHPHQW PHGLDQ
■
(VWLPDWHWUXHPHGLDQE\WDNLQJPHGLDQRIVDPSOH
■
■
)(:(5ODUJHILOHV
,QVHUWLRQ6RUW1 6OLJKWO\PRUHH[FKDQJHVRYHUKHDG
&DQGHOD\LQVHUWLRQVRUWXQWLOHQG
WKRXVDQG
PLOOLRQ
ELOOLRQ
WKRXVDQG
PLOOLRQ
ELOOLRQ
KRPH
LQVWDQW
KRXUV
\HDUV
LQVWDQW
VHF
PLQ
VXSHU
LQVWDQW
VHFRQG
ZHHNV
LQVWDQW
LQVWDQW
LQVWDQW
4XLFNVRUW1ORJ1
2SWLPL]HSDUDPHWHUV
■
0HUJHVRUW1ORJ1
FRPSXWHU
(YHQTXLFNVRUWKDVWRRPXFKRYHUKHDGIRUWLQ\ILOHV
'HDOLQJZLWKHTXDONH\V6WD\WXQHGIRUZD\SDUWLWLRQLQJ
■
6XSHUFRPSXWHUH[HFXWHV FRPSDULVRQVVHFRQG
1XPEHURIFRPSDULVRQVFORVHWR1ORJ1
,QVHUWLRQVRUWVPDOOILOHV
■
+RPHSFH[HFXWHV FRPSDULVRQVVHFRQG
WKRXVDQG
PLOOLRQ
LQVWDQW
VHF
ELOOLRQ
PLQ
LQVWDQW
LQVWDQW
LQVWDQW
/HVVRQ JRRGDOJRULWKPVDUHEHWWHUWKDQVXSHUFRPSXWHUV
/HVVRQ JUHDWDOJRULWKPVDUHEHWWHUWKDQJRRGRQHV
0HGLDQRIHOHPHQWV
&XWRIIWRLQVHUWLRQVRUWIRUHOHPHQWV