Invited talk
!"#"
!"#"
$
$
%
&
'
%
Main principles
and early works
%
(
)
DSC: Separate compression and joint
decompression of multiple correlated sources
#*+,. //
#*+0-.
1 2 3
#***- 5 6 2 /
4
7
(8
$
!""!-%
(
/
9
)
)
'
Information Theory
Video coding
Multimedia streaming
Communications
Multiview/3D video
Computer Science
Wireless sensor networks
Biometrics
Signal Processing
:
;!""
Hyperspectral imaging
#
(<
-!"#")
6
5/
8
$
. /( .) 8
X
=
Encoder
>
RX
Joint Decoder
Y
Encoder
ˆ , Y)
ˆ
(X
RY
RY
H(X,Y)
R X ≥ H ( X | Y );
H(Y)
RY ≥ H (Y | X );
R X + RY ≥ H ( X , Y )
H(Y|X)
H(X|Y)
H(X) H(X,Y)
RX
'
5/
Source X
(
X
.)
^
X
Decoder
Lossless Encoder
Y
RY
RX ≥ H ( X | Y )
H(X,Y)
>2
H(Y)
9
H(Y|X)
H(X|Y)
H(X) H(X,Y)
RX
/
( 5
)
.
?
?
?
3
1 (.1) 8
/
/= '
.
>
/
B
@(= =)A
X
Source X
V(U)
Lossy Encoding
Decoding
X̂
Y
% &
C
/
<
=
/ C
>
C
&
(& )
(9
? G
? 3
? '
E++ >
D
/
D5
.1
.
4
&
EF")
D . /E+
,
.
:
>
:
. /E+I(
D 1 E+0 E+F
)
E+;(
&
5
&
.
D<
D
:
H
:
(<
.
(' <
>
D5
%
D
'
1
E++
D<
'
EF"
JK
EF+
D9
:
E*+ E";
1
)
-E";
'
:
)
(M
E*+(
E*F(<
9
)
'
EF"
:
)
7
L D JK
(
EF"
DJ
EF"
&
'
)
E",
H EF"
D>
E"#
E";
<
(
:)
H
D.
D8
)
(
)
E+;
(7 7
D&
:)
E"!
D JK
E++( '
< E/
E++
'
E+I E+;(
'
9
)
'
)
)
$
5
? N!""O
P+"
< '
#***
#***!"";
-5/
P#0"
M
?
(
) &
/
*IEEExplore, August 2010
%
!""0!"#"
!""*
&
?
(
<
5
)
?
?$
?
?
/
/
/
/
'
'
/
9
Source X
X
(.
E+I 1
S
Encoder
^
X
Decoder
Y
2
s1=0
-E"!)
s2
s3
s2
Q
?
?
7
( )
3H /7(
/= ( /
/
)
'
)
3
X
Source X
S
Encoder
Decoder
X^
Y
s3
s2
s1
!
Q
x
?
?
%
3 /
R3H
( !)
X
Source X
S
Encoder
Decoder
Correlation Channel
B
x
!
Q
y
?5
?%
/
(
'
Y
s3
s2
s1
/
X^
/
) /3
3
<
?
(
8
)
? J
/
'
3
.
'
/ S
5
/
S
.
?
/
T
/
T
3
.
/
-
8
9
?
3
'
(
/
? 8
3
'
(
(
)
/
(!
'
/
)
$=R(
?
X
)
)4
)
Conventional
systematic channel
encoding
P
Conventional
channel decoder
^
X
Y
Correlation Channel
(Garcia-Frias and Zhao 2001)
9
10
%
-1
/
'
.
RU
parallel
10
10
-2
5
irregular LDPC
10
regular LDPC
B E R for X i
10
10
10
10
-3
10
Wyner-Ziv
limit
4
serial
10
4
10
5
5
-4
irregular
LDPC
-5
10
best
nonsyndrome
turbo
4
Slepian-Wolf
limit
irregular LDPC
threshold
-6
0.36
0.38
(Xiong et al. 2004)
0.4
0.42
0.44
H(X |Y )=H(p) (bits)
i
i
0.46
0.48
0.5
0.52
G
9
'
8
(Stankovic et al. 2006)
!""""
/
.
8
.1
/
G
V
5
?
7
V
7
.
W
(
7
/ '
. /
V
/
( 5 6 #*** !"",)
.
7
. W)
G
W
7
? G
(/ )
(
)
/
/
/
: bin 8
: bin 4
: bin 3
G
W
7
?
3 /
=
W
/
:
7=
3
V
?
Y
/
X
7
/
/
>
9
3
RF
G
W
7
?
3 /
=
W
/
:
7=
3
V
?
Y
/
X
^
X
7
/
/
>
9
3
RF
.
W
? G
V
7
( . W)
7
/
/
/
( -
!""!)
'
3
5>
--H( ) N H( X> )
?
6
X
.
Nested
Quantization
/
V
Slepian-Wolf
Encoding
Y
Slepian-Wolf
Decoding
B
V
Estimation
Y
^
X
.1
-
?
V
1
( . W)
Nested
Quantization
G
V
7
. /
Slepian-Wolf
Coding
V
5
7
'
5
'
C
(
(
Entropy
Coding
Quantization
? .
7
5
/.1
)
W)
<
.1 (G W#
)
1.53dB
<
(Yang et al. 2009)
.1 ('
W)
&
#
G# >#
Z
W
7#
V1
6
SW Encoder I
B
R1
=
V1
SW Decoder
G! >!
Z
W
B
Estimator
V2
R2
7 ! V2 SW Encoder II
!
V
T
V1 and V2
(>
=
1
7
Z
. /
5
5/
-
S
/V
&
!""F)
7
B
=
<
&
&
#R !R
," 9 ρR"**
('
5
&
W)
R !!;F 9 σ #Rσ !R#4
**
? $
? G
? G
4
4
%
(
H /
/
?
? $
/
)
/
/'
)
(
&
?
?
?
?
?
?
?
/
'
$
$
M
6
3
J
Wireless Sensor
Networks
Image/video
compression
Other
(>1000 publications)
Security
X
Source X
Decoder
Encoder
Y
Y
=
/
/
/
/
>
>
8
8
(
?H
? '
^
X
/
3
3
)
(
(
(
/
)
)
)
=
(
(.
X
Source X
=
D.
)
[F")
^
X
Decoder
Encoder
/
/
=
Y
/
>
?
? '
?H
? '
3
3
3
(
(
'
' 5>
'
)
)
(
H!0I)
Video
streaming
Scalability
.
DVC
low enc complexity
D.
Error
robustness/
protection
[F"
Multiview
video
83
/
Scalar
Quantizer
Video Frame
X=X2i
q2i
Turbo encoding p2i
for SW coding
WZ encoder
Y2i
K=X2i-1
Intraframe
encoding
Key Frame
H!03
(
(
1
$
<
1
!""!)
<
!"",)
Turbo decoder &
Estimation
Intraframe
decoding
^
X
2i-1
X^2i+1
Interpolation
^
X2i
$
(=
=
!""+)
At very low rate
H.264
Video Encoder
9
$
DCT
SQ
IRA
LT
Error resilient
Wyner-Ziv Encoder
H.264
Video Decoder
Erasure Channel
3
Base Layer
>
Raptor
Decoder
Estimation
Wyner-Ziv Decoder
3B
(=
=
3!""+)
!;0J
;\
#"\
/ .1
H.264
Scalable DVC system
?
8 /
/
( -Z
5 : $
?
5
?
G
?
?
/
/
5
/ /
)
H!0I4
?
?
'
H
3
'
'
'
&
Camera 1
Camera 2
MT
MT
Encoder
Encoder22
Base
Base
station
station
MT
MT
Encoder
Encoder11
'
(>
H!0I4
=
1
5
5
8E"*)
V
4
?
'
'
3
'
'
&
'4
,
?
?
'
'
4
V
?
? 5
C
/
9
/8
(98) /
3
Without correlation tracking
With correlation tracking
:
?H
(
!""0
?.
?9
?5
?
-
-!"#")
($
D
!""*)
(&
)
(9
)
(
!""*)
D
? :
/
? 5
'
/
5
4
4
? 6/
?
?
/
H!0I4
. G
/
'
/
? $
%
? &
? G
$
'
It is not just that DSC is so elegant that we
can’t let it go…