Shannon’s Information
Measures and
Markov Structures
© Raymond W. Yeung 2014
Institute of Network Coding
The Chinese University of Hong Kong
References
Part I −
Introduction to I-Measure
Preliminaries
An Example
Substitution of Symbols
Substitution of Symbols
___ ___ ______
___ ________
___ ___
___ ___
___ ___
___ ___
___ ___ ______
__ ________
__________ __________ __________ __________
___
__________
______________
___
__________
______________
Construction of the
I-Measure μ*
___
__________
Appendix 3.A
_____________
_______
_______
_____________
_____________
_______
_______
_____________
___
___
___
___
μ* can be Negative
Information Diagrams
____________
____________
____________
e
b
a
d
c
f
g
Information Diagrams for
Markov Chains
Information Diagrams for
Markov Chains
Information Diagrams for
Markov Chains
Information Diagrams for
Markov Chains
0
0
0
0
0
_________