Documente Academic
Documente Profesional
Documente Cultură
and Coding
By
Prof. Budhaditya Bhattacharyya
http://historycomputer.com/ModernComputer/thinkers/Shannon.html
2.
3.
4.
Channel
Destination
Source
Encoder
Source
Decoder
Channel
Encoder
Channel
Decoder
Channel
The theoretical communication between
source and destination
The Practical communication between
source and destination
Channel
Destination
Source
Encoder
Source
Decoder
Channel
Encoder
Channel
Decoder
Channel
A specific Example:
State
Information
Binary
levels
SUNNY
00
RAINY
01
CLOUDY
10
FOGGY
11
State
Information
Binary
levels
1/8
SUNNY
1110
1/8
RAINY
110
CLOUDY
10
1/2
SMOGGY
State
Information
Binary
levels
1/8
SUNNY
1110
01
1/8
RAINY
110
CLOUDY
10
CLOUDY
10
FOGGY
11
1/2
SMOGGY
Probability
State
Information
Binary Probability
levels
SUNNY
00
RAINY
The basic reason behind the change of coding is COST. This can be
achieved by efficient transmission of the same information using lower
or lesser number of bits/ message/second (Lavg)
State
Information
Binary
levels
1/8
SUNNY
1110
01
1/8
RAINY
110
CLOUDY
10
CLOUDY
10
FOGGY
11
1/2
SMOGGY
Probability
State
Information
Binary Probability
levels
SUNNY
00
RAINY