9/16/2013

Information Theory and Coding

ECE533

Overview
Modulation: BPSK, 8PSK, QPSK Constellation diagram
Limits and Performance of Channel: BER

jaj
Shannon and Nyquist Theorems
Foundation for Error Correcting AWGN and BSC Channel Models

Nikesh Bajaj
nikesh.14730@lpu.co.in
Digital Signal Processing, ECE Dept.
Lovely Professional University 2 By Nikesh Bajaj

Communication System Ba Information

Other
Sources
Source

Multiplexing
Formatting

Modulation
Source
Encoding

Freq.
Spreading

Synchronization
Encryption

Multiple
Access
Channel
Encoding

Tx

Channel
sh
Other
Sources

Freq. Multiple
Demultiplexing Demodulation Rx
Spreading Access

Information Source Channel

Formatting Decryption
Sink Decoding Decoding

3 By Nikesh Bajaj 4 By Nikesh Bajaj

ke

Modulation Digital Modulation

Ni

Analog Modulation? ASK, FSK, PSK, QPSK, 8-PSK, MSK

Digital Modulation? How it is done
ASK, PSK, FSK Why we need it
BPSK Which is better in terms of
Constellation of BPSK, 8-PSK BW Required
Performance (BER)
Circuit /HW/Requirement
M-ary?
Why it is required, Advantages, limitation,
5 By Nikesh Bajaj 6 By Nikesh Bajaj

1
 9/16/2013

BPSK BPSK

jaj
7 By Nikesh Bajaj 8 By Nikesh Bajaj

8-PSK
More General
Ba QPSK
sh
9 By Nikesh Bajaj 10 By Nikesh Bajaj
ke

BER vs SNR BER vs SNR

Ni

11 By Nikesh Bajaj 12 By Nikesh Bajaj

2
 9/16/2013

Eo/No with M-ary signals Eo/No with M-ary signals

What is M-ary Modulation??

jaj
Orthogonal signaling Multiple phase signaling

13 By Nikesh Bajaj 14 By Nikesh Bajaj

BER Vs Eb/N0 & Modulation

You should now

Know, How BER is computed
Know, How Eb/N0 effects BER
Able to read BER Vs Eb/N0 Graph
Ba Limits and Bounds
Shannons Theorem
sh

Able to make sense of each point and curve in graph

Able to understand which better

Reference: TODD K MOON book Nikesh Bajaj

nikesh.14730@lpu.co.in
Asst. Prof., ECE Dept.
15 By Nikesh Bajaj Lovely Professional University
ke

Goals of Comm. Engineer Constrain to achieve goals

Ni

Rb Nyquist theoretical minimum BW requirement

Shannon-Hartley capacity theorem- Shannon Limit
BER Government Regulations (e.g. Freq. allocations)
Required power or Eb/No Technological Limitations (e.g. State-of the-art
components)
Required BW
Other system requirements
System utilization
System Complexity

17 By Nikesh Bajaj 18 By Nikesh Bajaj

3
 9/16/2013

Nyquist Bandwidth Nyquist Bandwidth

Theoretical minimum bandwidth required for the Relation between BW and Rs
baseband transmission of Rs symbol per second without
Rs

jaj
ISI is Rs/2 BWmin
2
Rs
BWmin
2 Relation between BW and Bit rate ???
Number of bits per sample??
Example: For transmitting 2000 symbols per second M-ary modulation, M levels
minimum BW required is 1Khz k= log2 M, bits per symbol
This is Basic theoretical constrain. Bit rate R = kRs
2 symbol per second per Hz
Practically 1.8 to 1.4 symbols/s/Hz due to non ideal filters
R R R

Rs BWmin
19 By Nikesh Bajaj 20 k log 2 M 2 log 2 M By Nikesh Bajaj

Nyquist Bandwidth

BWmin
R
2 log 2 M
Ba Shannons Capacity Theorem
The cannel capacity C is the function of the average
received signal power S, average noise power N and
bandwidth W
Shannon-Hartley Capacity Theorem
Not in dB, it is
ratio
sh
S
C W log 2 1
N
Example: for 8-ary PSK system and 9.6kbps bit rate the
minimum BW required is =? Theoretically it is possible to transit the information over
For 4-ary PSK channel at rate R, R C with small probability of error by
For 16-ary PSK using complex coding.
But at rate R>C, it is not possible.
21 By Nikesh Bajaj 22 By Nikesh Bajaj
ke

Questions Shannons Capacity Theorem

Ni

If the SNR is 20 dB, and the bandwidth available is 4 kHz, This shows that S, N, and W limits the Transmission rate,
which is appropriate for telephone communications. not the error probability
Compute Capacity C.
If the requirement is to transmit at 50 kbit/s, and a N NoW
bandwidth of 1 MHz is used, then the minimum S/N Normalized channel capacity
required is ?
C S
Example. log 2 1 bits/s/Hz
Lets take the example of W-CDMA (Wideband Code Division Multiple Access), the W NoW
bandwidth = 5 MHz, you want to carry 12.2 kbit/s of data (AMR voice), then the
required SNR is given by 212.2/5000 1 corresponding to an SNR of 27.7 dB for a single Normalized channel bandwidth
channel. This shows that it is possible to transmit using signals which are actually much
weaker than the background noise level, as in spread-spectrum communications. W S
However, in W-CDMA the required SNR will vary based on design calculations. log 2 1 Hz/bits/s
C NoW
23 By Nikesh Bajaj 24 By Nikesh Bajaj

4
 9/16/2013

Graphical representation
C S W S
log 2 1 log 2 1

W NoW
C NoW
Shannons Capacity Theorem
If R=C
S E S ER
b

jaj
b No No
NoC No

C E C
log 2 1 b
W No W
C Eb C
2 W
1
No W
Eb W C W
2 1
No C
25 By Nikesh Bajaj 26 By Nikesh Bajaj

Shannons Limit

C
W


E C
log 2 1 b
Ba
No W

NO Error-Free communication at any information rate

.

There is limiting value of Eb/No, below which there can be

Shannon Limit
Shannons limit (Value of Eb/No)
sh
27 By Nikesh Bajaj 28 By Nikesh Bajaj
ke

Shannons Limit Noisy Channel Coding Theorem

Ni

Information rate H/Ts

Capacity C bits per use of channel
Noisy Channel Coding Theorem
1 H(X ) C
Ts Tc

H(X ) C

2 Ts Tc C/TCritical Rate

29 By Nikesh Bajaj 30 By Nikesh Bajaj

5
 9/16/2013

Summary Binary Symmetric Channel-BSC

Nyquist limit Noisy Channel Theorem
R

jaj
H(X ) C
BWmin
2 log 2 M Ts Tc

H(X ) C
Shannons theorem Ts

Tc
C S
log 2 1
W NoW

Shannons Limit
31 By Nikesh Bajaj 32 By Nikesh Bajaj

Ba
sh
33 By Nikesh Bajaj
ke
Ni