9/5/2013

Overview
Objective of Subject
Speech and Audio Signal Processing Syllabus: overview

jaj

ECE554 Reference books, Papers, Journals

Introduction to subject
Prerequisite Knowledge
Nikesh Bajaj
Review of Basics
nikesh.14730@lpu.co.in
Asst. Prof. DSP, SECE Summary
Lovely Professional University
2 By: Nikesh Bajaj

Syllabus
UNITs

Ba
Unit-1: Mechanics of speech : Speech production: mechanism of
speech production, Acoustic theory of speech production, Models of
speech signal: Lossless tube model, Digital models for speech signals,
UNITs

Syllabus
---------------MTE----------

Unit 4:Analysis Synthesis system for speech signal : Analysis by

Representation of speech waveform: Sampling speech signal, Basics
sh
of quantization, Delta modulation, Differential PCM
Unit 2:Time domain methods for speech processing : Methods for
extracting the parameters- Energy, Average Magnitude, Zero crossing
Rate, Silence Discrimination using ZCR and energy, Short Time Auto
Correlation Function, Pitch period estimation using Auto Correlation
Function
Unit 3:Short Time Fourier analysis for speech analysis : Fourier
transform and linear filtering interpretation, Sampling rates, Pitch and
formant extraction, Spectrographic displays.
3 By: Nikesh Bajaj
ke
synthesis, Pitch synchronous spectrum analysis, Analysis-Synthesis
System, Phase Vocoder, Channel vocoder, Homomorphic speech
analysis: Cepstral analysis of speech, Formant and Pitch estimation,
Homomorphic vocoders
Unit 5: Linear Predictive coding of speech : Auto correlation method,
Covariance Method, Solution of LPC equations: Cholesky method,
Durbin Recursive algorithm
Unit 6: Applications of audio and speech signal processing:
Algorithm: Dynamic timewarping, Gaussian mixture modeling, hidden
Markov modeling, Voice response system: speech synthesis, Speaker
recognition system: speaker verification system, speaker identification
system
4 By: Nikesh Bajaj

Syllabus Objective of Subject

Ni

UNITs ?
Unit-1:Mechanics of speech : with representation
Unit 2:Time domain methods for speech processing ?
Unit 3:Short Time Fourier analysis for speech analysis ?
-----------MTE-------------
Unit 4:Analysis Synthesis system for speech signal
Unit 5:Linear Predictive coding of speech
Unit 6:Applications of audio and speech signal processing

5 By: Nikesh Bajaj 6 By: Nikesh Bajaj

1
 9/5/2013

References CA Evaluation
Text Assignments
L. R. Rabiner and R. W. Schaffer. Digital Processing of Speech signals Edition:
8th Edition, Pearson Publication 1. Assignment +Test (Assignment based)

jaj
Other Books
Marks =30

2. Ben Gold and Nelson Morgan, Speech and Audio Signal

Processing, John Wiley & Sons, 2nd 2. Programming Exercise+ Test
3. Quatieri, Discrete-time Speech Signal Processing, Prentice Hall, 3rd
Marks 15+15

4. L. R. Rabiner Fundamentals of speech recognition Prentice Hall, 3rd

3. Design Problem (Implementation on MATLAB)

Marks =30

7 By: Nikesh Bajaj 8 By: Nikesh Bajaj

Introduction to Subject

Speech
Audio
Ba Introduction to Subject
Speech/Audio Processing

-Application of DSP
Where it is used? (Applications)
sh
Speech/Audio Coding
Speaker/Audio Recognition
Speaker/Audio Ver./Identification
Speech/Audio Enhancement
Speech/Audio Synthesizer

9 By: Nikesh Bajaj 10 By: Nikesh Bajaj

ke

Introduction to subject Prerequisite Knowledge

Ni

Application of these Signal & Systems

Analysis Basics, LTI System
Processing Fourier Series/Transform, Laplace/Z-Transform
Compressing
Digital Signal Processing


Transmitting
FIR, IIR Filters
Synthesizing
Programming
MATLAB
C/C++/Python/Octave Programming

11 By: Nikesh Bajaj 12 By: Nikesh Bajaj

2
 9/5/2013

Signal??? What is Signal

jaj
13 By: Nikesh Bajaj 14 By: Nikesh Bajaj

Signal
Ba Review of Basics
Signal & System
Signal?
Classification of Signals :Properties
Continues & Discrete
sh

Analog & Digital,

Deterministic & Random
Periodic & Aperiodic
Energy & Power
Even & Odd
Real & Complex

15 By: Nikesh Bajaj 16 By: Nikesh Bajaj

ke

Problems on Signals Review of Basics

Ni

Exercise of Chapter 1 from Oppenheim System

And Schaum Series Properties of System
With memory or Without Memory
Linear or Nonlinear
LTI Sys Time invariant or Time variant
Stable or Unstable
Causal or Non-causal
Invertible or Non invertible
Elementary Signals
Impulse, Unit step, Ramp signal
Sinusoidal., Exponential, Complex expo.
17 By: Nikesh Bajaj 18 By: Nikesh Bajaj

3
 9/5/2013

Problems of Systems Review of Basics

Exercise of Chapter 1 from Oppenheim Elementary functions
And Schaum Series Sinc Fun, Gate Fun, Sgn fun.

jaj
Fourier Series
Fourier Transform

19 By: Nikesh Bajaj 20 By: Nikesh Bajaj

Review of Basics
Digital Signal Processing

DFT/FFT
Filters-FIR/IIR
Ba LTI System
sh
21 By: Nikesh Bajaj 22 By: Nikesh Bajaj
ke

Impulse Response & Conv. Guess.?

Ni

Sir Isaac Pierre-Simon Jean Baptiste Joseph

Newton (4 January Laplace (1749- Fourier (21 March 1768
1643 31 March 1827) 16 May 1830)
23 By: Nikesh Bajaj 24 1727 By: Nikesh Bajaj

4
 9/5/2013

Question???
What do you mean by Transform?
Unit-1: Review of Fourier Trans. What is Fourier Series/Transform?

jaj
Analysis and Synthesis Tool Different between Fourier Series and
Fourier Transform
Different between Fourier Transform and
Laplace Transform

26 By: Nikesh Bajaj

History
In 1748
L. Euler: Vibrating String
Vertical deflation at any time is the linear

combination of normal modes, he showed it

Ba
Fourier
Jean Baptiste Joseph Fourier
-21 March 1768 16 May 1830, Auxerre, France,
Mathematician, Egyptologist,
Revolutionary Discovery (1822). Scientific Advisor
He claimed that any periodic signal can be represented by
sh

In 1753
a series of harmonically related sinusoidal.
D. Bernouli argued same on physical ground (No math)
but was not accepted. FOURIER SERIES
Eular discarded Trigonometric series He also obtained a representation of Aperiodic signal, not
as weighted sum of harmonically related sinusoidal, but
In 1759
as weighted Integral of sinusoidal that are not at all
J. L. Langrange strongly criticized Trig. Series. harmonically related.
27 By: Nikesh Bajaj 28 -FOURIER INTEGRAL or TRANSFORM By: Nikesh Bajaj
ke

Fourier Series
Ni

Fourier Series is a Great

Mathematical Poem
Lord Kelvin (William Thompson)

Laplace Rejected Fouriers Thesis

Laplace Generalized Fouriers one

29 By: Nikesh Bajaj 30 By: Nikesh Bajaj

5
 9/5/2013

Fourier Series Fourier Series

x(t) periodic signal Does FS always exist for any periodic signal?

2 Convergence Criteria: Dirichlet

jaj
a

x(t ) e jkt period , T
k
k
1. Absolutely Integrable
Where coefficients are x(t ) dt <
T
1
ak T T
x(t )e jkt dt 2. There should be finite number of Maxima and
Minima in any period.
3. There should be finite number of finite
31 By: Nikesh Bajaj 32
discontinuities in any finite period By: Nikesh Bajaj

x(t )
Fourier Series
Periodic signal x(t)

k
k
e jkt -To/2 -T1
1

T1 To/2
Ba A Sum of Sine Waves

Asin(x
sh
2T1

sin kT 1
a k

k
1 2 sin koT 1
a k

To ko w /T1

33 Line spectra, discrete

By:lines
Nikesh Bajaj 34 By: Nikesh Bajaj
ke

A Sum of Sine Waves Fourier Series

Ni

What is the Use of Fourier Series?

Use in Analysis :LTI system
Asin(x HOW?
Use in Synthesis

35 By: Nikesh Bajaj 36 By: Nikesh Bajaj

6
 9/5/2013

Fourier Series to
Fourier Transform Fourier Transform
If T0 ??? For Aperiodic signal x(t), FT

jaj

1
x(t )e
jt
will become Aperiodic X ( j ) dt

-To/2 -T1 T1 To/2
Inverse Fourier Transform
2T1

1
X ( j )e
jt
x(t ) d
will become Continuese 2

Fourier Transform comes in

37 the picture By: Nikesh Bajaj 38 By: Nikesh Bajaj

Fourier Transform
Does FT always exist for any aperiodic signal?
Convergence Criteria: Dirichlet
1. Absolutely Integrable
Ba Family of Fourier
Transform

Fourier series
Time
Continuous,
Periodic
Frequency
Discrete,
Aperiodic
x(t ) dt <
sh
Discrete Fourier Discrete, Discrete,
T transform Periodic Periodic

2. There should be finite number of Maxima and Continuous Fourier Continuous, Continuous,
transform Aperiodic Aperiodic
Minima in any finite interval.
Discrete-time Fourier Discrete, Continuous,
3. There should be finite number of finite transform Aperiodic Periodic
discontinuities in any finite period.
39 By: Nikesh Bajaj 40 By: Nikesh Bajaj
ke

Family of Fourier Transform Properties of FT

Ni

Linearity
Time Shifting
Conj. Property
Differentiation
Integration
Time & Freq Scaling
Duality
Freq. Differentiation
Parsevals relation

41 By: Nikesh Bajaj 42 By: Nikesh Bajaj

7
 9/5/2013

FT Pairs Fourier Transform

Impulse Response (t)

jaj
(t) F{(t)}

0 t 0 f

43 By: Nikesh Bajaj 44 By Nikesh Bajaj

Fourier Transform
Gate Function Ga(t), rect(t/a)

rect(t/a) 2a
Ba Fourier Transform
Sine signal
Sin(2fct)
sh
. . . . . . . .
0 t -fc 0 fc f
-a/2 0 a/2 t

/a

45 By Nikesh Bajaj 46 By Nikesh Bajaj

ke

Fourier and Laplace Limitation of FT

Ni

1= 10
x 2= 20
3= 40
4=100

x(t)=cos(1 t)+cos(2t)+cos(3t)+cos(4t)

x1(t)=cos(4t)
x2(t)=cos(3t)
x3(t)=cos(2t)
x4(t)=cos(1t)

x1(t) x2(t) x3(t) x4(t)

47 By: Nikesh Bajaj By: Nikesh Bajaj
48

8
 9/5/2013

Limitation of FT Why So???

x Support region In space In frequency
sin(t) 0

jaj
(t) 0
The basis function sin(t) is not localized in time!
The (t) (sample) is not localized in frequency

Fourier Transform does not give any

information about occurrence of frequency
components with time.
49 By: Nikesh Bajaj 50 By: Nikesh Bajaj

Ba
sh
51 By: Nikesh Bajaj
ke
Ni