EE412/CS455

Principles of Digital Audio and

Video

Lecture 1

Instructor: Dr. Nadeem Ahmad Khan

TA: Muhammad Waseem Abbas

Uzair Ikram

Acknowledgements

Following sources are specially acknowledged for the

images/pictures used in these course slides:
Principles of digital audio and video by Arch C.
Luther, Artech House Inc.
Digital Image Processing/2E, R.C. Gonzalez, R.E.
Woods, Addison-Wesley
Multimedia Communications Applications,
Networks, Protocols and Standards, Fred Halsall,
Pearson Education (Singapore) Pte. Ltd.

Multimedia World !
Modern advancement is converging
towards a multimedia world!

Evolutionary history: radio, TV, computer,

internet etc.

What is Multimedia?

Using multiple formats of electronic presentation

with user interaction for the purpose of
conveying information, educating or entertaining

What is Multimedia?

Formats of Multimedia
Text
Audio
Video
Images
Graphics
Animation

What is Multimedia?

Requirements of Interactivity
Two-way communication
User interface
Computing capability

Video Conferencing-1

http://agcommsvs.ca.uky.edu/videoconferencing/sites/default/files/video-conference.jpg

Video Conferencing-2

Modern Application Examples:

Smart Portable/Mobile Devices

Smart phones

http://socialmedianz.com/news

Tablet-PCs

http://images04.olx.com.pk/ui/

Modern Application Examples:

Kiosks

http://www.kiosk.com/images

Modern Application Examples:

Video Walls

Rear projection displays

http://en.wikipedia.org/wiki/Video_wall

http://blog.planetbulb.com/wp-content/uploads/2012/04/Videowall.jpg

Modern Application Examples: 3DTV

http://saleheroes.com/wp-content/uploads/2013/01/3Dtv.jpg

Multimedia Applications

Video Conferencing
Teleshopping/ Tele-banking
PC, Internet Computer
Interactive Encyclopedia
Movie-on-Demand (MOD) / N-MOD
TVs with Set-Top boxes

Interactive TV/ Interactive Cinema

Game Machines/On-line Games/Kiosk
Multimedia Production Systems

Audio, Images and Video!

Digital audio, images and video are
the most demanding media both from
the hardware and software point-ofviews

Audio-Video SystemClasses

Spectrum of Multimedia Products

Multimedia PC
Home Multimedia Systems
Semiprofessional class of system
Videoconferencing system
Video Delivery Systems
Production Systems
Studio
Field

Postproduction system

Price Performance Graph

Crowley & Tripp Naked Eye Roswellite

Professional Recording Microphone

Image From : http://hiddencove.pbwiki.com/Sonic%20Records

Professional Audio/Video Studio

Class A

Image From : http://hiddencove.pbwiki.com/Sonic%20Records

Professional Audio/Video Studio

Class B

Image From : http://hiddencove.pbwiki.com/Sonic%20Records

Professional Audio/Video Studio

Class C

Image From : http://hiddencove.pbwiki.com/Sonic%20Records

Audio\Video Mixing Master Control Room

Image From : http://www.tvprogear.com/images/Virtual%20Pages/Master%20Control%204.jpg

MMR = Multimedia Recorder/Player

MMR 3

MMR 2

MMR 1

Studio Production System

Postproduction System

MMR = Multimedia Recorder/Player

Large Production Facility

MMR 1

Storage

MMR = Multimedia Recorder/Player

Postproduction SystemsPrinciples

Multimedia Production

Scenes of a program are shot separately and

are put together afterwards
=> The Production-Postproduction Style

Production (Content Creation)

Involves initial acquisition of all program material

Video
Studio shots, Location shots, Library shots, Graphics,
Still photographs, Animation etc.

Audio
Studio clips, Location clips, Library clips, Music,
Sound effects etc.

Postproduction

Involves one or more of the following

processes
Selection
Processing
Special Effects
Mixing
(Pre-)Viewing
Conforming

Postproduction

Audio and Video is (generally) processed

separately

Postproduction

Time coding the contents is essential in

this style of Program creation
Several standards: e.g. SMPTE
Advantages in basing the code on local
clock time

Postproduction

Editing is the most important and basic

task in Postproduction

Postproduction: Editing
Typical Editing process

Select of Edit points: In-point, Out-point

Prepare Edit List (EDL)
Choose transition effects
Iterative improvement based on preview
Conforming

Postproduction: Editing

01

CBARS

00:00

00:00

00:00

02:00

02

BLACK

00:00

00:00

02:01

02:31

03

BLACK

D150

00:00

00:00

02:32

02:37

03

SCENE1

D150

00:00

00:05

02:32

02:37

04

SCENE1

00:06

04:06

02:38

06:38

05

SCENE1

W23 240

04:07

04:15

06:39

06:47

05

SCENE2

W23 240

00:00

00:08

06:39

06:47

06

SCENE2

00:09

04:09

06:48

10:48

Postproduction: Editing

Postproduction: Editing
Electronic Editing Mechanisms

Videotape editing (Linear Editing)- Phased out

Insert , assemble etc.

Computer editing (Nonlinear Editing)

Dedicated systems

PC with expansion cards

Computer Editing

DVD/Blue
-Ray
Player

Postproduction: Video Effects

Single-signal Effect
Normal, Zoom, Pan, Rotate, Diffuse, Emboss,
Wave etc.

Multisignal Effects
Wipe, Dissolve etc.

Video Effects

Postproduction: Graphics and

Animation
Todays graphic processors can generate
text, drawings, cursors, maps animation
which can be keyed in the natural video

Audio Postproduction
Captured/Created on a number of separately
recorded tracks that are processed and
then mixed to created the final audio
track(s)

Audio Postproduction
Typical Audio Elements

Dialog
Ambiance
Sound effects
Music

Audio Postproduction

Multimedia Transmission and

Distribution

Recorded Media
CD,DVD etc.
Broadcasting
Terrestrial
Satellite
Wired Distribution
Telephone Networks, DSL
Integrated Services Digital Networks (ISDN)
Cable
Data Networks (LANs, WANs, Internet)

Standardization is important !

Standardization
Societies/Organizations

Standards

ITU: International Telecommunication Union

(CCR/CCITT)

ISO: International Standards Organizations

SMPTE: Society of Motion Picture and
Television Engineers
IEEE: Institute of Electrical and Electronics
Engineers
EIA: Electronics Industries Association, USA
EBU: European Broadcasting Union

Advanced Courses and Research

Opportunities

Further courses in the stream will be

offered

Signal,

Image and Video Processing

Lab of the EE department
Limited RA openings on merit (and
aptitude) basis; several projects

Course
Policy

Course homepage

EE412/CS-455 homepage
Access via LMS

Classes/Lectures

Try to be there before the class starts

Classes/Lectures

Slides

vs

White board/Pen-paper

Classes/Lectures

Lectures have to be supplemented by self

reading
book
handouts

Classes/Lectures

Interactivity is the key to effective learning and

understanding!

Assignments/Labs/Term
Project (18%+12%)

Unannounced

Applicable rules and submission deadlines will be

indicated with the assignments

No make-ups

Tutorials

Attending Tutorials is very important (few will be

compulsory depending on your background)

Quizzes (15%)

10-15 minutes duration

Will cover reading assignments and

material covered in the class

Unannounced

No make-ups

What should be done in case of absence?

Midterm (25%)

Close book
Will be based on all material covered before the
midterm

Final Exam (30%)

Close book

Will be based on all material covered in the entire

course of 14 weeks

Necessary Readings
Reading Package
Page 1-9 (Luther: Chapter 13)
Page 15 (Luther: Chapter 13:Authoring)
Page 21-32 (Luther: Chapter 12)
Page 53 (Luther: Chapter 4)

Analog and Digital Concepts

Chapter 1

Multimedia Technology

Modern electronic technology is the

backbone of multimedia systems

Electronic technology :
Analog
Digital

Moores law: Wikipedia

Multimedia Technology

Modern Electronic technology:

Solid-state Integrated Circuits:
Progressing according to the Moores Law

Analog and Digital Concepts

Analog Systems
versus
Digital Systems

Analog Systems: Advantages

No ADC conversion required

Fast

Compact

Analog Systems: Limitations

Noise and Interference

Distortion

Instability/drift

Digital Systems: Advantages

Well defined accuracy/precision

Storage

General purpose / Programmable

Error-free transmission

Low cost

Digital Systems: Limitations

Limitations with respect to:

Speed

Compactness

Power consumption
=>Limitations diminishing with time

Necessary Readings
Reading Package
Page 1-9 (Luther: Chapter 13)
Page 15 (Luther: Chapter 13:Authoring)
Page 21-32 (Luther: Chapter 12)
Page 53 (Luther: Chapter 4)
Page 55-61, 83, 84 (Luther: Chapter 1)