Documente Academic
Documente Profesional
Documente Cultură
Chapter 1: Introduction
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Personal Data: Joachim Denzler
Phone 03641/946420
Fax 03641/946372
E-Mail joachim.denzler@uni-jena.de
URL http://inf-cv.uni-jena.de/
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Goals of todays lecture
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
What is Computer Vision?
l General Goals:
– Computation of properties of the 3d world from one or several
digital images
– Properties: geometric or dynamic
– Geometric properties: shape of an object, position in the world
– Dynamic properties: speed, velocity, and motion direction
l Several disciplines are involved
– Physics and Optics
– Mathematics and Computer Science
– Image Processing
– Artificial Intelligence
– Pattern Recognition
– Signal Processing, Control Theory
– Robotics
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Related Areas
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Application examples
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Optimal Sensor Data Acquisition
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Active Scene Exploration
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Object Tracking I
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Object Tracking II
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Object Tracking III
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Object Tracking IV
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
3d Reconstruction I
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
3d Reconstruction II
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
3d Reconstruction III
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
3d Reconstruction IV
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Visualisation I
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Visualization II
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Visualization III
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Visualization IV
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Visualization V
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
3d State Estimation I
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
3d State Estimation II
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Augmented Reality
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Augmented Reality
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Grasp Planning of Objects
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Future of Computer Vision?
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Some Examples from Own Research
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Further Examples
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Further Examples
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Further Examples
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Further Examples
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Image Processing and Computer Vision in Industry
l Selection of US companies:
http://www.cs.ubc.ca/spider/lowe/vision.html
– Inspection and quality control (IC inspection)
– Fingerprint, iris, and face recognition software
– Construction and design of new sensor (3d cameras)
– Image processing for industrial robots
l Selection of German companies and research institutes:
http://kogs-www.informatik.uni-
hamburg.de/~koethe/german_vision.html
– Quality control
– Remote sensing
– Medical image processing
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Chair for Computer Vision
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Chair for Computer Vision
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Chair for Computer Vision
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Sensors in Motion
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Sensors in Motion
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Research Areas
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Cooperation with Industry
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Typical Steps in Image Processing
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Typical Steps in Image Processing
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Typical Steps in Image Processing
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Typical Steps in Image Processing
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Typical Steps in Image Processing
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Typical Steps in Image Processing
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Structure of the Course
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Structure of the Course II
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Structure of the Course III
l Chapter 6: Segmentation
– Detection of discontinuities
– Edge links, boundary detection, Contour tracking
– Thresholding
– Region-based segmentation
– Motion in image segmentation
l Chapter 7: Representation of Segmentation Results
– Chain codes and interpolation techniques
– Signatures
– Contour/boundary descriptors
– Regional descriptors
– Principal component analysis
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Structure of the Course IV
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Procedure During the Semester
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
References in WWW
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Commercial Software
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Literature:
l Textbook:
– Gonzalez, Woods: Digital Image Processing. Prentice Hall.
2002.
l Slides: will be available in CAJ
– Please register with http://caj.informatik.uni-jena.de
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Is the human visual system perfect?
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Is the human visual system perfect?
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Is the human visual system perfect?
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Is the human visual system perfect?
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
A Puzzle: what can you see?
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Local Context: now you see more from the image
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Global Context: you see other parts of the object
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
More Global Context: even more
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
More Global Context: and more …
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
The „Scene“: now you recognize „tigger“ easily
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Attention and Object Recognition
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Attention and Object Recognition
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Attention and Object Recognition
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Task Driven Attention
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Task Driven Attention
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Image Comparison: find differences between images
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Image Comparison: easy job for the machine
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Variations in Images
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Noise
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Different Illumination
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Different Illumination
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Different Illumination
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Different Illumination
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Variation along a scan line
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
What does the machine already better?
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Accuracy: 3d Measuring
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Speed: Automatic Reading of Documents
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Speed: Automatic Reading of Documents
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Speed: Automatic Reading of Documents
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Exhausting: Licencs Plate Reading
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Medical Image Processing
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Introduction: Images
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Why is Computer Vision Difficult?
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
A digital image – Can you see anything?
15 15 14 15 16 16 16 16 16 16 17
14 15 15 14 15 16 15 16 16 16 19
14 15 15 15 15 16 16 16 16 17 26
14 15 15 17 20 23 22 19 18 21 34
14 15 18 24 34 42 42 33 25 30 51
14 15 19 32 42 53 55 49 36 36 57
15 15 20 33 39 50 66 71 53 38 59
15 17 23 35 38 49 69 78 56 36 58
15 18 33 51 50 53 71 79 57 35 56
15 23 41 61 57 53 69 78 56 35 56
15 24 47 69 64 55 67 77 57 36 56
14 21 39 61 58 50 59 67 52 33 49
14 17 24 35 35 31 34 39 33 23 27
13 14 19 23 22 21 21 23 21 18 19
13 14 16 17 16 16 16 16 16 16 16
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
A digital image – special „preprocessing“
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
The original image
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
The process of image formation
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Further important properties
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Sensors I
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Sensors II
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
„Our“ Sensor
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Simple model for image generation
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Sampling and Quantization
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Sampling in Practice
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Result of Sampling and Quantization
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Representation of images in the computer
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Sensor elements and arrangement
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Quantization
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Storage requirements
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Spatial resolution and subsampling
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Spatial resolution and resampling
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Quantization and image quality/information
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Quantization and image quality/information
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Sub- und resampling in practice
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Zoomin/Shrinking
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Zoomin/Shrinking
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Nearest Neighbor Interpolation
l Principle: use for the new grid position the intensity value
stored at the nearest neighbor on the original grid
l Advantage: very efficient
l Disadvantage: checker board effect
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Pixel replication
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Bilinear interpolation
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Subsamling
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Resampling: Examples
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Relations between pixels I
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Relations between pixels II
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Relations between pixels III
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Relations between pixels IV
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Distances
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Excursion in probability theory
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Relative frequency and probabiliy
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Joint Event
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Joint Event
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Conditional Probability
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Bayesian Law and Statistical Independency
l We now get
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Random Variables
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Cumulative Probability Function
l Properties:
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Probability Density Function
l Properties of a pdf:
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Transformations of RV
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Attributes of random variables I
l Expected value of a RV
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Attributes of random variables II
l Variance of a RV:
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Optimal Quantization
a1 a2 a3 aL aL+1
fj
b1 b2 bL-1 bL fj‘
L an +1
e =å (f - b )
ò n p(f )df ,
2
p(f = an ) ¹ 0
n =1 an
an +1
¶e
an +1 !
ò fp(f )df
ò - 2(f - bn )p(f )df = 0 Þ bn =
an
=
¶bn an +1
ò p(f )df
an
an
n = 1...L
¶e !
bn -1 + bn
= (an - bn -1 ) p(an ) - (an - bn )
2 2
p(an ) = 0 Þ an =
¶an 2
n = 2...L, a1 = fmin , aL +1 = fmax
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Example: low contrast
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Histogram
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
Result after requantization
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena
New Histogramm
Copyright © 2017 Joachim Denzler, Chair for Computer Vision, Uni Jena