Documente Academic
Documente Profesional
Documente Cultură
CSE 802
Michigan State University
Spring 2017
Lecture 1, January 9, 2017
Pattern Recognition
The real power of human thinking is
based on recognizing patterns. The better
computers get at pattern recognition, the
more humanlike they will become.
Ray Kurzweil, NY Times, Nov 24, 2003
Category A
Category B
Clustering
Classification
Handwritten numerals
Identical twins
https://www.robots.ox.ac.uk/~vgg/publications/2012/parkhi12a/parkhi12a.pdf
Jain CSE 802, Spring 2017
Problem Definition & Data
Oxford-IIIT Pet dataset: 7,349 images of cats & dogs of
37 different breeds: 25 dogs & 12 cats. ~200 images/
breed, split randomly into 50 for training, 50 for
validation, and 100 for testing. Three tasks are defined:
n Pattern representation
n Pattern classification
n System design
What facial features to use to account for the large intra-class variability?
John P. Frisby, Seeing. Illusion, Brian and Mind, Oxford University Press, 1980
Jain CSE 802, Spring 2017
Jain CSE 802, Spring 2017
Jain CSE 802, Spring 2017
Representation: Desirable Properties
n Invariance
n Account for intra-class variations
n Ability to discriminate classes of interest;
low inter-class similarity
n Robustness to noise, occlusion,..
n Provide simple decision making strategies
n Low measurement cost; real-time
Fruit
Conveyor
belt
Movable
Partition
Crates
A test of 145 items, every item on the shelf, was performed, using all
produce items available in a supermarket. Ten images per item was
collected for a total of 1,450 images. Leave-one-out method for
evaluation was used. For color & texture features combined, 84% of the
time, correct produce class was selected, 96% of the time, the correct
class was present in the top four choices.
http://researcher.watson.ibm.com/researcher/files/us-smiyaza/jhc-waiat.pdf
http://researcher.watson.ibm.com/researcher/files/us-smiyaza/jhc-wacv.pdf
Jain CSE 802, Spring 2017
Pattern Recognition System
Preprocessing
(enhancement,
segmentation)
Separate touching
or occluding fishes
Extract fish contour
http://www-tc.pbs.org/wgbh/nova/education/activities/pdf/2215_reef.pdf
Jain CSE 802, Spring 2017
Fish Key (Rule-based System, Decision Tree)
Step 1 Step 4 Step 7
If fish shape is long and If the fish has long whip-like If fish has stripes then
skinny tail, it is a spotted eagle ray go to step 8
then go to Step 2 If the fish has short, blunt If fish does not have
If fish shape is not long and tail, it is a peacock flounder stripes, it is a glassy
skinny sweeper
then go to step 3
Step 2 Step 5 Step 8
If the fish has pointed fins, If fish has spots then go to If fish has a v-shaped tail,
it is a trumpet fish step 6 it is a squirrel fish
If the fish has smooth fins, If fish does not have spots If fish has a blunt tail, it is
it is a spotted moray eel then go to step 7 a glass-eye snapper
Step 3 Step 6
If fish has both eyes on top If fish has chin whiskers, it is a
of the head then go to spotted goat fish
step 4 If fish does not have chin
If fish has one eye on each whiskers, it is a band-tail
side of the head then go puffer
to step 5 Jain CSE 802, Spring 2017
Jain CSE 802, Spring 2017
Representation: Fish Length as a Feature
Training samples
Template
Prototype
Input scene
Prototype warping
pattern Feature
Preprocessing Classification
extraction
Recognition
Training
Feature
Preprocessing Learning
Patterns selection
+
Class labels
x2 x2
x1 x1
Training
Primitive Grammatical
Preprocessing
Patterns selection inference
+
Class labels
Median Submedian
Acrocentric Telocentric
x1 w1
x2
Y (output)
xd wd
. .
. . . .
. . .
c outputs
d inputs First hidden layer Second hidden layer
NH1 input units NH2 input units
n Network training
How m ch
info mation are
y u mi sing
Qvest
Jain CSE 802, Spring 2017
Constraining the Recognition Problem
n Graffiti alphabet