Image Fusion using Wavelet

Transform

IMAGE FUSION
Extraction of complementary information &
removal of redundancy from multimodal images
to obtain all relevant information in a single
(hybrid) image.

Applications: Remote sensing, Medical Imaging,

Automated machine vision and aviation

Generic requirements imposed on

the fusion result
Preserve all relevant information contained
in the source images
Fusion process should not introduce any
artifacts or inconsistencies
Irrelevant features and noise should be
suppressed to maximum extent

Different Levels of Image Fusion

Pixel Level - pixels in the source images are

combined to contribute to each pixel in the fused

image

Feature Level salient features are extracted

from source images and fusion is performed

Decision Level - Decision from various fusion

experts are fused

Generic Image Fusion Approach

Fusion Method
Source images are decomposed using daubechies
wavelet filter of order 2
Low frequency coefficients are chosen using
maximum absolute value principle
All the high frequency coefficients are selected using
different fusion rules
The various fusion schemes are tested on several
pairs of CT and MRI images

Comparison of various fusion

methods
Fusion scheme based on

Pixel based fusion

Salience measure
Salience match measure
Local Deviation
Convolution
Local Gradient
Gradient match measure

Pixel based fusion

C ( A, p ), C ( A, p ) C ( B , p )
j
j
j

C ( F , p)
j

C j ( B , p ), C j ( B , p ) C j ( A, p )

C j ( F , p ) 0.5* C j ( A, p ) 0.5* C j ( B, p)
Useful features in the image usually are larger than
one pixel
Undesirable side effects such as reduction in contrast

Fusion based on salience measure

Salience of a pixel local energy in the
neighborhood of a coefficient
2
Local Energy E ( A, p ) w( q )C j ( A, q )
Q
w( q ) 1

Q 5x5 window centered at the current coefficient

position
C j ( A, p ), E ( A, p ) E ( B , p )
C ( F , p)

j
C j ( B , p ), E ( B , p ) E ( A, p )

Fusion based on salience match

measure
Two distinct modes of combination
Selection
Averaging
Match measure

M ( p)

2 w( q )C j ( A, q )C j ( B , q )
Q
E ( A, p ) E ( B , p )

Selection mode
If M(p)< T

C j ( A, p ), E ( A, p ) E ( B , p )
C ( F , p)

j
C j ( B , p ), E ( B , p ) E ( A, p )

Averaging mode
If M(p) T
Wmax C j ( A, p ) Wmin C j ( B , p ), E ( A, p ) E ( B , p )

Wmax C j ( B , p ) Wmin C j ( A, p ), E ( B , p ) E ( A, p )

C j ( F , p) =

1 M ( p )

1T

Wmin 0.5 0.5

Wmax 1 Wmin
T=0.95 is chosen

Fusion based on local deviation

C j ( A, p ), j ( A, p ) j ( B , p )
C ( F , p)

j
C j ( B , p ), j ( A, p ) j ( B , p )

Fusion based on convolution

Feature
S ( A, p ) F1 * C j

A, p , F2 * C j A, p , F3 * C j A, p

F1={{-1,-1,-1},{2,2,2},{-1,-1,-1}},
F2={{-1,2,-1},{-1,2,-1},{-1,2,-1}},
F3={{-1,0,-1},{0,4,0},{-1,0,-1}}
F1, F2 , F3 extracts the edge information of the subimages
based on direction

C j ( A, p ), S ( A, p ) S ( B , p )
C ( F , p)

j
C j ( B , p ), S ( B , p ) S ( A, p )

Fusion based on local gradient

Gradient f G G f ( x , y ) f ( x 1, y ) f ( x , y ) f ( x , y 1)
x
y
Compute the differences between the high frequency coefficient at
point p and its eight neighbors respectively
E is acquired by summing the squares of all differences

E ( A, p ) C j ( A, q ) C j ( A, p )
Q
E ( B, p ) C j ( B, q ) C j ( B, p )
Q

C j ( A, p ), E ( A, p ) E ( B , p )
C ( F , p)

j
C
(
B
,
p
),
E
(
B
,
p
)

E
(
A
,
p
)
j

Fusion scheme based on gradient

match measure
local energy

Match measure

E ( A, p ) w( q ) C j ( A, q ) C j ( A, p )
Q

M ( p)

2 w( q ) C j ( A, q ) C j ( A, p ) C j ( B , q ) C j ( B , p )
Q
E ( A, p ) E ( B , p )

Source Images

CT

MRI

Pixel and Feature based fusion methods using Wavelet

transform

Pixel fusion 1

Pixel fusion2

Salience match

Local deviation

Gradient

Gradient

Gradient match

Salience

Convolution

Image Fusion

The images fused with features such as

salience match measure, gradient and
gradient match measure are better among
the other feature level fusion methods.

Content Based Image Retrieval

Content based image retrieval is a system that implements methods
that effectively archive, query, and retrieve digital images by their
content.