PROCESSING OF MOTION VECTOR
WITH ADAPTIVE INTERPOLATION
SCHEME
S.Suganya ,Email id :suganya.somu@gmail.com
Mr.S.Radhakrishnan, Lecturer of Information Technology
Kalasalingam university, Anand Nagar, Krishnankoil
Synopsis:
Aspire of this paper is to detect the
problems of unreliable motion vector that cause
visual artifacts but cannot be detected by high
residual energy in motion compensated frame
interpolation. A correlation based motion vector
processing method is proposed to detect and
correct unreliable motion vectors based on
reliability level, motion vector correction and
frame interpolation stages. The adaptive frame
interpolation scheme is analyzed on occlusion
areas based on motion distribution. By using
this scheme it is easy to interpolate frames for
having clearer structure and edge artifacts are
greatly reduced and it results in better visual
quality for fast motions.
Keywords: Motion compensated frame
interpolation (MCFI), motion vector correlation,
adaptive frame interpolation, and occlusion.
I. Introduction
The application of motion compensation
frame interpolation technique is to increase video
frame rate in temporal resolution and used to
reduce motion jerkiness for video applications
having low bandwidth. The MCFI technique
requires motion information between two frames,
which can be re-estimated at the decoder and
directly employing the motion vectors results in
ghost artifact, blockiness in interpolated frames.
Therefore it is a challenge to produce high quality,
artifact free interpolated frame without proper
motion vector processing.
The motion estimation process is done in
order to find the motion vector pointing to best
prediction macro block in a reference frame. In
compression reductancy between adjacent frames
can be estimated where a frame is selected and
subsequent frames are predicted from reference
frame using motion estimation.
The motion estimation process analyzes the
previous and future frames to identify the blocks
that have not changed and motion vectors are
stored in place of blocks.
The rest of this paper is organized as
follows. The challenges in MCFI are
further described in Section II. In Section
III, we demonstrate the classification
process and the merging process using
MV correlation for the received MVF. The
proposed correlation-based MV
processing method and frame
interpolation scheme are presented in
Sections IV and V, respectively.
Experimental comparisons are given in
Section VI.
II. Challenges in motion
compensated frame interpolation
The following subsections describe the
challenges in MCFI that create visual artifacts in
the interpolated frames.
A. Co-located Motion vectors
The motion vector in the received bit
stream are often estimated using block-based
motion estimation at the encoder from ft-1 to ft+1,the
motion vectors represent the true motion vectors in
ft+1 but not in ft.
 correlation and areas where no motion
vector are available.

Motion vector classification:

Consider the motion vector into

three different reliability levels,
unreliable due to high residual
energy(L1),unreliable due to low inter
motion vector
correlation(L2),unreliable(L3).
Fig. 1. (a) Interpolated result using the
direct motion trajectory from the frame3 Block matching algorithm:
to the frame 5 of FOREMAN. (b)
Interpolated result using the direct Some fraction of images change
bidirectional MCFI from the frame 3 to from one frame to another frame, if an
the frame 5 of FOREMAN. image sequence shows moving objects,
then their motion within the scene can
be measured.
Each image frame is divided into fixed
number of square blocks, for each block
in the frame ,a search is made in the
reference frame.

Motion Estimation:

In video editing motion

estimation is a type of video
compression scheme.
The motion estimation process is done
by the order to find the motion vector
pointing to best prediction macro block
in a reference frame.
B.Irregular motion vector
For compression redundancy between
adjacent frames can be exploited where
The motion vector field between
a frame is selected as a reference and
two frames is smooth, except at object
subsequent frames are predicted using
boundary and occlusion areas which can
reference using motion estimation.
be detected by high residual energy,
The motion estimation process
usually the irregular motion vector
analyzes the previous or future frames to
appears in cluster. The vector median
identify blocks that have not changed
filter is an efficient way to correct motion
and motion vectors are stored in place of
outliers. The irregular motion vectors
blocks.
cannot be detected by high residual
energy or bidirectional prediction
difference.
IV.Correlation based motion vector
In order to detect all unreliable
processing using bidirectional
motion vectors the motion vector
prediction difference:
classification process should consider
the residual energy and motion vector
The residual merging
correlation.
map(MBMMr) and correlation merging
map(MBMMc)and received motion
vector field can select the best motion
III.Motion vector analyzis :
vector for each merged group and
neighbouring motion vector by
minimizing absolute bidirectional
Most of the visual artifacts are
prediction. The motion vector whose
caused by motion vectors with high
absolute bidirectional prediction
residual energy, motion with low
difference is less than the predefined
threshold value will be selected to
correct unreliable motion vector within
merged group.
` [2] S.-C. Han and J. W. Woods, “Frame-
V.Adaptive frame interpolation
scheme for occlusion areas
In the motion vector processing
there is no assignment of motion vector
to occlusion areas since the motion is
reliable when appropriate predictions
can be found from forward and backward
frames.
For the identified occlusion areas
the weights of forward and backward
are adjusted to obtain best visual
quality.
Ft(i,j)=wf.ft-1(i+1/2vx,j+1/2vy)+wb.ft+1(i-
1/2vx,j-1/2vy).
By analyzing the corrected
motion vector field the movements that
caused the occlusion can be identified.
VI.Conclusion
The use of motion vector
correlation to discover unreliable motion
vector that cannot be detected using the
received residual energies. The creation
of macro block merging map for
correlation based motion vector
selection process, so that the correct
motion vector can be found in smooth
areas. For the occlusion areas based on
absolute bidirectional prediction
difference energy so that the occlusion
areas can be discovered effectively and
analyzed and assign appropriate motion
vectors from neighbouring corrected
motion vectors and as the result the
ghost artifacts caused by occlusion areas
are removed and improves in visual
quality.
References:
[1] B.-D. Choi, J.-W. Han, C.-S. Kim and
S.-J. Ko, “Motion-compensated frame
interpolation using bilateral motion
estimation and adaptive overlapped
block motion compensation,” IEEE Trans.
Circuit Syst.Video Technol., vol. 17, no.
4, pp. 407–416, Apr. 2007
rate up-conversion using transmitted
motion and segmentation fields for very
low bit-rate video coding,” in Proc. Int.
Conf. Image Processing, Washington, DC,
Oct.1997, vol. 1, pp. 747–750.
[3] H. Sasai, S. Kondo, and S. Kadono,
“Frame-rate up-conversion using reliable
analysis of transmitted motion
information,” in Proc. ICASSP, Montreal,
QC, Canada, May 2004, vol. 5, pp. 257–
260.
[4] J. Zhai, J. L. K. Yu, and S. Li, “A low
complexity motion compensated frame
interpolation method,” in Proc. ISCAS,
Kobe, Japan, Sep. 2005,vol. 2, pp. 4927–
4930
[5] T. Ha, S. Lee, and J. Kim, “Motion
compensated frame interpolation by new
block-based motion estimation
algorithm,” IEEE Trans. Consume.
Electron. vol. 50, no. 2, pp. 752–759,
May 2004
[6] A.-M. Huang and T. Nguyen, “Motion
vector processing using bidirectional
frame difference in motion compensated
frame interpolation,”IEEE WoWMoM.
Newport Beach, CA, pp. 1–6, Jun. 2008.