Documente Academic
Documente Profesional
Documente Cultură
Outline
Motion estimation for video coding Block-based motion estimation:
EBMA algorithm, Integer accuracy EBMA algorithm, Half-pel accuracy HBMA
Frame t-1
Frame t
Adjacent frames are similar and changes are due to object or camera motion --- Temporal correlation
Yao Wang, 2003 EE4414: Motion Estimation Basics 3
Frame 66
Frame 69
EBMA/ HBMA
MV
Search Region
EDFD (d m ) =
xBm
2 ( x + d m ) 1 ( x)
min
Displacement between the current MB and the best matching MB is the MV Current MB is replaced by the best matching MB (motioncompensated prediction or motion compensation)
Yao Wang, 2003 EE4414: Motion Estimation Basics 8
Frame 66
Frame 69
11
Frame 69
P redicted Frame69
12
Regular structure suitable for VLSI implementation Challenging for software-only implementation
EE4414: Motion Estimation Basics 13
Difficulty:
Target frame only have integer pels
Solution:
Interpolate the target frame by factor of two before searching Bilinear interpolation is typically used
Complexity:
4 times of integer-pel, plus additional operations for interpolation.
Fast algorithms:
Search in integer precisions first, then refine in a small search region in half-pel accuracy.
14
dm
Bm : matching block
15
Bilinear Interpolation
(x,y) (x+1,y) (2x,2y) (2x+1,2y)
(2x,2y+1) (2x+1,2y+1)
(x,y+!)
(x+1,y+1)
16
17
anchor frame
Multiresolution approach
Aim to solve the first two problems First estimate the motion in a coarse resolution over low-pass filtered, down-sampled image pair
Can usually lead to a solution close to the true motion field
Then modify the initial solution in successively finer resolution within a small search range
Reduce the computation
Can be applied to different motion representations, but we will focus on its application to BMA -> Hierarchical BMA (HBMA)
Yao Wang, 2003 EE4414: Motion Estimation Basics 19
1,1
2,1 d1
d2 1,2 2,2 d2 q2
d3
d3
(a)
(b)
(c)
(d)
(e)
(f)
From [Wang02]
anchor frame
23
24
VcDemo Example
VcDemo: Image and Video Compression Learning Tool Developed at Delft University of Technology http://www-ict.its.tudelft.nl/~inald/vcdemo/ Use the ME tool to show the motion estimation results with different parameter choices
25
EBMA/ HBMA
26
f$ ( t , m, n ) = f ( t 1, m d x , n d y )
Bi-directional Motion Compensation
Can handle better covered/uncovered regions
f$ ( t , m, n ) = wb f ( t 1, m d b , x , n d b , y ) + w f f ( t + 1, m d f , x , n d f , y )
Two sets of motion vectors can be estimated independently, using BMA algorithms twice For better results, the two motion vectors should be searched simultaneously, by minimizing the bi-directional prediction error
27
28
References
Y. Wang, J. Ostermann, Y. Q. Zhang, Video Processing and Communications, Prentice Hall, 2002. chapter 6 Y. Wang, EL514 Lab Manual on Video Coding.
29