ICCSP-'12

Video Enhancement using Tone Adjustment

D.BakkiyaLakshmi , R.Kanchana and V. Nagarajan
Abstract- Various video enhancement techniques have been
proposed to make video frames better quality to human visual
systems. The quality of video and images from various sources
like video surveillance cameras, medical imaging, are in poor
quality. To enhance the quality video by a simple and
computationally efcient technique for video enhancement by
tone adjustment technique is proposed. This technique is helpful
in identifying people, license plates, etc. from poor quality video
surveillance cameras. Simulation results show that the proposed
technique achieve high contrast enhancement with low noise and
great video quality.
Keywords- Bilateral tone adjustment , video enhancement, tone
adjustment
I. INTRODUCTION
The dynamic range of natural luminance intensity can reach
approximately 1010:1 while conventional printers or displays
only show images in dynamic range Of 1001000:1 [1]. It is
due to the limitation of bit resolution in the video format and
also in capturing devices. That inconsistency makes video
details disappear if the background is too dark or too bright.
Therefore, various video enhancement techniques are
introduced to retrieve the hidden details in video by enhancing
contrast, and make video look closer to real scenes [2].
Human eyes are very sensitivity and can fnd the light
variation in faction of seconds. Human eyes have color
adaptive ability to recognize high dynamic range. But the
camera has high dynamic range and it is limited by its tone. It
is usually occurs that video taken in so dark then details can't
be seen easily. And videos taken by a camera is identical to an
image sensed by human eyes. But these images are diferent in
some situations due to the difference between human eyes and
a digital camera [3-5]. The dynamic range of human eyes is
four to six times as wide as a digital camera. Therefore, these
diferences especially in situations where strong luminance
contrast exists. Hence, the real scene cannot be corelated to
digital image. Most video enhancement methods attempt to
analyze pixels using surrounding pixels to improve detail
visibility [6]. To retain the video detail the bilateral tone
adjustment is done in video fames. The idea of bilateral tone
adjustment is to treat dark and bright regions separately using
two different tones. Bilateral tone adjustment retrieve the
details in dark and bright regions and but also boosts the
contrast in the mid-tone regions.
D.BakkiyaLakshmi , R.Kanchana and V. Nagarajan are all with the
Department of ECE, Adhiparasakthi Engineering College, Melmaruvathur,
India. (e -mail: bakkiyaI9@yahoo.com and nagarajanece31@redifail.com)
978-1-4673-1622-4/12/$31.00 2012 IEEE
II. VIDEO ENCHCEMENT
Some regions of a video catch human visual attention at
frst glance more than other regions, and the regions are
considered more salient method.
A. Framework Oerview
Global contrast enancement is required to reveal hidden
details in dark and bright regions. In addition to enhancing
regions with extremely high or low luminance, proposed
technique is also signifcantly stretches the contrast in mid-tone
regions, which most other curve-based global enhancement
methods ignore [7-9].
bML 1L11
LL^1
.1`
Figure I. Flow diagram of proposed video enhancement technique.
Saliency values can be regarded as complex local
information indicating the degree of human interest in each
pixel in a video. Saliency maps are most fequently used to
extract usefl objects in the preprocessing of surveillance
systems or recognition problems [10]. The saliency maps as a
reference for local contrast enhancement and proposes the
SWCE method. Fig. 1 illustrates the proposed video
enhancement technique. First, the videos are separated in to
124
IEEE
nn InoIoy
orHumunq
fames. Frames are transformed into the HSV domain to derive
the luminance and color maps. Then, Bilateral tone adjustment
is applied to the luminance map while the saliency detector
calculates the saliency map[II]. Basically all kinds of saliency
detection methods can be used for saliency map generation.
This adopts color saliency detection method because it
produces a satisfactory saliency map. SWCE is then performed
based on the adjusted luminance and saliency map. Finally, the
output image is the inverse HSV tansform of the enhanced
luminance map with the original color maps [12].
B. Saliency-Weighted Contrast Enhancement
Due to the Bilateral tone adjustment, we do not need to
gather and analyze global luminance information in this post
process of contrast enhancement. The SWCE is designed to
produce high contrast in regions with higher extent of human
interests. In addition, the noise is not over-enhanced because
SWCE controls the enhancement extent adaptively depending
on local saliency values. The proposed method reveals the
details contained in dark regions, and the enhancement result
is quite smooth and natural [13]. The SWCE is designed to
produce high contrast in regions with higher extent of human
interests. In addition, the noise is not over-enhanced because
SWCE controls the enhancement extent adaptively depending
on local saliency values. The proposed method reveals the
details contained in dark regions, and the enhancement result
is quite smooth and natural.
C Metrics
The quality of an image is examined by objective evaluation
as well as subjective evaluation. For subjective evaluation, the
image has to be observed by a human expert. But the human
visual system is so complicated and this cannot give the exact
quality of image. There are various metrics used for objective
evaluation of an image. Some of them are mean square error
(MSE), root mean squared error (RMSE), mean absolute error
(MAE) and peak signal to noise ratio (PSNR).
1) Mean Square Error
Mean Square Error (MSE) is given as
m H
MSE= LL(
A
(m,n)-A(m,n))2
Mean Absolute Error is defmed as
m H
MAE = LLI
A
(m,n)-A(m,n)1
i=1 }=I
2) Peak Signal to Noise Ratio
(2.1)
(2.2)
Peak signal to noise ratio (PSNR) is defned in logarithmic
scale in db. It is a ratio of peak signal power to noise power.
Since the MSE represents the noise power and the peak signal
power, the PSNR is defned as
PSNR = lO*log lO(I/MSE) (2.3)
125
This image metric is used for evaluating the quality of a
fltered image and thereby the capability and efciency of a
fltering process. In addition to these metrics, universal quality
index (UQI) is extensively used to evaluate the quality of an
image now-a-days. Further, some parameters, e.g. method
noise and execution time are also used in literature to evaluate
the fltering performance of a flter [14-15].
III. SIMULATION RSULTS
To enhance the better quality of a video the bilateral tone
adjustment technique is used here. In addition, noise
estimation is taken into account to quantif the artifacts of
noise generation during contrast enhancement process. The
video sequence is separated into fames to yield a single high
quality image.
Figure 2.
(c)
(d)
Noisy Enhanced
Shows original noisy frames and the results of the Proposed
Techniques for gray scale video
Noisy Enhanced
Figure 3. Shows is an original noisy fames fom indoor cctv and the results
of the Proposed Techniques
The image captured by all devices undergoes fltering by
smoothing flters. All recording devices, both analogue and
digital, have attribute which make them susceptible to noise.
The fndamental problem of image processing is to reduce
noise fom a digital color image.
Fig. 2. (a) (c) & (e) Shows the original input gray scale
video fames and in Fig. 2. (b) (d) & (f shows the output
enhanced gray scale video fames. Fig. 3 (a) (c) (e) & (g)
126
shows the color noisy fame taken fom the indoor cctv and
enhanced video is shown in Fig 3. (b) (d) (f & (h). In Fig. 4.
(a) (c) (e) & (g) shows the color noisy fame taken fom the
outdoor surveillance camera and Fig. 4. (b) (d) (f & (h)
shows the enhanced video.
(a) (b)
Noisy Enhanced
Figure 4. Shows is an original noisy fames fom indoor cctv and the results
of the Proposed Techniques
The proposed SWCE has the highest performance among
all other contrast enhancement algorithms, showing that
SWCE can perform enancement selectively in the salient
region which contains less noise.
The enhanced fame has signifcantly higher signal to noise
ratio (SNR) relative to the original fames of both gray scale
and color videos.
IV. CONCLUSION
This proposed video enhancement famework consisting of
Bilateral Tone adjustment ad SWCE. SWCE method
integrates the saliency map with a simple contast
enhancement, and also perfors more enhancements in regions
that humans give more attention. This work showed tat
SWCE achieves greater performance using luminance
component. To evaluate the enhancement perforance, the
PSNR value was used to measure the quality of enhancement.
This technique will also prove that enhancing the quality of
low-grade video surveillace cameras.
REFERENCES
[I] Y. -T. Kim, "Contrast enhacement using brightness preserving
bihistogram equalization," IEEE Trans. Consumer Electron., vol. 43, no.
I,pp. 1-8,Feb. 1997.
[2] S. -D. Chen and A. R. Ramli, "Minimum mean brightness error
bihistogram equalization in contrast enhancement," IEEE Trans.
Consumer Electron., vol. 49, no. 4, pp. 1310-1319, Nov. 2003.
[3] C. Wang and Z. Ye, "Brightness preserving histogram equalization with
maximum entropy: A variational perspective," IEEE Trans. Consumer
Electron., vol. 51, no. 4, pp. 1326-1334, Nov. 2005.
127
[4] T. -K. Kim, J. -K. Paik, and B. -S. Kag, "Contrast enhancement system
spatially adaptive histogram equalization with temporal fltering," IEEE
Trans. Consumer Electron., vol. 44, no. I, pp. 82-87, Feb. 1998.
[5] J. -Y. Kim, L. -S. Kim, and S. -H. Hwang, "A advanced contrast
enhacement using partially overlapped sub -block histogram
equalization," IEEE Trans. Circuit Syst. Video Technol., vol. 11, no. 4,
pp. 475-484, Apr. 2001.
[6] K. Schutte, "Multi -scale adaptive gain control of IR images," in Proc.
SPIE,voI. 3061. 1997,pp. 906-914.
[7] S. Cvetkovic, J. Schirris, and P. de With, "Locally -adaptive image
contrast enhancement without noise and ringing artifacts," in Proc.
ICIP, vol. 3. 2007, pp. 551-560.
[8] D. Chang and W. Wu, "Image contrast enhacement based on a
histogram transformation of local standard deviation," IEEE Trans. Med.
Imaging, vol. 17, no. 4, pp. 518-531, Apr. 1998.
[9] C. Siagian and L. Itti, "Rapid biologically -inspired scene classifcation
using features shared with visual attention," IEEE Trans. Patter
Anal.Mach. Intell., vol. 29, no. 2, pp. 300-312, Feb. 2007.
[10] L. Itti, "Automatic foveation for video compression using a
neurobiological model of visual attention," IEEE Trans. Image Process.,
vol. 13, no. 10, pp. 1304-1318, Oct. 2004.
[11] N. Rasmussen, D. Thorton, and B. Morse, "Enhancement of unusual
color in aerial video sequences for assisting wilderess search and
rescue," in Proc. IEEE ICIP, Oct. 2008, pp. 1356-1359.
[12] C. Wang, Q. Yag, X. Tang, and Z. Ye, "Salience preserving image
fsion with dynamic range compression," in Proc. IEEE Int. Con!
Image Process., Oct. 2006, pp. 989-992.
[13] G. Deng, "A entropy interpretation of the logarithmic image processing
model with application to contrast enhancement," IEEE Trans. Image
Process., vol. 18, no. 5, pp. 1135-1140, May 2009.
[14] S. Lee, "A efcient contrast -based image enhancement in the
compressed domain using retinex theory," IEEE Trans. Circuit Syst.
Vido Techno!., vol. 17, no. 2, pp. 199-213, Feb. 2007.
[15] V. Gopalakrishnan, Y. Hu, and D. Rajan, "Salient region detection by
modeling distributions of color and orientation," IEEE Trans.
Multimedia, vol. II, no. 5, pp. 892-905, Aug. 2009.