(TFM-CLAHE) BASED CONTRAST LIMITED HISTOGRAM EQUALIZATION FOR IMAGE

ENHANCEMENT OF MULTIMODAL MEDICAL BIOMETRIC IMAGES USING TFM

1 2 3 2
Gunasekaran Manogaran , K.Hariharan , N.R.Raajan , K.R.Sekar
2
School of Computing, SASTRA Deemed University, India
1
University of California, Davis, CA, USA
3
School of Electrical & Electronics Engineering, SASTRA Deemed University, India
harikalyan87@gmail.com, nrraajan@sastra.edu
Abstract: The research article mainly address a novel Triangular Fuzzy Membership (TFM) function-based
Contrast Limited Adaptive Histogram Equalization (CLAHE) for biometric image enhancement. Biometric
images have wide applications in the areas of verification and authentication systems. For accurate identification
and verification, pre-processing of captured biometric images becomes essential. When the region of interest is
smaller than the original image, a variation of histogram equalization called Adaptive Histogram Equalization
(AHE) is used. AHE enhances contrast of images by considering local regions. Along with local contrast, noise
in those regions also get amplified by using AHE. This amplification of noise can be resolved by applying a
Contrast Limited AHE (CLAHE) which limits the contrast in the enhanced local regions by clipping the
histogram at a pre-fixed limit. CLAHE yields good results by limiting the contrast and enhancing local regions,
but it is image invariant since it uses pre-determined clip limit for limiting contrast. The proposed research work
TFM-CLAHE puts forward the idea of image variant, automatic clip value determinant algorithm for
enhancement. The algorithm employs triangular fuzzy membership function to determine the clip-limit and
limits the contrast by clipping the histogram at the computed clip-level. TFM function computes the clipping
parameter by considering intensities of pixels. The computed fuzzy clip-limit overrides the pre-defined limit.
Consequently, the clipping parameter varies according to the image under consideration and yields better
enhancement results. The proposed work is experimented on multimodal biometric images acquired from
CASIA Iris, Face and Fingerprint databases. TFM-CLAHE computes appropriate clipping limit for each of these
heterogenous images. The results of the proposed work are evaluated on the grounds of images’ Average
Information Content (AIC), Mean Square Error (MSE), Peak Signal Noise Ratio (PSNR) and Natural Image
Quality Evaluator (NIQE). The results show good enhancement and these are compared with existing
conventional image enhancement techniques.
Keywords: Adaptive Histogram Equalization(AHE), Biometric images, Contrast Limited Adaptive Histogram
Equalization (CLAHE), Triangular Fuzzy Membership Contrast Limited Histogram Equalization (TFM-
CLAHE), and Triangular Fuzzy Membership (TFM), multimodal biometric images.
1. INTRODUCTION
Biometric systems use unique physiological or behavioural traits of humans like finger print, iris, face,
voice, gait etc., for verification and identification purposes. These systems play a significant role in
authentication systems, access control systems, secure transaction systems, law enforcement system, time and
attendance systems, surveillance control systems and similar security applications. When a biometric system is
used as an authentication tool, verification is done by comparing and matching acquired traits with the images
that are stored in the database. Better the image’s quality, better will be the performance of matching system.
Authentication system for biometric images involves three main steps namely, pre-processing acquired images,
feature extraction from images and finally matching images with templates stored in database. Pre-processing of
biometric images improve the quality of acquired images and aid in better matching. The images’ quality
heavily relies on sensors that are used to capture these traits. However, images’ quality can be enhanced by
employing techniques for image enhancement.
The primary aim of any image enhancement technique is to bring out hidden details of the image due to
poor quality of image. When an image is enhanced, it serves as a better input for further processing like feature
extraction, feature selection, segmentation, classification etc. Conventional gray-scale image enhancement
techniques compress pixel intensities or expand using threshold values. In techniques like histogram matching, a
transformation function is applied iteratively till the computed Probability Density Function (PDF) matches the
required PDF [1]. The resultant would be an image with a better contrast. The most common technique for
enhancing image is Histogram Equalization (HE). The reason for its wide application and usage is attributed to
the ease with which it is implemented and lesser cost of computation [2,3]. However, histogram equalized
images appear visually unnatural [4]. In due course of image enhancement using HE, intensity values of pixels
are changed which lead to increased or decreased values, resulting in image which is either too bright or too
dark. Thus, images tend to lose naturalness and appear saturated.
 A number of variations and extensions of HE has been proposed by researchers to resolve problems
associated with brightness issues. Initially, Kim et.al proposed a HE variant technique, namely, Brightness
preserving Bi-Histogram Equalization (BBHE) [5]. The given image is partitioned two segments based on the
mean value of brightness of the image, and HE is applied on each of these. Thus, such an equalization leads to
preservation of brightness in image. Wan et al. proposed a variation of BBHE, viz., Dualistic Sub-Image
Histogram Equalization (DSIHE), where variation is in terms of calculating median rather than mean [6]. Yet
another variation of BBHE, proposed by Chen, is Minimum Mean Brightness Error Bi-Histogram Equalization
(MMBEBHE), which provides better brightness of images when compared to BBHE [7]. Recursive mean
separate HE (RMSHE) is also an extension to BBHE [8]. Instead of dividing the given image into two,
histograms are recursively divided until required level of enhancement is achieved. Though these methods add
good contrast and brightness levels to image, unnecessary noise is also added.
The above-mentioned techniques perform image enhancement based on mean or median values of
brightness. However, possibility for expansion of histograms beyond the minimum and maximum values of
intensities of given image is less. Though Dynamic Histogram Equalization (DHE) technique [9], Brightness
Preserving Dynamic Histogram Equalization (BPDHE) [10] techniques, try to address these issues, these still
suffer from saturation side-effects.
A variation of HE is AHE, where local regions are considered, and HE is applied to local regions. This
technique was particularly useful when the region of interest is smaller than the obtained image itself. But this
suffers from a major drawback of noise amplification. Hence, it is essential to limit the images’ contrast, thus
bringing down the noisy enhancements. This is accomplished by using CLAHE where the contrasts are limited
by clipping the slope of histograms. The clipping is based on a pre-defined limit which may be appropriate for
different images [11].
Thus, the proposed research puts forward the idea of applying Triangular Fuzzy Membership (TFM)
function for determining clipping limit and performs clipping accordingly. The clipping parameter is computed
automatically based on the given image and contrast of enhanced image is clipped at the computed level. Thus,
the image gets enhanced with better contrast and lesser artefacts. Thus, the clip limit is chosen automatically
using TFM which is image variant. This selection results in significant improvement in image’s quality since the
clip-limit varies according to the image and serves as the primary factor for reducing noise during image
enhancement.
2. BACKGROUND STUDY
Several researchers have proposed different techniques for image enhancement and pre-processing of
images. These techniques include enhancement techniques like histogram equalization, noise-removal technique
like filtering etc. In [12] pre-processing of finger print images is carried out by using histogram equalization.
The acquired finger print images are first binarized onto which median filter is applied, resulting in a biometric
image that is noise-free and the results are evaluated based on correlation between the original image and pre-
processed image.
Lalit Maurya et.al.,[13] brought in the idea of image enhancement and brightness fusion using social
spider optimization algorithm. The technique employs optimization algorithm that outputs two images; one with
increased Peak Signal to Noise Ratio (PSNR) value and the other with a high Entropy value. These two images
are then fused to get a final image that has higher contrast and lower noise. PSNR and AMBE (Average Mean
Brightness Error) are used as evaluation metrics and results show that fused images possess better enhancement
with lesser noise.
Jenifer et.al., [14] put forward the idea of fuzzy logic-based inference system for classification of clip-
limit as low, medium and high. Contrast and entropy of the images form the basis for such a classification.
Contrast is limited based on fuzzy clip-limit computed and classified as three clip-labels viz., low, medium and
high. The work focuses on enhancing digital mammograms that aid in finding breast cancer at initial stage. The
results are evaluated based on metrics like Contrast Improvement Index(CII), PSNR and AMBE and the results
reveal that the technique considerably enhances the contrast of digital images leading to better diagnosis of
breast cancer.
Magudeeswaran et.al., [15] proposed Fuzzy logic-based HE that enhances the given image by
transforming a crisp histogram into a fuzzy histogram. Then this histogram is partitioned into two sub-
histograms. The partition is done based on mean values of the histogram. These two partitions are then finally
equalized. Metrics like NIQE and AIC are used to prove the effectiveness of the algorithm. The results show that
images exhibit better contrasts using Fuzzy HE.
 Zhiguo Gui et.al., [16] proposed a fuzzy logic-based algorithm for sharpening images. This techniqueis
used to solve the problem of enhancing local image’s contrast in a spatial domain by using fuzzy sets. The
results are evaluated based on entropy and variance and images enhanced so, yield better results.Jharna
Majumdar et.al.[17], designed a variation of CLAHE that computes the tile size and clipping value based on
input image that results in enhanced images. The algorithm works well on medical images, underwater images
and aerial images. Entropy, AMBE and fitness parameters are computed on enhanced images to assess the
effectiveness of enhanced images. The results prove that images enhanced using modified CLAHE method carry
higher information content.
Zhao Wei et.al. [18] proposed a variation of Global Histogram Equalization(GHE) that maximizes the
entropy of the enhanced image. Pixel Population Mergence (PPM) and Gray-levels distribution(GLD) are
carried out to enhance the image in addition to increasing the entropy values of these images. This technique
aims at resolving the problem of minimal entropy that is exhibited by images enhanced using GHE. PSNR and
Entropy values are used as evaluation parameters for assessing the effectiveness of the method and these show
that the enhanced images have higher information content than GHE enhanced images.
J.R.Tang et.al., [19] came up with an image enhancement technique that partitions the image histogram
into two. In each of these, clipping of histogram is done at a computed clip limit. The computation of the clip-
limit is based on the number of histogram bins, the mean and median values of the image in each partition. The
smallest of the three mentioned parameters is taken as the clipping limit and contrast is limited accordingly.
Finally, the segments are fused. The effectiveness of the technique is proved using metrics like AMBE and
PSNR.
Magudeeswaran et.al. [11] proposed a new image enhancement technique that uses CLAHE with fuzzy
system. The idea involves three steps: transformation of gray level intensities into a fuzzy membership plane
followed by CLAHE enhancement on membership plane and finally transforming membership plane back to
gray scale intensities. The technique is evaluated on digital brain images and the results reveal that the images
exhibit good contrast enhancement in addition to preserving local brightness. NIQE and AIC are computed to
evaluate the quality of images enhanced.
Liyun Zhuang [20] researched on applying mean and variance on sub images and equalizing the
intensities using histogram. Experimental results prove that images under consideration are effectively
enhanced, the fine details of image are brought out and images’ original brightness is also preserved. Metrics
like PSNR, MSE, Entropy and AMBE are used to prove the effectiveness of enhanced images.
In [21], Kumud et.al., proposed a new algorithm for enhancement of image that operates on blocks of
images. The given input image is partitioned into a number of blocks. For every block, histograms are fuzzified
and equalized. Fuzzy membership functions are used to transform the pixel intensities. This process is applied
on each of the partitioned blocks and are integrated finally. PSNR and MSE metrics are used to show the
effectiveness of the enhanced images.
3. PROPOSED TFM-CLAHE IMAGE ENHANCEMENT TECHNIQUE
The proposed TFM-CLAHE method employs triangular fuzzy membership (TFM) function for automatic
determination of clipping-parameter that limits the contrast level in an image, thus resulting in an enhanced
image. TFM-CLAHE is an extension to CLAHE method, but unlike using a pre-fixed clip limit, in this proposed
work, the clipping parameter is determined by using a triangular fuzzy membership (TFM) function. The
clipping parameter, thus obtained, is variant to image on which TFM-CLAHE is applied. This proposed work
aims to enhance biometric images, especially heterogeneous images involved in multi-modal authentication
system. Heterogenous biometric traits like fingerprint, iris, face etc., are used in combination for a multimodal
authentication system [22-23] [33]. When contrasts are limited at a pre-defined clip value, enhancement of
resulting images yield uniform enhancements, even if images vary. This is because, the intensity values in a
specific context-region is uniformly affected. Higher clip limit results in higher enhancements and lower values
of clip limit results in lower performance. Instead, if a suitable clipping-parameter determination method is used
which varies according to the image, then the enhancement yields good results since it is image specific. Thus,
triangular fuzzy membership (TFM) function comes as a solution to compute clip limit which is variant to image
and determines the clipping limit based on the image. For a multimodal authentication, multiple biometric traits
are used in combination for authenticating users. Thus, instead of uniform enhancement of images, TFM-
CLAHE enhances by adjusting the clip limit for each of these heterogeneous images based on their intensities.
The proposed algorithm updates new clip limit by using the TFM function which makes it flexible and varies
according to image. This algorithm is applied on multiple biometric images viz fingerprint, face and iris.
3.1. Histogram Equalization (HE)
Histogram Equalization (HE) is one of the popular techniques for image enhancement that focuses on
improving images’ contrasts, resulting in an enhanced image. When overall global contrast of an image is to be
increased, histogram equalization is employed. Equalizing a histogram adjusts the pixel’s intensity values in a
uniform way by distributing the pixel values equally[14]. Thus, those regions where the intensity values are low
are enhanced by improving contrast in those areas. Let a gray scale image be x and let n ibe the total number of
gray level i in the given image. The probability that a pixel i in an image occurs is given as follows:

(1)

Where gray levels’ total count is represented by L. This generally ranges between (0-255), for a gray
scale image. The total pixels in the image is given by n, and is the associated probability for each of i

pixels. The Cumulative Distribution Function (CDF) corresponding to is given by the following equation:

(2)

Using the cumulative distribution function for transformation, HE maps the given input images’ intensity
values to values ranging between x0 to xL-1. Thus, the transformation function based on CDF is given by:

(3)

The resultant of enhanced image using histogram equalization is defined as

(4)

where the co-ordinates of the image are given by i and j.

3.2. Adaptive Histogram Equalization (AHE)
Histogram Equalization operates on generating histograms on global regions of image. When fine details
of the image need to be captured, then local regions of context need to be enhanced. Adaptive Histogram
Equalization (AHE) is an extension of HE where local regions are considered and HE is computed for each local
region. The image is segmented into number of regions and each of the local region is a called a tile or a
window. Similar to transformation function of HE, here too transformation function is applied but to each tile in
a local region of gray scale image. Consequently, every pixel in a local or context region, is transformed based
on the histogram of tile under consideration, i.e., its neighbourhood. Thus, the resulting transformation function
and Cumulative Distribution Function (CDF) of pixel values in the neighbourhood are proportional.
Since contrast is enhanced in each local region under consideration, regions with varied intensity values
can be simultaneously analysed [24-25]. Region-wise enhancement, however, amplify noise that is present in
those regions along with other intensities, resulting in an enhanced image with amplified noise.
3.3. Contrast Limited Adaptive Histogram Equalization (CLAHE)
Contrast Limited Adaptive Histogram Equalization (CLAHE) was proposed to limit and bring down the
levels of over amplified noise [26]. The level of amplification of contrast is represented by the transformation
function’s slope. The slope of the transformation function represents the level of amplification of contrast.
CLAHE limits such contrasts by clipping the slope of the transformation function at some pre-defined clip limit.
Those clipped portions of histograms are then redistributed. Thus, by clipping and redistribution, the images
tend to appear enhanced, natural and with minimized amplification of noise introduced by the adaptive HE [26].
 In (CLAHE), the slope of histogram is cut at some pre-determined threshold and this acts as the limiting
factor for noise amplification. Thus, CLAHE tries to minimize higher contrasts, thus resulting in a smoother
histogram of the image [27-28], and the image’s contrast is enhanced by applying a clip-limit for each tile
region, thereby curtailing noise amplification.
Unlike, AHE, HE equalizes images by applying contrasts on global regions. This is accomplished by
extending the contrast of the high intensity histogram regions and compressing the regions where intensities of
pixels are low. When the region of interest is small in an image and if global equalization is employed, then,
these portions do not tend to exhibit clear delineations from other regions. CLAHE algorithm tries to overcome
the issue by restricting the enhancement rate [29]. The enhancement through HE technique is dependent on

(5)

Therefore, the rate of enhancement can be limited by restricting the value of p(x). When the slope of the
histogram is clipped, the number of bins in the histogram is either increased or decreased based on the clip
parameter [29]. The histogram’s slope of the input image is trimmed using the clip limit parameter which is
given by equation(6)

(6)

where is the pre-defined clip limit and w is the size of tile or window region under consideration. For
a gray-scale image, the number of bins is 256, i.e., the range of pixels from 0-255. Those regions that are
clipped are then redistributed to the existing bins. HE is then computed for the altered histogram [30]. Though
CLAHE provides an edge over AHE by providing a limit factor for minimizing amplification of noise, the
downside of CLAHE method is that the histograms are trimmed at a pre-fixed user specified clipping value.
This value remains the same for all images and is crisp. Hence, the proposed research brings in the idea of
applying Triangular Fuzzy Membership (TFM) Function for determining clipping limit automatically.
3.4. Proposed Methodology -Triangular Fuzzy Membership Contrast Limited Adaptive Histogram
Equalization (TFM) CLAHE algorithm
TFM-CLAHE provides automatic, image variant fuzzy clip-limit for limiting contrast and resulting in
enhanced image. The proposed research applies Triangular Fuzzy Membership (TFM) Function for determining
clipping limit and performs clipping accordingly. The clipped portion of histogram that surpasses the clip limit
are redistributed among all histogram bins equally. The triangular fuzzy membership function (TFM) takes three
values as inputs which form the minimum, maximum and mean values of image’s pixel intensities in the
considered window and computes the fuzzy number which determines the clipping parameter for image
I. The value returned by TFM ranges between 0 and 1 and clipping is done accordingly. Those intensity values
that exceed the calculated clipping limit are redistributed as in CLAHE, thus resulting in a smoothened
histogram.

A triangular fuzzy number computed by the membership function is denoted by . The

mathematical formulation of TFM is given by the following equation.

(7)
 Where the parameters {a, b, c} (with a < b < c) determine the coordinates of the three corners

of the underlying TFM. Here denotes the image dependant clipping parameter.

The point b, with membership value of 1, is the mean value and a and c are left hand spreadand right
hand spread of .

The TFM-CLAHE algorithm computes the fuzzy clip-limit by using the following equation, thus is a
replacement of pre-defined crisp clip-limit with a TFM calculated fuzzy clip limit.

(8)

where isthe TFM clipping parameter ranging from 0to 1.

This TFM lets areas of lower local contrast to attain a higher contrast and limits noise in high contrast
regions. After computation of clip-limit, the calculation of probability of occurrence of pixel is given
as follows:

(9)

Cumulative Distribution Function (CDF) corresponding to is given as

(10)

This becomes the image’s accumulated histogram. The transformation function is given by

(11)

The resultant of enhanced image using TFM-CLAHE is as follows:

(12)

where i and j are the co-ordinates of enhanced image.

The algorithm for enhancing individual image regions by using the TFM-CLAHE technique is described below:
The pseudocode for TFM-CLAHE is given in Algorithm 1:
Algorithm 1: TFM-CLAHE
Input: Biometric images
Output: TFM-CLAHE enhanced image
1. Segment each input image into a number of non-overlapping window or tile. Each of these regions are
of equal size of nxn blocks. Each of these corresponds to the pixels of neighbourhood.
2. Compute histogram of each of the segmented tile or window.
3. Compute TFM clip limit for limiting the contrast of the image, which automatically

determines clip-limit that is image variant.

 4. Limit the slope of each histogram such that height of the slope is within the computed clip limit.
5. Redistribute clipped pixels to get smooth histogram
6. Check if required enhancement is achieved. If yes, go to step 7. Else go to step 3 to recomputed clip-
limit.
7. Enhance biometric images by altering gray scale intensities according to the modified histogram.
The table below shows sample clip-limit values computed by TFM-CLAHE.
Biometric Trait IMG # Clip-limit
1 0.0772
2 0.0773
Iris 3 0.0684
4 0.0732
5 0.0697
TFM-CLAHE Steps 6 0.0485
Input image
7 0.0565
Divide image into tiles
Face 8 0.0472
Generate histogram for each tile
9 0.0426
Apply TFM to compute clip limit
Limit contrast based on computed 10 0.0407
clip limit 11 0.0478
Quality check for enhanced image 12 0.0573
Enhanced image Fingerprint 13 0.0533
14 0.0436
(i)15
Input Image 0.0525 (ii) Segment input image
Table 1: TFM-CLAHE Computed Clip-limit values into tiles

(iii) Compute histogram for each tile

……

(iv)Compute clip
(v) Limit the contrast based on
limit using (TFM)
TFM clipping parameter

(vi)Check
Required
Contrast

No

Yes

(vii) Output: Enhanced

Image
 figure 1: Flow chart of proposed TFM-CLAHE

4 EXPERIMENTAL RESULTS AND DISCUSSION

The experimental set up for the proposed algorithm includes Intel (R) Core (TM) i3-7100U processor
with 4 GB RAM with 64-bit OS, x-64 based processor. TFM-CLAHE technique is compared with conventional
image enhancement techniques like Contrast Limited Adaptive Histogram Equalization (CLAHE), Adaptive
Histogram Equalization (AHE), Histogram Equalization (HE) and unenhanced original image. The images
under consideration are biometric images from multiple modalities. These images are obtained from three
benchmarked databases, viz., CASIA Iris, CASIA Face and CASIA Fingerprint databases. The proposed method
automatically computes clip-limit depending on the image under consideration. Biometric images have smaller
region of interests when compared to the original image. Hence, heterogeneous biometric images are employed
to test the clip-limit computation of the proposed method. The results reveal that the proposed technique works
well on these heterogeneous images by computing the clip-limit and enhancing images accordingly.
Chinese Academy of Science, Institute of Automation (CASIA) is a database which has huge
repository of datasets for conducting biometric ideal tests. A variety of biometric traits like iris, fingerprint,
facial images, palm print, multispectral palm, handwriting and signature datasets are stored in this repository.
This research work is conducted on three of these databases which are acquired from CASIA Iris Image
Database version 1.0, CASIA Face Image Database for Testing version 1.0, CASIA Finger Image Database
version 5.0. The Iris database has a total of 756 images which are captured from 108 eyes with 7 images for
each eye. Face database has a total of 1000 classes with 4 images in each class. The fingerprint database has a
total of 500 classes with 400 samples in each of the class.

(i) (ii)

(iii) (iv)
 (v)

Figure 2: Comparison of Iris Image and Histograms (i) Original unenhanced image (ii) Image Enhanced
using HE (iii)Image Enhanced using AHE (iv) Image Enhanced using CLAHE (v) Image Enhanced using
Proposed TFM-CLAHE
The results of experiments are evaluated on three traits of biometrics, namely Iris, Face and Fingerprints
from these databases. Multiple modalities are considered for evaluating the effectiveness of the proposed
algorithm on heterogenous images and compared against classical enhancement techniques. Average
Information Content (AIC), Naturalness Image Quality Evaluator (NIQE), Peak Signal Noise Ratio (PSNR) and
Mean Square Error (MSE) are used as metrics to assess the effectiveness of the proposed algorithm.
Figure 2 shows gray scale images of Iris and their corresponding histograms. Results of enhanced images
using HE, AHE, CLAHE and proposed TFM-CLAHE are also sketched. For the histogram images, intensity
values from 0-255 are plotted in x-axis since images under consideration are gray scale images. The count of
each pixel values is plotted in y-axis. Figure 2(i) shows the original iris image and its respective histogram. In
2(ii) iris image is enhanced using histogram equalization. Though the original image is enhanced, the
enhancement is uniform. In case of an iris recognition system, the region of interest is at the centre and higher
contrast in these regions will yield better results rather than uniform enhancement. Histogram of HE enhanced
image shows uniform distribution of intensity values. Figure 2(iii) shows the results of enhancing given input
image using Adaptive Histogram Equalization (AHE) technique. AHE, though comes as a solution to global
enhancement, this also results in over amplification of unwanted noise in local regions. The corresponding
histogram shows pixel intensities that are distributed non-uniformly. Iris image enhanced using CLAHE is
sketched in figure 2(iv). Though amplification of noise in local regions are limited, using a pre-defined clip limit
yields a uniform enhancement. Histogram of CLAHE enhanced image also shows peak values for certain
intensity values. Image enhancement using TFM-CLAHE is shown in figure 2(v). The figure shows that the
proposed method exhibits better enhancement over other methods. The figure also illustrates that the region of
interest shows higher contrast values than other regions. The circular shaped pupil, iris and surrounding circular
regions have higher brightness values than other regions of the image. An iris image enhanced in such a
way,tend to produce better results for further processing. The histogram of the proposed method also exhibits
smoother distribution of pixel intensities.
In figure 3, the results of enhancement of various techniques applied on facial images are illustrated. The
original image 3(i) is enhanced using Histogram Equalization (HE) and the outcome is shown in figure 3(ii).
The facial features are enhanced in a global way, affecting pixel intensities to be distributed in a smoother way.
Such an enhancement leads to a washed-out effect of the image. AHE enhancement as shown in figure 3(iii)
contributes to a good amount of contrast enhancement. The natural appearance of image is compromised in the
process of enhancement .The histogram of these images exhibits peak values between high and low pixel
intensity levels. Limiting the contrast using TFM computed clip limit shows better enhancement in terms of
preserving the brightness. Figure 3(v) shows TFM-CLAHE enhanced image which appears visually pleasing
and natural as compared to figure 3(iv) which is the resultant of enhancement using CLAHE where the contrast
is limited based on a pre-defined limit. The histogram of the proposed method also shows that the pixels are
evenly spread and distribution is smoother.
Figure 4 shows the comparative results of images enhanced using classical techniques and proposed
technique. The techniques are applied on fingerprint images. Ridges, valley, delta, cross-over regions present in
finger prints make these traits unique and differ from individual to individual. HE enhanced fingerprint applies a
global enhancement and the regions like ridges, delta etc. are uniformly enhanced along with other regions of
fingerprint. This is depicted in figure 4(ii). The histogram corresponding to this image shows smooth
distribution. Figure 4(iii) shows image of fingerprint enhanced using AHE. Contextual regions are fairly
enhanced, but unnecessary artefacts are also enhanced. The histogram of AHE enhanced image also shows few
peak values for certain pixel values. CLAHE enhanced image shown in figure 4(iv) exhibits good enhancement
though clear demarcation of ridges and valleys is subtle. The corresponding histogram also shows non-smooth
distribution. Image enhancement using proposed TFM-CLAHE is shown in figure 4(v). Fingerprint image is
enhanced by limiting the contrast at a clip-limit that is computed according to the given fingerprint image.
Enhanced TFM-CLAHE image shows clear demarcation among valleys, ridges, delta and cross-overs. The pixel
distribution in the corresponding histogram is also smooth and uniform.
Thus, the results reveal that the proposed method, TFM-CLAHE, provides better enhancement on varied
images that are used. The clip-limit varies according to the image and limits the contrast appropriately. The
region of interest in each of these images are suitably enhanced. The main aim of the proposed research, TFM-
CLAHE is to enhance the contrast of images by applying enhancements to local regions and keeping the
contrast level below image-dependant clip-limit. The results also show that the proposed method retains the
naturalness of images and are visually pleasing. Adding on to this, the region of interests shows higher contrast
values than other regions. The cause of such appropriate enhancement is use of right clip-limit that is not pre-
determined but is adjusted based on the image. Thus, the use of triangular membership function to compute
clipping limit for varied images, yield better results since there is no pre-determination of any clip-limit and can
be varied automatically depending on the image under consideration.

(i) (ii)

(iii) (iv)

(v)
 Figure 3: Comparison of Lena Face Image and Histograms (i) Original unenhanced image (ii) Image
Enhanced using HE (iii) Image Enhanced using AHE (iv) Image Enhanced using CLAHE (v) Image
Enhanced using Proposed TFM-CLAHE

(i) (ii)

(iii) (iv)

(v)
Figure4: Comparison of Fingerprint Image and Histograms (i) Original unenhanced image (ii) Image
Enhanced using HE (iii) Image Enhanced using AHE (iv) Image Enhanced using CLAHE (v) Image
Enhanced using Proposed TFM-CLAHE
4.1 Image Quality Assessment (IQA)
Average Information Content (AIC), Natural Image Quality Evaluator (NIQE), Peak Signal to Noise
Ratio (PSNR) and Mean Square Error (MSE) are the metrics that are employed in the proposed research work to
assess quality of enhanced image. These values are also compared with classical image enhancement
algorithms. IQA provides mathematical models that evaluate the quality of images.
4.1.1 Average Information Content (AIC)
AIC computes the information content of an image. Image with a high AIC value, shows that the
information content of the image is also high. Hence an image that yields a higher value is said to carry higher
information content. The average information content or entropy is defined as
 (13)

where is the kth probability density function[30].

Figures 5, 6 and 7 illustrate AIC values for images enhanced using proposed TFM-CLAHE technique
and image enhancement techniques such as HE, AHEand CLAHE. The proposed technique is applied on
datasets from three different databases. It is apparent from the figures that the images enhanced using the
proposed method carry high information content as compared to other techniques.

Figure 5: Comparison of AIC values for CASIA Iris Database among various image enhancement
techniques and proposed algorithm

Figure 6: Comparison of AIC values for CASIA Face Database among various image enhancement
techniques and proposed algorithm
Figure 7: Comparison of AIC values for CASIA Fingerprint Database among various image enhancement
techniques and proposed algorithm

AIC
Biometric IMG
Trait # Original TFM-
HE AHE CLAHE
Image CLAHE
1 5.6949 4.8625 6.8025 5.2026 7.1877
2 5.7597 4.91 6.7215 5.314 7.0041
Iris 3 5.7631 4.8854 7.0232 5.4341 7.3042
4 6.702 5.6077 7.0564 6.2693 7.5077
5 6.355 5.2081 7.4393 5.8552 7.5277
6 7.2525 5.9714 7.0116 7.1805 7.4872
7 7.3234 5.6938 7.2536 7.1584 7.4009
Lena Face 8 6.5275 5.3296 7.1853 6.3067 7.2593
9 6.8398 5.7256 7.022 6.612 7.4888
10 7.1898 5.9594 7.2705 7.0098 7.4792
11 7.2769 5.8814 7.0602 6.888 7.6455
12 7.1583 5.8787 7.1777 6.6138 7.638
Finger Print 13 6.9607 5.8625 7.2572 6.5259 7.6533
14 6.735 5.6383 7.1303 6.3325 7.3788
15 6.604 5.6722 7.2695 6.2326 7.4258
Table 2: Comparison of AIC values
Table 2 shows AIC values of original image and images enhanced using HE, AHE and CLAHE. The
values are computed for three different set of images namely iris, face and fingerprint. It is evident from the
table that the proposed TFM-CLAHE method has higher AIC values when compared to other techniques.
4.1.2Natural Image Quality Evaluator (NIQE)
Yet another metric for measuring image quality is Natural Image Quality Evaluator (NIQE) [31-32]. It is
based on a model of Natural Scene Statistic (NSS). This is based on simple space domain which includes
collection of statistical features. The roots of these images are from a set of images that are both natural and
undistorted. The NIQE index scores range between 0 and 100 with lower values indicating better image quality.
 Figures 8, 9 and 10 show NIQE values computed on proposed method and conventional techniques. The
outcome of calculation shows that TFM-CLAHE enhanced images have lower NIQE values in comparison with
other techniques.

Figure 8: Comparison of NIQE values for CASIA Iris Database among various image enhancement
techniques and proposed algorithm

Figure 9: Comparison of NIQE values for CASIA Face Database among various image enhancement
techniques and proposed algorithm
Table 3 summarizes the natural image quality evaluator index of images enhanced using various
techniques and the values show that the image enhanced using the proposed TFM-CLAHE method exhibits
better image quality.
 Figure 10: Comparison of NIQE values for CASIA Fingerprint Database among various image
enhancement techniques and proposed algorithm

NIQE
Biometric IMG
Trait # Original TFM-
HE AHE CLAHE
Image CLAHE
1 21.8744 20.887 22.8775 18.8784 17.8709
2 19.8759 20.8784 18.8809 18.8797 17.2165
Iris 3 22.8765 21.8785 21.8788 19.8347 18.7807
4 19.8777 19.8791 18.8801 18.4127 17.8807
5 21.8752 22.8777 21.8774 22.8785 19.8785
6 4.2582 4.6226 4.92 3.0971 3.0262
7 4.5149 5.2806 4.7013 4.3492 3.7423
Lena Face 8 4.9694 3.4264 4.8383 4.163 3.098
9 6.4476 4.2088 5.298 5.4924 4.0194
10 6.8143 6.6968 5.5055 6.4829 5.4829
11 22.8869 19.884 22.887 21.8934 18.7644
12 18.8798 18.8873 20.8891 19.8871 18.7092
Finger Print
13 21.8804 20.8779 20.8816 20.8933 20.4302
14 19.8831 19.8809 19.8785 18.8919 17.3209
15 21.8894 20.8869 21.0028 20.8927 19.8875
Table 3: Comparison of NIQE values
4.1.3 Mean Square Error (MSE)and Peak Signal to Noise Ratio (PSNR)
Mean Square Error is an image quality assessment metric. It assesses the error sensitivity of the enhanced
image as compared to the original image. Lower values of MSE indicate lower error in the enhanced image as
compared to the original. It is given by the following equation.

(14)

where is the gray level values of original image O and is the gray level values of enhanced
image E. M and N are the dimensions of the images.
 Peak Signal to Noise Ratio (PSNR) is a significant metric that measures the quality achievement of
enhanced image in comparison with the original image as well as it indicates the degree to which contrast in the
image is achieved. A higher value of PSNR indicates that there is a minimal degradation of the image as
compared to the original image. PSNR computation is given by the following equation.

(15)

where L is the intensity level of image and for a gray scale image, it is 255.
Figures 11 to 13 illustrate the comparative values of MSE. The values of computed MSE for images
enhanced using various enhancement techniques and proposed method are tabulated in table 4. The table and
figures indicate that the images enhanced using the proposed method exhibits lower error values as compared to
the original image, thus yielding a better quality.

Figure 11: Comparison of MSE values for CASIA Iris Database among various image enhancement
techniques and proposed algorithm

Figure 12: Comparison of MSE values for CASIA Face Database among various image enhancement
techniques and proposed algorithm
 Figure 13: Comparison of MSE values for CASIA Fingerprint Database among various image
enhancement techniques and proposed algorithm
Figures 14 to 16 illustrate PSNR values of images enhanced using various image enhancement
techniques. These values are tabulated in table 5. The table and figures indicate that the images enhanced using
the proposed method exhibit higher values of PSNR as compared to the original image, thus revealing that the
images are enhanced with better contrast and quality.

MSE
Biometric IMG
Trait # HE AHE CLAHE TFM-CLAHE
1 0.00052 0.00170 0.00014 0.00006

2 0.00095 0.00160 0.00041 0.00013

Iris 3 0.00096 0.00160 0.00041 0.00013

4 0.00044 0.00150 0.00030 0.00011

5 0.00070 0.00140 0.00026 0.00010

6 0.00023 0.00023 0.00020 0.00018

7 0.00006 0.00012 0.00025 0.00006

Lena Face 8 0.00034 0.00030 0.00018 0.00013

9 0.00028 0.00013 0.00027 0.00013

10 0.00008 0.00013 0.00025 0.00008

11 0.00150 0.00042 0.00038 0.00031

12 0.00140 0.00026 0.00018 0.00015

Finger Print 13 0.00026 0.00022 0.00120 0.00016

14 0.00130 0.00019 0.00029 0.00007

15 0.00160 0.00029 0.00023 0.00014

Table 4: Comparison of MSE values

Figure 14: Comparison of PSNR values for CASIA Iris Database among various image enhancement
techniques and proposed algorithm

Figure 15: Comparison of PSNR values for CASIA Face Database among various image enhancement
techniques and proposed algorithm
 Figure 16: Comparison of PSNR values for CASIA Fingerprint Database among various image
enhancement techniques and proposed algorithm

PSNR
Biometric IMG
Trait # HE AHE CLAHE TFM-CLAHE
1 32.8397 27.6627 38.54 42.2291

2 30.2411 27.8692 33.9196 38.7503

Iris 3 30.1888 27.8669 33.8779 38.7522

4 33.6074 28.2981 35.2133 39.4347

5 31.5419 28.4589 35.8142 40.2038

6 36.297 36.3428 37.0054 37.4939

7 42.4779 38.824 35.8277 42.4948

Lena Face 8 34.6895 35.1927 37.3659 38.9811

9 35.5882 38.7589 35.7538 38.9739

10 40.8857 38.9108 35.9627 41.2405

11 28.1128 33.7268 34.1899 35.0631

12 28.6921 35.8636 37.549 38.2256

Finger Print 13 35.934 36.6453 29.1029 38.0459

14 28.955 37.1681 35.4276 41.5973

15 27.978 35.3745 36.3611 38.4115

Table 5: Comparison of PSNR values

Table 6 below, summarizes the statistical significance of the proposed TFM-CLAHE method against
conventional methods. T-test is a statistical significance test which specifies if the difference between pair of
methods' mean values shows a significant difference between the pair.The table holds P-values assigned by T-
test conducted between pair of methods where one of the methods in the pair is the proposed method.This test is
conducted between TFM-CLAHE-CLAHE, TFM-CLAHE-AHE and TFM-CLAHE-HE to demonstrate that
proposed method varies significantly with other methods. The test is applied on three different databasesfor four
metrics viz., AIC,NIQE,MSE and PSNR.The statistical computation adopts confidence level of 5% where P-
value is lesser than 0.05. The table also indicates that the computed values satisfy the adopted P-value
(<0.05).Therefore, the table demonstrates that the proposed method shows significant improvement in
enhancing an image under consideration.

Proposed Method CLAHE AHE HE

TFM-CLAHE (Face Database) 0.000008 <10-10 <10-10

AIC TFM-CLAHE (Iris Database) <10-10 0.022440 <10-10

TFM-CLAHE (Finger Print Database) 0.000003 <10-10 <10-10

TFM_CLAHE (Face Database) 0.000009 0.000622 0.000001

NIQE TFM-CLAHE (Iris Database) <10-10 0.000001 0.002010

TFM-CLAHE (Finger Print Database) 0.000003 0.000285 0.001184

TFM_CLAHE (FACE DATABASE) <10-10 0.000023 0.000016

MSE TFM-CLAHE (Iris Database) <10-10 <10-10 <10-10

TFM-CLAHE (Finger Print Database) <10-10 <10-10 <10-10

TFM_CLAHE (Face Database) <10-10 0.000002 0.000018

PSNR TFM-CLAHE (Iris Database) <10-10 <10-10 <10-10

TFM-CLAHE (Finger Print Database) 0.001259 0.002118 0.000056

Table 6: Statistical significance of Proposed TFM-CLAHE with conventional image enhancement
techniques for CASIA database
5 CONCLUSION
In this research work, a novel triangular fuzzy member-based contrast limited adaptive histogram equalization
(TFM-CLAHE) technique is proposed. This technique enhances the images by increasing the contrast and
computing clip-limit automatically on the basis of input image to minimize amplification of noise. When clip-
limit is computed automatically, the limiting factor becomes image dependant. Thus, it enhances the input image
by increasing the contrast depending on the pixel intensities. The clipping values vary according to the images.
This technique retains brightness and naturalness of the image in addition to producing smoother distribution of
pixels in the histogram. The computed clip parameter limits the contrast thereby preventing over amplification
of noise. Application of a pre-defined clip-limit as in CLAHE, is image invariant and enhances the images in a
global way that results in an enhanced image having uniform contrast. TFM-CLAHE method computes the clip-
limit that is dependent on input image and adjusts the clip-limit accordingly, thus replacing a crisp clip-limit
with a fuzzy clip-limit. To alter the clipping limit based on image chosen, TFM-CLAHE calculates the clipping
limit applying triangular fuzzy member function. The experiments are conducted on heterogeneous biometric
images to test its effectiveness on varied images. Three different databases from CASIA database viz., Iris, face
and fingerprint are used and images are enhanced. Multiple biometric images are thus enhanced and these used
as a means of authentication in multimodal authentication systems. Experiments also showed that clip-limits
varied according to input images and resulted in a contrast improved images.
REFERENCES
[1] William K. Pratt, "Digital Image Processing: PIKS Inside", Fourth Edition. John Wiley & Sons, Inc, 2007.
[2] X. Su, W. Fang, Q. Shen, and X. Hao, “An image enhancement method using the quantum-behaved particle
swarm optimization with an adaptive strategy”, Mathematical Problems in Engineering, vol. 2013, 3 pages,
2013.
[3] Ke Gu , Guangtao Zhai , Xiaokang Yang, “Automatic Contrast Enhancement Technology with Saliency
Preservation” IEEE Transactions on Circuits and Systems for Video Technology”, pp. 1480-1494, 2014.
[4] C. G. Ravichandran and V. Magudeeswaran, “An efficient method for contrast enhancement in still images
using histogram modification framework”, Journal of Computer Science, vol. 8, no. 5, pp. 775–779, 2012.
[5] Y. Kim, “Contrast enhancement using brightness preserving bi-histogram equalization”, IEEE Transactions
on Consumer Electronics, vol. 43, no. 1, pp. 1–8, 1997.
[6] Y. Wan, Q. Chen, and B.-M. Zhang, “Image enhancement based on equal area dualistic sub-image
histogram equalization method”, IEEE Transactions on Consumer Electronics, vol. 45, no. 1, pp. 68–75,
1999.
[7] S. D. Chen and A. R. Ramli, “Minimum mean brightness error bi-histogram equalization in contrast
enhancement”, IEEE Transactions on Consumer Electronics, vol. 49, no. 4, pp. 1310–1319, 2003.
[8] S. D. Chen and A. R. Ramli, “Contrast enhancement using recursive mean-separate histogram equalization
for scalable brightness preservation”, IEEE Transactions on Consumer Electronics, vol. 49, no. 4, pp.
1301–1309, 2003.
[9] M. Abdullah-Al-Wadud, M. H. Kabir, M. A. A. Dewan, and O. Chae, “A dynamic histogram equalization
for image contrast enhancement”, IEEE Transactions on Consumer Electronics, vol. 53, no. 2, pp. 593–600,
2007.
[10] N. S. P. Kong and H. Ibrahim, “Color image enhancement using brightness preserving dynamic histogram
equalization”, IEEE Transactions on Consumer Electronics, vol. 54, no. 4, 2008.
[11] V.Magudeeswaran, J.Fensia Singh, “Contrast Limited Fuzzy Adaptive Histogram Equalization for
Enhancement of Brain Images”, International Journal of Imaging Systems and Technology,vol.27 pp.98-
103, 2017.
[12] Dr.E.Chandra, Ms.K.Kanagalakshmi, “Noise Elimination in Fingerprint Image Using Median Filter”,
International Journal of Advanced Networking and Application, Vol.2, Issue 6 pp.950-955,2011.
[13] L.Maurya, P.K.Mahapatra and A.Kumar,“A social spider image fusion approach for contrast enhancement
and brightness preservation”, Applied Soft Computing, Vol.52, pp.575-592, 2017.
[14] Sheeba Jenifer, S.Parasuraman, Amudha Kadirvelu, “Contrast Enhancement and Brightness Preserving of
Digital Mammograms using Fuzzy Clipped Contrast Limited Adaptive Histogram Equalization Algorithm”,
Applied Soft Computing,2016.
[15] V.Magudeeswaran, V.Ravichandran, “Fuzzy Logic Based Histogram Equalization for Image Contrast
Enhancement”, Mathematical Problems in Engineering, Vol.2013, 2013.
[16] Zhiguo Gui, Yi Liu, ”An Image Sharpening Algorithm Based on Fuzzy Logic”, Optik, pp.697-702,2011.
[17] Jharna Majumdar, Santhosh Kumar,“Modified CLAHE: An Adaptive Algorithm For Contrast Enhancement
of Arial, Medical and Underwater Images”, International Journal of Computer Engineering and
Technology, Vol.5, issue 11, pp. 32-47, 2014.
[18] Zhao Wei, Haung Lidong, Wang Jun, Sun Zebin, “Entropy Maximization Histogram Modification Scheme
for Image Enhancement”, IET Image Processing, pp.226-235, 2015.
[19] J.R. Tang, N.A. Mat Isa, “Adaptive Image Enhancement based on Bi-Histogram Equalization with a
clipping limit”, Computers and Electrical Engineering, Vol.40, No.8, pp.86-103, 2014.
[20] Liyun Zhuang, Yepeng Guan, “Image Enhancement via Subimage Histogram Equalization Based on Mean
and Variance”, Computational Engineering and Neuroscience, Vol.2017, 2017.
[21] K.Saxena, A.Pokhriyal, Sushma Lehri, “SCIENCE:Soft Computing Image Enhancement for Contrast
Enhancement”, International Journal of Advanced Computing, Vol.47,Issue 1,2014.
[22] B.SreeVidya and D.Pugazhenthi , “Multiple Biometric Security in Cloud Computing”, International
Journal of Advanced Research in Computer Science and Engineering”, Vol.3, Issue 4, 2013.
[23] Sree Vidya B and Pugazhenthi D. “Multimodal Biometric Cryptographic Based in Cloud Environment to
Enhance Information Security”, International Conference World Academy of Science Engineering and
Technology Vol2, 2015.
[24] Wang, Z. and Tao, J., “A fast implementation of adaptive histogram equalization”, 8th International
Conference on Signal Processing, Vol. 2, 2006.
[25] Hossain, F. and Alsharif, M.R., “Image enhancement based on logarithmic transform coefficient and
adaptive histogram equalization”, International Conference on Convergence Information Technology, pp.
1439-1444, 2007.
[26] Reza, A.M., “Realization of the contrast limited adaptive histogram equalization (CLAHE) for real-time
image enhancement”, Journal of VLSI signal processing systems for signal, image and video technology,
38(1), pp.35-44. 2004.
[27] Hitam, M.S., Awalludin, E.A., Yussof, W.N.J.H.W. and Bachok, Z., “Mixture contrast limited adaptive
histogram equalization for underwater image enhancement”, International Conference on Computer
Applications Technology (ICCAT), pp. 1-5,2013.
[28] C.H. Ooi, N.S. Pik Kong, H. Ibrahim, “Bi-histogram equalization with a plateaulimit for digital image
enhancement”, IEEE Trans. Cons. Electron. 55 (4) pp.2072–2080, 2009.
[29] K. Liang, Y. Ma, Y. Xie, B. Zhou, R. Wang, “A new adaptive contrast enhancement algorithm for infrared
images based on double plateaus histogram equalization”, Infrared Phys. Technol. 55 pp.309–315, 2012.
[30] Y. Chang and C. Chang, “A simple histogram modification scheme for contrast enhancement”, IEEE
Transactions on Consumer Electronics, vol. 56, no. 2, pp. 737–742, 2010.
[31] A. K. Moorthy and A. C. Bovik, “Blind image quality assessment: from natural scene statistics to
perceptual quality”, IEEE Transactions on Image Processing, vol. 20, no. 12, pp. 3350–3364, 2011.
[32] A. Mittal, R. Soundararajan, and A. C. Bovik, “Making a completely blind image quality analyzer”, IEEE
Signal Processing Letters, vol. 20, no. 3, 2013.
[33] Sree Vidya B, Chandra E, “Multimodal biometric hashkey cryptography based authentication and
encryption for advanced security in cloud”, Biomedical Research, pp.506-516,2018