2016 International Seminar on Application for Technology of Information and Communication

Face Recognition using 3D GLCM and Elman

Levenberg Recurrent Neural Network

Rocky Yefrenes Dillak Sumartini Dana Marthen Beily

Electrical Engineering Deparment Electrical Engineering Department Electrical Engineering Department
Politeknik Negeri Kupang Politeknik Negeri Kupang Politeknik Negeri Kupang
Kupang, Indonesia Kupang, Indonesia Kupang, Indonesia
rocky_dillak @ yahoo.com sumartinidana @ yahoo.com marthen.beily @ yahoo.co.id

AbstractFace recognition has been widely used as biometric
systems currently. Because of its ability to recognize a person
identity reliably and accurately based on face. This research
aims to develop a method that can be used for face recognition
system. The proposed approach works as follows:(i) preprocess
input images using gray-scaling, contrast stretch and Amoeba
Median Filter, (ii) extract its characteristic features using 3D
GLCM which is expanded from 2D GLCM, (iii) train these
characteristic features using The Elman Levenberg Neural
Network to obtain the recognition rate. Data used in this paper
were taken from The Essex database which contains 7900 face
images taken from 395 individuals (male and female). Based
on experiments conducted, this method reached the recognition
rate of 98.86 percent which showed the considerable
enhancement compared to previous methods
Keywordsface recognition; 3d-GLCM; elman recurrent;
neural network; levenberg
I. INTRODUCTION
Biometric system such as fingerprints, iris, or face is a
security system created to measure and analyze biological data
of a person based on certain characteristics. Because of its
uniques characteristic which each person has different features
from others, biometric features can be used as an indicator of
one's identity to fulfill the information security.
Since known as one of the excellent biometric systems,
face recognition currently has been widely developed and
become an interesting research topic in the field of pattern
recognition and artificial intelligence. As one of the important
biometric identification technology of human body, its
maturation and improvement will bring brand-new
management ways for state security, social security, bank
financial security, social welfare and electronic currency
payments.
However, the performance of this system usually depends
on features extraction and classifier algorithm. Hence, the use
of suitable algorithm will increase the accuracy of recognition
rate. The suitable algorithm is the algorithm that able to
extract the face features so can be used to differ each face [1].
Various research have proven that Gray level co-
occurrence matrix (GLCM) is powerful basis for use in
pattern recognition. The textural properties calculated from
the GLCM help understand the details about the image
content. Such as conducted in [2] and [3] proved that the use
of GLCM could increase the accuracy higher than PCA. In
[4], they expanded GLCM from 2-dimensional to 3-
dimensional. Thus the result is 3D GLCM is better than 2D
GLCM. The expanded GLCM also was used in [5] to train iris
features and the result indicated that this algorithm is suitable
to use in features extraction.
Backpropagation Neural Network (BPNN) is one of the
excellent classifiers in patterns recognition. Despite its good
ability in recognize features, BPNN often get stuck in local
minima consequently it cannot reach best error though be
trained coutinuously. Furthermore, BPNN usually consumes
plenty of time in training phase. Elman Recurrent levenberg
Neural Network (ERNN) is a Recurrent neural network that
using Elman network as architecture and Levenberg
Marquardt as learning algorithm. Some previous research
showed that The Levenberg algorithm is able to learn patterns
better than BPNN in both time consumption and accuracy as
was carried by [6], [7], and [8]. Likewise it has not been used
in face recognition specifically to train features that are
extracted from 3D GLCM.
Based on background explained above, in this paper we
investigated the use of 3D GLCM and ERNN to recognize
face
II. RELATED WORKS
The research in face recognition has been conducted by
many researchers. Usually, they use PCA as feature extraction
algorithm as conducted by [9]. In this paper, PCA was used to
extract face features subsequently were trained by SOM
classifier to recognize the face. The result from this research
indicated a good accuracy.
The research that closely linked to ours as was carried in
[10]. In this paper, they used GLCM and Eucledian Distance

152
 2016 International Seminar on Application for Technology of Information and Communication

to recognize face. The results showed that the method could
recognized face with an accuracy of 96.25 %.
The use of Levenberg Marquardt Algorithm (LMA) as
classifier in face recognition carried in [11]. The result from
this research showed that levenberg could accelerate the
learning time and reached better accuracy.
The related research also was conducted in [12] which
focused on the use of backpropagation neural network
(BPNN) in classifying images. The result from this paper
reported that BPNN was able to recognize face with the
accuracy of 98.7 %.
C. Features Extraction
The gray level co-occurrence matrix (GLCM) method first
that was introduced by Haralick et al [13] in 1973 is most
used method for texture analysis. This method is a second
order statistic method which counts the order of cooccurrence
of brightness value of paired pixels at a certain distance and a
direction. However, since the 2D-GLCM is unable to fully
represent the texture features of the space domain images,
3D-GLCM which is expanded from the original 2DGLCM as
was proposed in [4] can strengthen and demonstrate the
texture features of the space domain images and powerfull in
extracting the images properties as were used in some
previous methods. It can be described in the Fig 2

III. THE PROPOSED METHOD

A. Data used
We used The Yale database and The Essex database which
consist of 7900 images, each 395 individuals (male and
female) has 20 images per individuals. Contains images of
people of various racial origins, mainly of first year
undergraduate students, so the majority of individuals are
between 18-20 years old but some older individuals are
also present. Some individuals are wearing glasses and
beards. The image format is 24bit color JPEG, and using
camera S-HVS camcorder. The lightings are artificial,
mixture of tungsten and fluorescent overhead. This
research is using Essex database because many of Fig. 2. The Structure of 3D GLCM
researchers already using the database and achieve a
better accuracy than other database. The proposed method as
shown in Fig 1.
From Fig 2 above, R is the referenced pixel, N2 is the 1st
neighbour, and N2 is the 2nd neighbor. In our approach, we
used all possibilities angle formed at distance =1. Finaly we
extracted six elements from 3D GLCM formed namely :

Maximum Probability=max(pijk ) (1)

Q Q Q
Entopy = Pijk ( ln pijk ) (2)
i =1 j =1 k =1
Q Q Q
Energy = pijk
2
(3)
i =1 j =1 k =1
Q Q Q (i - i )( j j )( k k )
Correlation = Pijk (4)
i =1 j =1 k =1 i j k
Q Q Q
Contrast = Pijk (i j ) 2 + (i k ) 2 + ( j k ) 2
i =1 j =1 k =1
Fig. 1. The proposed method (5)
Q Q Q pijk
B. Preprocessing Homogeneity =
1 + ( i j ) + ( i k ) + ( j k )
2 2 2
i =1 j =1 k =1
All images used in this paper were converted into gray
(6)
scale form and filtered using Amoeba Median Filter (AMF).
This filter is a median filter that is combined with
morphological operations of amoeba. In image enhancement, Subsequently these extracted features were trained by The
AMF is a powerful filter to reduce noise without changing the ERNA/LMA to obtain the accuracy of identification.
contour. After was filtered, input image will be enhanced by
applying contrast stretching

153
 2016 International Seminar on Application for Technology of Information and Communication

D. Identification TABLE I. PARAMTERS VALUE OF ERNN / LMA

This phase is divided into two steps namely training and
testing. Network training process is basically a process of
adjusting the weights of all nodes in input layer, hidden layer
and output layer. The process continued till the network have
reached the allowable or acceptable error. After had trained,
network would be tested using images which did not use in
training phase. In this paper we used ERNN with levenberg as
learning algorithm which has proven that this algorithm could
accelerate the training time
The training algorithm flowchart of ERNN / LMA as
despicted in Fig. 3
No Parameters Value
1 No. Input Neurons
6 neurons + bias
2 Hidden Layer
1 layer (7-12 neurons + bias)
3 Contex Layer 1 layer (7-12 neuron)
4 Output Neuron 1
As described in Table 1, we used six neurons input + biase
(total neuron in the context layer always same as input layer),
which each neuron represent one feature extracted. Namely
x1:maximum probability, x2:correlation, x3: contrast, x4:
energy, x5:entropy, x6 :homogeneity, and b1:bias. Meanwhile
on the output layer we used one neuron to recognize all faces.
For instance face with id=0, if correctly recognized will result
0 likewise face with id=1, if correctly recognized will result
as 1.

The network architecture of ERNN / LMA as can be described

in Fig 4

min < max

= 10 y _ desiredOutput( t +1)

SSEnew < SSE = * (t +1) = y _ desiredOutput (t +1) y( t +1)

y(t +1)

= /

min = 0.1

z1( t +1) z2(t +1) z3(t +1) zn ( t +1) b2( t +1)

( SSEnew SSEmin )
p = p +1 or
(p = epochmax )

Fig. 3. Training Algorithm Flowchart xi (t ) b1(t +1) x1(r t ) x2(r t ) x3(r t ) xnr (t )

In order to get better result in recognition, few parameters of

x1(t ) x6( t )
ERNN / LMA will be tested vary on network. The various
parameters and their respective values used in the training
process are shown in Table 1 Fig. 4. Architecture of ERNN / LMA

154
 2016 International Seminar on Application for Technology of Information and Communication

IV. RESULTS AND DISCUSION We compared the results from both database using 6-7-1
We conducted this experiment using The Essex database structure as shown in Fig. 5
and The Yale database. Data images in each database were
divided as training set (105 images) and testing set (60
images)
In this research, we trained ERNN / LMA consecutively
using various structures to find the best parameters. Such as
structures 6-7-1 means input layer has six neurons, hidden
layer has seven neurons and output layer has one neuron. We
investigated from 100 epochs to 500 epochs and observed the
SSE obtained from each epoch as shown in Table 2 (using The
Essex database).

TABLE II. COMPARISON OF CANDIDATE ERNN / LMA STRUTURES (THE

ESSEX DATABASE)

Iterations
Structures
Fig. 5. Result from The Essex database and The Yale database using 6-7-1
100 250 350 500
structure
6-7-1 0.002934 0.000617 0.00027 0.0003
Fig 5 shows that the structure reached minimum error
6-8-1 0.06632 0.0093 0.000964 0.0007391 when trained The Essex database. However the result was not
6-9-1 0.04408 0.006 0.00073 0.0051949 significant compared with result obtained from The Yale
database. This difference occurs because of the characteristics
6-10-1 0.005 0.00097 0.00085 0.00075 of both database in taking faces.
6-11-1 0.0012 0.0006 0.0005 0.000788 To evaluate the performance of ERNN / LMA, we
6-12-1 0.0076 0.005 0.0007 0.00093 compared this classifier with Eucledian Distance (ED)
classifier to measure our correct recognition rate (CRR) as
shown in Table 4.

Based on result in Table 2, the combination of 6-7-1 TABLE IV. COMPARISON OF CORRECT RECOGNITION RATE BETWEEN
structure is better to use because it reached the smallest SSE. DIFFERENT CLASSIFIERS
Meanwhile for The Yale database, we obtained results as
The Essex Database The Yale Database
shown in Table 3. Number of
Testing Eucledian Eucledian
Images LMA/ERNN LMA/ERNN
TABLE III. COMPARISON OF CANDIDATE ERNN / LMA STRUTURES Distance Distance
(THE YALE DATABASE)
15 90.12 85.5 88.3 81.2
Iterations
Structures 30 91.3 83.6 88.9 82.1
100 250 350 500 50 92.6 84.5 89.76 83.5
6-7-1 0.014 0.0021 0.001 0.0005 70 93.6 85.4 90.5 84.8

6-8-1 0.02 0.003 0.0007 0.0009 90 94.4 86.6 92.4 85.3

6-9-1 0.4 0.0621 0.00323 0.0051949 110 95.6 87.6 93.5 85.8

6-10-1 0.25 0.0807 0.0085 0.0075 130 95.7 88.1 94.3 86.3
150 96.88 89.87 95.6 87.7
6-11-1 0.112 0.03 0.0013 0.0008
160 98.86 90.5 97.8 89.8
6-12-1 0.04 0.088 0.004 0.0093

Results from Table 4 showed that ERNN/LMA reached

From Table 3, the structure of 6-7-1 reached SSE of CRR of 98.86 % from The Essex database and 97.8 % from
0.0005 means that this combination should be used as the best The Yale database which is better than ED classifier. The
structure for testing phase. ERNN/LMA is also better when tested using images from The
Yale database.

155
 2016 International Seminar on Application for Technology of Information and Communication

In order to measure our method performance, we have REFERENCES

compared with some previous methods which also had used
the same database with our research and the results as can be [1] Liu, C. The Development Trend of Evaluating Face-Recognition
shown in Table 5. Technology. 2014 International Conference on Mechatronics and
Control (ICMC) pp. 1540-1544. July 3 - 5, 2014
[2] Eleyan, A., and Demirel, H. Co-Occurrence based Statistical Approach
TABLE V. COMPARISON WITH SOME PREVIOUS METHODS
for Face Recognition. International Symposium on Computer and
Sciences 2009. pp. 611-615 Sept. 2009
Methods CRR (%)
[3] Appati, J., Fosu, G., Gogovi, G. Face Feature Extraction for
Sekhon et. al 86 Recognition Using Radon Transform. American Journal of Engineering
Research (AJER). Vol 03, Issue 03, pp 219-224. 2014
Khalajzadeh et. al 86.06
[4] Chen, W.S., Huang, R.H., dan Hsieh L., IrisRecognition Using 3D Co-
Assadi et. al 88.96 Occurrence Matrix, Springer-Verlag Berlin Heidelberg, Germany,
LNCS, 5558, pp. 1122-1131. 2009
Narang et. al 96.1 [5] Dillak, R.Y., Bintiri, M.G. A Novel Approach for Iris Recognition.
Ch'ng et. al 96.5 The IEEE Region 10 Symposium (TENSYMP), 09-11 May 2016
[6] Nawi, N.H., Khan, A., Rehman, M.Z., Aziz, M.A., Herawan,T.,
Pankaj et. al 98.7 Abawajy, J.H. An Accelerated Particle Swarm Optimization Based
Levenberg Marquardt Back Propagation Algorithm. ICONIP 2014,
Proposed Method 98.86
Part II, LNCS 8835, pp. 245253, 2014
[7] Faisal, T., Nasir, M., Taib., Ibrahim, F. Neural network diagnostic
system for dengue patients risk classification. J Med Syst. Vol. 36, pp.
Based on Table 5, the comparison of some previous 661676. 2012
methods indicated that our proposed method reached CRR of [8] Bascil, M.S., Temurtas, F., A Study on Hepatitis Disease Diagnosis
98.86 % higher than others Using Multilayer Neural Network with Levenberg Marquardt Training
Algorithm. J Med Syst. Vol 35 pp. 433436. 2011
[9] Anggraini D. R, Face Recognition Using Principal Component
Analysis and Self Organizing Maps Third ICT International Student
V. CONCLUSION Project Conference (ICT-ISPC2014), pp. 91-94, 2014
[10] Huang, Y., Chen, J., Liao, J., Kuang, P. Face Recognition Based On
In this paper, we have presented a novel approach for face Texture Features Using Hybrid Projection Function. International
recognition. Based on our experiments, it could be concluded Conference on Wavelet Active Media Technology and Information
that 3D GLCM and ERNN/LMA were suitable to be used in Processing (ICWAMTIP), pp. 82 85, 17-19 Dec. 2012
face recognition. The feature extraction method used was able [11] Narang, G., Singh, S., Narang, A. Robust face recognition method
based on SIFT features using Levenberg-Marquardt Backpropagation
to extract characteristic features of face images. Meanwhile neural networks. 6th International Congress on Image and Signal
ERNN/LMA was also able to recognize such features with Processing (CISP). pp . 1000 1005, 16-18 Dec. 2013
good accuracy. The proposed method reached CRR of 98.86 [12] Pankaj, D.S ., Wilscy, M. Face Recognition Using Fuzzy Neural
% which improved the CRR from some previous methods. Network Classifier. PDCTA 2011, CCIS 203, pp. 53-62, Springer-
However, in next research it should be combined with more Verlag Berlin Heidelberg 2011
than one feature extraction algorithm such as PCA and 3D [13] Haralick, R.M., Shanmugam, K., Dinstein, L.: Textural Features for
Image Classification. IEEE Trans. on Systems, Man, and Cybernetics 3,
GLCM. 610621 1973
[14] The Essex Face Database, cswww . essex.ac . uk/mv/allfaces/index.html
ACKNOWLEDGMENT [15] The Yale Face Database,cvc.yale.edu/projects/yalefaces/yalefaces.html
We expressed our gratitude to The Essex database [14] and
The Yale database [15] that have provided face images used in
this research

156