Documente Academic
Documente Profesional
Documente Cultură
4 (2003) 255-261
C 2003 The Optical Society of Japan
The educational system has gradually shifted from a face-to-face to an e-learning system, which has become prevalent
in advanced countries with the advance of information technology, and connection of global networks. Accordingly, a
growing demand is emerging for more reliable individual certification with technical precision in order to measure and
record learning achievements and credentials of participants. The present system has a limit in terms of registration
capacity, therefore, its accuracy has often been questioned. Against this background, an individual certification system
is proposed particularly for access control in e-1earning, Under our proposed system, a compact optical correlator for
facial recognition is employed. This correlator was previously tested for of biometrics authentication accuracy and
proved highly reliable, having recorded remarkably low error rates (below I %). The recorded error rate is sufficiently
robust that the system itself can be regarded as a valid and practical viable attestation system.
Key words: Compact optical correlator, access control for e-learning, multi-level zone plate array, facial recognition
255
256 OPTICAL REVIEW Vol.
lO, No. 4 (2003) R. INABA et al.
i
Preprocessing
* ~
}
normalization, cutting, ~
~ ;
i
~
using COPaC ;
i
Post-processing {
Correlation signal
comparison between intensity of
<-~~
i
~= NTSC~
i
=
{; ;~i
Fig. 2. Algorrthm for facral rdentificatron usrng mobile network for e learnmg
(b) Taking facial images by a cellular phone attached current embryonic stage, the detailed algorithm is primarily
camera for identification, as students access the concerned with the identification between the authentication
progress of lectures and BBS using the web function servers and user purpose, which is common to both cases. In
of the cellular phone. addition, a verification experiment on robustness was carried
Although it is necessary to construct an ad hoc system out by checking the effects of using wireless local area
adjusted to the purposes of respective parties', given the network and the cellular phone. Figure 2 shows the
OP'I'lCAL REVIEW Vol. IV, ~lo. 4 (2UV3) R. 1NABA et al. 257
algorithm for facial identification using a mobile network for requirements as an small aberration, high efficiency, com-
e-learning. pactness as array structure and fiexibility in designing a
As image input devices, digital cameras and portable- system of massive parallelism. The system features the
attached cameras were selected for their greater utility (i.e. MLZPAS and two space light modulators, making the best of
wider circulation and reasonable cost). As image delivery the parallelism and high speed of light. The present
devices, wireless local area network and cellular phones processing speed is 6.6 face/sec and depending on the
were proposed. Images taken by these cameras were function of spatial light modulators (SLMS).
forwarded to the authentication server by e-mail. A person The COPaCII was evaluated by an authorization method
who is logging-in is to be identified by the image in the designed for this type of general attestation accuracy. A
server's database through the individual's. E-mail addresses collation experiment conducted on 300 facial images dealt
are also used as a key to individual identification, as with each one individually. Then, two different kinds of
participants were asked to register these when first register- mismatched rates: False Non-Match Rate (FNMR) and False
ing the database with their facial images. Match Rate (FMR) were calculated and tested. The sample
The instant a person enters; the matching process begins number 300 was determined based on the definition of one
in a search for his/her reference image stored in the of the accuracy evaluation authorities, the National Bio-
database. Simultaneously, the input image is pre-processed metric Test Center (NBTC). The error margin P in the
by edge-extraction and binarization (20%). This pre-proc- sample number N was given by the following equation, with
essed image is forwarded to a compact optical parallel a reliability of 95% and an error margin P = 0.01.
correlator (COPaC), where a parallel joint transform
N = 3/P (1)
correlator (PJTC) system is installed and calculates corre-
lation signals in the light intensity. Using this intensity level, The results are shown in Fig. 3. FNMR O% and FMR
it identifies the person based on the threshold value set 0.3% were obtained at the threshold value of 62 where the
beforehand. The result returns to the user via E-mail, and 10west error rate of both values was recorded. Moreover, the
access is permitted if the data match. Likewise, it is possible effects of temperature modulation and mechanical vibration
to append and assign questions, task and lecture information. have to be noted. As the main causal factor, heat radiation
The difference from conventional attestation systems from the drive circuits such as light sources and CCD
needs to be addressed. Old systems have not assumed the cameras was examined. I : I collation for experiments of 300
network environment where facial images are taken by low pairs as carried out every there alternate hour for 12h, and
resolution camera. In this experiment, 640 x 480 pixels was peak error rates were FNMR and FMR: Iess than I %.3)
the minimum size possible, even with a cellular phone At the biometric security level that the IPA (Information
attachment camera. However, it automatically becomes Technology Promotion Agency, Japan) sets as a desired
160 x 120 pixels at the time of forwarding by E-mail due target, a system with FMR below I % can be applied to a PC
to its compression scheme. Therefore, a low resolution 10gin control.9'10) This durability test thus demonstrated that
image with little information has yet to be detectable in the system is sufficiently steady and capable of performing
order to put the system into practice. Furthermore, in well for access control in educational institutions. Moreover,
wireless local area network, it is necessary to compress it is widely believed that the waiting time for connected
images to a maximum of 100 KB. In this case, resolution access in the Internet use is just seven seconds.11) Given the
level was 72 pixels/inch, but the same pixel volume is corresponding time with the database, the attestation speed
subject to change depending on the image size. Using requires approximately I sec in e-1earning. Since the
wireless local area network, the image size needs to be processing speed in COPaCII is 6.6 faces/sec, the one-by-
adjusted according to the average speed of 4 Mbps. To tackle one one-by-one modeling of checkpoint control system
this underlying problem in the network-type face recognition would provide a sufficiently viable processing speed.
5)
system, the system was further examined for its durability.
Therefore, Iow resolution image with little information is
still needed to put the system into practice. 1 OO
x False Non-Match Rate:FNMR
' False Match Rate:FMR
2.2 Compact optical parallel correlator (COPaC II) and 80
its evaluation
~<~)
This chapter features the COPaC II,6) which is the core of
e) 60
the recognition system. As shown in Fig. I , this optical ~c~:I
*
recognition correlation has advantages in its compactness, ~
*~
~:~ 40
bring 20 x 24 x 43 cm3 in size and 6 kg in weight. Our
%
application of the PJTC principle to the face recognition
~~
system is unprecedented in this field, and therefore merits 20
~
attention and further evaluation. ~~
In our PJTC system, the multi level zone plate arrays o
(MLZPAs)7,8) play essential roles: (a) they generate multiple
images, and (b) they act as the Fourier-transformers. One of
O 50 100 150 250
Threshold of intensity [a.u.]
200
diffractive optical elements, the MLZPA satisfies such Fig. 3. Evaluatron of face recogmtron system
*'=_*~:"..'/~r~' "'*-'~'-- -'1~;
c:l
0.4
shooting conditions are arbitrary and irregular. To meet this C~
~ Pij/P• -
j= l as the quality of image compression. Thus, the higher the
compression ratio becomes, the lower the quality of the
N-1 image. Input images are all compressed JPEG images of 10
registered persons. The database contains 100 non-com-
pressed images.
Experimental results are shown here. The x-axis is the
PSNR, while the y-axis is the comparative value. It is proved
~ that the data size has a negligible effect on face recognition
1
rate despite a high compression rate of I 120.
-:; 06
(L) ill umination)
~>
c~;
threshold
Influence of illumination (natural or other light) and
c:1
background settings on the recognition rate deserves careful
o
f(1 0.4 0.45
.~ attention. In front of a complex background, the influence of
c:l
1:~ natural light and backlight generally prevents a clear picture,
~
~ 0.2 blurring central parts of the face (i.e., the edges of eyes and
nose with a mouth). Figure 6 depicts this case of a complex
O background where the picture was taken using natural light.
640x4 80 320x240 1 60X 1 20
As shown, there was no strong influence of recognition rate
against this type of background. However, the edge of the
~
picture emphasizes the part of the imagelit by light coming
-. I. r~j,i ~ ~~ ;i!
* ~. ,1'i from the background and the back. Therefore, the feature
ResolutiOn element disappears with the relative decrease in of pixels of
the edge parts.
Frg. 4. Effect of camera resolution. The next stage is to examine the filter of edge extraction.
Ur 1 IUAL Kt~ VlbW VOl. IU, ll~O. 4 (~VVj) l~. INABA et a/. ~5~
(a)Complex background
250
~ 200
~~ 150
~~S 100
c:i
~)
~$:1 50<~
~ O
3 13 23 33 43 53 63 73 83 93
Database number
(b)Natural lights
_ 250
~~~ 200
~: 150
"~:~) 100
~ 50
~~
03 13 23 33 43 53 63 73 83 93
Database number
Images Binarization image Results of correlation
.'{ ~
center part:4 center part:8 center gradual
rectanglar distribution of Gaussian
(a) Technique of edge-enhancement with weight.
x registered person
~~ 1
c~
e unregistered person -~ 1
c~~
x regi stered person
~ unregistered person
~cL) 0.8
o
-(L) 0.8
:I
~
::i
~> 0.6
c~5
oooxe ooe ~> 0.6
c~l
~ ~~~~
x x ~{
~
~
~:!
A nonlinear Sobel filter with the preprocessed weight of 2 technique not only under this peculiar environment but also
was used under a stable and interior illumination condition. under ordinary fixed conditions. Subsequent recognition
To consteracta unstable background, the filter was adjusted experiments were thus carried out under a fixed photo-
to stress the central portions. This process was facilitated by shooting condition (plain background and indirect illumina-
creating a filter of which the weight alters in a to rectanglar tion 300 Ix from the first using ten samples. The filter with
or Gaussian shape. Through this enhancement, the feature weight in a Gaussian shape is more effective, as the result in
element of the central part of the face could be extracted. Fig. 7(b) shows. The expression of the filter applied here can
Moreover, the proposed filter should provide an optimal be given as (3).
260 OPTICAL REVIEW Vol 10 No 4 (2003) R. INABA et al.
250
- :;
c~~
-- 200
c~l
~:::
~J)
'~(,)
~:10 150
.~
~
c:;
~~ I OO
(L)
o threshold
o
~H 80 [a.u.]
o
~ 50
+'
.~
cl)
~
(L)
.~
~::
300
code# 1 9 ~::~ "***~,.~:~~~ {~~~~~**i+=~~.,~
=~~~~, :'~~~;,~ ~
250
-~ 200
.-~
"
>~
150
.*~
~{
~~~ 100
~l
50
O
2 8 14 20 26 32 38 44 50 56 62 68 74 80 86 92 98
Number of database images
3.4.2 Face recognition experiment using cell-phones from ment between Waseda University and Japan Women's
one 's home University.
It has been suggested that a cellular phone with a camera The processing speed in COPaCII of 6.6 faces/sec is also
could possibly used for access control. The present reso- remarkable as the recognition speed in a one-to-open access
lution level of these cameras ranges from 1 10,000 to control system. Under the presumed situation of a central-
300,000 pixels, which is supposedly within the tolerance ized control, the speed of about 200 ms is demanded, as
level, although there is some variation in the type of camera: deduced from the fact that science classes have 50 students.
some are CCDs, others CMOS censors. The J-SH5 1 (serial We have fabricated an ultra-fast facial recognition system
number, product by SHAPE) was selected, as a cellular- with Vander Lugt matched filtering, which is another well-
phone attached camera. It is assumed that the owner of this known optical correlation distinct from PJTC. The system
portable takes self-portraits. JPEG compression was auto- has achieved a 1000 faces/s throughput of 1-channel
matically made and the email function of a cellular phone is processing. It is hoped that in future a centralized control
used. An image was transmitted to a recognition server. In system in e-1earning will be implemented yielding von better
this experiment, we used ten persons for consecutively days. perf ormance.
Figure 9 shows the example of code#19. To demonstrate
whether or not the system could clearly recognize others, the Acknowledgements
collation with 100 people was performed. The result The authors would like to express heartfelt thanks to Mr. Hiroshi Koizumi
confirms that a poorly-sensitivity photo is a picture by the of Topcon Research Center for his support in fabricating the compact optical
cellular phone-attached camera, It is therefore shown that parallel correlator. This research was supported by the Telecommunications
Advancement Organization of Japan and by the Japan Science Technology
individual attestation in a mobile environment of both a
Corporation and Grants-in-Aid for Scientific Research from Ministry of
portable camera and camera-attach pocket cellular-phone is Education, Culture, Sports, Science and Technology.
possible.
References
4. Conclusion
1) S. Aoki: Media Education 9 (2002) 15.
With e-1earning becoming a more dominant and popularly 2) P. J. Phillips, A. Martin, C. L. Wilson and M. Przybocki: IEEE
used method, an individual recognition system is essential Computer (2000) 56.
3) K. Kodate, R. Inaba, E. Watanabe and T. Kamiya: Meas. Sci. Technol.
for security together with the enhancement of the whole
13 (2002) 1756.
range of infrastructure and teaching contents. With this in 4) R. Inaba, Y. Yaginuma and K. Kodate: Proc. Int. Conf. Optics 2002,
mind, this paper sought to implement on our compact optical 2002, p. 35.
correlator system through experiments and evaluations. The 5) E. Watanabe, R. Inaba, K. Kodate: Image Electron. Eng. Jpn. 31
system features biometrical identification schemes with (2002) 848 [in Japanese].
6) R. Inaba, Y. Yaginuma, E. Watanabe and K. Kodate: Trans. Inst.
reasonable prospects for further applications. Through one-
Electrical Engineers Jpn. 122-C (2002) 1259 [in Japanese].
to-one identification experiments using the images of 300 7) K. Kodate, A. Hashimoto and R. Thapliya: Appl. Opt. 38 (1999) 3060.
persons' taken in one day, FMR 0.3% and FNMR 0.0% 8) Y. Orihara, W. Klaus, M. Fujino and K. Kodate: Appl. Opt. 40 (2001)
validates the robustness of our COPaC system. 5877.
Among a series of challenges of the system between 9) S. Liu, M. Siliverman: IT Professional 3 (2001) 27.
10) Y. Seto and M. Mimura: IEICE Trans. Inf. Syst. E84-D (2001) 800.
clients and the server are camera resolution, compression
1 1) J, Nielsen: "Designing Web Usability: The Practice of Simplicity,"
rate for transferring images and improving pre-processing
(Macmillan Computer Pub., 1998).
filter. Experimental results proved the system's high practic- 12) M. Rabbani and P. W. Jones: Tutorial TEXTS in Optical Engineering,
ability after it was applied to a mobile e-1earning environ- TT7, 1991.