Documente Academic
Documente Profesional
Documente Cultură
Computers
*, C.
Bradley
D(?partment of Mechanical Engineering, Uniuersity of Victoria, Victoria, BC, Canada, V8W 3P6
Received 4 January
Abstract
Tool condition monitoring has gained considerable importance in the manufacturing industry over the preceding two
decades, as it significantly influences the process economy and the machined part quality. Recent advances in the field of
image processing technology have led to the development of various in-cycle vision sensors that can provide a direct and
indirect estimate of the tool condition. These sensors are characterised by their measurement flexibility, high spatial
resolution and good accuracy. This paper provides a review of the basic principle, the instrumentation and the various
processing schemes involved in the development
of these sensors. 0 1997 Elsevier Science B.V.
Keywords:
Machine
vision; Manufacturing
information;
1. Introduction
The concept of tool condition monitoring has
gained considerable importance in the manufacturing
industry. This is mainly attributed to the transfonnation of the manufacturing
environment
from manually operated production machines to CNC machine
tools and the highly automated CNC machining centres. For modem machine tools, 20% of the downtime is attributed to tool failure, resulting in reduced
productivity and economic losses. A reliable monitoring system could prevent these problems and allow optimum utilisation of the tool life, which is
highly desirable.
The current trend is for CNC machine tools to be
tended by operators, who are not fully equipped with
the blend of training and experience necessary to
gauge a tools wear. A skilled machinist will pay
* Corresponding
author.
Flank wear
close attention to cutting tool performance particularly when a new combination of tool, material and
part program parameters are being tried. However,
the recent trend towards unsupervised
machining
centres equipped with open architecture controllers
has changed the manufacturing
environment significantly. In this environment,
operators will not be
available to make tool changing decisions. Also, the
pre-planned tool replacement strategies are no longer
appropriate as the machining conditions vary considerably. Thus, there is a great demand for monitoring
systems that ensure optimum performance
of the
unsupervised machining centres.
In addition to the complexity of the metal cutting
operation, the various combinations of the operating
conditions, tooling and the materials, increases the
probability of the machine tool breakdown. Although
several models [l-5] have been developed to predict
cutting tool life, none of these are universally successful due to the complex nature of the machining
0166-3615/97/$17.00
0 1997 Elsevier Science B.V. All rights reserved.
PII SO166-3615(96)00075-9
56
S. Kurada, C. Bradley/
- The background
57
Direct
Fig. 1. Illustration
Fig. 2. Illustration
Indirect
Fig. 3. Classification
niques.
of previously
(see Fig.
3): direct
58
S.
59
Flank face
Fig. 4. Schematic
sensing system.
diagram
of a computer
vision-based
tool wear
- Spatial parameters, derived directly from the surface profile, are commonly used to characterise
textural properties of various machined surfaces.
Amplitude parameters,
R, (centre-line
average)
and R, (RMS average), are the most widely used
and are essentially the same.
- Frequency parameters, derived by decomposing
the surface profile into a number of periodic
components of different wavelengths and amplitudes, are used to reveal more information about
the machining process. The decomposition procedure is commonly carried out by using a discrete
Fourier transformation.
The stylus profilometer has traditionally been used
for surface roughness measurement in an industrial
60
techniques that have been used extensively for various machine vision applications include [31]:
Front lighting, which involves direct illumination
of the object, has been widely used in tool wear
and surface roughness measurement.
Buck lighting provides excellent contrast, but limited to silhouette information.
Structured lighting refers to the sources of illumination, where the geometric shape of the projected light pattern is controlled by some means.
Structured light sensing has been used to estimate
the depth of the crater wear region.
3.2. Cameras
Two types of video cameras have been used for
tool condition monitoring. The earlier studies employed vidicon cameras, which consist of a photosensitive surface present inside a vacuum tube. When
an electron beam scans this surface, analogue voltage
proportional to the scene brightness (at that point in
the image) is produced. These cameras suffer from
geometric distortions and image drift.
The emergence of cost effective and improved
solid state technology over the past decade, has made
CCD sensors readily available for various machine
vision applications. The basic structure of the CCD
is that of an analogue shift register consisting of a
series of closely spaced capacitors. Typical sensors
offer a pixel resolution of 768 X 493 with imaging
rates of 30 images/set.
High resolution cameras
offer sensor sizes up to 2048 X 2048 pixels, but at
lower temporal resolution and at a very high cost.
High speed cameras, with imaging rates of up to
1000 images/set,
are limited by a reduced spatial
resolution and high cost. The CCD cameras have a
standard C-mount, which is compatible with a wide
variety of lenses.
Lri
Input DigitalImage
+
Breakage
Check
forTool Breakage
No
Fig. 5. Typical
parameters.
Breakage
sequence
equipped with
processing.
real
for determining
time
low
level
image
pre-
Fig. 6. Photograph
61
Fig. 7. Photograph
variance operator.
of a segmented
62
S. Kurada, C.
Computers in
34 (1997)
Fig. 8. Photograph
surface.
of the characteristic
4. Cutting
tool inspection
Research work carried out in the direct assessment of the tool condition is presented in the following sections.
4.1. Flank wear
The first attempt to utilise a vision system for
characterising tool wear is attributed to Matsushima
et al. [38]. The cutting tool was examined by a TV
camera at every tool change. The gray level image
was converted into a binary image by using a threshold value, selected manually from the intensity histogram. The flank wear width was calculated directly
63
64
Non-coherent
Non-coherent
Du et al. [47]
Oguamanam
et al. [48]
Non-coherent
Pedersen [43]
Non-coherent (PW)
Coherent (CW)
Coherent
(dia. 0.8 mm)
Non-coherent
: Not available.
E43
mm)
CCD (RGB)
VIDICON
(0.001 mm)
Philips LDH 0600 CCD
(0.001 mm)
TN 2500 CID
(0.0015 mm)
Thresholding
Template matching
Medium
Medium
Low
Tbresholding
Thresholding
Medium
Thresholding
Medium
Low
Speed
High
Thresholding
Thresholding
VIDICON
(488 X 380 pixels)
VIDICON
Algorithm
Camera
Light Source
Non-coherent
Software
Hardware
of vision-based
Researcher
Table 1
Characteristics
Confidence
+
Level of 0.002
Approx. 5% (PW)
0.03 mm (PW)
0.03 mm (CW)
0.1 mm
Accuracy
Results
Lab
In-cycle
Lab
+
+
In-cycle
Lab
In-cycle
Lab
4.2% (PW)
7.8% (CW)
+
Repeatability
Application
__
Area
3
2
;=
zz
Y
s
B
!z
;:
S
z
$
\
_B
9
66
texture assessment
the image intensity distribution along with the farfield diffraction pattern, for on-machine assessment
of workpiece surface texture. The degradation of the
surface finish with severity of tool wear was shown
by generating profiles from the intensity distribution.
A more successful attempt at quantifying roughness using a vision system involved the use of a
Gray level histogram of the light scattering pattern
from ground surfaces [35]. Optical roughness parameter, defined as the ratio of statistical parameters
derived from the histogram, was correlated with R,
for samples from different materials. A non-linear,
increasing trend with R,, was observed for the optical parameter. As the gray level histogram is based
on tallying the number of pixels for each intensity
level, the optical parameter is affected by the overall
uniformity and degree of illumination. By incorporating a fibre optic lighting arrangement to the measurement system, the technique was extended for
samples from different machining
processes [36].
The technique was further modified to include a
yellow LED (light emitting diode) light source in the
measurement system [53]. A qualitative comparison
of gray level histograms was carried out for various
machined surfaces, but failed to evaluate the results
on a broader set of samples.
Shiraishi and Sato [54] implemented dimensional
and roughness control in a turning operation by
developing an optical system based on the shadow
graph principle. Surface profiles of the turned part
were imaged by passing a laser light beam over the
edges profile. The sensor determined the maximum
value of roughness (typically rough surfaces were
examined, R, = 10 km> on the part and a flat bite
tool was used, where necessary, to keep the roughness profile within tolerance.
Digital Fourier patterns of the light scattering
distribution were shown to be an effective way of
comparing various machined surfaces [55]. It has
been pointed out that these patterns facilitate the
manifestation
of various machining process characteristics. The possibility of generating these patterns
with an optical set-up was investigated by Huynh et
al. [56]. The peaks in the power spectrum, derived
from the Fourier pattern, were found to correlate
with the feed rate spacing. Statistical parameters
computed from the spectrum were used to characterise surface roughness. Cuthbert et al. [57] derived
S. Kurada, C. Bradley/
the gray level hismgram of the optical Fourier pattern to deduce a roughness parameter. As rougher
surfaces tend to c:reate a diffuse pattern on the
camera, the technique was limited to lower roughness range (R, < 0.4 pm). Also, the need for the
precise alignment of the imaging optics, makes it
unsuitable for on-line inspection.
A new hybrid roughness parameter, based on both
the spacing and amplitude characteristics of the machined surfaces, was proposed from the data obtained with a vision system [58]. The parameter was
shown to be successful in the assessment of wear
track for the evaluation of lubricants. However, the
measurements have been limited to the higher roughness range (6-100 pm) due to the low resolution of
the camera.
The ideal roughness profile, that the tool should
produce on the workpiece, was determined by imaging the cutting tool [59]. The profile was found to be
similar to the one observed on the workpiece, and
the differences werf: attributed to the swelling of the
material during the cutting process. Based on an
extensive literature survey, a design strategy for the
potential development of an on-line roughness sensor
was proposed by Jolic et al. [60]. Three algorithms,
based on analysing the scattered light distribution of
machined surfaces, were utilised to process the sensor data. Ceramic parts, machined by different processes, were examined. Parameters from the three
algorithms were faund to correlate reasonably well
with the stylus measurements.
An in-process assessment of turned part quality
was performed by Lonardo et al. [61]. Diffraction
patterns of the rotating stainless steel samples were
recorded by a CCD camera and input into the neural
network for classification.
The ability of the supervised and unsupervised networks for accurately classifying the machined surfaces was assessed.
More recently, a fairly comprehensive
database
comprising of three:-dimensional light scatter images,
their classification
measures, lookup tables of the
most efficient measures and the 3D stylus maps was
compiled for samples from different machining processes [62]. The classification measures used include:
geometric, colour content and AI. The lookup tables
were provided to identify the best measures for a
given machining process. It has been pointed out that
the system is capable of discriminating
surfaces with
67
Theoretically,
the surface roughness
workpiece is given by
f2
R, = ~
18fiR
of a turned
Non-coherent
Non-coherent
Non-coherent
Coherent
: Not available.
Coherent
Note: +
35 mm SLR
camera
CCD
(640 x 80)
CCD
Coherent
Various processes
Turning
Various processes
Low
High
High
Reflection
Diffraction
pattern + Neural network
Milling, turning
Medium
Compared
Grinding,
Medium
flat lapping
Grinding
Low
processes
Grinding
Speed
Medium
Algorithm
Gray level histogram
Machining
Camera
CCD
(49 1 x 384)
CCD
(480 X 525)
CCD
(480 x 525)
CCD
Light source
Non-coherent
Highlights
Software
systems
Hardware
Researcher
Table 2
Attributes of vision-based
Lab
Lab
(480 X 525)
Lab
In-process
In-cycle
+
+
+
+
Lab
8.9%
+
Lab
8.6%
Repeatability
Application
area
2
<
z?
2
cn
i;
9
&
z
Y
s
B
E
9
S
2
f
2
ii
_B
0
S. Kurada, C. Bradley/Computers
69
Fig. 9. Integration
control network.
of vision-based
tool monitors
70
7. Concluding
remarks
References
[II V. Solaja and E. Kulanic, Effect of tool life data analysis on
tool life equation,
71
72
S. Kurada. C. Bradley/
H. Takeyama
[631