Documente Academic
Documente Profesional
Documente Cultură
net/publication/221531759
CITATIONS READS
5 55
4 authors, including:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Geok See Ng on 09 October 2014.
A. Data
F. Liu, G. S. Ng, and C. Quek are with Centre for Computational The data employed in the paper is collected from the KK
Intelligence, Nanyang Technological University, School of Computer Women’s and Children’s Hospital of Singapore. They
Engineering, 639798, Singapore. (e-mail: fliu@pmail.ntu.edu.sg; represent a 20 day’s records for a patient in the hospital under
asgsng@ntu.edu.sg, ashcquek@ntu.edu.sg;)
T. F. Loh is with KK Women’s and Children’s Hospital, 229899,
the BIPAP ventilation mode. The sampling time of the record
Singapore. He is with the Department of Paediatric Medicine. (e-mail: is about an hour. It consists of measured patient-status
lohtf@kkh.com.sg)
) (δ
2 2
f k = ∏ exp − xi − ciII,iLk (i ) II
i , iLk ( i ) (3)
i =1
B. Method
where o is the output; n is the number of rules; m is the
The key strength of the fuzzy system (FS) is its ability to
input dimension; the input data is X = [ x1 , x2 ,… , xm ] ; f k is
model the dynamics of a problem using a set of high-level
IF-THEN fuzzy rules, where the main merit of neural the firing strength of the k th rule for data.
network (NN) is its low-level learning capability. The interpretability and accuracy are two important issues
In this paper, the Mandani-type fuzzy system [16], other in neuro-fuzzy modeling. Interpretability refers to the
than the Takagi-Sugeno-Kang (TSK) fuzzy system [17], is capability of the fuzzy model to express the behavior of the
employed due to its ability to produce interpretable rules. The system in an understandable way, while the accuracy refers to
fuzzy rule in Mandani system has the form in (1). the capability of the fuzzy model to faithfully represent the
IF x1 = A and x2 = B THEN y = C (1) system [18]. However, interpretability and accuracy are
where x1 and x2 are input variables; y is output variable; usually pursued for contradictory purposes and sometimes are
A , B and C are fuzzy sets. dipoles apart as the system complexity increases. When
The hybrid of the FS and NN is shown in Fig. 1. It is a tuning the membership functions (MF) of the rules to
5-layer neural network, including input, condition, rule node, diminish the modeling error, the interpretability of the rules
consequence, and output layers. Each input variable in the FS may be degraded during the tuning process, where the fuzzy
corresponds to one input node and each fuzzy set for the input sets can drift closer to each other and may end up overlapping
variable corresponds to a neuron in the condition layer. each others [19]. An iterative process is proposed in the paper
Similarly, one output node for each output variable, and the to deal with the problem, shown in Fig. 2.
consequence layer consists of the nodes for its fuzzy sets. In
the rule node layer, each rule node is generated for a fuzzy
rule. There are links for each input/output variable to each of Initial rule generation MF tuning (lower
their fuzzy sets. The fuzzy rules are represented in the learning rate)
network by linking the condition, rule node and consequence
layers. Rank rule
5167
2) Rule ranking via Hebbian importance IˆC = IˆA + IˆB (9)
For the i th data sample ( X i , yi ) and the k th rule, define
the degree of the rule to cover the sample in (4) 4) Reduce rules and features
{(
Ck ,i = f k × exp − yi − c IV
oLk ) (δ ) }
2
IV
oLk
2
(4)
In the temporary rule set pool, if there is only one
membership function within one dimension, this dimension
The Hebbian importance of the k th rule is defined in (5). (feature) will be removed; if there is any rule that has the
n
same conditions and consequences with others, it is removed;
I k = ∑ ck ,i (5) if there are any conflicting rules that have equivalent
i =1 conditions but different consequences, the one with the
This is based on the Hebbian learning rule [21]. If all the higher degree of importance is preserved and others are
input-output samples repeatedly fire a rule by the product of deleted. Finally, the original rule set is replaced by the
their firing strength and the membership values, and the temporary rule set pool.
accumulated strength surpasses that of other rules, it indicates
the existence of such a rule. In another view, the accumulated 5) Membership function tuning
strength exerted by the sample pairs reflects the degree of The least-mean-square (LMS) algorithm is used in the
coverage of them by the rule. The rule that covers the samples paper for the tuning of membership functions.
to a higher degree will have greater influence on the modeling Assuming the error function is
accuracy. This is due to the fact that when the MFs of the rule 1 n
E = ∑ ( oi − yi )
2
(10)
or the rule itself are merged or deleted respectively, it will 2 i =1
result in a larger change in the fuzzy inference results and the error at i th sample is
significantly affect the modeling accuracy. Thus such a rule is
ei = oi − yi (11)
of greater importance.
th th
At the step, all of the rules are sorted in a decreasing order For the j input dimension of the k rule, the centroid
of their Hebbian importance. c II
and the width δ II
are updated using (12) and
j , iLk ( j ) j , iLk ( j )
5168
objective of the experiment is to model the manual setting of in the CV1 and CV2. In CV3, only the RSPOP produce less
FiO2 by clinician using a neuro-fuzzy hybrid system. number of rules than the Hebb-Rule-Reduct. From the
Among all of the variables in the medical records, the average number of rules in the last column, the proposed
SaO2, FiO2, RR, PEEP, set or measured at current time step, system produces the least among all these Mandani systems.
are used to predict the value of FiO2 at next time step. To Fig. 4 – 6 show the target and predicted values of FiO2 in
model the FiO2, the use of SaO2, FiO2 (old) and PEEP has testing set of the 3 cross-validation groups. In CV1, small
been suggested [22]. The variable RR is advised by clinician. deviations appear only when the amount of FiO2 becomes
There are a total of 408 data samples, divided into 3 higher or lower abruptly. In CV2 and CV3, the output of the
cross-validation groups to evaluate the performance of the proposed system is nearly perfect-match to the target setting
system. Within one cross-validation group, the first 60% data of FiO2.
is used as training set and the following 40% data is used as The membership functions and some sample rules are
testing set, shown in Fig. 3. extracted to show the interpretability of the proposed system.
The membership functions for the 4 input variables and 1
output variable are shown in Fig. 7 – 11. The overlap between
the fuzzy sets is low for all the variables. Each fuzzy set has a
clear semantic meaning.
Three samples fuzzy rules are shown in Fig 12. These rules
are the acquired knowledge from the data by the proposed
system. They can be understood by human user and used to
assist the clinicians.
TABLE I.
COMPARISON OF RMSE
RMSE
Model Average
CV1 CV2 CV3
Hebb-Rule-Reduct 2.085 0.753 0.536 1.125
POPFNN 13.776 6.031 2.375 7.394
RSPOP 13.841 6.031 2.166 7.346
Fig. 3. The FiO2 serious and the division of 3 cross-validation groups EFuNN 3.417 2.908 1.219 2.515
DENFIS 3.045 2.243 1.045 2.111
ANFIS 2.409 1.863 0.560 1.611
5169
Fig. 9. MFs for PEEP
Fig. 12. Three sample fuzzy rule derived from the proposed system.
IV. CONCLUSION
In this paper, the setting of FiO2 in artificial ventilation is
Fig. 8. MFs for FiO2 (old) modeled by a neuro-fuzzy hybrid system. An iterative rule
reduction and tuning process is proposed to produce
interpretable fuzzy rules while still maintaining low modeling
error. Fuzzy sets are merged through their Hebbian
importance and the redundant rules and features are removed.
5170
An effective, compact rule set is obtained after learning. The [18] J. Casillas, O. Cordon, F. Herrera, and L. Magdalena,
"Interpretability improvements to find the balance
proposed system is tested on the real ventilation data. The interpretability-accuracy in fuzzy modeling: an overview," in
overall modeling error is lower than the other comparable Interpretability issues in fuzzy modeling: Springer, 2003, pp. 3-22.
neuro-fuzzy system, while the extracted fuzzy rules can be [19] M. Setnes, R. Babuska, U. Kaymak, and H. R. v. N. Lemke,
"Similarity Measures in Fuzzy Rule Base Simplification," IEEE
understood by human user and used to assist clinicians. Transactions on Systems, Man, and Cybernetics, Part B
(Cybernetics), vol. 28, pp. 376-386, 1998.
[20] D. O. Hebb, The organization of behavior. New York: John Wiley
REFERENCES and Sons, 1949.
[21] C. F. Juang and C. T. Lin, "An online self-constructing neural fuzzy
[1] H. W. I. Wan and S. Fadzilah, "Artificial Intelligence in medical inference network and its applications," IEEE Transactions on Fuzzy
application: An exploration," Health Informatics Europe Journal. Systems, vol. 6, pp. 12-32, 1998.
Available: http://www.hi-europe.info/files/2002/9980.htm, 2002. [22] H. F. Kwok, D. A. Linkens, M. Mahfouf, and G. H. Mills,
[2] L. M. Fagan, "VM: Representing Time-Dependent Relations in a "Rule-base derivation for intensive care ventilator control using
Medical Setting," in Dept. Computer Science: Stanford University, ANFIS," Artificial Intelligence in Medicine, vol. 29, pp. 185-201,
1980. 2003.
[3] C. Hernandez-Sande, V. Moret-Bonillo, and A. Alonso-Betanzos, [23] N. K. Kasabov, "Evolving fuzzy neural networks for
"ESTER: an expert system for management of respiratory Weaning supervised/unsupervised online knowledge-based learning," IEEE
Therapy," IEEE Transactions on Biomedical Engineering, vol. 36, Transactions on Systems, Man, and Cybernetics, Part B
pp. 551-564, 1989. (Cybernetics), vol. 31, pp. 902-918, 2001.
[4] R. Rudowski, C. Frostell, and H. Gill, "A knowledge-based support [24] K. K. Ang, C. Quek, and M. Pasquier, "POPFNN-CRI(S): Pseudo
system for mechanical ventilation of lungs. The KUSIVAR concept outer product-based fuzzy neural network using the compositional
and prototype," Computer Methods Programs Biomedicine, vol. 30, rule of inference and singleton fuzzifier," IEEE Transactions on
pp. 59-70, 1989. Systems, Man, and Cybernetics, Part B (Cybernetics), vol. 33, pp.
[5] N. Shahsavar, H. Gill, U. Ludwigs, A. Carstensen, H. Larsson, O. 838-849, 2003.
Wigertz, and G. Matell, "VentEx: An on-line knowledge-based [25] K. K. Ang and C. Quek, "RSPOP: Rough set-based pseudo
system to support ventilator management," Technology and Health outer-product fuzzy rule identification algorithm," Neural
Care, vol. 1, pp. 233-243, 1994. Computation, vol. 17, pp. 205-243, 2005.
[6] G. W. Rutledge, G. Thomsen, B. Farr, M. Tovar, L. Sheiner, and L. [26] N. K. Kasabov and Q. Song, "DENFIS: Dynamic evolving
M. Fagan, "VentPlan: A ventilator-management advisor," presented neural-fuzzy inference system and its application for time-series
at Proceedings of the Fifteenth Annual Symposium on Computer prediction," IEEE Transaction on Fuzzy Systems, vol. 10, pp.
Applications in Medical care, 1991. 144-154, 2002.
[7] M. Dojat, F. Pachet, Z. Guessoum, D. Touchard, A. Harf, and L. [27] J.-S. R. Jang, "ANFIS: Adaptive-network-based fuzzy inference
Brochard, "NeoGanesh: a working system for the automated control system," IEEE Transactions on Systems, Man, and Cybernetics, vol.
of assisted ventilation in ICUs," Artificial Intelligence in Medicine, 23, pp. 665-685, 1993.
vol. 11, pp. 97-117, 1997.
[8] C. Schuh, C. Zelenka, and M. Hiesmayr, "FuzzyKBWean: A
computer program for fuzzy knowledge-based weaning of ICU
patients," presented at Proceedings of the ERUDIT-Workshop,
Austria, 2000.
[9] K. M. Goode, D. A. Linkens, P. R. Bourne, and J. G. Cundill,
"Development of a fuzzy rule-based advisor for the maintenance of
mechanically ventilated patients in ICU: a model-based approach,"
Biomedical Engineering: Applied Basis Communication, vol. 10, pp.
236-246, 1998.
[10] H. F. Kwok, D. A. Linkens, M. Mahfouf, and G. H. Mills, "SIVA: A
hybrid knowledge-and-model-based advisory system for intensive
care ventilators," IEEE Transactions on Information Technology in
Biomedicine, vol. 8, pp. 161-172, 2004.
[11] Y. Sun, I. Kohane, and A. R. Stark, "Fuzzy logic assisted control of
inspired oxygen in ventilated newborn infants," presented at
Proceedings of Annual Symposium on Computer Applications in
Medical Care, 1994.
[12] T. Nemoto, G. E. Hatzakis, C. W. Thorpe, R. Olivenstein, S. Dial,
and J. H. T. Bates, "Automatic control of pressure support
mechanical ventilation using fuzzy logic," American Journal of
Respiratory and Critical Care Medicine, vol. 160, pp. 550-556,
1999.
[13] G. S. Ng, S.S. Erdogan and P. W. Ng, “Contender's network, a new
competitive-learning scheme,” Pattern Recognition Letters, vol. 16,
no. 11, pp. 1111-1118, 1995.
[14] G. S. Ng and H. C. Sim, “Recognition of partially occluded objects
with back-propagation neural network,” International Journal of
Pattern Recognition and Artificial Intelligence, vol. 12, no. 5, pp.
645-660, 1998.
[15] G. S. Ng and H. Singh, “Data equalisation with evidence
combination for pattern recognition,” Pattern Recognition Letters,
vol. 19, no. 3, pp. 227-235, 1998.
[16] E. H. Mandani and S. Assilian, "An experiment in linguistic
synthesis with a fuzzy logic controller," International Jounal of
Man-Machine Studies, vol. 7, pp. 1-13, 1975.
[17] M. Sugeno and G. T. Kang, "Structure identification of fuzzy
model," Fuzzy Sets and Systems, vol. 28, pp. 15-33, 1988.
5171