Bsc(Hons)Information Systems year 3 System Security and Control

Fuzzy classifiers

1.0 Definition of Fuzzy Classifiers

Fuzzy classifiers have been defined by in “kuncheva 2000”as any classifier that uses
fuzzy sets or fuzzy logics in its operations. A fuzzy set is a mathematical set of vague
qualitative and quantitative data, mainly generated by means of natural languages for
example let us consider a birds view on a forest, the main data items will consists of
where is the boundary of the forest?, which locations are in the forest and which does not
form part of the forest and son on. Fuzzy sets will be further elaborated as proceed.

1.1 Why use Fuzzy classifiers?

A classifier is an algorithm that assigns a class label to an object, based on the object
description. The classifier predicts the class label and the object description comes in the
form of a vector that contains the values of the features or attributes. In addition the
classifier learns to predict the class labels using a training algorithm or a training data set.
Once trained the classifier is ready to work on unseen objects.

1.2 Key elements in fuzzy classifiers

1.2.1 Soft labelling

Classification in fuzzy classifiers belongs to the general area of pattern recognition and
machine learning. For example in weather forecasting a standard classifier will just list
out a single “crisp” label (rain) but a fuzzy classifier offers soft labelling that is it can
assign degrees of membership in all four classes that is rain, cloud, sunshine and wind. A
standard classifier can output probabilities but however a probability of 0.2 for cloudy
weather means that there would be 20% chance that 2morrow will be cloudy. A

1
Bsc(Hons)Information Systems year 3 System Security and Control

probabilistic model will also assume that the four classes form a full group and snow and
thunderstorms must be represented by one of the classes only.

1.2.2 Interpretability

Fuzzy classifiers operate in a transparent way as steps and logic statements leading to the
class statements are traceable.

1.2.3 Limited data and available expertise

Examples include predicting and classification of rare diseases, oil depositions, terrorist
activities, natural disasters. Fuzzy classifiers can be built using expert opinion, data or
both.

2.0 Fuzzy Techniques

The use of Fuzzy Logic techniques may be relevant in case representation to allow for
imprecise and uncertain values in features, the methods that can be used are:

2.0.1 Case-based reasoning

The CBR process of matching cases can be carried out by the fuzzy logic process of
measuring the degree of similarity of cases.

CBR and fuzzy logic both deal with how to determine degree of similarity, but they tend
to use different approaches. CBR commonly deals with features, geometry, and structure
(Bridge 1998, and Liao et al. 1998), whereas fuzzy logic deals explicitly with uncertainty
and ambiguity expressed intentionally by humans when they are asked to describe
similarity. Fuzzy words describe uncertainty intentionally and fuzzy sets represent the
intended uncertainty.

2
Bsc(Hons)Information Systems year 3 System Security and Control

Fuzzy CBR combines numerous conditions and partial matching in queries. As the
number of conditions specified increases, the chance of turning up a good match
increases.

2.1 Fuzzy sets, mathematical representations

Universum

The traditional deterministic set in a universum can be represented by the

characteristic function mapping into a two-element set {0,1} namely for

if , and
if .

A fuzzy subset of is defined by a membership function mapping into a

closed unit interval , where for

if ,
if , and
if possibly belongs to but it is not sure.

For the last case - the nearer to 1 the value is, the higher is the possibility that

For example take the example of the bird:

• Is location A in the forest? Certainly yes, .

3
Bsc(Hons)Information Systems year 3 System Security and Control

• Is location B in the forest? Certainly not, .

• Is location C in the forest? The answer may be yes or no so let’s put

2.1.2 Uses of fuzzy sets

Fuzzy sets can be used for:

• Uncertain Decision making

• Behavioral studies
• Artificial intelligence and so on,

2.2 Multivariate Analysis

For the multivariate problem at hand, the case base algorithm first analyses the spread of
each feature from the validation set against each of the values from the test set. The
minimum and maximum deviation from any test set value for each feature is then found.
A sharp difference between the maximum and minimum deviation for that feature is seen
as a low score of the validation set.

The figure shows how the values of user1 validation set differ from the experiment set
values. We see an almost linear relationship among the values. This means that most of
the data from the validation set agreed with data obtained experimentally except for a few
features where a sharp deviation was noted. Thus, the fuzzy logic accepts the data from
the validation set as valid.

4
Bsc(Hons)Information Systems year 3 System Security and Control

140

120

100
Deviation

80

60

40

20

0
0 5 10 15 20
Features

Figure 2-1: deviation of validation set from the experiment set

2.3 Applying the Fuzzy Classifier

The algorithm is based on absolute difference between test data and data waiting to be
validated. If the value awaiting validation is significantly different from the test results
the validation set scores a “bad” for that particular feature. This exercise is repeated for
all the 17 features. The validation set is accepted or rejected after counting its scores for
all the features. If the set scores more “good” than bad then the set is accepted as valid
else it is rejected as invalid.

2.4 Algorithm

1. for each feature

2. for each test value
3. diff= abs (test data – data to be validated)
4. maxi=max (diff)
5. mini=min (diff)
6. gap=maxi-mini

5
Bsc(Hons)Information Systems year 3 System Security and Control

7. If gap>=100 set scores a “bad” else set scores a “good”

8. Count the number of bad and good obtained at 7
9. If count good>count bad then test data scores pass else fail

2.5 Practical Example

The figure below shows some test data obtained after experiment. Our task is to validate
user data by comparing them the experiment data.

Figure 2-2: Test Data

The first step towards the validation is to calculate the deviation of each feature value for
the user data against experiment data. For example feature1 deviates along the following
set of values given by D1 through D10 in the figure below. D1= abs(Test1 feature1-
user1 feature1)

6
Bsc(Hons)Information Systems year 3 System Security and Control

Figure 2-3: calculation of deviation

Then the maximum and minimum deviation of D1 through D10 is calculated as given in
the figure below. A large difference classifies the feature as ‘bad’. The fuzzy logic
accepts all small differences and awards a classification as ‘good’. The final decision is
based on the frequency of good scores. A high frequency of good scores will accept the
user set.

Figure 2-4: fuzzy classification

7
Bsc(Hons)Information Systems year 3 System Security and Control

3.0 Conclusion

Fuzzy classifiers are an area which relieves computer decision making from the
inflexibility it languished from for many decades. This example has practically
demonstrated how fuzzy classification can help take more humane decision by allowing
some latitude for deviation and barring all sharp deviation as unacceptable. Yet the fuzzy
further rationalizes decision making by taking into account the frequency of the sharp
deviation of the user data from experiment data

This project in all humility has helped us to better understand the use of fuzzy classifiers
and how it can be used to make decisions in various computer applications. Fuzzy
classification finds wide application across a number of industries and brings a simple
solution to complicated problems.