Journal

of Advanced Research in
Signal Processing & Applications
Vol.1, Issue1, 2014

A Comparative Study of Power Distribution Over

voltages Classification Using feed forward Artificial
Neural Networks and General Regression Neural
Networks
Pascal Dieu Seul Assala, Haoyong Chen#
South China University of Technology, Guangzhou, 510641 PR-China School of Electric Power

Abstract- Power outages due to overvoltage and following damages affect a large part of
power distribution networks. A right identification system for the overvoltage can help in
fast intervention and shorten the outage duration. In the present work, authors present a
comparative study of distribution overvoltage identification. The study is conducted with
data simulated from ATP-EMTP with a network designed from data of real case studies
conducted on 10kV distribution network of the city of Qingyuan electrified by the China
Southern Power Grid. The comparison study is conducted with data from time domain
analysis and Wavelet Packet Decomposition (WPD) analysis. Two identification tools are
used: the General Regression Neural Network (GRNN) and the Feed forward Artificial
Neural Network (FANN). Training and identification performances are compared at the
end of the study bringing out some specificities of the two identification tools regarding
identifications of the direct strike lightning overvoltages, temporary overvoltages and
capacitor bank energization overvoltages.
Keywords: Power distribution, neural networks, over voltages, wavelet packet
decomposition
#

Corresponding AuthorE-mail: eehychen@scut.edu.cn

I. INTRODUCTION
Overvoltage in power distribution system
is the first cause of damage in electronics
[1]. A power outage is also a phenomenon

ADR Journals 2014. All Rights Reserved

induced by distribution overvoltage events.

In order to protect a sub-network, a
protection relay will trigger to stop the
energy generated from the surge event to
flow towards the protected area. This
Page 1

Journal of Advanced Research in

Signal Processing & Applications
Vol.1, Issue1, 2014

triggering will sometimes be repeated in a

very

sequence to attempt to re-energize the

classification.

protected area until the surge is detected to

transform (STFT) [3] is a deterministic

delay longer and, therefore, the protection

versus statistical method analysis [4], a

apparatus will definitely shut down the

covariance analysis [5]. Support vector

protected network area awaiting for the

machine

distribution network response team to

classification is combined with wavelet

manually come to inspect the possible

transform (WT) method [6] and has also

causes and ensure the security of the

been associated with S-transform as a

affected

next

discrimination tool [7]. ANN pattern

energization balanced study of overvoltage

recognition capabilities have been used in

identification between the most used

Ref. [8]. In Ref. [9], ANN is combined

pattern recognition tool the FANN and the

with the Fisher discriminant function

GRNN a new generation of neural

(FDF).

network

prior

to

the

networks (NN) introduced by Specht [2]

belonging to the probabilistic neural
networks (PNN) family.

At

good

results
The

(SVM)

present,

for

overvoltage

short-time

theory

overvoltage

Fourier

used

for

classification

works have gained a lot of attention from

the researchers and many research works

Regardless of the source provoking the

have brought about many advances in the

event, over voltages are harmful to power

area. GRNN and FANN capabilities are

network system lines and can cause

used with different datasets simulated on

insulator breakdown and can decrease

ATP based on a real-world distribution

magnetic circuit quality. In a power

system of Qingyuan city, which is a part of

transformer, this will bring a loud noise

Chinas Southern Power Grid. Processed

and higher Foucault currents circulating in

samples are generated from time domain

the magnetic circuit leading to transformer

and time-frequency domain analysis of

heating. Voltage surge will often cause

simulated data. Results obtained highlight

equipment

of

the advantages and specific aspects of

protective devices and even loss of human

using GRNN and FANN for applications

life. In the area of power quality, several

of overvoltage classification.

damage,

maloperation

research works have been done providing

ADR Journals 2014. All Rights Reserved

Page 2

Journal of Advanced Research in

Signal Processing & Applications
Vol.1, Issue1, 2014

1.Wavelet Packet Decomposition

(2) respectively are used in the present

Wavelet packet decomposition (WPD)

study.

theory emerges from wavelet signal

processing.

It

was

introduced

by

Coifmanand Wickerhauser [10]. WPD

gives a more complete signal time
frequency

analysis

compared

to

the

discrete wavelet transform (DWT). The

DWT recursively processes a signal using
the pyramid algorithm [11]. In DWT, the
discrete signal of length N to be processed
is sent to two mirror filters. The output of
the low-pass filter consists of N/2 wavelet
r r r
r
ar={a1,a2,a3,....a(N/2)1}

coefficients

being the approximation of the signal at

scale r of wavelet signal analysis. The
high-pass

filter

outputs

the

detail

r r r
r
coefficients dr={d1,d2,d3,....d(N/2)1} at
the resolution level r. The difference
between WPD and DWT is that the DWT
will only use the wavelet coefficients for

Fig. 1: Wavelet Packet Decomposition

Tree.

2. Feedforward Artificial Neural

Networks

processing from one resolution level to

A feed forward artificial neural network

another while the WPD will use both low-

(FANN) is a type of classic artificial

pass and high-pass filters output. This

neural networks (ANN) that are based on

gives a full signal sub-band representation.

the first model of human neuron presented

FigureFig. 1

pyramidal

by McCulloch and Pitts. The artificial

processing of WPD. Shannon wavelet

neuron in the model used on FANN is a

packets with low-pass filter and high

mathematical unit built on a set of inputs, a

pass filter from Ref. [11] as in Eqs. (1) &

summation unit, an activation function and

presents

the

ADR Journals 2014. All Rights Reserved

Page 3

Journal of Advanced Research in

Signal Processing & Applications
Vol.1, Issue1, 2014

an output. Mathematically, a neuron is

an input pattern of the overvoltage data to

presented as modeled in Eq. (3),where X is

be identified; the hidden layer is made of

the neuron with number of n inputs and

neurons, each of them computes its output

one output y(X), g is the activation

independently of others of the same layer.

function; it computes the neuron output

The output layer in our case is a unique

based on the net function Netf that is

neuron that outputs the identified type best

mathematically modeled in Eq. (4). The

sigmoid activation function is presented in
Eq. (5).

Element

Value and details

Activation function

Sigmoid1

Topology

Feedforward
multilaye perceptron

Number of layers
Learning

3
and Supervised, LMS

type

algorithm
In FANN, a neuron located in layer L

matching the input pattern.

only sends information to neurons located

Table 1: Basic Characteristics of the FANN.

at layer L+1 and only receives signals

The mathematical expression of Sigmoid

from neurons of layer L1 [12]. Three-

activation function is presented in Eq. (5).

layer FANNs are very powerful tools for

3.

pattern recognition that can be used to

implement a wide range of real life

General

Regression

Neural

Networks

applications requiring a decision-making

Firstly developed by Specht [2], a GRNN

[13]. The network in this study is a three-

is a type of probabilistic neural network.

layer FANN. Training algorithm and

For a known joint probability density

network information are as presented in

function f(x,y), the regression of y gives an

Table 1. A three-layer FANN at its first

input Xas presented in Eq. (6). X is a

layer (also called input layer) will receive

vector of size p; p1.

ADR Journals 2014. All Rights Reserved

Page 4

Journal of Advanced Research in

Signal Processing & Applications
Vol.1, Issue1, 2014

2
Where, Di =(XXi)T(XXi).
overvoltage

In Eq. (8), Ai and Bi are defined following

identification study is unknown. Assuming

Eq. (9). Ai & Bi are updated during the

f(x,y)

in

the

ongoing

that the first partial derivative of f is small

at any x and the underlying density is
continuous, as stipulated in Ref. [2], for
our GRNN, neurons will use the third
activation function in table 1 of Ref. [14]
for computing the probability estimator of
f(X,Y) presented in Eq. (7).

clustering process each time a training

sample

that

belongs

to

the

group

represented by the cluster center is

processed during the training. When a
training sample difference from all the
cluster centers is greater than a predefined
limit r, it becomes a new cluster center.

4. Data Construction
Combining Eqs. (6) & (7) and calculating

4.1. Overvoltage Types

different integration yields to the generic

Three types of over voltages have been

model of GRNN. (Eq. (5) in Ref. [2])

selected to support the undergoing study:

presents the mathematical model. In regard

the direct strike lightning surge, the

to the work conducted in the present paper,

temporary overvoltage and the capacitor

the model (Eq. (9) in Ref. [2]) presented in

bank energization overvoltage.

Eq. (8) has been chosen.

Direct Strike Lightning Overvoltage:

D2i

Aiexp 22

The most devastating overvoltage type in

(X)=

i=1

Di
m

Biexp 22
i=1

power distribution lines is the lightning

(8)

ADR Journals 2014. All Rights Reserved

overvoltage. It can affect the power

network by inducing overvoltage or a
direct strike on a power cable. For both
cases, the resulting overvoltage is usually
Page 5

Journal of Advanced Research in

Signal Processing & Applications
Vol.1, Issue1, 2014

of very high amplitude, a steep front, and

in the time domain analysis that will be

low

used in the next stage of our work for

energy.

The

power

distribution

network modeled on ATP for running the

online

detection

of

lightning

strike

simulations is a three-phase overhead

overvoltage. In the first 3 ms, the voltage

network without protection cable. For that,

of the struck phase will be directly damped

only the direct strike lightning surge has

after the lightning strike while adjacent

been taken into account for analysis. When

phases will present some few peaks at the

lightning strikes on the overhead cable, the

highest amplitude before being damped.

voltage is raised from the normal 1015kV

Figure 3 shows a typical lightning impulse

to several MV. The adjacent lines are also

recorded in one phase.

affected and some effect isdepicted in Fig.

Fig. 2.

Fig.
Fig. 2: Overvoltage Resulting from a

3:Measured

Lightning

Impulse

Waveform.

Lightning Direct Strike on Phase C of the

Temporary

Overvoltage:

Temporary

Overhead Line.

overvoltage isthe result of phase-to-ground

fault clearance. A temporary overvoltage

The voltage of the phase at which

lightning directly strikes embeds the
impulses with the highest amplitude at the
striking instant; the waveform is rapidly
damped in the following 5ms. The
adjacent phases are affected in a different

can provoke rising voltage waveform up to

2.5 p.u. of the host distribution network
voltage

amplitude

temporary

[15].

overvoltage

resulting

typical
from

Phase B to ground fault clearance is shown

in Figure 4.

way. Figure 2 shows two differences

ADR Journals 2014. All Rights Reserved

Page 6

Journal of Advanced Research in

Signal Processing & Applications
Vol.1, Issue1, 2014

Among three types of overvoltages under

study, the capacitor bank energization
overvoltage is the type that lasts longer
and

produces

lower

peaks

in

the

waveform. The amplitude of capacitor

bank energization overvoltage depends on
the host network voltage level at the time
of energization and the initial charge of the
capacitor. An overvoltage resulting from
energization of the capacitor bank initially
discharged with line voltage above 90% of
Fig.4: Temporary Overvoltage Waveform

the maximum value is presented in Figure

in a Three-Phase Overhead Distribution

5.

Network.
The bold dot on the plot in Figure 4
materializes the instant at which the phaseto-ground default appears and the high
increase of voltage appears from the
instant at which the default is cleared.
Capacitor

Bank

Overvoltage:

The

Energization
principal

use

of

capacitor banks in power distribution

Fig. 5: Waveform of Capacitor Bank

networks is to improve the power factor.

Energization Overvoltage.

This is done by providing the reactive

energy Q consumed by a load using a

4.2. Time Domain Analysis

source different from the power generator

In the time domain analysis, data used for

or

The

identification are recorded from three

capacitor bank can be located at different

nodes in the network following the

points in the network chosen taking into

description in Ref. [16]. A vector is built

account cable characteristics and the

from the same phases signal propagated

amount of reactive power to be produced.

to each of the three recorders installed on

the

distribution

transformer.

ADR Journals 2014. All Rights Reserved

Page 7

Journal of Advanced Research in

Signal Processing & Applications
Vol.1, Issue1, 2014

the network. The three data sets calculated

ARS=

are then concatenated to build an input

vector for the specific overvoltage. The

FF=

for a specific phase as proposed in Ref.

(16).

RMS(A)
Mean(A)

(14)

Mean(A) stands for the average value of

the

signal.

RMS(A)

and

Mean(A)

ST is the sampling period, t0 the time at

calculated over the studied period T

which the overvoltage occurs and T the

bounded by t0 & t5.

considered period of the overvoltage

waveform for the time domain analysis.

6. The ripple factor of the signal:

RF=

1. Rising time from occurrence to 20% of

maximum value calculated in t0 to t1
interval:
R02=t1t0
2.

(13)

5. The form factor of the signal:

seven parameters calculated at a recorder

[16] are presented below from Eqs. (10) to

max(A)*0.8
(t3t0)

max(A)min(A)
Mean(A)

(15)

7. The signals peak time ratio over its

period:

(10)

t4t2
PTR=
TTH

Rising time from 20 to 90% of the

(16)

maximum value calculated in t1 to t2

4.3. Frequency Band Analysis

interval:

The spectral analyses of the three types of

R09=t2t1

3.

(11)

the choice of frequency bands of the

Time from occurrence to falling down

to half of its maximum value:

TTH=t5t0

overvoltages under study are the guides for

signals to be retained as parameters for
identification. Figures 6-8 depict the

(12)

4. Absolute rising slope from 20% to

maximum value:

ADR Journals 2014. All Rights Reserved

spectrum of a direct strike overvoltage, a

temporary overvoltage and a capacitor
bank

energization

overvoltage

respectively.

Page 8

Journal of Advanced Research in

Signal Processing & Applications
Vol.1, Issue1, 2014

The second and third stages of the analysis

in the present work use data provided by
WPD analysis.
In the second stage, signals are grouped
into 1 kHz bandwidth frequency groups
and their energy will be calculated.
Harmonics number 1 and 2 are excluded in
Fig.

6:

Direct

Strike

Lightning

Overvoltage Spectrum.

the first group of 1 kHz frequency

bandwidth.

Every

recorder

will

be

processed and 10 parameters computed

and concatenated with those from other
two recorders to build a 30-element input
vector for every overvoltage sample.
The choice of data in the third stage is
performed as follows:
Looking back at Figures 6 Figure 8, it
appears that a right choice of few
Fig. 7: Temporary Overvoltage Spectrum.

parameters can be performed to obtain a

better classification results for a pattern
recognition tool. Keeping the original
WPD with sub-band groups of 1 kHz
bandwidth, the spectral analysis shows that
signals of the first, the third the seventh
and the tenth groups have significant
information that can be used to classify the
three types of over-voltages under study.
This last step will give performances of the

Fig. 8: Capacitor Bank Energization

FANN and GRNN in classification using

Overvoltage Spectrum.

rightly chosen classification input datas.

ADR Journals 2014. All Rights Reserved

Page 9

Journal of Advanced Research in

Signal Processing & Applications
Vol.1, Issue1, 2014

Data analyzed in the present work are

using input vector characteristics that are

sampled at 500 kHz, analysis and further

also based on the precedent figures. Data

signal processing are performed under

are obtained from WPD analysis, the

Matlab.

is

energy of selected frequency bands will be

conducted under three categories of inputs.

calculated to serve as elements of every

The

comparative

study

From time domain analysis, data formally

used for internal and external overvoltage
classification will be used for the first level
of evaluation. It is obvious that the

input vector. In this case, input vector

elements are not normalized. An extra
evaluation is performed with data of the
third

stage

normalized

p.u.

100Vmax

those obtained with the internal and

voltage.

external classification in Ref. [16]. The

main objective in this part will be to

mentioned cases will follow in Sec. 7 to

collect

bring out specific information about the

information

about

the

adaptability of two types of neural

discussion

line-to-ground

of

obtained results will be far lower than

some

the

to

from

the

peak

previously

conducted comparative study.

networks in classification with a nonaccurate choice of input datas.

5. Performance Evaluation

The second stage of the analysis will be

As stipulated in Sec.5.3, the analysis is

dedicated to the frequency band analysis

performed with three types of over-

of different inputs. Simulated datas will

voltages analyzed in frequency domain

be processed with the WPD and specific

and in wavelet sub-band decomposition

sub-bands will be considered for building

domain. The results are evaluated in time

input data for classification. The goal in

spent for training the NN for different

this second part will be to evaluate the

sizes of input data on the same computer

neural network performances with a larger

and the ratio of right identified input data

input vectors.

over the total test data available. The

The third stage will be about the

evaluation of classification performances

ADR Journals 2014. All Rights Reserved

complete comparison results are presented

in Table 2.

Page 10

Journal of Advanced Research in

Signal Processing & Applications
Vol.1, Issue1, 2014

Input

NN

Inpu Trai Training Test Ident

t

ning

ificat

=0.0204 and 18 cluster centers; data

ion
type

data
type

vecto samp time (s)

samp Resu

r size les

les

normalized to p.u. of 100Vmax the lineto-ground peak voltage.

lts
(%)

FANN

Time

21

54

6. Discussion

0.734571 142 54.22 With regard to the study carried out in the
present paper, there are some observations

domain

WPD

4. GRNN built on smoothing parameter

that can be obtained from interpreting the

GRNN1 21

54

0.0281182 142 98.6

FANN

30

61

4.862906 163 75.5

GRNN2 30

61

0.023164 163 65

FANN

12

61

2.013288 163 81.12

GRNN3 12

61

0.032108 163 69.5

FANN4

61

2.1602197 163 83.11 input vectors; the FANN despite the time

obtained results. At the first sight, we can

confirm with Ref. [14] that regardless of
the output performance, training GRNN is

12

hundreds of times faster than training

61

taken for training can provide a better

0.0100708 163 91.21

Table 2: Table of Performance Details.

1. GRNN built on smoothing parameter

training data.
The GRNN performs best for normalized

0
GRNN4 12

FANN for the same type and amount of

output performance for raw data nonnormalized and regardless of the size of
the input. Normalizing input data is very
crucial for improving the performance of
GRNN

=0.0701 and 46 cluster centers.

2.

GRNN built on smoothing parameter

=0.147 and 61 cluster centers.

3.

GRNN built on smoothing parameter

=0.0204 and 61 cluster centers.

ADR Journals 2014. All Rights Reserved

II.

CONCLUSION

In the present paper, authors have focused

the study on enlightening some usage tips
of the GRNN and FANN. GRNN is

Page 11

Journal of Advanced Research in

Signal Processing & Applications
Vol.1, Issue1, 2014

relatively new to the public and is not yet

widely used as FANNs are well known for
their speed in processing despite the
memory size used to store a complete
trained GRNN that is evaluated to be far
higher than the required memory for
storing the FANN. FANN appears to
behave better in case of non-normalized
data or input data vectors that have a high
variance between equivalent elements.
Adjusting the parameter r in Section 4 for
2
evaluation of Di or modifying the

REFERENCES
1. Hasse P.Overvoltage Protection of
Low Voltage Systems,2nd Edn. plus
0.5em minus 0.4em. The Institution of
Engineering and Technology London,
United Kingdom; 2008.
2. Specht DF. A general regression neural
network, IEEE Transactions on Neural
Networks. Nov 1991; 2(6): 56876p.
3. DevPaul
system

SIV.Power

distribution

equipment

overvoltage

protection.IEEE

Transactions

on

minimum required output error does not

Industry Applications. Sept 1994; 30:

significantly improve the performance of

12907.
4. Math IYHG, Bollen HJ, Axel berg

GRNN.
FANN and GRNN are both good tools for
autonomous decision making applications ,
although

the

GRNN

performance

outperforms the FANNs, the FANN can

still be an indicated tool for data cases
where normalization of inputs cannot help
reduce the first partial derivative of inputs
to

model

suitable

data

for

better

performance of GRNN.

PGV,

et

al.

Classification

of

underlying causes of power quality

disturbances:

Deterministic

versus

statistical methods. EURASIP Journal

on Advances in Signal Processing.
Nov. 2007
5. Omer DGE, Gerek Nezih, Barkana A.
Covariance

analysis

of

voltage

waveform signature for power-quality

event

classification.

IEEE

Transactions on Power Delivery. Oct

III. ACKNOWLEDGMENT

2006; 21(3): 22231p

This work was supported in part by National
Natural

Science

Foundation

of

China

(51177049) and by National Science Fund for

Excellent Young Scholars (51322702).

ADR Journals 2014. All Rights Reserved

6. Eristi

H,

DemirY.

Automatic

classification of power quality events

and

disturbances

transform

and

using
support

wavelet
vector
Page 12

Journal of Advanced Research in

Signal Processing & Applications
Vol.1, Issue1, 2014

machines.

IET

Generation,

feed forward neural network. In PES

Transmission and Distribution. Oct

General Meeting. Vancouver Canada;

2012; 6: 96876p.

Jul. 2013; 15p.

7. GeevMokryani AP, Siano Pierluigi.

13. Duda, Richard O., Peter E. Hart, and

Identification of ferroresonance based

David G. Stork. Pattern classification.

on s-transform and support vector

John Wiley & Sons, 2012.

machine.European

Transactions

on

14. Specht

DF.

Probabilistic

neural

Electrical Power. June 2010;18: 1412

networks. Neural Networks. 1990; 3:

24p.

10918p.

8. Mokryani MRHG, Esmaeilpoor J.

15. AlbertoCerretti

AG,

Gatta

Fabio
fault

Identification of ferro resonance based

Massimo,

LauriaS.Ground

on wavelet transform and artificial

temporary

overvoltages

neural

networks: Evaluation and experimental

network.

European

Transactions

in
on

mv

Transactions on Electrical Power, Mar

tests.IEE

Power

2008; 19(3): 47486p.

Delivery.Jul 2012; 27(3):15921600p.

9. Min Wang AVM.Classification of

16. Assala PDS, Chen H, JI T. Fast

power quality events using optimal

identification of power distribution

time-frequency representationspart 1:

networks over voltages based on

Theory.IEEE Transactions on Power

mathematical morphology and feed-

Delivery. Jul 2004; 19: 148895p.

forward.

10. Coifman YMRR, Wickerhauser MV.

Wavelet
processing.

analysis

and

Wavelets

and

Article

Submitted

to

International Journal of Engineering

signal

Intelligent

Their

Engineering

Systems
and

for

Electrical

Communication.

Applications. 1992; 15378p.

11. Mallat S.A Wavelet Tour of Signal
Processing:

The

Sparse

Way.

Academic press, 2008

12. Assala PDS, Chen H, JI T. Power
system overvoltage identification using

ADR Journals 2014. All Rights Reserved

Page 13