Documente Academic
Documente Profesional
Documente Cultură
Regular Paper
Department of Electronics & Communication Engineering, National Institute of Technology, Durgapur, India
Department of Electrical Engineering, National Institute of Technology, Durgapur, India
a r t i c l e i n f o
a b s t r a c t
Article history:
Received 22 June 2011
Received in revised form
12 March 2012
Accepted 12 May 2012
Available online 15 June 2012
In this paper, an improved particle swarm optimization technique called Craziness based Particle
Swarm Optimization (CRPSO) is proposed and employed for digital nite impulse response (FIR) band
stop lter design. The design of FIR lter is generally nonlinear and multimodal. Hence gradient based
classical optimization methods are not suitable for digital lter design due to sub-optimality problem.
So, global optimization techniques are required to avoid local minima problem. Several heuristic
approaches are available in the literatures. The Particle Swarm Optimization (PSO) algorithm is a
heuristic approach with two main advantages: it has fast convergence, and it uses only a few control
parameters. But the performance of PSO depends on its parameters and may be inuenced by
premature convergence and stagnation problem. To overcome these problems the PSO algorithm has
been modied in this paper and is used for FIR lter design. In birds ocking or sh schooling, a bird or
a sh often changes directions suddenly. This is described by using a craziness factor and is modelled
in the technique by using a craziness variable. A craziness operator is introduced in the proposed
technique to ensure that the particle would have a predened craziness probability to maintain the
diversity of the particles. The algorithms performance is studied with the comparison of real coded
genetic algorithm (RGA), conventional PSO, comprehensive learning particle swarm optimization
(CLPSO) and Parks and McClellan (PM) Algorithm. The simulation results show that the CRPSO is
superior or comparable to the other algorithms for the employed examples and can be efciently used
for FIR lter design.
& 2012 Elsevier B.V. All rights reserved.
Keywords:
FIR band stop lter
RGA
PSO
CLPSO
CRPSO
Parks and McClellan (PM) Algorithm
1. Introduction
A digital lter is simply a discrete time, discrete amplitude
convolver. Filtering is, in essence, the multiplication of the signal
spectrum by the frequency domain impulse response lter, e.g. for an
ideal band stop lter the pass band part of the signal spectrum is
multiplied by one and the stop band part of the signal is by zero.
Digital lters are basic building blocks in many digital signal processing systems. They have wide range of applications in communication, image processing, pattern recognition, etc. There are two major
classes of digital lters, namely, nite impulse response (FIR) lters
and innite impulse response (IIR) lters depending on the length of
the impulse response [1]. FIR lter is an attractive choice because
of the ease in design and stability. By designing the lter taps to be
symmetrical about the centre tap position, a FIR lter can be
guaranteed to have linear phase. FIR lters are known to have many
n
computational cost and non-existence of theoretical proof of convergence to global optimum in sufciently general conditions.
The conventional gradient based optimization method [7] is not
sufcient to optimize the multimodal and non-uniform objective
function, and it cannot converge to the global minimum solution. The
classical gradient based optimization methods are not suitable for
FIR lter optimization because of the following reasons: (i) highly
sensitive to starting points when the number of solution variables
and hence the size of the solution space increase, (ii) frequent
convergence to local optimum solution or divergence or revisiting
the same suboptimal solution, (iii) requirement of continuous and
differentiable objective cost function (gradient search methods),
(iv) requirement of the piecewise linear cost approximation (linear
programming), and (v) problem of convergence and algorithm complexity (nonlinear programming).
So, evolutionary methods have been implemented in the design of
optimal digital lters with better control of parameters and the
highest stop band attenuation. Different heuristic optimization techniques are reported in the literatures. When considering global
optimization methods for digital lter design, the GA [810] seems
to have attracted considerable attention. Filters designed by GA have
the potential of obtaining near global optimum solution. Although
standard GA (also known as Real Coded GA (RGA)) shows a good
performance for nding the promising regions of the search space,
they are inefcient in determining the global optimum in terms of
convergence speed and solution quality. In order to overcome the
problems associated with RGA, orthogonal genetic algorithm (OGA)
[11], hybrid Taguchi GA (TGA) [12] have been proposed. Tabu search
[13], Simulated Annealing (SA) [14], Bee Colony Algorithm (BCA) [15],
Differential Evolution (DE) [16,17], Differential cultural algorithm
[18], Particle Swarm Optimization (PSO) [1921], some variants of
PSO like Quantum PSO (QPSO) [22], PSO with Quantum Infusion
(PSO-QI) [23,24], Adaptive inertia weight PSO [25], Chaotic mutation
PSO (CM PSO) [26,27], some hybrid algorithms like, DE-PSO [28,29]
have also been used for the lter design problem.
Most of the above algorithms show the problems of premature
convergence, stagnation and revisiting of the same solution over
and again. In order to get rid of these problems and to maintain
the diversity of the particles and moreover, because in birds
ocking or sh schooling, a bird or a sh often changes directions
suddenly, the authors, in this paper have modied the conventional PSO by introducing an entirely new velocity expression
associated with many random numbers and a craziness velocity
having a predened probability of craziness.
This paper describes an alternative technique for the FIR band
stop (BP) digital lter design using Craziness based Particle Swarm
Optimization Technique (CRPSO). CRPSO technique tries to nd the
best coefcients that closely match the ideal frequency response.
Based upon the improved PSO approach, this paper presents a good,
comprehensive set of results, and states arguments for the superiority
of the algorithm. Simulation results demonstrate the effectiveness
and better performance of the proposed designed method.
The rest of the paper is arranged as follows. In Section 2, the FIR
lter design problem is formulated. Section 3 briey discusses on the
algorithms of real coded genetic algorithm (RGA), classical PSO,
CLPSO, and the CRPSO techniques. Section 4 describes the simulation
results obtained for FIR BP lter using PM algorithm, RGA, classical
PSO, CLPSO and the proposed CRPSO. Finally, Section 5 concludes
the paper.
2. Problem formulation
A digital FIR lter is characterized by
Hz
N
X
n0
hnzn ,
59
N
X
hnejwk n ,
n0
X
abs absHo1dp
absHods
60
the group best of the group at kth iteration. The searching point in
the solution space may be modied by
1
Sik 1 Sk
V k
i
i
4
where V i k is the velocity of ith particle at kth iteration; w is the
weighting function; C1 and C2 are the positive weighting factors;
rand1and rand2 are the random numbers between 0 and 1; Si k is
the current position of ith particle vector at kth iteration; pbesti k
is the personal best of ith particle vector at kth iteration; gbest(k) is
Table 1
Steps for RGA.
In RGA, initialize the real chromosome string vectors of np population, each consisting of (N/2 1) number of h(n) coefcients within maximum and minimum bounds
(, 1, respectively) for positive symmetric linear phase even Nth (N 20 or 28 or 36 in this work) order lter design. The steps of RGA as adopted from [35] and
used for the implementation of FIR BS lter are as follows:
Step 1. Initialization.
Step 2.Decoding the strings and evaluation of error tness value of each string.
Step 3. Selection of elite strings in order of increasing error tness values from the minimum value.
Step 4. Copying the elite strings over the non-selected strings.
Step 5. Crossover and mutation generate the off-springs.
Step 6. Genetic cycle updating.
The iteration stops when the maximum number of genetic cycles is reached. The grand minimum error tness value, its corresponding chromosome string having
optimal (N/2 1)h(n) coefcients and nally, (N 1) number of optimal lter coefcients are obtained by concatenation to get the nal optimal frequency spectrum
of the lter.
10
61
RGA
PSO
CRPSO
Population size
Iteration cycles
Crossover rate
Crossover
Mutation rate
Selection probability
C1
C2
vmin
i
vmax
i
wmax
wmin
Pcr
vcraziness
120
100
0.8
Two point crossover
0.001
1/3
120
100
2.05
2.05
0.01
120
100
2.05
2.05
0.01
1.0
1.0
0.4
1.0
0.3
0.0001
Table 4
Optimized coefcients of FIR BS lter of order 20.
h(N)
RGA
PSO
CLPSO
CRPSO
h(1) h(21)
h(2) h(20)
h(3) h(19)
h(4) h(18)
h(5) h(17)
h(6) h(16)
h(7) h(15)
h(8) h(14)
h(9) h(13)
h(10) h(12)
h(11)
0.0045
0.0366
0.0762
0.0514
0.0732
0.0007
0.0938
0.0399
0.2985
0.0300
0.5840
0.0079
0.0277
0.0662
0.0569
0.0674
0.0047
0.0851
0.0568
0.2947
0.0309
0.5881
0.0079
0.0306
0.0658
0.0559
0.0595
0.0028
0.0844
0.0507
0.2915
0.0360
0.5898
0.0065
0.0324
0.0626
0.0557
0.0585
0.0050
0.0884
0.0448
0.2926
0.0323
0.5894
Table 2
Steps of CRPSO.
Step 1: Initialization: Population (swarm size) of particle vectors, nP; maximum iteration cycles; lter order N 20 or 28 or 36; number of lter coefcients to be
optimized, (h(n) (N/2 1)) (since the FIR BS lter is positive, symmetric, linear phase and is of even order); xing values of C1, C2, Pcr, vcraziness; minimum and
maximum values of lter coefcients, hmin 1, hmax 1; number of samples 128; dp 0.1, ds 0.01; initialization of the velocities of all the particle vectors.
Step 2: Generate initial particle vectors of lter coefcients (N/2 1) randomly within limits; Computation of initial error tness values of the total population, nP.
Step 3: Computation of population based minimum error tness value and computation of the personal best solution vectors (hpbest), group best solution
vector (hgbest).
Step 4: Updating the velocities as per (6) and (8); updating the particle vectors as per (5) and checking against the limits of the lter coefcients; nally, computation
of the updated error tness values of the particle vectors and population based minimum error tness value.
Step 5: Updating the hpbest vectors, the hgbest vector; replace the updated particle vectors as initial particle vectors for step 4.
Step 6: Iteration continues from step 4 till the maximum iteration cycles or the convergence of minimum error tness values; nally, hgbest is the vector of optimal FIR
band stop lter coefcients (N/2 1); form complete (N 1) coefcients by copying (because the lter has linear phase) before getting the optimal frequency spectrum.
62
RGA
PSO
CLPSO
CRPSO
h(1) h(29)
h(2) h(28)
h(3) h(27)
h(4) h(26)
h(5) h(25)
h(6) h(24)
h(7) h(23)
h(8) h(22)
h(9) h(21)
h(10) h(20)
h(11) h(19)
h(12) h(18)
h(13) h(17)
h(14) h(16)
h(15)
0.0122
0.0368
0.0256
0.0231
0.0080
0.0344
0.0613
0.0466
0.0512
0.0003
0.0906
0.0474
0.2981
0.0307
0.6032
0.0062
0.0350
0.0303
0.0195
0.0068
0.0287
0.0599
0.0413
0.0558
0.0006
0.0862
0.0466
0.3023
0.0237
0.6038
0.0105
0.0334
0.0286
0.0230
0.0004
0.0238
0.0554
0.0423
0.0496
0.0026
0.0900
0.0507
0.3006
0.0271
0.6038
0.0060
0.0281
0.0236
0.0242
0.0005
0.0228
0.0515
0.0408
0.0538
0.0006
0.0874
0.0468
0.2974
0.0289
0.6035
Table 6
Optimized coefcients of FIR BS lter of order 36.
h(N)
RGA
PSO
CLPSO
CRPSO
h(1) h(37)
h(2) h(36)
h(3) h(35)
h(4) h(34)
h(5) h(33)
h(6) h(32)
h(7) h(31)
h(8) h(30)
h(9) h(29)
h(10) h(28)
h(11) h(27)
h(12) h(26)
h(13) h(25)
h(14) h(24)
h(15) h(23)
h(16) h(22)
h(17) h(21)
h(18) h(20)
h(19)
0.0007
0.0321
0.0044
0.0033
0.0078
0.0370
0.0230
0.0289
0.0014
0.0258
0.0563
0.0434
0.0516
0.0035
0.0868
0.0552
0.2968
0.0345
0.5998
0.0011
0.0262
0.0057
0.0025
0.0104
0.0333
0.0202
0.0247
0.0004
0.0267
0.0568
0.0413
0.0528
0.0047
0.0861
0.0527
0.2993
0.0328
0.5992
0.0046
0.0311
0.0047
0.0081
0.0061
0.0278
0.0257
0.0268
0.0020
0.0259
0.0533
0.0342
0.0549
0.0013
0.0897
0.0516
0.2934
0.0271
0.5939
0.0050
0.0250
0.0015
0.0018
0.0074
0.0312
0.0193
0.0272
0.0034
0.0232
0.0484
0.0466
0.0479
0.0000
0.0803
0.0502
0.2979
0.0328
0.5993
Figs. 13 show the magnitude (dB) plots for the FIR BS lters of
orders 20, 28 and 36, respectively. The statistical test results have
been calculated by using [37]. The maximum, mean, variance and
the standard deviation of stop band attenuation have been
calculated for the lter orders of 20, 28 and 36 and are shown
in Tables 79, respectively, for all the above mentioned optimization algorithms.
The proposed CRPSO based approach for 20th order BS lter
design results in the highest 17.57 dB stop band attenuation,
minimum pass band ripple (normalized) 0.095, minimum stop
band ripple (normalized) 0.132. The proposed CRPSO based
approach for 28th order BS lter design results in the highest
25.22 dB stop band attenuation, maximum pass band ripple
(normalized)0.066, maximum stop band ripple (normalized)
0.0547. The simulation results show that the proposed CRPSO
based approach for 36th order BS lter design results in 29.38 dB
stop band attenuation, maximum pass band ripple (normalized)0.061, maximum stop band ripple (normalized)0.0339.
The novelty of the proposed lter design approach is also justied
by the comparison made with [24]. The particle swarm optimization with quantum infusion (PSO-QI) model proposed in [24]
reveals no improvement with respect to the PM algorithm,
whereas, the proposed lter design technique shows 3.39 dB,
6.51 dB, 7.32 dB improvement as compared to PM for the BS
lters of orders 20, 28 and 36, respectively.
From the diagrams and above discussions it is evident that
with almost same level of the transition width, the proposed
CRPSO based lter design approach produces the highest stop
band attenuation (dB) and the lowest stop band and pass band
ripples (normalized) with a little change in the transition width,
compared to those of PM algorithm, RGA, PSO and CLPSO, as
shown in Tables 79. So, the lters designed by the CRPSO result
in the best responses in the stop band region, Thus, it can be
nally inferred that the CRPSO based FIR BS lter design is the
best among the techniques reported in this work.
4.2. Comparative effectiveness and convergence proles of RGA, PSO,
CLPSO and CRPSO
In order to compare the algorithms in terms of the error tness
value, Fig. 4 shows the convergences of error tnesses obtained
when RGA, PSO, CLPSO and the CRPSO are employed, respectively.
The convergence proles are shown for the BS lter of order 36.
Similar plots have also been obtained for the BS lters of orders of
20 and 28, which are not shown here. The CRPSO converges to
much lower error tness as compared to RGA, PSO and CLPSO
which yield suboptimal higher values of error tnesses. As shown
in Fig. 4, in case of BS lter of order 36, the RGA converges to the
minimum error tness value of 7.62; the conventional PSO
converges to the minimum error tness value of 6.72; the CLPSO
converges to the minimum error tness value of 6.05; whereas,
the CRPSO converges to the minimum error tness value of 5.47.
Table 7
Comparison summary of the parameters of interest of order 20 for different algorithms.
Algorithm
Order 20
Stop band attenuation (dB)
PM
RGA
PSO
CLPSO
CRPSO
Maximum
Mean
Variance
Std. deviation
14.18
14.92
15.45
16.51
17.57
14.18
15.61
16.12
16.55
18.03
0.00016
0.8208
0.2291
0.00056
0.2923
0.0126
0.9059
0.4786
0.0236
0.5406
0.196
0.12
0.086
0.07
0.095
0.195
0.179
0.169
0.149
0.132
63
Table 8
Comparison summary of the parameters of interest of order 28 for different algorithms.
Algorithm
Order 28
Stop band attenuation
PM
RGA
PSO
CLPSO
CRPSO
Maximum
Mean
Variance
Std. deviation
18.71
19.3
20.2
22.13
25.22
18.768
24.52
25.09
24.468
26.464
0.004136
15.82
18.38
3.1666
0.4707
0.0643
3.977
4.287
1.779
0.686
Maximum pass
band ripple (normalized)
0.115
0.084
0.08
0.072
0.066
0.116
0.109
0.0978
0.0779
0.0547
Table 9
Comparison summary of the parameters of interest of order 36 for different algorithms.
Algorithm
Order 36
Stop band attenuation
PM
RGA
PSO
CLPSO
CRPSO
Maximum
Mean
Variance
Std. deviation
22.06
24.28
25.13
27.0
29.38
22.106
34.02
35.69
35.80
34.89
0.0018
109.398
67.528
120.489
21.566
0.0422
10.459
8.217
10.976
4.644
0.079
0.086
0.081
0.065
0.061
0.0788
0.0611
0.0554
0.0444
0.0339
5
0
-5
-10
Magnitude (dB)
Magnitude (dB)
-10
-15
-20
-25
-30
PM
RGA
PSO
CLPSO
CRPSO
-35
-40
-45
-30
-40
PM
RGA
PSO
CLPSO
CRPSO
-50
-60
-70
-50
0
0.1
0.2
0.3
0.4
0.5
0.6
Frequency
0.7
0.8
0.9
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
Frequency
0
-10
Magnitude (dB)
-20
-20
-30
-40
PM
RGA
PSO
CLPSO
CRPSO
-50
5. Conclusions
-60
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
Frequency
Fig. 2. Magnitude (dB) plot of the FIR BS lter of order 28.
0.9
In this paper, a novel Craziness based Particle Swarm Optimization (CRPSO) technique is applied to the solution of the constrained,
multimodal, non-differentiable, and highly nonlinear FIR band stop
lter design problem to obtain the optimal lter coefcients. With
64
18
RGA
PSO
CLPSO
CRPSO
16
14
12
10
4
0
10
20
30
40
50
60
70
80
90
100
Iteration cycle
Fig. 4. Convergence prole for RGA, PSO, CLPSO and CRPSO in case of 36th order
BS FIR lter.
almost same level of the transition width, the CRPSO produces the
highest stop band attenuation and the lowest stop band and the
pass band ripples as compared to those of PM algorithm, RGA and
conventional PSO and CLPSO. It is also evident from the results
obtained by a large number of trials that the CRPSO is consistently
free from the shortcoming of premature convergence exhibited by
the other optimization techniques. Thus, it reveals that the CRPSO
may be used as a good optimizer for the solution of obtaining the
optimal lter coefcients in a practical digital lter design problem
in digital signal processing systems.
References
[1] L. Litwin, FIR and IIR digital lters, IEEE Potentials 0278-6648 (2000) 2831.
[2] T.W. Parks, C.S. Burrus, Digital Filter Design, Wiley, New York, 1987.
[3] T.W. Parks, J.H. McClellan, Chebyshev approximation for non recursive digital
lters with linear phase, IEEE Transactions on Circuits Theory CT-19 (1972)
189194.
[4] J.H. McClellan, T.W. Parks, L.R. Rabiner, A computer program for designing
optimum FIR linear phase digital lters, IEEE Transactions on Audio and
Electroacoustics AU-21 (1973) 506526.
[5] L.R. Rabiner, Approximate design relationships for low-pass FIR digital lters,
IEEE Transactions on Audio Electroacoustics AU-21 (1973) 456460.
[6] Z. Lin, An introduction to time-frequency signal analysis, Sensor Review 17
(1997) 4653.
[7] T. Ciloglu, An efcient local search method guided by gradient information
for discrete coefcient FIR lter design, Signal Processing 82 (10) (2002)
13371350.
[8] S.U. Ahmad, A. Antoniou, A genetic algorithm approach for fractional delay
FIR lters, IEEE International Symposium on Circuits and Systems, ISCAS
(2006) 25172520.
[9] N.E. Mastorakis, I.F. Gonos, M.N.S. Swamy, Design of two dimensional
recursive lters using genetic algorithms, IEEE Transaction on Circuits and
SystemsI; Fundamental Theory and Applications (2003) 63463950 (2003)
634639.
[10] Lu Hung-Ching, Tzeng Shian-Tang, Design of arbitrary FIR log lters by
genetic algorithm approach, Signal Processing 80 (2000) 497505.
[11] S.U. Ahmad, A. Andreas, Cascade-form multiplier less r lter design using
orthogonal genetic algorithm, in: IEEE International Symposium on Signal
Processing and Information Technology, 2006, pp. 932937.
[12] W. Tang, T. Shen, Optimal design of FRM-based FIR lters by using hybrid
Taguchi genetic algorithm, in: 2010 International Conference on Green
Circuits and Systems (ICGCS-2010), 2010, pp. 392397.