Professional Documents
Culture Documents
4, 2010
327
Bing L. Luk
Department of Manufacturing Engineering and Engineering Management,
City University of Hong Kong,
Kowloon Tong, Hong Kong
E-mail: meblluk@cityu.edu.hk
Abstract: Adaptive infinite-impulse-response (IIR) filtering provides a powerful approach for
solving a variety of practical signal processing problems. Because the error surface of IIR filters
is typically multimodal, global optimisation techniques are generally required in order to avoid
local minima. This contribution applies the particle swarm optimisation (PSO) to digital IIR filter
design in a realistic time domain setting where the desired filter output is corrupted by noise.
PSO as global optimisation techniques offers advantages of simplicity in implementation, ability
to quickly converge to a reasonably good solution and robustness against local minima. Our
simulation study involving system identification application confirms that the proposed approach
is accurate and has a fast convergence rate and the results obtained demonstrate that the PSO
offers a viable tool to design digital IIR filters. We also apply the quantum-behaved particle
swarm optimisation (QPSO) algorithm to the same digital IIR filter design and our results do not
show any performance advantage of the QPSO algorithm over the PSO, although the former does
have fewer algorithmic parameters that require tuning.
Keywords: IIR filter; global optimisation; particle swarm optimisation; PSO; system
identification; quantum-behaved particle swarm optimisation; QPSO.
Reference to this paper should be made as follows: Chen, S. and Luk, B.L. (2010) Digital IIR
filter design using particle swarm optimisation, Int. J. Modelling, Identification and Control,
Vol. 9, No. 4, pp.327335.
Biographical notes: Sheng Chen received his BEng from Huadong Petroleum Institute,
Dongying, China in 1982 and his PhD from the City University, London, UK in 1986, both in
Control Engineering. He obtained his Doctor of Sciences (DSc) from the University of
Southampton, Southampton, UK in 2005. He has been with the School of Electronics and
Computer Science, the University of Southampton since 1999. His research interests include
wireless communications, machine learning, finite-precision digital controller design and
evolutionary computation.
Bing L. Luk received his BSc in Electrical and Electronic Engineering from Portsmouth
Polytechnic, UK in 1985, his MSc in Digital Computer Systems from Brunel University, UK in
1986 and his PhD in Robotics from the University of Portsmouth, UK in 1991. He has been with
the Department of Manufacturing Engineering and Engineering Management at City University
of Hong Kong, Hong Kong, China since 2000. His research interests include mobile robotics,
telemedicine research, non-destructive test methods, machine learning and evolutionary
computation.
Introduction
328
y (k ) +
b y (k i ) =a x (k i ),
i
i =1
(1)
i =0
az
bz
A(z )
H M (z ) =
=
B (z ) 1 +
L
i
i =0 i
M
i
i =1 i
(2)
where
d (k )
is the filters desired
e (k ) = d (k ) y (k ) is the filters error signal and:
wH = aT
bT = [a 0 a1 " aL b1 " bM ]T
(3)
response,
(4)
1
N
(k ).
(5)
k =1
(6)
space W D .
b
b3 = k 2 ,
b2 = k0 (1 + k1 )k 2 + k1 ,
b1 = k0 (1 + k1 ) + k1k 2 .
(9)
(10)
(8)
( ( ) (
j =1
))
pb[il ] = u[il ] ;
End for;
J N (w ) and:
Wj [Wmax, j , Wmax, j ]
Initialise particles
S
{ u[0]
i }i=1
v[l]
i
Modify
velocity
Velocity
approaches zero
or out of limits?
No
Update positions
u [l]
i
Modify
position
Yes
position
out of bounds?
No
S
Evaluate costs {F(u[l]
i )} i=1
[l] S
update { pb i }i=1 and gb [l]
Terminate?
Yes
( ( )
gb[l ] = pb[l] ;
i
Vj =
[V
max, j ,
Vmax, j ]
j =1
is imposed so that:
(
If ( v
gb
(13)
j =1
No
(12)
VD
Output solution
l=0
Yes
(11)
Figure 1
(7)
s.t. w W D
{u[il ]}i =1 ,
A swarm of particles,
b2 = k1 ,
b1 = k0 (1 + k1 ),
329
[l +1]
j<
i
Vmax, j
v[il +1]
= Vmax, j ;
v[il +1]
= Vmax, j ;
(14)
330
If v[il +1]
== 0
v[il +1]
= v Vmax, j ;
= v Vmax, j ;
Else
v[il +1]
End if;
If u[il +1]
u[il +1]
End if;
If
(17)
j
j
u[il +1] j
u[il +1]
> Wmax, j
= rand () Wmax, j ;
< Wmax, j
Initialise particles
Update
S
{ u[0]
i }i=1
= rand () Wmax, j ;
{pb
distance to
l=0
[I max ]
Modify
position
Terminate?
Yes
Output solution
gb
(15)
calculated as:
(16)
pm[l ] =
position
out of bounds?
S
Evaluate costs {F(u[l]
i )} i=1
[l] S
update { pb i }i=1 and gb [l]
and
c2 = 0.5 + (2.0 l ) (1.0 I max ) ,
Yes
No
l = l + 1 and go to Step b.
u[l]
i
u [l]
i
; otherwise, set
, and its
Update positions
pm [l], mean of
[l] S
i }i=1
1
S
pb
[l ]
i ,
i =1
(18)
331
For (i + 1; i S ; i + + )
1 = rand ();
SNR = d2 n2 .
2 = rand ();
u = rand ();
For ( j = 1; j D ; j + + )
p = 1 pb[il ]
+ 2 gb[l ]
u = ce | pm[l ]
u[l ]
j)
d2 =
(1 + 2 );
|;
= p u log(1 u );
= p + u log(1 u );
(z )H S ( z 1 )
dz
,
z
(21)
v H
(z )H S ( z 1 ) dzz can be
End for;
Figure 3
End for;
H
1 v
Else
u[il +1]
x2
(20)
unknown
plant
(19)
plant
output
x(k)
Step b.
The QPSO algorithm has fewer algorithmic parameters
that require tuning than the PSO algorithm. The
contraction-expansion coefficient ce is critical to the
performance of the algorithm and it is typically determined
by experiment. The empirical formula for computing ce
(Sun et al., 2004, 2005, 2006):
noise
+
d(k)
adaptive
IIR filter
y(k) +
e(k)
Example one
This example was taken from Shynk (1989). The system
and filter transfer functions respectively are:
H S (z ) =
0.05 0.4z 1
1 1.1314z 1 + 0.25z 2
(22)
and
H M (z ) =
a0
1 + b1z 1
(23)
332
Figure 4
Figure 5
(a)
(a)
(b)
(b)
(c)
Notes: The dashed line indicates the global minimum.
The ASA result is quoted from Chen et al. (2001)
and the RWBS result from Chen et al. (2005).
(c)
Note: The large square indicates the global minimum.
333
For the PSO, the swarm size was set to S = 30 and the
maximum number of iterations to I max = 20. Figure 4(a)
depicts the evolution of the normalised cost function
averaged over 100 different random runs obtained using the
PSO. Under the identical experimental conditions, the ASA
(Chen et al., 2001) and the RWBS (Chen et al., 2005) were
also applied to this example and the results obtained are
reproduced in Figures 4(b) and 4(c), respectively. It can be
seen from Figure 4 that both the ASA and RWBS had a
similar convergence speed, requiring on average 300 cost
function evaluations to converge to the global optimal
solution while the PSO had a slightly faster convergence
speed as it required a slightly fewer cost function
evaluations, about 250 on average, to converge. The work of
White and Flockton (1994) applied a GA to the same
example. The result given in White and Flockton (1994)
shows that the GA was slower to converge to the global
minimum, requiring an average of 600 cost function
evaluations to do so.
For the QPSO with the swarm size S = 30 and the
maximum number of iterations I max = 20, appropriate
values for cmax and cmin were found empirically to be
cmax = 1.4 and cmin = 0.6. The learning curve of the QPSO
is also depicted in Figure 4(a) in comparison with that
obtained by the PSO. For this example, we do not see any
convergence advantage of the QPSO over the PSO. From
Figure 4(a), it can be seen that initially the QPSO algorithm
converged faster than the PSO algorithm but after about 100
cost evaluations it became slower than the PSO. In fact, the
QPSO algorithm took on average 300 cost function
evaluations to converge to the global optimal solution. The
distribution of the solutions obtained in the 100 experiments
by the PSO algorithm is shown in Figure 5, in comparison
with the solution distributions obtained by the RWBS
algorithm and the QPSO algorithm, which confirms that the
solution quality of the PSO algorithm was better than the
other two algorithms.
Figure 6
(a)
(b)
Example two
This was a third-order system with the transfer function
given by:
H S (z ) =
(24)
(c)
Note: The ASA result is quoted from Chen et al. (2001)
and the RWBS result from Chen et al. (2005).
334
Figure 7
(a)
(b)
Conclusions
References
strm, K.J. (1970) Introduction to Stochastic Control Theory,
Academic Press, New York.
Awadallah, M.A. and Soliman, H.M. (2008) An adaptive power
system stabiliser based on fuzzy and swarm intelligence, Int.
J. Modelling, Identification and Control, Vol. 5, No. 1,
pp.5565.
Chen, S. and Luk, B.L. (1999) Adaptive simulated annealing for
optimization in signal processing applications, Signal
Processing, Vol. 79, No. 1, pp.117128.
Chen, S., Istepanian, R. and Luk, B.L. (2001) Digital IIR filter
design using adaptive simulated annealing, Digital Signal
Processing, Vol. 11, No. 3, pp.241251.
Chen, S., Wang, X.X. and Harris, C.J. (2005) Experiments with
repeating weighted boosting search for optimization in signal
processing applications, IEEE Trans. Systems, Man and
Cybernetics, Part B, Vol. 35, No. 4, pp.682693.
(c)
335
Soo, K.K., Siu, Y.M., Chan, W.S., Yang, L. and Chen, R.S.
(2007) Particle-swarm-optimization-based multiuser detector
for CDMA communications, IEEE Trans. Vehicular
Technology, Vol. 56, No. 5, pp.30063013.
Sun, J., Xu, W-B. and Feng, B. (2004) A global search strategy of
quantum-behaved particle swarm optimization, Proc. 2004
IEEE Conf. Cybernetics and Intelligent Systems, Singapore,
13 December, pp.111116.
Sun, J., Xu, W-B. and Feng, B. (2005) Adaptive parameter control
for quantum-behaved particle swarm optimization on
individual level, Proc. 2005 IEEE Int. Conf. Systems, Man
and Cybernetics, Big Island, Hawaii, 1012 October, Vol. 4,
pp.30493054.
Sun, J., Xu, W-B. and Liu, J. (2006) Training RBF neural
network via quantum-behaved particle swarm optimization,
Proc. ICONIP 2006, Hong Kong, China, 36 October,
pp.11561163.
Sun, T-Y., Liu, C-C., Tsai, T-Y. and Hsieh, S-T. (2008) Adequate
determination of a band of wavelet threshold for noise
cancellation using particle swarm optimization, Proc. CEC
2008, Hong Kong, China, 16 June, pp.11681175.
White, M.S. and Flockton, S.J. (1994) Genetic algorithms for
digital signal processing, Lecture Notes in Computing
Science, Vol. 865, pp.291303.
Widrow, B. and Stearns, S.D. (1985) Adaptive Signal Processing,
Prentice-Hall, Englewood Cliffs, NJ.
Wilson, P.B. and Macleod, M.D. (1993) Low implementation cost
IIR digital filter design using genetic algorithms, Workshop
on Natural Algorithms in Signal Processing, Chelmsford,
Essex, UK, pp.4/14/8.
Yao, W., Chen, S., Tan, S. and Hanzo, L. (2009) Particle swarm
optimisation aided minimum bit error rate multiuser
transmission, Proc. ICC 2009, Dresden, Germany, 1418
June, 5 pages.
Notes
1