Professional Documents
Culture Documents
wavelet transform
Hai-Tao Fang
a,b,
*
, De-Shuang Huang
a
a
Institute of Intelligent Machines, Chinese Academy of Sciences, P.O. Box 1130, Hefei, Anhui 230031, China
b
Automation Department of University of Science and Technology of China, Hefei, Anhui 230026, China
Received 15 September 2003; received in revised form 11 January 2004; accepted 12 January 2004
Abstract
Lidar is an ecient tool for remotely monitoring targets or objects, but the eective range is often limited by signal-
to-noise ratio (SNR). The reason is that noises or interferences always badly aect the measured results. So, to detect
the weak signals buried in noises is a fundamental and important problem in the Lidar systems. It has been found that
digital lters are not suitable for processing Lidar signals in noises, while the wavelet transform is an ecient tool for
signal analysis in timefrequency domain that is very sensitive to the transient signals. In this paper, we propose a new
method of the Lidar signal acquisition based on discrete wavelet transform (DWT). This method can signicantly
improve the SNR so that the eective measured range of Lidar is increased. The performance for our method is in-
vestigated by detecting the simulating and real Lidar signals in white noise. To contrast, the results of Butterworth lter,
which is a kind of nite impulse response (FIR) lter, are also demonstrated. Finally, the experimental results show that
our approach outperforms the traditional methods.
2004 Elsevier B.V. All rights reserved.
PACS: 42.79.Q; 42.86
Keywords: Lidar; De-noising; Discrete wavelet transform; Power spectral density
1. Introduction
So-called Lidar (Light Detection and Ranging)
is meant to determine the range of a target irra-
diated by the Lidar by analyzing the echo of light
pulses scattered on the investigated object. Al-
though the Lidar has been successfully applied to
many elds, it is most widely used in atmospheric
research in environments. For instance, the Lidar
can be used to study the high cirrus clouds over
equatorial regions [1], high-latitude polar strato-
spheric clouds [2], stratospheric ozone [3] and
stratospheric aerosols or stratospheric aerosols [4],
etc. Currently, Lidar is the unique detector, which
can provide ones with remote or selective sensing
about 20 dierent gaseous compounds in the
atmosphere.
*
Corresponding author. Tel.: +8605515591108; fax: +860551-
5592751.
E-mail addresses: fanght@iim.ac.cn (H.-T. Fang), dshu-
ang@iim.ac.cn (D.-S. Huang).
0030-4018/$ - see front matter 2004 Elsevier B.V. All rights reserved.
doi:10.1016/j.optcom.2004.01.017
Optics Communications 233 (2004) 6776
www.elsevier.com/locate/optcom
Lidar is an active remote sensing instrument,
and it transmits electromagnetic radiation and
measures the anti-radiation that is scattered back
to the receiver of the Lidar after interacting with
various constituents of the atmosphere. In partic-
ular, Lidar uses a laser (emitter) to send a pulse of
light into the atmosphere, and a telescope (re-
ceiver) to measure the intensity (signal) scattered
back to it. By measuring the scattering and at-
tenuation experienced by the incident pulse of
light, ones can investigate the properties of the
scatters in the atmosphere. The backscattered ra-
diation detected by a Lidar can be described by the
Lidar equation. For example, for a simple back-
scattered Lidar, the Lidar equation can be written
as
p
r
k
L
C
R
2
h
2
OR
bk
L;R
4p
exp
_
2
_
R
0
k
e
k
L
; R
0
dR
0
_
; 1
where p
r
k
L
is the power received by the Lidar at
the laser wavelength k
L
; C is the Lidar constant; R
is the range; h c t
p
with t
p
being the pulse du-
ration and c the speed of light. The term OR
describes the overlap between the laser beam and
the receivers eld of view, and it is equal to 1 for
the case with the complete overlap between the
laser and the receivers eld of view. In addition,
bk
L;R
represents the combined aerosol or the
molecular backscatter; k
e
k
L
; R denotes the ex-
tinction coecient at the laser wavelength k. For
Lidar with single wavelength, the corresponding
Lidar equation can be solved following the method
suggested by [4].
Obviously, the solutions for the Lidar equation
described by Eq. (1) completely depend on p
r
k
L
s
p
_
1
1
w
s;b
tf t dt; 6
where W s; b is the WT coecient; s is called scale
parameter, and 1=
s
p
a normalization factor for
conservation of energy; b is translation factor;
w
s;b
t wt b=s is the wavelet function at a
particular scale s and translation factor b, and f t
the function to be transformed.
The scale factor s can be interpreted as a mea-
sure of frequency. A smaller scale factor indicates
extracting high-frequency components in the
transformed signal whereas a big scale factor
indicates extracting the corresponding low-
frequency components. Eq. (6) can also be inter-
preted as a convolution of the signal with the
wavelet function in the time domain. Since the
wavelet function is of a localized property, the WT
has sensitivity to the transient signals such as Lidar
signal. In addition, since the WT has dierent
resolutions on noise and signal, thus it can per-
form the de-noising processing on Lidar signal.
It is easily proved that the WT has the following
linear property:
W
sn
s; b W
s
s; b W
n
s; b; 7
where W
s
s; b is the WT coecient of the noise-
free signal, W
n
s; b is the WT coecient of noise,
and W
sn
s; b the WT coecient of the signal plus
noise.
In fact, the WT can be applied to solve a nite
group of data. In other words, the WT, similar to
the discrete FT (DFT), can be extended to the case
of discrete WT (DWT). The DWT uses two kinds
of basis functions. The one is the scaling function,
/t, also called the father wavelet (interpreted
as a low-pass lter), and another is the wavelet
function, wt, also called the mother wavelet
(interpreted as a high-pass lter). A common al-
gorithm for calculating discrete wavelet coe-
H.-T. Fang, D.-S. Huang / Optics Communications 233 (2004) 6776 71
cients is the so-called Mallat algorithm [12]. The
aim of the DWT is to decompose an arbitrary
signal f t into a summation of all possible wavelet
bases at dierent scales. The original input signal,
f t, passes through these two complementary l-
ters and emerges as two signals at each scale. In-
tuitively, it can be interpreted as a successive
sequence of the combinations of two band pass
lters.
In general, the wavelet function wt can be
written as a linear combination of the scaling
functions. And the scaling function has the fol-
lowing property:
/
t
2
_ _
2
p
n
h
n
/t n; 8
w
t
2
_ _
2
p
n
g
n
/t n: 9
There are two sequences, h
n
and g
n
, of coecients,
where h
n
is related to the low-pass lter and g
n
to
the high-pass lter in the DWT algorithm. At each
scale the two lters are applied to the input signal
simultaneously. The actual shapes of the frequency
responses of these two lters are determined by the
kinds of the wavelet functions used. The WT is a
multiple layered decomposition transform. The
original signal is decomposed into high- and low-
frequency components, then the corresponding
low-frequency component is again decomposed
into the two parts, and so on. At each successive
scale, the length of the vector upon which the l-
ters operate is halved; this is referred to as deci-
mation. Thus, the total number of available scales
is log
2
N, where N is the length of the input data
vector.
The coecients of DWT are related not only
to the input signal f t, but also to the types of
mother wavelet wt and its scaling function
/t. When a mother wavelet that is to most
match the signal features is chosen, the DWT
coecients of the signal will be obviously bigger
than the ones of the noise buried in noisy signal
at each scale. The success of the de-noising
technique based on wavelet transform lies in the
fact that by the WT the signal can be decom-
posed into a few of larger coecients while the
noise can only be transformed into many smaller
coecients. It is based on this principle that we
propose using wavelet transform method to re-
move the noise in signal.
Through wavelet decomposition, a similarity
index W s; b referred to as the wavelet coecients
between the signal and the wavelet function is
calculated. The index represents how closely the
wavelet wt correlates with the original signal. If
the index W s; b is larger, the similarity is stron-
ger; otherwise, it is weaker. As a result, we can use
the following formula to reconstruct f t:
f t W s; b wt; 10
where denotes inverse DWT.
In addition, there also exist more popular or-
thogonal wavelet bases with some interesting
properties [13]. As more ecient and faster algo-
rithms are developed in the future, the WT will
become into practical and feasible tools in signal
processing [13,14].
4. Experimental results and discussion
In this section, we present two experimental
results on the proposed algorithm for reducing
noise in signal. First, the simulating signal is gen-
erated from the function y exp128
x 0:3
2
3 jx 0:7j
0:4
, where the input x is
obtained from the uniform distribution on
0; 1:024. The corresponding functional output, y,
is articially contaminated by stochastic noises
generated from normal Gaussian white noise with
zero-mean. In this experiment, the sym5 wavelet
(symlet) is chosen to perform the WT decomposi-
tion with the level of 5. The reason that symlet
family is chosen is that they are good candidates as
a de-noising tool [15]. Since the symlets do not
have explicit mathematical expressions, they can
be calculated only numerically, the waveform of
sym5 wavelets is illustrated in Fig. 5. More de-
tailed description of symlets can be found in
[15,16]. Fig. 6 shows the contaminated signal dis-
tribution by noise with the SNR of 2 dB. The SNR
is here dened as follows:
72 H.-T. Fang, D.-S. Huang / Optics Communications 233 (2004) 6776
SNR 10 log
n
i1
I
2
k
_ __
n
i1
I
k
_
^
I
k
2
_
;
11
where I
k
and
^
I
k
denotes the original signal and the
contaminated signal, respectively. Fig. 7 shows the
de-noised simulating signal distribution, where the
corresponding SNR is improved to 25 dB. For
contrast, the original noise-free simulating signal
was also illustrated in Fig. 7. From Fig. 7, it can be
seen that the sharp features of the original signal
are still remained in the reconstructed signal, and
the gain improvement of the SNR is over 10 times.
Therefore, the de-noising method based on DWT
is a very potential and ecient one.
In the following, we consider a practical ex-
ample. Assume that we are given N samples from
real Lidar:
y
i
f
i
t e
i
; i 1; 2; . . . ; N; 12
where e
i
is regarded as noisy components.
In practice, the Gaussian wavelet or Mexican
hat wavelet is often used as mother wavelet. The
Mexican hat wavelet is compactly supported in the
time domain rather than the frequency domain,
and often used in the case where high resolution
processing is required in the time domain. For
Lidar signal is a transient signal in the time do-
main, Mexican hat wavelet is here selected. The
Mexican hat wavelet used in our experiment is
dened as
wt
2
3
p p
1=4
1 t
2
e
t
2
=2
: 13
The corresponding waveform of the Mexican hat
wavelet is shown in Fig. 8. In addition, assume
that the scaling function used in this experiment is
/t
1; 0 6t 61;
0; otherwise:
_
14
In fact, the Lidar signal tends to dominate low-
frequency components. It can be expected that the
majority of high-frequency components are noise
parts. They have very small wavelet coecient
values. To remove those elements regarded as
Fig. 5. The sym5 wavelet waveform.
Fig. 6. The contaminated signal.
Fig. 7. The reconstructed signal.
H.-T. Fang, D.-S. Huang / Optics Communications 233 (2004) 6776 73
noise parts among the whole wavelet coecient,
W s; b, a threshold should be suitably selected. In
practice, there are many criteria for possibly se-
lecting a reasonable threshold value. In this paper,
we use a universal threshold, i.e.,
th r
2 log
2
N
_
; 15
where N is the dimensionality of the input data
vector and r the standard deviation of the noise.
The r is often estimated from the median value of
the DWT coecients at the rst level (D
1
) of signal
decomposition, i.e.,
r jmedianD
1
j=0:674: 16
Once the threshold value has been calculated
one can apply a soft or hard modeling policy to
reduce the noise in signal. For the Lidar signal
tends to dominate low-frequency components, a
soft threshold that is best in reducing noise but
worst in preserving edges, is selected. In this
strategy, for each DWT coecient, W s; b, and
the threshold, th, the soft threshold value can be
calculated as
W
st
ij
sgnjW
ij
th; jW
ij
j Pth;
0; jW
ij
j < th;
_
17
where W
ij
is the j th DWT coecient at scale i of
the decomposition. Note that the threshold was
applied only to the detail coecients.
As a result, the de-noising procedure with soft
threshold can be summarized as follows:
Step 1. Remove meaningless data intervals in
the original Lidar signal since they are undetect-
able data for the Lidar system. Assume that the
whole length of the stored signal dataset is ex-
tended to 2n by linear padding technique (what
must be stressed is that 2n is the nearest value to
the length of the original signal dataset). Applying
the DWT with Mexican hat wavelet based on
Mallat algorithm to the original signal, the matrix
of wavelet coecients can be obtained.
Step 2. Remove the elements regarded as noise
parts among the wavelet coecients. A soft
threshold approach is used to select the threshold
value. The wavelet coecient columns that are
larger than the given threshold value are selected,
and the corresponding columns indexes are also
stored. However, those column indexes involved in
the linear padding part are removed. The selected
column indexes generate a new compressed Lidar
signal dataset in the wavelet domain. The column
indexes are also used to reconstruct the original
signal.
Step 3. Use the stored column indexes of the
selected wavelet coecients and apply inverse
DWT. Consequently, the de-noised and com-
pressed Lidar signal are obtained.
Fig. 9 shows the de-noised Lidar signal distri-
bution based on the above DWT de-noising pro-
cedure with soft threshold. The experimental
results show that the eective range for Lidar is
greater then 80 km, i.e., the echo noises from over
Fig. 8. The Mexican hat wavelet.
Fig. 9. The de-noised Lidar signal by DWT.
74 H.-T. Fang, D.-S. Huang / Optics Communications 233 (2004) 6776
80 km are smaller than the tolerance values.
Fig. 10 shows the power spectral density (PSD) of
Lidar signal processed by DWT. Compared with
the PSD of simulating Lidar signal illustrated in
Fig. 3, most components of the real Lidar signals
are retained regardless of whatever the frequency
content is. Fig. 11 shows the PSD distribution of
Lidar signal processed by Butterworth lter. By
comparing Fig. 10 with Fig. 11, it can be found
that the high-frequency components of Lidar sig-
nal processed by Butterworth lter are lost. In
other words, our proposed DWT plus soft
threshold technique is a more ecient and poten-
tial approach to reduce noise in Lidar signal with
respect to the traditional ltering methods.
5. Conclusions
This paper proposed a noise reduction method
in Lidar signal based on discrete wavelet transform
(DWT). The noisy component in real Lidar signal
is usually to distribute in wider band while the
signal from longer distance (greater than 40 km)
with low SNR is almost buried in the noise. So it is
impossible to eliminate the noise using conven-
tional digital lter by selecting a cut-o frequency
simply. The wavelet coecient noise reduction
method by using nonlinear soft threshold tech-
nique can remove the noise and retain the signal
components regardless of the signals frequency
content. As a result, the noise in Lidar signal was
almost entirely suppressed so that the eective
working range for Lidar instrument was increased
greatly. The experimental results about both sim-
ulating and real data for Lidar demonstrate the
eectiveness and eciency of our proposed ap-
proach. In particular, the experimental results on
real Lidar signal show that our proposed approach
is still ecient at larger distance (in our example
above 80 km) where a poor signal-to-noise ratio
occurs. Future research work will include how to
apply this method to solving more real problems.
References
[1] A.H. Omar, J. Geophys. Res. 106 (D1) (2001) 1227.
[2] V. Santacesaria, A.R. MacKenzie, L. Stefanutti, Tellus (B)
53 (3) (2001) 306.
[3] L.R. Douglass, M.R. Schoeberl, S.R. Kawa, E.V. Browell,
J. Geophys. Res. 106 (D9) (2001) 9879.
[4] F.G. Fernald, Appl. Opt. 23 (5) (1984) 652.
[5] S. Lerkvarnyu, Moving average method for time series
Lidar data. Available from <http://www.gisdevelop-
ment.net/aars/acrs/1998/ps3/ps3016.shtml>.
[6] D.S. Huang, Intelligent Signal Processing Technique for
High Resolution Radars, Publishing House of Machine
Industry of China, 2001.
[7] D.S. Huang, Systematic Theory of Neural Networks for
Pattern Recognition, Publishing House of Electronic
Industry of China, Beijing, 1996.
Fig. 10. The PSD distribution of Lidar signal processed by
DWT.
Fig. 11. The PSD distribution of Lidar signal processed by
Butterworth lter.
H.-T. Fang, D.-S. Huang / Optics Communications 233 (2004) 6776 75
[8] A. Felinger, T.L. Pap, J. Inczedy, Anal. Chim. Acta 248
(1991) 441.
[9] S. Shearman, Personal Eng. Instrumentation News 15 (9)
(1998) 24.
[10] O. Rioul, M. Vetterli, IEEE SP Mag. 8 (1991) 14.
[11] Y. Sheng, Wavelet transform, in: A.D. Poularikas (Ed.),
The Transforms and Applications Handbook, The Elec-
trical Engineering Handbook Series, CRC Press, Boca
Raton, FL, 1996, p. 747.
[12] B. Walczak, D.L. Massart, Chemom, Intel. Lab. Syst. 36
(1997) 81.
[13] D.S. Huang, Y.Q. Han, J. Electron. 5 (2) (1998)
107.
[14] D.S. Huang, Z. Bao, J. Electron. 12 (3) (1995) 200.
[15] I. Daubechies, Ten Lectures on Wavelets, SIAM, Phila-
delphia, PA, 1992.
[16] I. Daubechies, Commun. Pure Appl. Math. XLI (1988)
909.
76 H.-T. Fang, D.-S. Huang / Optics Communications 233 (2004) 6776