Module

2

Random Processes

Version 2, ECE IIT, Kharagpur







Lesson
8
Stochastic Processes


Version 2, ECE IIT, Kharagpur
After reading this lesson, you will learn about

Stochastic Processes
Statistical Average
Wide sense stationary process
Complex valued stochastic process
Power Density Spectrum of a stochastic process


Many natural and man-made phenomena are random and are functions of time.
e.g., i) Fluctuation of air temperature or pressure, ii) Thermal noise that are
generated due to Brownian motion of carriers in conductors and semiconductors
and iii) Speech signal.

All these are examples of Stochastic Processes.

An instantaneous sample value of a stochastic process is a random variable.

A stochastic process, some time denoted by X(t), may be defined as an ensemble
of (time) sample functions.

Ex: Consider several identical sources each of which is generating thermal noise.

Let us define X
ti
=X(t=t
i
), i=1,2,.., n (n is arbitrarily chosen) as the random
variables obtained by sampling the stochastic process X(t) for any set of time
instants t
1
<t
2
<t
3
..<t
n
. So, these n random variables can be characterized by
their joint pdf, i.e. p(x
t1
, x
t2
, x
t3
,.., x
tn
).

Now, let us consider another set of random variables ( )
i
X t + , generated from
same stochastic process X(t) with an arbitrary time shift ' '
1
1
( ),....... ( )
i
t t
X X t t X X t t
i

+ +
= = + = = +
and with a joint pdf
1 2
( , ,....., )
n
t t t
p x x x
+ + +
.

In general, these two joint pdf-s may not be same. However, if they are same for
all and any n, then the stochastic process X(t) is said to be stationary in the
strict sense. i.e.,
1 2
1 2
( , ,......, ) ( , ,....., )
n
t t tn t t t
p x x x p x x x
+ + +
= for all ' ' and all n.

Strict sense stationarity means that the statistics of a stochastic process is invariant
to any translation of the time axis. Finding a quick example of a physical random
process which is stationary in the strict sense may not be an easy task.

If the joint pdfs are different for any ' ' or n the stochastic process is non-
stationary.
Version 2, ECE IIT, Kharagpur

Statistical Averages

Like random variables, we can define statistical averages or ensemble averages
for a stochastic process.

Let X(t) be a random process and ) ( i t t t X X i = =
Then, the n-th moment of X
ti
is:
i i
n
i
n
i t t t t dx x p x X E ) ( . ] [
-

= 2.8.1
For a stationary process, ( ) ( )
ti ti
p x p x
+
= for all and hence the n-th moment is
independent of time.

Let us consider two random variables ( ), 1,2
ti i
X X t i = =
The correlation between X
t1
& X
t2
is measured by their joint moment:
2 1 2 , 1 2 1 2 1 ) ( . ] [
- -
t t t t t t t t dx dx x x p x x X X E

+

= 2.8.2
This joint moment is also known as the autocorrelation function, (t
1
,t
2
) of the
stochastic process X(t). In general, (t
1
,t
2
) is dependent on t
1
and t
2
.

However, for a strict-sense stationary process,
p(x
t1
,x
t2
) =p(x
t1
+T, x
t2
+T),

For any T and this means that autocorrelation function (t
1
,t
2
) for a stationary
process is dependent on (t
2
t
1
), rather than on t
2
and t
1
,
i.e.,
) ( ) t - (t ) , ( ] [ 1 2 2 1 2 1 = = = t t X X E t t , say where =t
2
t
1
2.8.3
It may be seen that, ( ) ( ) = and hence, ( ) is an even function.

Note that hardly any physical stochastic process can be described as stationary in
the strict sense, while many of such processes obey the following conditions:
a) Mean value, i.e., E[X] of the process is independent of time and,
b) over the time domain of interest.
1 2 1 2
( , ) ( ) t t t t =

Such stochastic processes are known as wide sense stationary. This is a less
stringent condition on stationarity.

The auto-covariance function of a stochastic process is closely related to the
autocorrelation function:

1 2 1 1 2 2
1 2 1 2
( , ) {[ ( )][ ( )]}
( ) ( ). ( )
t t
t t E X m t X m t
t t m t m t
=
=
2.8.4
Here, m(t
1
) =E[ X
t1
]. For a wide sense stationary process,
Version 2, ECE IIT, Kharagpur
2
1 2 2 1 m - ) ( ) ( ) t - (t ) t - (t = = = 2.8.5

It is interesting to note that a Gaussian process is completely specified by its mean
and auto covariance functions and hence, if a Gaussian process is wide-sense
stationary, it is also strict-sense stationary.

We will mean wide-sense stationary process when we discuss about a stationary
stochastic process.

Averages for joint stochastic processes

Let X(t) & Y(t) denote any two stochastic processes and X
ti
=X(t
i
), i=1,2,.n and
j=1,2,,m are the random variables at t
1
>t
2
>t
3
.>t
n
and
[n and m are arbitrary integers].
'
'
( ),
j
t
Y Y t =
j
' ' '
1 2 m
t >t >......>t

The two processes are statistically described by their joint pdf:
' ' '
t1 t2 tn 1 2 m
p(x ,x ,.....x , yt ,yt ,......yt )

Now, the cross-correlation function of X(t) and Y(t) is defined as their joint moment:
1 2 1 2 1 2 1 2 1 2
( , ) ( ) ( , )
xy t t t t t t
t t E X Y x y x y dx dy


= =

t t
2.8.6

The cross-covariance is defined as,
1 2 1 2 1 2
( , ) ( , ) ( ). ( )
xy xy x y
t t t t m t m t = 2.8.7

Here, m
x
(t
1
) =E[ X
t1
] and m
y
(t
1
) =E[ Y
t2
]. If X and Y are individually and jointly
stationary, we have,
1 2 1 2
1 2 1 2
( , ) ( )
&
( , ) ( )
xy xy
xy xy
t t t t
t t t t
=
=
2.8.8

In particular,
' '
1 1
1 1
( ) ( ) ( . ) ( )
xy t t yx
t t
E X Y E X Y

+

= = =

Now, two stochastic processes are said to be statistically independent if and only if,
' ' '
' ' '
1 2
1 2
1 2
1 2
( , ,..... , , ....., )
( , ,..... ). ( , ....., )
t t tn
t t t m
t t n
t t t m
p x x x y y y
p x x t p y y y =
2.8.9
for all t
i
, t

j
, n and m

Two stochastic processes are said to be uncorrelated if,
] ].E[Y E[X ) t , ( 2 1 t t 2 1 = t xy . This implies, 0 ) , ( 2 1 = t t xy 2.8.10
i.e., the processes have zero cross-covariance.
Version 2, ECE IIT, Kharagpur

Complex valued stochastic process

Let, Z(t) =X(t) +jY(t), where X(t) and Y(t) are individual stochastic processes.
One can now define joint pdf of Z
ti
=Z(t =i), i=1,2,,n, as
)

1 2 1 2,
( , ,........ , , ........
t t tn t t tn
p x x x y y y

Now the auto correlation function ) t , (t
~
2 1 zz of the complex process z(t) is defined as,

) t , (t
~
2 1 zz = )] jy )(x jy [( .
2
1
] Z . [ .
2
1
2 2 1 1 2 1 t t t t
*
+ + = t t x E Z E
= ] )} , ( - ) , ( j{ ) , ( ) , ( [ .
2
1
2 1 2 1 2 1 2 1 t t t t t t t t xy yx yy xx + + 2.8.11
Here, : Auto-correlation of X; ) , ( 2 1 t t xx
: Auto-correlation of Y; ) , ( 2 1 t t yy
and are cross correlations of X&Y. ) , ( 2 1 t t yx ) , ( 2 1 t t xy

For a stationary ), (
~
t z ) ( ) , ( 2 1 zz zz t t = and . ) ( ) ( ) , (
*
2 1
*
= = zz zz zz t t

2.8.12

Power Density Spectrum of a Stochastic Process

A stationary stochastic process is an infinite energy signal and hence its Fourier
Transform does not exist. The spectral characteristic of a stochastic process is obtained
by computing the Fourier Transform of the auto correlation function.

That is, the distribution of power with frequency is described as:
2
( ) ( )
j f
f e d

2.8.13
The Inverse Fourier Transform relationship is:
df

=
-
f j2
(f)e ) (

2.8.14
Note that,
2
1
(0) ( ) ( ) 0 f df E X

= =

(0) represents the average power of the stochastic signal, which is the area under the
( ) f curve.
Hence, ( ) f is called the power density spectrum of the stochastic process.

If X(t) is real, then ( ) is real and even.
Hence ( ) f is real and even.

Version 2, ECE IIT, Kharagpur

Problems

Q2.8.1) Define and explain with an example a wide sense stationary stochastic
process.

Q2.8.2) What is the condition for two stochastic processes to be uncorrelated?

Q2.8.3) How to verify whether two stochastic processes are statistically independent
of each other?



Version 2, ECE IIT, Kharagpur