NATIONAL INSTITUTE OF TECHNOLOGY KURUKSHETRA

THEORY EXAMINATION
Question Paper

Month and year of the Exam. ..Nov. 2012

Semester... ......sth
Subject: ........Information Theory and Coding
Course No... ..ECT-305

The questionpaperhas ......08. . questions spread over . .....02..... pages.

Unless stated otherwise, the symbols have their usual meanings in the context with the subject.
Assume suitably and state, additional data required, if any. The candidates, before starting to
write the solutions, should please check the question paper for any discrepancy, and also enJure
that they have been delivered the question paper ofcorrect corrse no. and the correct subject title.

Note: Attemptiive questions in all, selecting at least one questionfrom each unit.

UNIT-I
State the central limit theorem and explain it with the help of a suitable example.

The pdf of random variable X is given by

(
lxe-* ''
-2,"
forx>0
Jv\x)=7
t 0 elsewhere
Compute: (i) most probable value (ii) average value (iii) variance of the random variable X.

Explain the terms: (i) wide sense stationary process (ii) strictly stationary process (iii) ergodic
process.

In a raildom process X(t)=Acos(2ttf"t), the frequencyf. is constant and the amplitude A is

uniformly distributed with
It o<a<l
lo@):lo otherwise
Determine whether or not this process is stationary in strict sense.

UNIT.II
Explain the terms:
(i) Information (ii) Entropy (iii) Mutual information (iv) channel capacity
A binary symmetric channel is extended to form symbols of two binary digits. Find out
"orri.,irg
the channel capacity of the extended binary channel. How is the capacity of this ch4nnel related
to the channel capacity of the simple BSC?
 4.(a) State and prove Shahon,s fi,
efficiency maximized by extension of source?

A zero memory source emits eight messages with probabilities:

0.22, 0.20, 0.1 g, 0.15, 0.10, 0.0g,
0'05, 0'02" Find out the Huffinan code and the code efficiency. (2+2+1)
why is this code uniquely
decipherable?

5.(a) For a block code with minimum distance r.y,l'#-J1'n",,

(i) It can correct all the error patterns of l: ltd^,, -l) /2 ) orfewer errors.
(ii) It is not capable of correcting all the emor patterns of / errors with I >
t.

Explain the construction of stand ard anay. For the (7, 3)

code with generator matrix
[r o o I o r tl
(4+2)

r o I r- ol
"=lo
L0 0l0lll_]
construct the standard array andidentifu the correctabre error patterns.

6.(a) Draw the diagram and,exPlain operation of a decoder for the (7,4) cyclic code with d^in: 3
generated by g(x) :
l+X +Xr.the
that decodes the received code word in a serial manner. The
receivedwordisr:( l0l 101 1).

Explain the decoding procedure of BCH codes.

UNIT-IV
7.(a) Explain the meaning of catastrophic codes. What is the condition
for non catastrophic codes? (2+1+1)
Why are systematic convolutional codes noncatastrophic?

A convolutional code is described by the following generator sequences:

g(') : (1 l0), g(2) = (101), g(3) = (l ll) (5+1)
Find the transfer function and the free distance of this code.

8.(a) With the help of a suitable example, explain the Viterbi algorithm for maximum
likelihood
decoding of convolutional codes.

Explain any one of the following.

(i) Normal-state operation of the receiver in selective ARe system
(ii) Hybrid ARe schemes