You are on page 1of 113

Modern Control Theory lOEE55 Modern Control Theory lOEE55

70 MODERN CONTROL THEORY

Subject Code : 10EE55 IA Marks : 25


UNIT - 6
Non-linear systems: Introduction, behavior of non-linear system, common physical non
No. of Lecture Hrs.! : 04 Exam : 03 linearity-saturation, friction, backlash, dead zone, relay, multi variable non-linearity.
Week Hours , 3 Hours
Total No. of Lecture : 52 Exam : ioo
Hrs. Marks UNIT-7
Phase plane method, singular points, stability of nonlinear system. limit cycles. construction
of phase trajectories.
PART-A
7 Hours

UNIT - 1 & UNIT - 2


UNIT - 8
STATE VARIABLE ANALYSIS AND DESIGN: Introduction, concept of state, state
variables and state model, state modeling of linear systems, linearization of state equations. Liapunov stability criteria, Liapunov functions, direct method of Liapunov & the linear
system, Hurwitz criterion & Liapunov's direct method, construction of Liapunov functions
State space representation using physical variables, phase variables & canonical variables
for nonlinear system by Krasvskii's method.
10 Hours .'
....6l1ours
.'
UNIT -3
TEXT BOQKS:
Derivation of transfer function from state model, digitalization, Eig'en values, Eigen vectors,
generalized Eigen vectors. . I. Digital control & state variable methods- M. Gopal- 2m' edition, TIIM Hill
2003
6 Hours
2. Control system Engineering- I. .1. Nagarath & M. Gopal,.- 3'" edition, New
UNIT -4 Age International (P) Ltd.
Solution of state equation, state transition matrix and its properties, computation using
Laplace transformation, power series method, Cayley-Hamilton method, concept of
controllability & observability, methods of determining the same REFERENCE BOOKS:
I. State Space Analysis of Control Systems- Katsuhiko Ogata -Prcntice lIall
10 Hours
Inc
2. Automatic Control Systems- Benjamin C. Kuo & Farid Golnaraghi, 8'10
PART-B edition, John Wiley & Sons 2003.
3. Modern Control Engineering- Katsuhiko Ogata- PHI 2003
UNIT -5 4. Control Engineering theory and practice- M. N. Bandyapadhyay PHI.
POLE PLACEMENT TECHNIQUES: stability improvements by state feedback, necessary 2007
& sufficient conditions for arbitrary pole placement, state regulator design, and design of 5. Modern control systems- Dorf & Bishop- Pearson education. 1998
state observer, Controllers- P, PI, PID. .
10 Hours

Dept ofEEE, SJBIT Page 1 Dept. of EEE, SJBIT Page 2


Modern Control Theory 10'EE55 Modern 'Control Theory lOEE55
"
CONTENTS PART-A
UNIT -1 & UNIT - 2
STATE VARlABLE ANALYSIS AND DESIGN: Introduction, concept of state, state
SI. No. Titles Page No. variables and Statemodel, state modeling of linear systems, linearization of state equations.
State space representation using physical variables, phase variables & canonical variables
10 Hours

I. UNIT -1 STATE VARIABLE ANALYSIS AND DESIGN 04 State Variable Analysis & Design
State Variable Analvsis or State Space Analvsis :-
The state variable approach is a powerful tool/technique for the analysis and design
2. UNIT - 2 STATE SPACE REPRESENTATION 24
of control system.

'The state space analysis is a modem approach and also easier for analysis using
digital computers. It's gives the total internal state of the system considering all initial
3. UNIT - 3 DERIVATION OF TRANSFER FUNCTION FROM
conditions.
STATE MODEL 42
Why do we need state space analysis?

4. UNIT- 4 SOLUTION OF STATE EQUATIONS


. '. 57 The conventional approach used to study the behaviour of linear time invariant
control' systems, uses time domain or frequency domain methods. When performance
specifications
, are
.
given for single input, single output linear time invariant systems, then
5. UNIT -.5 POLE PLACEMENT TECHNIQUES' 78 system can be 'designed by using Root locus. When time domain specifications are given,
Root locus technique is employed in designing the system. If frequency domain
specifipationsare given, frequency response plots like Bode plots are used in designing the
6. UNIT -6 NON LINEAR SYSTEMS .: 99 system.

,;i!J In' conventional methods, the systems are modelled using Transfer Function
7. UNIT - 7. PHASE PLANE ANALYSIS 105
.
approach, which is the ratio of Laplace transform of output to input, neglecting all the initial
conditions.

8. UNIT - 8 STABILITY ANALYSIS 121


The dratvbacksin the transfer function model and analysis are,

Dept. of EEE,SJmT Page 3 Dept. of EEE. SIB1T Page 4


"

Modern Control Theory lOEE55 Modern Control Theory lOEE55

1. Transfer function is defined under zero initial conditions. Comparison: Classical vs, Modern Control
2. transfer function is applicable to linear time invariant systems.
Classical Control (Linear) Modern Control (Linear)
3. It is restricted to single input and single output systems. ~---------------.,-----.---------------.
~ Developed in 1920- ~ Developed in 1950-
4. Does not provides information regarding the internal state of the system.
1950 1980
5. The classical methods like Root locus, Bode plot etc. are basically trial and ~ Frequency domain ~ Time domain analysis I

error procedures which fail to dive the optimal solution required analysis & Design(Transfer and dcsign(Differential
function based) equation based)
State variables analysis can be applied for any type of systems like,
r ~ Based-on SISO ~ Based on MIMO
models models
Linear system
~ Deals with input and ~ Deals with input,
Non- linear system output variables output and state variables
Time invariant system ~ Well-developed ~ Not well-developed
- Time varying system robustness concepts robustness co~ccpts
(gain/phase margins)
- Multiple-input and multiple output system.
~ No ~
the analysis can be carried with initial conditions. Controllabi lity/Observabilit Controllability/Observabi Iit !

Y inference y can be inferred


~ . No optimality ';- Optimality issues can
Atlvantages of state variable analysis
concerns be incorporated
I. Convenient tool for MIMO systems ~ Well-developed ~ Fairly well-developed.
2. Uniform platform for representing time-invariant systems, time-varying concepts and very much in and slowly gaining !

use in industry popularity in industry


systems, linear systems as well as nonlinear systems L__ __]_ _j
3. Can describe the dynamics in almost all systems (mechanical systems,
electrical systems, biological systems, economic systems, social systems etc. . State:-
4. It can be performed with initial conditions. The state is the condition of a system at any time instant 't'.
5. Variables used to represent system can be any variables in the system. State var;able:-
6. Using this analysis the internal states of the system at any time instant can be
A set of variable which described the state of the system atany time instant
predicted.
are called state variables.
7. As the method involves matrix algebra, can be conveniently adopted for
OR
digital computers.
The state of a dynamic system is the smallest number of variables (called
state variables) such that the knowledge of these variables at t=to, together with the
knowledge of the input for t=to, completely determine the behaviour ol:.E,hesystem
for any time t 2: to.

Dept ofEEE, SJBIT Page 5 Dept. of EEE, SJIlIT Page 6

"
Modern Control Theory lOEE55 Modern Control Theory lOEE55
State space:-
The set of all possible values which the state vector X(t) can have( or
assume) at time t forms the statc space of the system.
Uj_ (t) ---+ ---+ Yl (t)
State l'ector:- U2(t) ---+ ---+ Y2(t)
Control
It is a (nx I) column matrix whose clements are state variables of the
U3(t) ---+ ---+ Y3(t)
system,(where n is order of system) it is denoted by X(t). System

.1Lm(t) ---+
~ Yp(t)
..
State Variable Selection

).- Typically, the number of state variables (i.e. the order of the system)
! ! ! !
is equal to the number of independent energy storage elements. However, Xt(t) X2(t) X3(t) ..... Xn(t)
there are exceptions!
Control
Is there a restriction on the selection of the state variables?
U~ ~y
System
YES! All state variables should be linearly independent and they must
collectively describe the system completely.

.' x
State Space Formulation .' The different variables may be represented by the vectors(column matrix) as
shown below

In the state variable formulation of a system, in general, a system consists of Input vector Output vector Statevariable vector
rn-inputs, p-outputs and n-statc variables, The state space representation of the
U1(t) Yl(t) Xl(t)
system may be visualized as shown in figure I, I.

Let, State variables" Xl(t), Xz(t), X3(t)' Xn{t), U2(t) Y2(t) X2(t)
U3(t) Y3(t) X3(t)
Input variables ~ Uj_ (t), U2(t), U3(t), Um(t),

..,. Output variables= Yl (t), Y2(t), Y3(t), Yp(t),


~(t)
.
Yp(t)
U(k)= Ylk)=
X(k):
Xn(t)
State variable representation can be arranged in the form of n number of
first order differential equations.

Dept. of EEE, SJBIT. Page 7 Dept. of EEE, SJBIT Page 8

'.
Modern Control Theory lOEE55 Modern Control Theory 10EE55

dxl
dt
=X
dx2 x, = ani XI + an2X2 + + annx, + bnl u, + : bnmUm
dt In matrix form the above equation can be expressed as

Xl aU ~2 a1n Xl bll bl2 .....~ blm Uj_


X2 a2l a22 a2n X2 b21 b22 b2m liz
X3 a31 a32 a3n X3 b31 b32 b3n li3
+

arltl 11 b"l bn2 bmll Urn


"
It can also be written as
Any 'n' dimensional time invariant system has state equations in the function form
as, X(t) = A X(t) + B U(t)
X(t) = f( X, U) State equation :..(1) State space analysis
While out puts of such system are dependent on the state of the system and
Classical control theory ys modern control theory
instantaneous inputs. " The develbpment of control system analysis and design can be divided into three

...Functional output equation can be written as, eras. In the first era, we have classical control theory , which deals with techniques
developed befor~ 1950. classical control embodies such methods as root locus. Bode.
Y(t) = g(X, U) Output equation ....(2)' ,
Nyquist and Routh- Hurwitz. These methods have in common the use of transfer
functions- in the complex frequency(s) domain, emphasis on the use of graphical
State Model Of Linear System
techniques, the use of feedback and the use of simplifying assumptions to approximate
);> State model of a system consist of the state equation & output equation.
the time response . since computers were not available at that time , a great deal of
);> The state equation of the system is a function of state variables and inputs as defined
equation I.
, .
emphasis. was
.
placed on developing methods that were amenable t01l'manual
by
For linear tine invariant systems the first derivatives of state ~ari~bles can be
.
compbtation and graphics. A major limitation of classical control methods was the use of
single -input, single output (SISO) methods .. Multivariablc (i.e multiple - input
expressed as linear combination of state variables and inputs.
multiple - output or MIMO) systems were analyzed and designed one loop at a time
XI = all X] + al2 X2 + + aln Xn + bll Ul +.., + bIro Urn Also the usc of 1iransfer functions and the frequency domain limited one to linear time -
invariant syst;ms.
X2 = a21X] + a22X2 + + a2nXn + b2l Ul + + b2rnUrn
" In't!'le seoond era, we have modern control ( which is not so modern any longer

Dept. of EEE, SJBIT Page 9 Dept. of EEE, SJBIT Page 10


Modern Control Theory 10EESS Modern' Control Theory 10EESS
which referees to state - space methods developed in the late 1950,s and early 1960s. In
In other words, the state of a system represents the minimum amount of
modern control, system models are directly written in the time domain. Analysis and
information that we need to know about a system at t. such that its future behaviour can
design are done ill time domain. It should denoted that before Laplace transforms and
be determined without reference to the input before 10.
transfer functions became popular in the 1920s Engineering were studying systems in
the time domain. Therefore the resurgence of time domain analysis was not unusual, but
The idea of state is familiar from a knowledge of the physical world and the means
it was triggered by the development of computers and advances in numerical analysis.
of solving the differential equations used to model the physical world. Consider a ball
Because computers were available, it was no longer necessary to development analysis and
flying through the air. Intuitively we feel that if we know the ball's position and
design methods that were strictly manual. An Engineer could use computers to
velocity, we also know its future behaviour. It is on this basis that an outfielder positions
numerically solve or simulate large system that were nonlinear and time varying. State
himself to catch a ball. Exactly the same information is needed to solve a differential
space methods removed the previously mentioned limitations of classical control, The
equation model of the problem. Consider for example the second order differential
period or the 19~Oswas the heyday of modem control.
equation

System representation in state variable form


X +aX + bX = f(t)
This chapter introduce the concept of state variable and the various means of
representing control systems in state variable form, Each method of state variable The solution to this equation be found as the sum of the forced response, due to

representation results in a system description interms of 'n' first -order differential f(t) and the natural or unforced response ie the solution of homogeneous equation

equations, as opposed to the usual nth -order equation. s A convenient tool for X+aX+bX=O
this new system representations is matrix notation. If XI (t), X2(t) -------- Xn(t) are state variables of the system chosen then the
System state and state yariable initial conditions of the state variables plus the u(t)'s for t > 0 should be sufficient to

It is important to stress at out set that the concept of system state is first of all, a decide the future behaviour i.e y(t)'s for t > O. Note that the state variables need not be

physical concept. However it is often convenient to interrns of mathematical model. physically measurable or observable quantities. Practically however it is convenient to

Here this mathematical model is assumed to consist of ordinary differential equations -----Chose easily measurable quantities. The number of state variable is then equal to the

which have a unique solution tor all inputs and initial conditions. It is in terms of this order of the differential equation which is normally equal to the number of energy

mathematical model that the 'system state' or simply 'state' is defined. storage elements in the system.

Definition The state of system at any tim';-'i;j'Ts-the rmnnnumset ot numbers

X I (to) ,X,(t,,) -------- X,,(to) which along with the input to the system for t to is State eguatjon~ for linear systems in matrix form
sufficient to determine the behaviour of the system tor all t to. The state of a linear time -invariant nth order system is represented by the following set
of 'n' number of first order differential equations with constant coefficients in terms of n
state variable XI,X2-------- X,

Dept. of EEE, SJBIT Page 11 Dept. of EEE, SjBIT Page 12


Modern Control Theory 10EE55
'. Modern Control Theory lOEE55

Output eQuatjon

b"T
The state variables XI(t) -------X net) represents the dynamic state of a system. The.

X2 =a21 r+a22X2 j--+'''X'+ --+b,.u. .


system output! outputs may be used as some of the state variables themselves ordinarily,
the output variables
..
X, = anI XI+an2 X2 + -- --- +ann X, + bnlVI + - - +bnm V
In matrix form the above equations may be written as
.
' .
Y, = e" X, + e,l Xl + ---------- C" X"
Y2 =Cli X, + en X2 + ---------- Cl" X

11a12 ----------- a1n x, b11 b12 ----------- b1 m .1 1 1 '


Yp = Cpl X, + Cpl Xl + ----------Cp" X"
In matrix form,

b21 b22 ---------- b2m


}'1
.
Cll C 12 ----------- Cln
I
I +
I C21 C22 ----------- C2n
I
I =
I

Xn anI an2 ----------- ann bn1 bn2 ----------- bnm

o
X A X + B u Cp1 Cp2 ----------- Cpn

X is called derivative of state vector whose size is (nxI) or c x


X is called state vector whose size is (n x I) Y = output vector of size ( P x I)
e = Transmission matrix of size ( P x n)
A is called system matrix whose size is (n x n) X = State vector of size ( n x I)
.. B is called input matrix whose size is ( n x m) Sometimes the output is a function of both state variables and inputs. for this general

U is called input vector whose size is (m xl)


case
'.
Dept. of EEE. SIBIT Page 13 Dept. of EEE, SIBIT Page 14
Modern Control Theory 10EE55 Modern Control Theory 10EE55
Y=CX+DU State Model usi\w pbase -variables ( BUSH FORM)
or
Cll C]2 ----------- Cln x, 011 012 -------- 01m Let us now consider how the state model defined by equation (Z) may be obtained for an
nth order SISO system whose describing differential equation relating output y with input
u is given by .
C2l C22 ----------- C2n X2 021 022 -------- 02m Uz
dn,ly dn,2y dy
= + "
dtn
+. an,1~ + an,2 dtn,2 + ------------al r y bou - (3)

where an-I: An._2 , ai, no are constant coefficients

dn-Iy
dy,
yeO), -t6t
Cpn OP1 OP2 --------- QPm ------------ - (0), are initial conditions
.dt' dt

To arrive at the state model of equation (3) it is rewritten in shorthand form as


D matrix is of size (p x m)
State Mode!
Yn +an-I],)l-r + an',)l-2
:2]
.
+--------------a Iy + noy = bnu _ (4)

The state equation of a system determines its dynamic state and the output equation gives We first define the state variables
its output at any time t > 0 provided the state at t = 0 and the control forces for
t 0 are known. These two equations together form the state model of the-system, XI, X2: ---------- Xn which can be done in many possible ways, A convenient way
The state model of a linear system is therefore given by is define'

X=AX+BU (I)
Y = CX+ DU

..
State Model of SISO linear and time invariant svstem,

If we let m = I and p= I in the state model of a multiple input multiple output linear time
x, =y",1
invariant system we obtain the following state model for SISO linear system. With the above definition of state variables equation (4) is reduced to a set of'n' first
order differential equations given below;

x AX +bu
0
----+(2)
XI=Y =X2
Y=CX+du X2 ='1 = X3

Where band C arc ( nx 1) vectors

. ,
I 'I
Xn_1 = l-I = X,

Dept. of EEE. SJBIT Page 15 Dept. of EEE, SIBIT Page 16


Modern Control Theory lOEE55 Modern Control Theory lOEE55

the above equations result in the following state equations Deriyation of transfer functjon from a given state model

0 1 0---------- .- 0 Xl 0 Having obtained the state model we next consider the problem of determining transfer
0 0 1 ------------ 0 )\2 0 function from a given state model ofS[SO I MIMO systems.
0 0 1 ----------- 0 .'
I) 'SISP SYSTEM

0 0 0 ------------- 1
-~ -al -a2 ------------ -an x,
+
0
bo
u

u(s)
;_;__----.l. I' G( s)
yes)

It is to be noted that the matrix A has a special form. It has all 1's the upper off G(s) is called transfer function defined as

- diagonal, its last row is comprised of the negative of the coefficients of the original yes)
differential equation and all other elements are zero. This form of matrix A is known as G(s) = yes) = u(s) G(s) or y (s) = G(s) u(s) -------- (I)
u(s)
the 'BUSH FORM' .The set of state variables which yield 'BUSH FORM' for the
matrix A are called 'Phase variables' State Model is given by

x (t) = AX (t) +Bu ----------- (2)


yet) = ex (t) + Du ----------- (3)
When 'A' is in 'BUSH FORM', the vector b has the specialty that all its elements
except the last are zero. In fact A and B and therefore the state equation: can be written
Taking laplace transformation on both sides of equations ( 2) and (3) and neglecting
directly by inspection of the linear differential equation.
initial conditions
The output being y = X I ,the output equation is given by
We get sX(s) = AX (s) +
y=[lO--O] x, Bu(s) -----(4) Yes) = CX (s) t-
Du(s) ---- (5)

From (4)
(sI -A) Xes) = Bu(s)

Or Xes) = --------- (sl-A rlBu(s) --------(6)

Substituting ( 6) in (5)

Yes) FC (sl-A rIBu(s) + Du(s)


Where C = [ I 0 ------0)
yes) = ( C (sl -A r1B+D) u(s) --------------- (7)
Note: There is one more state model called canonical state model. we shall consider this
Comparing ( 7 ) with (I)
model after going through transfer function.

Dept ofEEE. SJBIT Page 17 Dept. ofEEE, SJBIT ",. Page lB


Moderr:!._Control Theory iOEESS Modern Control Theory 10EESS
G(s) = C( sl -A )"' B + D ---------( 8)
Deriyatiye of st~te models (mm transfer fUDcUoo
An important observation that needs to be made here is that while the state model is not
unique, the transfer function is unique. i.e, the transfer function of equation (8) must work More often the system model is known in the transfer function form. It therefore becomes
out to be the same irrespective of which particular state model is used to describe the necessary to have methods available for converting the transfer function model to a state
system. model. The process of going from the transfer function to the state equations is called
decomposition of
the transfer function. In general there are three basic ways of
(ii) MJI\JO SYSTEM decomposing a transfer function in direct decomposition, parallel decomposition, and
cascaded decomposition has its own advantage and is best suited for a particular
situation.
u,(s) y,( s)
G(s) Decomposition of TF
112(S) y, (5)
1. Converting a TF with a constant term in numerator. Phase variables-
III input
s ,j. I Pout puts variables that are successive derivatives of each other.

lIm(S) Yo (s) C(S) 24


R(~) s3 + 9s2 + 268 +24
"
G(s) = C( sl -A ) -I B + D Where yes) =Gis) U(s)
"

YI(S) o ll(S) G 1~(S) ------------------- o Im(S) Ul(S) Take in LT.


Y2(S) G 21(S) G 22(S) ------- ----- _______G 2m(S) U2(S)
I I I
I I I
I I I C=Xl
yp(S) G p1(S) G .2(5) ---------------- ___ G !'n,(S) Urn(S)
C=Xl=X2
.. X'~ -.I,
G(s) matrix is called transfer matrix of size (p x m) C=. 1 =.(2= X3
y( s) matrix is of size (px I) 'C=X3=Xl
lI(S) matrix is of size (mx I)

)',(s) = G , Irs) lI,(s) + G ds) U2(S)'1 -------------------+_ G Im(S)Um(s) X3+ 9X3+26 X2+ 24 X1=24R
)'I(S) Transfer function
X3~ - 24XC26 X2-9X3 + 24R
lIes) =

X2.~ =.[ 0 01 0J[x~


1 ~OJ 0 X2 + R
Similarly ""
G \2(5), -------- arc defined
"
~ X3 -24 -26-9 X3 24

Dept. ofEEE, SjBIT


Page 19 Dept. of EEE, SjBIT
Page 20
Modern Control Theory 10EE55 Modern Control Theory 10EE55

C(S)
C= [1 X1(S)

2. Converting a TF with polynomial in numerator C(t) = X, + 7 Xl + 2 XI

C(S)
R(S)

3. Cascading form

---- _ ~--~~------
X1(S)_ 1
83 + 982 + 26s +24
The denominator ofTF is to be in factor fOIl11

C(S) 24

Taking in LT R(S)
24
(s +2) (S+3) (S+4)

Xl
Xl=X2
Xl =X2= X3 X
X~
[ X3
2 [0 1 0J [X~rOl
0
-24 -26-9
1 X
X3
+ 0 R(t)
1
X'l = X3

'. Xl 1
----
s+4
= _ _;;_---
1 + 4 s-1
s-1

X2

Dept of EEE.SJBlT Page 21 Dept of EEE. SJBIT Page 22

.'
Modern Control Theory
lOEE55
Modern Control Theory lOEE55
UNIT-2

STATE-SPACE REPRESENTATION

1 Introduction
Xl=X2-4Xl The classical control theory and methods (such as root locus) that we have been using in
class to date are based on a simple input-outputdescriptionof the plant, usuallyexpressedas a
X2=X3- 3 x r transfer function. These methods do not use any knowledgeof the interior structure of the plant,
X3= - 2X3+24V and limit us to single-input single-output(SISO) systems,and as we have seenallowsonly limited
control of the closed-loopbehavior when feedbackcontrol is used. Modem control theory solves
manyof the limitationsby using a much"richer"descriptionof the plant dynamics. The so-caned
C = [1 o state-space descriptionprovide the dynamicsas a set of coupled first-order differential equations
in a set of internal variables known as state variables, together with a set of algebraicequations
that combinethe state variablesintophysicaloutput variables.

1.1 Definition of System State

- ----rhe concept of the, state of a dynamic system refers to a minimum set of variables, knownas
state variables, that fully describe the systemand its responseto any given set of inputs[1-3]. In
particulara state-determined system modelhas the characteristic that:
A mathematicaldescriptionof the systemin terms of a minimumset of variablesxi(f), i
= 1... n, !ogetherwith knowledgeof those variablesat an initial time 10 and the
system inputs' for time t 2:: to, are sufficientto predict the future system state and
outputs for alltime t > to.

This definition asserts that the dynamic behavior of a state-determinedsystem is completely


characterizedby the.response of the set of n variablesXj(f), wherethe number n is definedto be
the order of the system.
The system shown in Fig. 1 has two inputs III (t) and u2 (I), and four output vari- abies YI
(f) .... Y4 (I). : If the system is state-determined, knowledgeof its state variables(XI
(to). x2 (to) . '" xn (to)) at someinitial time to, and the inputs UI (t) and U2 (I) for 12:: 10 is
sufficient to determine all future behavior of the system. The state variables are an internal
descriptionof the system which completely characterizethe system state at any time I, and from
whichany output variables Yi( I) may be computed. Largeclasses of engineering,biological,social
and economicsystems may be representedby state-determinedsystem models. System models
constructed withthe pure and ideal (linear) one-port elements (suchas mass, spring and damper
clements)are state-determined

[Type text]
Page 24
Dept. of EEE.SJBIT
Page23

"
Modern -Control Theory 10EE55

Input vector U Output vector y where Xi = dx./dt and eachof the functions ,Ii (x, u, I), (i = 1. ... , n) may b",.a general
nonlinear, time varying function of the state variables, the system inputs, and time. I

Uf:,"(I) ~ System
...~ descibed by state variables
-L..rl.> l)
It is common to express the state equations in a vector form, in which the set of 11 state
variables is written as a state vector x(t) = [XI (I), X2 (t). ' .. ,x,,(t)(, and the set of I' inputs
is written as an in~)Utvector U(I) = [1/, (I), U2 (f), ... , u,. (t)f. Each state variable is il time
u~(I) ~,--_{X_1 ,X_2_'
,_
.. ~_}--'t Ym(t) " varying component of the column vector X(/).

This form of the state equations explicitly represents the basic elements contained
Figure 1: System inputs and outputs. in the definition of ,a state determined system. Given a set of initial conditions (the values
of the Xi at some time (0) and the inputs for I ?: 10, the state equations explicitly specify
the derivatives of all state variables. The value of each state variable at some time f;.1 later
system models. For suchsystems the number of state variables, n, is eflual to the number of may then be found by direct integration. The system state at any instant may be
independent energy storage elements in the system. The values of the state variables at any interpreted as a point in an l1-dimensionalstate space, and the' dynamic state response x(t)
time t specify the energy of each energy storage element within the system, and therefore can be interpreted as a path or trajectory traced out in the state space.
the total system energy, and the time derivatives of the state variables determine the rate In vector notation the set of 11 equations in Eqs. (1) may be written:
of change of the system energy. Furthermore, the values of the system state variables at
any time t provide sufficient information to determine the values of all other variables in the . ,
"
x = f (x. u, I). (2)
system at that time. . ,
where f (lI.. u. I) is a vector function with 11 componentsr, (x. u, I). ,
There is no unique set of state variables that describe any given system; many In this note we restrict attention primarily to a description of systems that arc linear and
different sets of variables may be selected to yield a complete system description. lime-invariant (LTI), that is systems described by linear differential equations with constant
However, for a given system the order n is unique, and is independent of the particular set coefficients. For an,LTI system of order II, and with I' inputs, Eqs. (1) become a set of 11
of state variables chosen. State variable descriptions of systems may: be formulated in coupled first-order linear differential equations with constant coefficients:
terms of physical and measurable variables, or in terms of variables that are {lot directly , XI + + + ([,,,X,, + blltl, + + o.,;
measurable. It is possible to mathematically transform one set of state variables to , X2
,
,;- t(l11X, G12X2
6 a21XI + G22X2 + ." + G2nX" + b21UI + ." + h21'U,.
another; the important point is that any set of state variables must provide a complete (3)
description of the system. In this note we concentrate on a particular set of state
variables that are based on energy storage variables in physical systems: Xn O"IXI + an2X2 + " , + QnnXIl + bnlUI + ". + hl,:r

where the coefficients aij a~d bij are constants that describe the system. This set of 11
1.2 The State Equations equations defines the derivative~ of the state variables to be a weighted sum of the state
variables and the system inputs.
A standard form for the state equations is used throughout system dynamics. In the standard Equations (8) may be written compactly in a matrix form:
form the mathematical description of the system is expressed as a set of n' couple'd first-order
ordinary differential equations, known as the stale equations, in which the time derivative As given above in page 10
of each state variable is expressed in terms of the state variables XI (r),... , x; (I) and the
system inputs UI (I), ... , Ur (t). In the general case the form of the 11 state equations is: x = Ax +Bu (5)
In this note we use bold-faced type to denote vector quantities. Upper case letters arc
XI = fi (x,u, t)
used to denote general matrices while lower case letters denote column vectors. See
X2 = fi(x, u, t) Appendix A for an introduction to matrix notation and operations.
(1)
x; =./;' (x, u, t
[Type text] Page 25 [Type text] Page 26

"
"
Modern Control Theory lOEE55 Modern Control Theory lOEE55

where the state vector x is a column vector of length II, the input vector u is a .column vector
of length r, A is an 11 x 11
. '. .
square matrix of the constant coefficients ai;, a'nd B is an n x r
1.4 State Equation Based Modeling Procedure
The ~omplet~system model for a linear time-invariant system consists of (i) a set of II
matrix of the coefficients b" that weight the inputs. state equations, defined in terms of the matrices A and B, and (ii) a set of output

1.3
.. .
Output Equarioris
equations th'at relate any output variables of interest to the state variables and inputs,
and expressed in terms of the C and D matrices. The task of modeling the system is to
derive the elements of the matrices, and to write the system model in the form:

A system output is defined to be any system variable of interest. A d~crtpti(;m of a Ax +Bu (11)
y Cx + Du. (12)
physical system in terms of a set of state variables does not necessarily include all of the
variables of direct engineering interest. An important property of the linear s\ate 'equation The matrices A and B are properties of the system and are determined by the system
structure and elements. The output equation matrices C and D are determined by the
description is that all system variables may be represented by a linear combination of the particular choice of output variables.
The overall modeling procedure developed in this chapter is based on the following steps:
state variables Xi and the system inputs u.. An arbitrary output variable in a system of
1. Determination of the system order n and selection of a set of state variables from
order 11 with r inputs may be written: the linear graphsystem representation.

(6) 2. GeAeratioh of a set of state equations and the system A and B matrices using a
well ~fined! methodology. This step is also based on the linear graph system
where the c, and d, are constants. If a total of III system variables are'defined as outputs, description.
the 111 suchequations may be written as:
y] 3. Determination of a suitable set of output equations and derivation of the appropriate
ClIX] + ('12.\2 + + ell/X" + d]]u] + + d1ru,. C and D matrices.
)'2 ['21Xl + ('22.\"2 + + e21/XII + d2]1I] + + (hrllr
(7) 2 Block Diagram Representation of Linear Systems
Described by State Equations
or in matrix form:
The matrix-based state equations express the derivatives of the state-variables explicitly in
As given above in page 10 terms of the states themselves and the inputs. In this form, the state vector is expressed as
the direct result of a vector integration. The block diagram representation is shown in
Fig. 2.. This general block diagram shows the matrix operations from input to output in
.-
The output equations, Eqs. (8), are commonly written in the compact form:
terms of the A, B, C, D matrices, but does not show the path of individual variables .
y = Cx +Du (9) In state-determined systems, the state variables may always be taken as the outputs of
integrator blocks. A system of order II has II integrators in its block diagram. The
where y is a column vector of the output variables y;(t), C is an III x II matrix of the.constant derivatives of the state variables are the inputs to the integrator blocks, and each state
coefficients C;j that weight the state variables, and D is an III x r matrix of the constant equation expresses a derivative as a sum of weighted state variables and inputs. A detailed
coefficients ,i;, that weight the system inputs. For many physical systems the matrix D block diagram representing a system of order n may be constructed directly from the state
is the null matrix; and the output equation reduces to a simple weighted combination of and output equations as follows:
the state variables:
y =Cx. (10) Step I: Draw n integrator (S-] ) blocks, and assign a state variable to the output
of each block.
[Type text]
Page 27 [Type text]
Page 28
Model II COIILI 01 Theory lOEES5 Modern Control Theory lOEE55

'--
JL
--,I,.~ ~

ro -v
"j

B W':+-+":"'
"
I~r"'
'~_"_j:--....,)XI SA,_I II.,:.,X,:_" '>_"
r, ,. __1 .)=;> YI'J
~.;..(+, u(l)

'. +
+v-->y(t)
Figure 2: Vector block diagram for a linear system described by state-space 'system dynamics ..
+

Step 2: At the input to each block (which represents the derivative of its state variable)
draw a summing element.
Step 3: Use the state equations to connect the state variables and inputs'to the
summing elements through scaling operator blocks. .'
Step 4: Expand the output equations and sum the state variables and inputs through
a set of scaling operators to form the components of the output. ' Figure 3: Block diagram for a state-equation based second-order system .

Example 1 Example 2
Draw a block diagram for the general second-order, single-input single-output Find the transfer function and a single first-order differential equation relating
system: the outputy(t) to the input l/(t) for a system described by the first-order linear
XI state and output equations:
XI all al2
+
hi
X2 u(t) dx
X2 a21 a22 b: ax(t) + bu(t) (i)
XI
dt
y(t) CI C2 + du(t). (i) y(t) cx(t) + du(t) (ii)
X2

Solution: The block diagram shown in Fig. 3 was drawn using the four steps Solution: The Laplacetransform of the state equation is
described above. '
~X(s) = aX (s) + bU(s). (iii)
3.Transformation From State-Space Equations to Clas- which may be rewritten with the state variable X(s) on the left-hand side:
sical Form (s - ol X)) - bl1l-----c- _ (iv)
The transfer function and the classical input-output differential equation for any system Then dividing by (s - a), solve for the state variable:
variable may be found directly from a state space representation through the Laplace
transform. The following example illustrates the general method for a first order system. b
X(s) =s _ a U(s). (v)

[Type text] Page 29 [Type text] Page 30


Modern Control Theory 10EESS Modern Control Theory 10EE55

and substitute into the Laplace transform of the output equation Y (s) = cX(s) + The state equations, written in the form of Eq. (16), are a set of n simultaneous
dUes): . opera- tional expressions. The common methods of solving linear algebraic equations, for
example Gaussian: elimination, Cramer's rule, the matrix inverse, elimination and
be
Yes) --+d U(s) substitution, may be directly applied to linear operational equations such as Eq. (16). For
.'i-a
low-order single-in~ut single-output systems the transformation to a classical formu- lation
-=-._ ds +U(s) (vi) may be performed 'in the following steps:
(be - ad) .. :
(s - a) 1. Take t~e Laplace transform of the state equations.
The transfer function is: "
Yes) d\+ (be- 2. Reorganize each state equation so that all terms in the state variables are on
fl(,) =-- =
. U(s) ad) (8 - or (vii) the left-hand .side,

The differential equation is found directly: 3. Treat the state equations as a set of simultaneous algebraic equations and solve
for those state variables required to generate the output variable.
(.\'- a) Y (s) = (ds + (be - ad)) U(s). (viii)
4. Substitute for the state variables in the output equation.
and ret\'rif;ng as a differential equation:
dv du 5. Write the output equation in operational form and identify the transfer function.
dt - ay = d dt + (be - ad) u(l). (ix)
6. Use the transfer function to write a single differential equation between the
Classical represenfations of higher-order systems may be derived in an analogous set of output variable and the system input.
steps by using the Laplace transform and matrix algebra. A set of linear state and output This method is illustrated in the following two examples.
equations written in standard form
Ax +Bu (13)
Example 3
y ex +Du (14) Use t~e Laplace transform method to derive a single differential equation for the
capacitor voltage Vc in the series R-L-C electric circuit shown in Fig. 4
may be rewritten in the Laplace domain. The system equations are then
Solution: The linear graph method of state equation generation selects the
sX(s) = AX(s) + BU(s)
Yes) = CX(s) + DU(s)

and the state equations may be rewritten:


sx(,,) - Ax(s) = [sl - Al xes) = Bu(s).
(15)

~ (16) "s(t)
.~/~ 1(1 R C

"
where the term "I creates an II x II matrix with s on the leading diagonal and'zeros elsewhere.
(This step is necessary because matrix addition and subtraction is only defined for matrices
of the same dimcnsion.) 111C matrix [sl - A] appears frequently throughout linear system
~_7
theory; it is a square II x II matrix withclemcnts directly related to the A matrix: (8) Physical system (b) Linear graph (c) Normaltree
c
(.\' - (/11') -a12
-all (05- (/22) -a2n
[.1'1- A] ~ (17) Figure 4: A series RLC circuit.

-(1;,1 (s - a",,)

[Type text] Page 31 [Type text] Page 32

:
.
Model II Corm 01 Theory 10EE55 Modern Control Theory 10EE55

capacitor voltage vc(t) and the inductor current iL(t) as state variables, and Cramer's Rule, for the solution of a set of linear algebraic equations, is J useful method to
generates the following pair of state equations: . apply to the solution of these equations. In solving for the variable Xi in a set of 11 linear
algebraic equations, such as Ax = b the rule states:
o l/C (i)
-1/L -R/L det A(i)
Xi = det[A] (IS)
The required output equation is:

-
where A (,) is another n x n matrix formed by replacing the ith column of A with the vector
y(t) = 1 0 (ii) b.
If
Step I: In Laplace transform form the state equations are: [.1'1- A] X(s) = BU(s) (19)

sVc(s) = OVc(s) + IIC h(s) + OVs(s) then the relationship between the ith state variable and the input is
sh(s) = -lILVc(s) - RlLh(s) + 1ILI/,(s) (iii) det lsI - A](i)
Xi(S) =--------U(s) (20)
det lvl - A]
Step 2: Reorganize the state equations:

sVc(s) - IIC h(s) OVs(s) (iv) where (sl - A) (i) is defined to be the matrix formed by replacing the ill,' column of (sJ - A)
with the column vector B. The differential equation is
1ILVc(s) + ls+ RILlh(s) lILV,(s) (v)
det [vl - A],, = det (.I'I - At) Ilk (/). (21)
Step 3: In this case we have two simultaneous operational equations in the
state variables vc and it.. The output equation requires only Vc. If Eq. Example 4
(iv) is multiplied by [.I' + RILl, and Eq. (v) is multiplied by IIC, and the
equations added, h(s) is eliminated: Use Cramer's Rule to solve for Vl.(t) in the electrical system of Example 3.
Solution: From Example 3 the state equations are:
[.I' (s + RlL) + IILC] Vc(s) = IILCVs(s) (vi)
vc o I1C
+
o (i)
Step 4: The output equation is y = Vc. Operate on both sides of Eq. (vi) by -lIL -RIL IlL
[S2 + (RlL)s + IILCrl and write in quotient form:
and the output equation is:
_ IILC v: (vii)
Vc(s) - S2 +(RIL)s + 11LC s(s) VL = -Vc - RiL + V,(t). (ii)

Step 5: The transfer function H(s) = Vc(s)IV,(s) is: In the Laplace domain the state equations are:
H(s) -liTe
S2 +(RlL)s+I1LC s -IIC V,.(s) o
(viii)
Vi"(S), _(iii)
IlL s +RIL h(s) IlL
Step 6: The differential equation relating vc to V, is:

dlvc + R dvc +...!_v = -+-V (t) (ix)


dl2 L dt LC C LC S

[Type text) Page33 [Type text) Page 34


..
Modern Control Theory lOEESS Modern Control Theory lOEESS
..
The voltage Vc(s) is given by:
Xes)
adj lsI - A] B U(s).
(24)
0 -lIC det[s! - AI
det (sl - A)(i) det and substituting into the output equations gives:
lIL (s +RIL)
Vc(s) Vin(.~)= VineS)
det[(s! - A)] s -lIC
det Yes) = C [sT - Ar' BU(s) + DU(s)
lIL (.I' +RIL)
= C lsI - Ar' B +D U(s). (25)
1ILC
, VineS). (iv) Expanding the inverse in terms of the determinant and the adjoint matrix yields:
S + (RIL)s + (lILC)
The current h(t) is: C adj(sl - A) B + det[sl - AID U(s)
YeS)
det[sI - AI
s 0 H(s)U(s) (26)
det (vl - A)12) det lIL lIL
h(s) deiT0I - A)]-V;n(S) = - s -lIC VineS) so that the required differential equation may be found by expanding:
det
ilL (.I' + RIL) def[sI - A] Y (s) = [C adj (sI - A) B + det [.1'1- A] DJ U(s). (27)
.I'lL
-, Vi"(S). (v) and taking the inverse Laplace transform of both sides .
.1' + (RIL)s + (1ILC)

The output equation may be writtemiirectly-frern4he--baplace traflsierm-of Eq.


(ii): Example 5
-Vc(s). - Rids) + V,(s) Use the matrix inverse method to find a differential equation relating VL(t) to
-1ILC -(RIL)s Vs(t) in the system described in Example 3.
=-cc~---c-~-=- + , + 1 v,(s)
.1'2 + (RIL)s + (lILC) s- + (RIL)s_JlILC) Solution: The state vector, written in the Laplace domain,
-1IL(, - (RIL)s + (.I' 2 + (RIL)s + (lILC V,(s)
Xes) = lsI - Ar' BU(s) (i)
.12 +(RIL)s + (lILC)
,
s: from the previous example is:
s2 + (RIL)s + (lILC) Vs(s). (vi)
Vc(s) _ s -lIC -, o
giving the differential equation h(s) - lIL s + RlL lIL (ii)

The determinant of lsI - AI is


(vii)
det lsI - A] = .1'2 + (RIL)s + (IILC) (iii)
For a single-input single-output (SI50) system the transfer function may be found directly
by evaluating the inverse matrix
and the adjoint of lsI - AJ is
s -I/C s+RlL I/C
Xes) = (sl Af' BU(.I). (22) adj IlL s + RIL (iv)
-IlL s
Using the definition of the matrix inverse:
From Example.5 and the previous example, the output equation VL(t) = -Vc -
lsI - Ar' = adj [sl - AJ = [-1 - RJ and D = [IJ. The transfer function, Eq.
RiL + V,(t) specifies that C
det[sl - Ar .'
(23) (26) is: .

[Type text) Page 35 [Type text)


Page 36
Moaen~Control Theery leEESS Modern Control I heory 10EE55

Since
s+R/L l/C
o
C adj (sI - A)B -1 -R
-1IL s
IlL
..
R 1
-r -Le' (vi) .

the transfer function is


-(RIL)s - l/(LC) + (s 2 +(RlL)s + (lILC 1
/its) =
(S2 + (RlL)s + (lILC
(vii)
(S2 + (RIL)S + (lILC'

which is the same result found by using Cramer's rule in Example 4. Figure 5: Block diagram of a system represented by a classical differential equation.

Eq. (30) may be solved for U(s,


I
U(s)= X(s)
4 Transformation from Classical Form to State-Space
Representation
. a,,+I"~IS~I+"'+als~(H-I)+a(ls'H

and rearranged to generate a feedback structure that can be used as the basis for a block
(32)

diagram:
The block diagram provides a convenient method for deriving a set of state e({llationsfor '1 1,,-1 1 aI I au 1
2(s) =-U(s) - -- + ... + -;=T + --_-" 2(s). (33)
a system that is specified in terms of a single input/output differential equatio,n. A set of an an s an s an s
n state variables can be identified as the outputs of integrators in the diagram, and state The dummy'variable 2(s) is specified in terms of the system input lI(t) and a weighted slim
equations can be written from the conditions at the inputs to the integrator blocks (the of successive integrations of itself. Figure 5 shows the overallstructure of this direct-form
derivative of the state variables). There are many methods for doing thi,s; we present block diagram. A string of 11 cascaded integrator (lis) blocks, with 2(s) defined at the input
here one convenient state equation formulation that is widely used 'in control system to the first block, is used to generate the feedback terms, 2(s)ls-l, i = 1,... 11, in Eq, (33).
theory. : Equation (3l) serves to combine the outputs from the integrators into the outputy (I).
Let the differential equation representing the system be of order n, and withou,t loss of A set'of.-state equations may be found from the block diagram by assigni})gthe state
generality assume that the order of the polynomial operators on both sides Ps the same: variables ,x,(t) to the outputs of the Il integrators. Because of the direct cascade connection
a"s" + a"~ls"-l+ "'+ao Y(s)= b"s"+b"~IS"~l+ "'+bn U(s). (28)
of the integrators, the state equations take a very simple form. By inspection:

We may multiply bothsides of the equation by s?" to ensure that all differenjial operators
have been eliminated:
a" + a"~ls~1 + ...+ als~("~I) +lOS~" Y(s) =
"
b"+b"~IS~1 +"'+bls-("~I)+"'+bos~" U(.t). (29) U() (II llfl~ I 1
--X1 - -X2 .. - ---x" + -~-II(I). (34)
from which the output may be specified in terms of a transfer function. If we define a dummy nit all (in (In

variable 2(s), and split Eq. (29) into two parts .

[Type text] Page 37 [Type text] Page 38


Modern Control Theory lOEE55 Modern Control Theory lOEE55

In matrix form these equations are


.\'j 0 o o x, o
~'-2 () () o o - 0
g U (I) .
-~II-::!: 0 0 1 o 6
':'-\-11-1 0 0 o o 8
:\:11 ... -au/a" -a,/a" ... -an-2/all -a,,_I/all Xn l/an (35)
The A matrix has a very distinctive form. Each row, except the bottom one, is filled of
zeroes except for a one in the position just above the leading diagonal. Equation (35) is
a common form of the state equations, used in control system theory and known as the :
phase variable or companion form. This form leads to a set of state variables which may not Figure 6: Block diagram of the transfer operator of a third-order system found by a direct
correspond to any physical variables within the system. realization. .
The corresponding output relationship is specified by Eq. (31) by noting that X;(s) =
Z(s)/S("~'-iJ. " 0
(36) y(t) 26 13 0 R ~~ R + [OJu (I). (iii)
But z (t) = dx.i/dt , 'whichis foundfrom the nthstate equation in Eq. (34). When substituted X3
into Eq. (36) the output equation is:

x, 5 The Matrix Transfer Function


_ b"an-I , X2 ,{ h
Y(s) = bII-I - + ...!'...u(t). (37) For a multiple-input multiple-output system Eq. 22 is written in terms of the r component
an 'I a" input ~ector U(s)
X(s) = lsI - Ar' BU(s) (38)
Example 6 generating a set of n simultaneous linear equations, where the matrix is B is n x r. The m
component system output vector Y(s) may be found by substituting this solution for X(s)
Draw a direct form realization of a block diagram, and write the state equations
into the output equation as in Eq. 25:
in phase variable form, for a system with the differential equation
(flv ..IF)' . dv du Y(s) = C [sl- Ar' B (u(s)} + 0 (u(s)}
--. +/--;+19-'-+13v=13-+2611 (i)
ell' dt- cit . cit C lsI - Ar' B + D (u(s)} (39)
and expanding the inverse in terms of the determinant and the adjoint
Solution: The system order is 3, and using the structure shown in Fig. 5 the matrix
blockJiagram is as shown in Fig. 6.
C adj (sf - A) B + det lsI - A] D
The slate andoutput equations are found directly from Eqs. (35) and (37): Y(s)
det[sI - A] U(s)
CJ ::
x, o o x, o H(s)U(s), (40)

o where H(s) is defined to be the matrix transferfunction relating the output vector Y(s) to
o + 1 Ollu(t), (ii) the input vector U(s):
I
-13 -19 -7
[Type text] Page 39 [Type text] Page 40
Modern Control Theory lOEE55
Modern Control Theory 10E~55
"

H(s) = (C adj (sl - A) B + det lsI - A] D) UNIT-3 DERIVATION OF TRANSFER FUNCTION FROM STATE MODEL
(41)
det[sI-A]
UNIT-3
Derivation of transfer function from state model, digitalization, Eigeri values, Eigen vectors,
generalized Eigen vectors.
6 Hours

Converting transfer-functions to state models using canonical forms

The state variables that produce a state model are not, in general. unique. HO\~eVeLthere ex ist several
common methods of producing state models from transfer functions, Most control theory texts contain
developments of a standard form called the control canonical form, sec, e.g., [I]. A:;ther is the phuse
variable canonical form.

Control Canonical Form

When the order of a transfer function's denominator is higher than the order of its numerator, the
transfer function is called strictly proper. Consider the general, strictly proper third-order transfer
function

"
.r.<!l = /),.\"'+ h,s + h" (1)
U(s) .1'] + a,.\"' +<I,s+a"
"
Dividing each term ~y the highest order of s yields

Y(s)
(2)
U(s)

which is a function containing numerous lis terms, or integrators. There arc various signal-now graph

configurations that will produce this function. One possibility is the control canonical form shown in

Figure I,The state model for the signal flow configuration in Figure I is

Dept. of EEE,SIBIT Page 42


[Type text) Page 41
"
Modern Control Theory " '10EESS Modern Control Theory 10EESS

(boX,(s) + b,X,(s) + b,X, (s) = Yes)


. U(s) U(s)
(3)

.1'~["" ", b,l~:l+[Olll which is identical to equation (2) proving that the control canonical form is valid.

Lx,
As an example consider the transfer function

Y(s)
C(s) 2s'+8s+6
R(s) s'+8s'+26s+6

The coefficients corresponding with the control canonical forrn are:


60 = 6, b, = 8, b, = 2, ao = 6, a, = 26, and a, =8.
The state model based on control canonical form is

Figure 1. Control cnnonical form block diagram.


"
The validity of(3) is tested by rearranging (2) to yield

I. I I I I I
Yes) +(1, -'} (s)+<I, ,Y(s)+ao,Y(s) = b, -U(s) +b, ,U(s)+ho,U(s) (4)
s s, S s s s
and then substituting the expression for Yes) from the state model output equation in (3) yields
, " .. Examination! of Figure 1 shows one potential benefit of manipulating systems to conform to control
h"X,(s) + ",X,(s) + h,X,(s) =1>, ~U(s) + b, -',U(S) +h" ~U(S) canonical form. If xtCs) happened to carry units of inches (position), then X,es) might be inches/second
s s s
(veloclrv), and X,es) might be inches/second/second (acceleration),
I
-lI, -(boX,(s)
s
+ b,X,(s) + b,X,(s)
..
Phase Variable Canonical Form

- (/, -',(""X,(s) + h,X,(s) + h,X,(s)) Devl!lopme~t of the phase variable canonicalform as presented in [2J begins with the general fourth-
s order, strictly proper transfer function
1
- (/" ,(b"X,(s) + h,X,(s) + h,X3(S).
s Yes) b,S3 + b,s' +b.s + bo b,s -I + b,s -2 + bls -3 + bos"

Eql!!\ion (5) can be rewri Iten as


(5) .
, U(s)
which can be rearranged to read
s' + a,s' + a,s' + a,s + ao I+a,s-I +a,s-' +als J +ao5"
(6)

Y[s ) = b,S-IU(S)+ b,s-'U( s ) + b,s-JU(s) + bos-4U(s)


(7)
-a,s-Iy( s) - a,s-'Y( s ) - a,s-'Y( s)-aos-4y( s)
Dept. of EEE. SIBIT Page 43 Dept. of EEE. SIBIT
Page 44
"
"

Modern Control Theory 10EE55 Moderri Control Theory 10EE55

The denominator in (6) is fourth order and leadsone to concludethat a block diagramconsistingof
four l/s terms may be useful.Constructionof the phasevariablecanonicaiform is Initiated by setting
the output to SAMPLEDDATAAND DIGITAL CONTROL SYSTEMS
(8)

which maybe representedusingfour integrators asshownIn Figure2. Figure 2.1 (a) shows the blockdiagram of a sampled-data control system. The continuous error'signal ell) is sampled at an
interval of time T by means of a sampler. The plant output is also a continuoussignal and it is due to the het that a hold
circuit preceeds the plant. -

U(s) ---G-~0---E}--- .Y(S)

Figure 2. Block diagram of the output equation;

After substituting Y(s)from (8) into (7),the expressionbecomes

Y( s) = b s-'U( s) + b,s-'U(s) + b,s- U( s) + bos-4U(s)


3 3

-a3bos-IU( s) - a2bos-6U(s) -a,bos-'U( s)- aA,s"'U( s)


(9) ,.)
It is left for the reader to show that the additional terms when applied to the block diagram results in
Figure 3.8 (b) in 12j:The reader may also wish to examine the similarities between control canonical
~I
form and phase variable form. 1(1)

It is important to note that a particular transfer function may be represented by block diagrams of
many different canonical forms, yielding many different valid state models. .
(tl)
The advances made in microprocessors, microcomputers, and digital signal processors have Figure 2.1:. (a) Blockdiagram of a sampleddata control system. (b) Blockdiagram of a digital control
accelerated the growth of digital control systems theory. TIle discrete-time systems are dynamic
system
systems in which the system-variablesare defined only at discrete instants of time.

The terms sampled-data control systems, discrete-time control systems and digital control Figure 2.1 ~) shows the blockdiagram of a digital control system. A digital control system uses digital Signals and a digital
systems have all been used interchangeably in control system literature. Strictly speaking, sampled- compuler to control a process. The continuoustime errorsignals are converted from analog form to digital form by means of an
data are pulse-amplitude modulated signals and are obtained by some means of sampling an analog AID converter. In practice, the AID converter itself contains the sampler. After processing the inputs, Ihe digital computer
signal. Digital signals are generated by means of digital transducers or digital computers, often in pro~des an output in digital form. This output is then converted to analog form by means of a LlIA convertel In practice, the
digitally coded form. The discrete-time systems, in a broad sense, describe all systems having some DlA converter rtself contains the holddevice. ...
form of digital or sampled signals.

Discrete-time systems differ from continuous-time systems in that the signals for a discrete-time The use of sampled data in control systems enables time.sharing among different input signals using the same control
systems are in sampled-data fonn. In contrast to the continuous-time system, the operation of equipment. Different input signals can be sampled periodically by staggering sampling time and thus a nurnber of inputs can
discrete-time systems are described by a set of difference-equations. The analysis and design of be handled overthe same control equipment.
discrete-time systems may be effectively carried out by use of the a-transform, which was evolved
from the Laplace transform as a special form. Sampled data technique is most appropriate for control systems reqUiringlongdistance data transmission. It is well known
that pulses may be transmitted with little loss of accuracy. Data in analog form mal' suffer considerable distortion in the
~-d Iii

Dept. of EEE, SIBIT Page 45


Dept of EEE, SIBIT Page 46
Modern Control Theo~y lOEE55 Modern Control Theory lOEE55
Ihal pulses may be Iransmilled wilh lillie loss of accuracy, Dala In analog form may suffer considerable distortion in the
Iransmission channel, Using the sampleddata technique, a number of communication signals can be sequentially sampled
and transmilled through a s'ingle transmission channel, thus decreasing the cost of transmission installation, This technique is
referred 10 as 'illle.muitiplexing, ' The process is repeated ,with a time period T, called sam~ling1ime, and the signal at the output end of the sampler is
available in the form of plilses of very short duration 61, each followed by a skip period when no output appears at the output
---enaDf the sampler, The continuoustime signal f(l) is thus sampled at a regular interval of time T, as shoVYllin Figure 2,2 (cl,
In some control applications, it is required that the load be driven by a weak power input signal, The signalsampling reduces
The sampled signal is denoted as 1 (I), which is obtained after sampling the continuous time input signal 1(1),
the power demand made on the signal and is, therefore, helpful for signals of weak power origin,

Figure 2,2 (c) shows the Signal.modulated pulse train having pulse-width M and is a case of practical.sampling, However,
Sampler
in the case of ideal.sampling, the pulse width t::.tapproaches to zero and therefore the output ((I) of an ideal sampler is the
signal.modulated impulse train as shOWl in Figure 2.2 (~,
A. sampler is the basic element of. discretetime conlrol system, which converts a continuoustime signal into a train of
, ,
pulses occuring at the sampling instants 0, T,2T, '''' where T is the sampling~d, Note that, in between the sampling
instanls, the sampler does not transmil any information, Figure 2.3 shows two samplers operating in synchronism is., their sampling time and instants of operation are the same.
The continuoustime signal f(l) is thus being sampled twice, As the two samplers operate in synchronism, the output of the
second sampler will ob~ously be r(Q.
Figure 2.2 (a) shows a switch being used as a S31l111lerA. continuouslime signal f(I), as shown!n Figure 2.2 (b), is the input
to the sampler, The switch is closed for a very short duralion of time t::.1, and then remains open for some dural ion of time,
f(t)~[r(~J'.r(~
T T
SampieH Sampler2
Figure 2.3: Signal f(l) sampled twice

Therefore
~!
.
[I (t)] =1..'(t)-.
"
"
Thus, starring a starred function results in the starred function ITself

tT"
-)f~
Sampling Process
-H-.t
--r~.
1'1 The sampler converts a continuoustime signal W into a sequence of pulses 'Whereinthe magnITudeof the pulse gives the
Figure 2.2: Uniform penodic s.mpllng: (a)Sarnpler (b)Continuous signal (c)Practical sampling (0ldeal strength of the input signal at the instant of sampling, The pulse considered is of very short time duration and thus may be
sampling approximated as an impulse,

Considering the sampler output to be a train of weighted impulses, we can relate the continuoustime signal f(Q to the
sampler outputt'(t) as
Dept. of EEE, 5J8fT Page 47 Dept. of EEE, 518fT
Page 48
Modern Control Theory 10EE55 Moderri Control Theory 10EE55

!XI

(2.1)[ '"(t) =f(t)oy(.t) (2:3)( (I) = t [(kT)8(t - kT)


k=-oo
where oy{l) represents a train of unit impulses.
Equation (23) gives Ihe sampler output, which is a train of weighted impulses.
The sampler output is equal to the product of the continuous-time input signal fW and the train of unitimpulses 8y{1) In other
Most of the standard timefunctions are zero for t < 0, then in Equation (23), the lower limit can be put as zero instea
words, the sampler may be considered as a modulator with the continuous-time input signal f(l) as the modulating signal
and the train of unitimpulses ~(t) as the carrier, as shown in Figure 2.4.
as the function f(kT) is zero for t < In this book, therefore, unless othe011isestated, we shall assume that this is thE
..
Thus, Equation (2.3) becomes

eo
(2.4)(1) = L f(kT)o(t-kT).
k=O
, I,!

. ~

~~
-':;;~.!vJt.1t'.l':)r -1rl1d."

Figure 2.4: Sampling process


_- ~
. t

'-6'.,ff~rt..tf"t. T 1<]1",1) I

'.
2,2,2,1 Laplace Transform of a Sampled (Starred) Function

The unitimpulse 6(t kT), occuring at sampling instants I = !iT; k = 0,

1,2, ...... , is the firsftimederwative of the sampled unt-step function u(l k~ occuring at t = kT; k = 0,1.2, ...

The unii-impulss train may be expressed mathematically as Therefore,


00

(2.2)dr{t) = E o( t - kT) ~ [u(t-kT)]


Ic=-oo
1 -.rkT
where 8(t - k TJ is the unitimpulse occuring at I= k T s . -;e
-skT
As the continmus-fime signal f(l) appears only at sampling instants in the output; the same is denoted.by f(1r. TJ and the
sarnpled-oulput signal can be represented as
= e
Thus, the Laplace transform of Equation (24i is given bi'

'.
Dept of EEE, SIB!T Page 49 Dept. of EEE, SIB!T Page SO
Modern Control Theory lOEE55 ModerrcContro! Theory lOEE55
"X

(2,S)F (s)::: f',


L. j(kT)e-
skT
k=1)

F '(5) is known as the Laplace transform of a sampled (starred) function or simply a starred transform.

..
If f(l) is a unit-step function, Ih~/) f(k D = 1 and the Laplace transform of the starred unit-step function r(l) is given by


F (1)

(2.6)F" (1)
t I.e-skT
'Xi

k=:()

1 + e -sT + e -ZsT +...


_
catm
.
-2,.,
'
-1lI.-m",O 11\.111, 2010
(iI)

Figure 2.5: (a)Sampler (b)Sampler input Fourier spectra (c)Sampler output Fourier (a)Sampler output Fourier spectra: w s

_1_
F (I) .I_e-fl .
~ is immediately obselVed from Figure 2.5 (c) and Figure 2.5 (d) that so long as w s ~ 2 w m' the original spectrum is preserved
in the sampled signal and can be extracted from it by low-pass filtering (shown in the dolled line in Figure 2.5 (c)). This is
Signal Reconstruction: Holding Devices the well-known Shanon's sampling theorem according to VYflichthe information contained in a signal is fully preserved in the
sampled version so long as the sampling frequency (w ~ is at least twice the maximum frequency (w rJ contained in the
The use of a sampler in control systems generates high-frequency components in the sampled oupu!. The sampler Input signal. That is,
Feurler-specna is shown in Figure 2.5(b) wherein wm is the highest frequency contained in the input signal. The sampler
output contains the Originalinput frequency component wm and complementary high-frequency components in addition, as
shovln in Figure 2.5 (el and Fi[IUre2.5 (d) that correspond to W s > 2w m and OJ s < 2w m respectively, where w s is the
sampling fre(IUency. The original signal is reconstructed from the sampled signal by means of various types of hold-circuits (extrapolators). The
simpfest hold-circuit is the zero-order-hold (ZOH) in which the reconstructed signal acquires the same value as the last
received sample for the entire sampling period. The zero-order-hold (ZOH) circuit has the characteristics of a low-pass filter and
f(J,J)~F'(jW)
therefore, if a ZOH circuit is placed after the sampler, the high-frequency (complementary) components present in the
T (al recMSlftJcted signal are easily filtered out and at the output of ZOH the original signal appears. The ZOH de~ce is also known
as a "box-car" generator. The schematic diagram of sampler and ZOH is ShOVv11 in Figure 2.6 (a), while signal reconstruction
is illustrated in Figures 2.6 (b) and 2.6 (c).

___2h_-ll\n 0 (1m (b)

Dept. of EEE, 5j8fT


Page 51 Dept. of EEE, S~BrT
Page 52
Modern Control Theory lOESS Modern Control Theory lOEE55

f'(t)

. :. ..
Therefore, the Laplace transform of the output of ZOH is given as

1 1 -sT
H(s) S- s' e
, (I-e....n
If(s) = ---s
'.,
Now, the transfer function of ZOH is given by

laplacetrailSform 0/ OUlplu 01 ZOR .,


laplacetrmlSjormoJ inputoj ZOH
o H(s)
(2.7)or, Gho(S) 1
(~l
Figure 2,6: (a)Sampler and zero-order-hold (ZOH), (b)Sampled signal. (e) Reconstructed signal by ZOH (I_esT)
j
Note that the higher-order holds offer no particular advantage over the ZOH, The ZOH, when used in conjunction with a high
sampling rate, provides satisfactory performance, '
2.2.3,2 Frequency Response of ZOH
Transfer-Function of a ZOH Circuit
We already know from Equation ~}) that the transfer function of a zero-orderhold circuit is
In Figure 2,7, a unit impulse input is given to a ZOH circuit that holds the input signal for a duration T and thus the output
appears to be a unit-step function until duration T. Therefore, the output of ZOH can be as

.'
Put s = jlJJ in the pteceeding relation and we have

(l-e -j"T)
Figure 2,7: Unit impulse input to ZOH jw
h(t) = u(t) - u(t - T).

Dept of EEE, 51BIT Page 53 Dept. of EEE, 51BIT Page 54


Modern Control Theory lOEE55 Modern Control Theory lOEE55

(2.8B)
()
O' sin( :.':) > 0
I -J..;T12
\e -e -l-,rr") . T!~ { 7r, sin(~} < 0
:::
p
. ' ,e jw ~

To view th: previou~derivations,the amplitude and phase plots are shown in Figure 2,8.

Ia,.,{jwll

S
. (' IT)
"Ill ,-.
u-
t
iA!j"m
--:;;-

"
Te-pTiZ '( wT)
(1) . Sill T
0)
~ w, 3;0.
l

LGI>cIi<
1': 'bT)
sU'T' -jwT12 3""
(1) ,e , , .:

If the sampling frequency is (Ij m- then the sampling time T is given by -180' " ; "" " "" ..

T= ,b1..
f.;.,,!s
'.
. (b)
Figure 2.8: Frequency response of the IOH: (a)Amplitudeplot (b)Phase plot

Gho(j(u) (6
= Tsin(~) e-jC~;).

sin("W)
(2.8A)IGho(j(u)I == T (ii
Dept. of EEE. Sl8fT
Page 55 Dept. of EEE, 518lT
Page 56
Modern Control Theory lOEE55
Modern Control Theory lOEE55

UNIT-4 SOLUTION OF STATE EQUATIONS


x(l) = e'" e A' X(tO)

.' = l"'O) x(lO)


UNIT -4
Solution of state equation, state transition matrix and its properties, computation using Laplace transformation, .
At 1=0 (zerbinitial condition),
.
~~~ . .
power series method, Cayley-Hamilton method, concept of controllability & observability, methods of determining x(l) = <x(O) (8) .",.

10 Hours From Eq.8, it is observed that the initial state


x(O) =x"

After obtaining the various mathematical models such as physical, phase and canonical at 1=0 is driven to a state X(I) at time 't ' by matrix exponential function e " . This matrix
forms of state models, the next step to analysis is to obtain the solution of state equation. From the exponential function, which transfers the initial state of the system in '[' seconds, is called
solution of the state equation, the transient response can then be obtained for specific input. This STATE TRANSITION MATRIX (STM) and is denoted by
completes the analysis of control system in state-space.
Properties of State Transition Matrix (I):
The solution of state equation consists of two parts; homogenous solution and forced solution. The
1). (0)=1 proof follows from the definition,
model with zero input is referred as homogenous system and with non-zero input is referred as forced
e
A,
= 1 t At t --
iI't' A'I'
t -- t
system. The solution of state equation with zero input is called as zero input response (ZIR). The solution 2! 3! .
of state model with zero state (zero initial condition) is referred as zero state response (ZSR). Hence = ~(/)
total response is sum of ZIR and ZSR. Substituting t=O results into (0)=1.

2). ~.'(t) =~(-l):


a) Zero Input Response (ZIR): A'I'
Consider the n-th order LTI system with zero input. The state equation of .1'l'Ooj:-Consider ~(I) - ! + Ao' t 2!*~-_
such system with usual notations is given by . A't' A'I'
~(-/) = 1- A/t ---+
2! 3! .....
X(I) = AX (t) (I)
~ Multiplying $(/) and $( -I),
with x(O) = XO (2)
$(1)$( -I) = I
Let the solution of Eq.( I) be of the form
Pre-multiplying both sides with $.'
X(/) = e"'.k (3)
$(-1) = $ '(I)
where e" is matrix exponential function defined as
3). $(/,')$(1,) = $(1, + I,):
A'I' A1/'
e" =ltAI+--t--t
2! 3! ......
(4) ,!, A' I,' A't,'
Proal '!'(I,) = 1 tAl, ~~ +3'-
and k is a constant vector.
A't' A
Differentiating Eq. (3); and $(1,) = 1 + At, t ---z1- --t--
t t.. ..
3t1

X(/) = Ae"k A'(t, t/,l' ,1(/, ~/.'i


(/,Mt,)=ltA/,t~)+---.,.-- t .
21 :1
k = (e'''),' x(tO) = eO A' x(O)
Dept. ofEEE. SJBIT Page 57 Dept. of EEE, SJBIT Page 58
Modern Control Theory lOEE55 Modern Control Theory lOEE55
= ~(I, + I,)
31 - 21 +...
1-21+
4)~(l2al,)~(I, -I,,)=~(I, -In): 2 3
(This property implies that state transition processes can be divided into a number of
sequential transitions), i.e. the transition from z, to 12. ____
x(t,) =~(I, -/o)x(lo); is equal to transition rrom'to'to 't,'and from itj t to 't2' i.e.,
x(l, ) = ~(I, -I" )X(I,,)
x(l,) = ~(t, - I, )X(/, )
b)o = [+ AI
. A'/2
4- -t-t
2!
A'I2
3! ..,,,.
, A (I, - I,) 0 I
Proof: ~(I, -(,) = [+ A(I, - I,) t --2:-! - t .". t It
I 2 12
-t" ...
0 1 0 1 0 2!
A 2 (I, -10)
~(,-I,,)=/tA(I,-lo)+ 2! +"" ,I' I'
It/t-t-+
2! 3!
... It/2 t2I't ...
_ . . Ail, tlor A'(I, +~,j .
ljl(/,-t,)j;(/,-/o) -/TJ{t,+/n)~--2!- +--]- T.""" I' I'
o Itl+ -+ -t".
= P(I, -/ 0) 2! 3!

Evaluation or State Transition Matrix ~(I): e1 te'


Few method to evaluate the STM arc; o e'
I) Power series method 2). Inverse Laplace Transform Method:
Consider the-state equation with zero input as
2) Inverse Laplace transform method
3) Cayley-Hamilton theorem . '
X(IO)=x(O)
.
x(t) = Ax(t);
,
1). Power series method:
It is infinite solution which can be trunkatcd to 2 or 3 terms. Taking Laplace Transform on both sides,
By the definition. Sx(s) - x(O) = Ax(s)
II ,A:!t2 AJf~ [SI - A]x(s).: x(O)
e =[+,j/'r--+--t
IN' 21 3! ".".
Premultying both sides by [SI-Arl,
Example, Compute the STM by power series method given
xes) = [SI - Ar
J x(O)
o a) A = I I 1 Taking Laplace Inverse on both sides,
-] -2 b) A = 0
x(t)= .I[SI-Ar'x(O)
. A'I' Al('
a) ~(I) = I t AI + -- t __ + Comparing the above example with
2! 3! """ X(I) = eAr x(O) .
I 0 o o 'I'-t o I J t' It shows that .
t 1+ Ar'
o I -] - 2 -I - 2 2! -] -2 31+"" e'" = STM = ~(t) = -I lSI -

I'
1--+-+
2 3
I'
...
,
1-1- + -t
I'
2
..
,
~(/) =

Example:
. -I [SI - A]-'

.
, (3 2 J
_I + 1.- -_ e te-I_,_ te-I Obtain the STM by Laplace Transform (Inverse Laplace Transform) method for given
2 -, T
system matrices
+ I I
a). A = , ' o 1 b). A=
o
Dept. of EEE, SjBIT
Page 59 Dept. ofEEE, SjBIT
Page 60

'.
Modern Control Theory lOEE55
Modern Control Theory lOEE55
-I
1 o o S -I
c). A = b).A=_1_2 [SI- A] =
S-I - 2 ' (S ~ 2)

-I
2 3
S+2
a). A = 0 lSI - A] = - 1 -,
OS-I S (S + I)' (S + I)
~{t) = [SI - Ar' =
S+2 -[ S
S-I
(S+ I)' (S+I)'
S-I -I 0 S -I
~(s) = lSI - Ar' = '" (I + t)e" te"
o S -I [S_1]2 "'( )
't' t = .l't'(t) =
-Ie -, (I - t)e -,
e' te'
~(t) = .1~(S) = 0
e o I
lSI _ A] = S -I
c). A = _ 2
-3 2 S+3

S+3
., lSI - Ar' =
S -I -2 S
2 S+3 (S + 2)(S + I)

Hence ~(t) = ---


S+3

(S + 2)(S + I)
- 2
I
S ..
S+3 I
- 2 S
~(t) = .'~(I) = ., (S + 2)(S + I)
2e-' - " e' - e-.:!I
- 2e-' + 2e-21 - e' + 2e--:'1

3. STM by CaUJy-Hamilton Theorem:


This method is useful for large systems. The theorem states that "Every non-
singular square matrix satisfies its own characteristic equation." This theorem helps for
evaluating the fu?ction of a matrix.
For nxn, non-singular matrix A the matrix poly function rCA) is given by

f(A)=rxoJ+rx,A+rx,A'+ .... +rx"A"'

.
= ~(t)

where rxo ,rx, .. ,rx, constant coefficients which can be evaluated with eigen values of

. ~...
matrix A as described below.
.
~: For a given matrix, form its characteristic equation IAi- AI = 0 and find
eigcn values as A" A, ,..... 1., .

Dept of EEE, SjBIT Page 61 Dept. of EEE, SjBIT Page 62

'.
Modert._1Control Theory lOEE55
Modern Control Theory lQEE55
Step2 (Case 1):lfall eigen values are distinct, thcn form 'n' simultaneous
equations as, I(A)=A'O = ()(ol t()(,A

I 0 0
= ()(.o O +,
- I -2
()(o 0 0 ()(,
+
e'''' "I(A,,) = ()(0 t ()(, A" t IX2 A,,' t ..... 0 ()(o -()(, - 2()(,

S:ve for ()(o,()(, ,()(, , .. e , -9 -10


(Case 2); If some Eigen values are repeated then obtain one independent equation
10 II
by using this Eigen value and find co-efficentstx , .(X,.()(, .. ()(, 2). Find STM by Cayley Hamlton method, given;
Step 3: Substitute the co-efficients ()(n'()(, ,()(, ..... ()(" in function 1 o b) A= 1 o
a) A= 0 -I -2 c) A=
- 2 -3
= ~(t) a) Consider A =
Examples:
o
I) Find /(A) of A'o for A = 0
Characteristic equation is 1M- A I = 0
. -I -2
A- I -I
Now characteristic equation is 1M- AI = o. o A- I
A, = landA, = 1. Since A is of2x2 second order system, hence,

(A t I)' = o. e" =()(o t()(,A .


(I)
"
e = ()(0 :+ (X ," at , A = A,
Hence, Eigen values arc A, = -1.A, "O.A, = -I. will be e'" =()(o.+()(,A,
Since' A' is of 2x2. the corresponding poly function is
e' = ()(o t ()('. (2)
./(1\) = A'" = o, ', (1) Differentiating Eq, (1) with respect to and substituting = 2
()(,A te" = (X ,ilIA =71.1
(3)

(-I)'" = (Xo - ()(,


From Eqs. (2) arid (3) ()(0 = e' - 0Ii = e' - te'

()(n -()(,
11;:
= l = e' (1- I)
Hence STM is given by
Since it is case of repeated Eigen values, to obtain the second equation ~(/) = e" = ()(ol+ ()(, A
di fferentiating the expansion for[( ) on both sides (i.e. Eq I),
1 0 1
!!"[A
dA IO] ,.-, = ()(, =()(oO I:t()(, 0

lOA' e' (I -I) o tel let


+
Hence.jx, =It()(, =1-10=-9 o e'(J- t) o te'
Dept. of EEE, SJBIT
Page 63
Dept of EEE, SIBIT
Page 64

"
Modern Control Theory 10EE5& Modern Control Theory lOEE55

ao= ex,
o e - 2a, ao - 3a,
Ze" _ e-2t e-/ -e -2r
o b) A -= I 1 ; characteristic equation is AI - A = 0I I - e-I + 2e
as before.
-2 -i-e-' + 2e-" ,-21

X. = -1, A, =-1. Deterimine the STM of system matrix


For second order system, :~ L 4
e" = OCo +ex,A (I) A = 0 2 0 by Cayley-Hamilton method.
3
e~" = + OC A
ex , , Now characteristic equation is,
e-'=oco-ex,;(A,=-I) (2) A-2'-1 -4
Differentiating Eq. (I) with respect to

ex, = te"
hence OCo = e-' (1 + t) from Eq. (2).
and substituting = 2=-1 I;v:- AI ~

Eigen values are
! 0.
O
A- 2
0
A -I
o

A, = 2.A, = 2.A, = I
=0

Corresponding function will be


The STM is given by ~(t) = e" = OCol + A e~" =a,,+a,A.+ex,A,' (I)
On simplification,
e" =ao +2ex,+4a, (2)
(/ = (I-+te-'
.I. )
... t)e-'
Differentiating Eq. (I) with respect to ,and suhstituting ,=2,
(1- t)e -, On simplification

c). A =
o characteristic equation is IAI - AI = O. te' = ex, + 4a, (3)
-2 -3
and e'" = e, + ex,A, + a,A;

I A+3=OI
A
2
-I A, = -I,A, = -2.
From Eqs.
= ao + ex, + a,
(2), (3) and (4), solving for ao,a, .,
(4)

Eigen values are distinct. The corresponding functions are,


exo = Lte' - 3e 2t + 4e' ;
e~" =ao +oc,A, (1)
(Xl = - 3te21 + 4e21 - 4e'

e-t =((0 -(Xl (2) ex 2 = te" - e21 + e'


And e~" = ao + Hence STM o = (Xol + ex ,A + a,A'
e-" ex,A, (3) e" 12e' - 12e" + l3te" - 4e' + 4e" ",

= exo- 2ex, o e" o


From Eqs. (2) and (3) solving for a 0 and a, , o - 3e' + 3e" e'
ao =2e-I-e-" and "
"

Hence the STM will be ~(t) = aoI + a, A. On simplification

Dept. of EEE. SIBIT Page 65 Dept. of EEE, SIBIT Page 66


Modern Control Theory 10EE55 Modern Control Theory lOEE55

Solution of Non-homogeneous State Equation


Consider the state equation with forced input u{t) as
x(t, = -I-I I

-10
x{t) +
0
10
u(t)

x(l) = ,1x(/) + BII{t); (1)


, yet) = [1 O]x(t);x(O) = 0
x(t" ) = ,t"
Solution: The state equation solution is
.I{t) - Ax(l) = BII{t)
Pre-multiplying both sides by e' A, , x(t) = eAIx(O) + eA(H) BU(T)dT (I)
e- /'[x(l) - AX(/)] = e-'''I/(I) (2)
" Since x(O) =0,
Consider, 1

d [e-'''x(l)]
ill ",
-Ac' "x(l) te "x(t)
= ~(t -T)Bu{T)dT (2)
(' - /,[.\'9TO - Ax(l)] (3)
hence Eq (2) can be written as Now, th~ state transition matrix ~(l) can be evaluated as
d Ie -"
' x ()]
t = (' -/,
11(1 ) e" ~~(t) = -I lSI - A]-I
ilt
Integrating both sides with time limits 0 and t lilt
1.0128e-a" - 0.0128e- .

"e-'/'X(/)I' = e' ".8I1(T)dT - 0.114e-,1+ 0.114e-",1 - 0.0128e-,1 + 1.012e -al

.. ~,t-T);,
:1
I.bI28e-u,(H)

- 0.114e-,(H) + 0.114e-.,(H)
- 0.0128e-"('-' 0.114e-a, (I- - 0.114e-,(H)

- 0.0128e-Q (H) + 1.012e-"-"


e-"x(t) = x(O) + e-" BU{T)dT Hence'
:-1 ; 0
Pre-multiplying both sides by e" , x(t)"
, .~(t _;T)

'
10
lOdT

x(l) = e""lol x(O) t eAI'-Tt BU(T)dT 9.094 -IO.247e-a,1 + 1.153e-,1


-0.132 + 1.15Ie-,1-1.01ge -at
lIN
ISR .'. y(t) = Cx(i) = [I 0}x(1)
= 9.094 -1O.247e-a,1 + 1.153e-a" ;
X{t)'=~(t)X(O) t ~(/-T)BlI{T)dT.
where, al=1.1125, a2=9.88
Example 2: Consider the system
If the initial time is I" instead of 0 then,
o 1 0
x(l) =~(t - t. )x(t.) t ~(l-T)Bll(T)dT
x(t) =_ 2 _ 3 x(t) + I U(I)
(4)

The Eq (4) is the solution of state equation with input as utt] which represents the change yet) = [! l}x(t); x{O) = I
of state from .1(1,,) to x(1) with input utt). Solution: The
Example 1: Obtain the response of the system for step input of 10 units given state model
as

Dept. of EEE,5J8fT .
Page 67 Dept. ofEEE, SJ8fT
Page 68
Modern Control Theory 10EE55 Modern Control Theory 10EE55

-I
2e -e
-21
e-/ -e -21 Solution: State transition matrix
2~, 2. ~4'
-e --e
3 3
ZIR = ~(t)x(O) I -t . 4 ~"
-e "'t'-e
2e- f _ e-2t e " _ e-2t 1 3 3
-2e~'+2e~2' -e~'+2e~2' -I
x(t) = ~(t)x(O) + ~(t - T )Bu(T)dT
2e-t e" _e" + e-21
_

- 2e~' + 2e~2' + e~' - 2e~2' 10~, -e ~" --1


-c
4 ~4,
3 3
-e
~, ~e--I + e" + ~e'41
3. 3
ZSR = ~(t -r)Bu(r}dT .'
Cootr611abjlity and Observability
2e~(r-T) - e~2(r-T e~('~T) - e~2('~T) 0ldr
_ 2e~'('-T) + 2e~2(1~T) - e-('~T) + 2e~2(r-T) I Consider the typical state diagram of a system .
e-(l-T) _ e-2(t-T
dT
_ e~(I~T) + 2e~2('~T)

.'. x(t) = ZlR + ZSR The system has two state variables. XI(t) and X2(t). The control input u(t) effects the state
variable XI(t) while it cannot effect the effect the state variable X2(t). Hence the state
-, variable X2(t) cannot be controlled by the input u(t). Hence the system is uncontrollable.
-e i.e., for nth order, which has 'n' state variables, ifany one state variable is uncontrolled
by the input u(t), the system is said to be UNCONTROLLABLE by input l1(t).
.!.(l+e~2'
2 Definition:
-e ~2' For the linear system given-by
y(t) = Cx(t) = [l l)x(t) X(t) = AX (t) + Bu(t)
y(t) = CX(t) + Du(t)
.!.(l + e~"
= [I I J = 2 is said to be completely state controllable. If there exists an unconstrained input vector
_ e-2t
u(t), which transfers the initial.stntcofthesysrcjn x(to) to its final state X(tf)in finite time
f(tt-to) i.e. fr. It can be seen if' all the initial states arc controllable the system is completely
=.!.(I + e~") - e~2'
2 controllable otherwise the system the system uncontrollable.

=.!.(l-e~" Methods to determine the Controllability:


2 I) Gilbert's Approach
2) Kalman's Approach.
o 2 o
Example 3: x(t} = _2 _ 5 x(t) + u(t) Gilbert's Approach:
I
It determines not only the controllability but also the uncontrollable state' variables, if the
y(l} = [2 i]x(t};x(O} = [I 2]" it uncontrollable.

Dept of EEE, SIBfT Page 69 Dept. of EEE, SIBIT Page 70


Modern Control ~~eory lOEE55 Modern Control Theory lOEE55
Consider the solution of state equation
.-\'(1) = AX (I) + fJu(t); x(t,,) = X (0) -I -I
as
o -2 o
.1'(1) = (" X(O) + e"('" BlI(T)dT . Assuming without loss of generality that X(t) =0, the o -2 I -2 0
solution will be I -I I 0 o -I

- X(O) = e:" BU(T)dT p-IB = 0 I I o


-I I 0 -I
The system is state controllable, iff'the none of the elements of B is zero. If any element As [TI B vector contains zero element, the system is uncontrolled and state XI(t) is
is zero. the corresponding initial state variable cannot be controlled by,the input u(t). uncontrolled, '
Hence the system is uncontrollable. The solution involves A, B matrices and is
independent of C matrix, the controllability of the system is frequently refen-;d,to ali the
controllability of the pair [A, B].
Example: Check the controllability of the system. If it is uncontrollable,
2) Kalman'S approach:
identify the state, which is uncontrollable.
-I -I I This method determines the controllability of the system.
X(t) = X(I) + u(t)
o - 2 0 Statement: The system described by
Solution: First, let us convert into diagonal form. X(/) = Ax(t) + ElI(t)
1A/-AI=lo
III .; I I
I
11+2=0
y(t) = ex(t)

is said to completely state controllable iff the rank of controllability matrix Q. is equal to
[1I-1](1I+2J~0
order of system matrix A where the controllability matrix Qc is given by,
ii' + 311+ 2 "0
(II t 2)(iI + I) = () Q, = [B IABIX BI..... yt' sj.
II = -2,11 = - I i.e., if system matrix A is of order nxn then for state controllability
Eigcn vector associated with 11=-2 p(Q,)=n
-2 11- I f
where p Q,.) is.rank of Qc.
1
o 01 v, = I
Example: Using:Kalman's Approach determine the state controllability of the system
described by :
Eigen vector associated with II = - I
y+3y+2y=u+u (I)
I-I + I I 1 with x, = y,x, '= y - u
I 0 - I+2 x, = -3x, :-2x, - 2u
XI =x2 + u
v~ :; 0 f'=
o '. X, =,0 I' x, + I
u(t)
o x, - 2 - 3 x, -2
p.' = _-_1_1 o 0'. I I
A= : ,B =
I -I -2 -3 -2
o
Dept. ofEEE, SJBIT
..
~'lge 71 Dept. of EEE, SjBIT
Page 72

:.
Modern Control Theory lOEE55
Modern Control Theory lOEE55
Verify the result with Gil~_r!,~ upproach.
-2
Now AB = Solution: Kalman's approach: Here,
-2 -3 -2 4
0 0 0 0
-2
Q, = [BIAB]= I A 0 0 1 ,B = o ;AB= 1 ;A 'B = - 3
-2 4
0 -2 -3 I -3 7

IQ,I = _I2 -21


4 =0 BIA2BIAB
I
hence rank P(Q,) is <2 and system matrix A is of2x2. Therefore system is not state 0 0
controllable. Q 031
Example: Determine the state controllability of the system by Kalman's approach. -3 7
o I 0 0
x(t) = 0 0 1 x(t) + 0 u(t)
= Order of system. Therefore, system
o -2 -3 I
is state controllable. Verification by
Gilbert's approacb:
Transferring the system model into canonical form with usual pr~edure.

o 0 o 2
Z(I) = 0 -I o Z(I) + - I 11(1)
I
o o -2
2

Her~, B = - 1 has no zero element in any row. hence system is controllable.


2
Observability:
Concept:
A system is completely observable, if every state variable of the system effects some of
the outputs. In other words, it is often desirable to obtain information on state variables
from the measurements of outputs and inputs. If anyone of the states cannot be observed
from the measurements of the outpits and inputs, that state is unobservable and system is
not completely observable or simply unobservable.
Consider the state diagram of typical system with state variables as x I lind x, and y and
u(t) as output and inputs respectively.

.. u~.,
tt.)
-I -~

Dept. ofEEE, SJBIT Page 73 Dept. of EEE, SJBIT


.' Page 74

.'
Modern Control Theory 10EE55
Modern Control Theory 10EE55
On measurement of yet), we call observe x 1(1) but we cannot observe X2(t)by
measuring alii y(I), hence statc is not completely observable.
ATCT]= 1
-2
Definition: " =[C
00
J\ system described by
x(t) = AX(/) + BU(f) lit =0 pet) < 2
y(/) = CX(/) + P"(/) is said to be completely observable iff with measurement of output Order of system is 2. So, system is unobservable.
yet) over-finite time interval to t If along with input u(t); t to the initial state x(to) c~n be
estimated. Example: Show that the system
Explanation: o. o o
Consider the output equation x(t) = 0 0 1 x(t) + 0 u(t)
y(f) = CX(/) + /)11(1)
-6 -11 -6 1
Assuming /)=0, y(I)=Cx(t).
yet) = [4 5 I!x-(t) is not completely observable by
All the stale variables x(t) can be estimated with measurement of yet) provided C matrix
do not contain the 'zero' clement. If any element of C matrix is zero, the corresponding I) Kalman's approach
slate cannot be estimated and hence system is_un~bscrvablc. 2) Gilbert's approach

Kollman's Approach:
-~------ Solution: Kalman's approach
The system described by the model 0 0 0 0 -6
X(f) = AX(I) + Butt)
,1'(1) = CX(I) T DU(f) A; 0 0 I A = 0 -II
is said to be completely observable iff the rank of observability.matrix ~" is equal to the
-6 -II -6 0 -6
order of system matrix A where,
~,,=[C' A'CT A"C' A" 'C'l 4
For nthorder system, rank of~" must be n. C= [4 5 11 cT 5
i.c. P(~,,) = n
It involves A and C matrices. The pair A. C is observable.
6 -6
Example: Consider the system AT cr : _ 7 ; A r' C T = 5
- 2 () 3
x(t l = 0 _ I x(t) + I lI(f) -I -I

1'(1) = [1 oh(1)
Test the observability using Kalman's approach. 6 -61
t4= "I ~ =0
Solution: Here 5 -7 5
- 1 0 1 -I -I
oj
A= - ;C=jJ
P(~:) <3 add order of system is 3, Therefore system is unobservable.
o .'

-2
o -2 .' Gilltert's approach:
Transferring the system model into observable canonical form with usual
A'e' = procedure ..the output equation will be
() -I 0 o yet) = [0 - 2- 2j;(t

Dept. of EEE, SJIlIT Page 75 Dept of EEE,S)BIT Page 76


Modern Control Theory 10EE55 Modern Control Theory lOEE55

UNIT-S POLE PLACEMENT TECHNIQUES


UNIT- 5
POLE PLACEMENT TECHNIQUES: stability improvements by state feedback, necessary
& sufficient conditions for arbitrary pole placement, state regulator design, and design of
state observer, Controllers- P, PI, PID,
#/I
10 Hours

Stability improvement by state Feedback: The main goal of a feedback design is to


stabilize a system, if it is initially unstable or to improve its stability if transient
phenomena don't die out sufficiently fast,
Consider single input single out put system with n-th order described by
X(t) = AX(I)

.
+ Bu(t)
'
Let us dssumc that all th~ state variables are measured accurately, and then it is possible to implement
a linear tontrollaw of the form
u(t) = -KX(t)
where,
K = [k,k2 .. .... kn, ] is
(Ixn) feedback gain matrix.
Subs~tute Eq (1) in Eq (I) to obtain closed loop system
model as '
X(t) = AX(I) - BKX(t)
= [A - BK]X(t)
The characteristic Eqn of closed loop system will be
S~-(A-BK) =10
When Eq (4) is evaluated, this yields an nih order polynomial in S containing the n-gains K"
K2, ..... Kn. The control Law design then consists of picking the gains so that the roots of Eq
(4) are in desired locations.
In the next section it can be seen that if the state model is in controllable canonical' form, then the
roots of characteristic Eqn (4) can be chosen arbitrarily. If all the given values of (A-BK) are
placed in len- half of s-plane, the closed loop system is asymptotically stable. And the state Xu)
decays to Zero irrespective of initial state X(O)- the initial perturbation in the state. The system
state can be maintained Zero value in
spite of disturbances that act upon the system. System with this property arc called
REGULATOR SYSTEMS. Control configuration of such system as shown

Dept. ofEEE, SJBIT Page 77 Dept. of EEE, SJBIT Page 78


, "
"
'.
Modern Control Theory 10EESS Modern Control Theory 10EESS

Algorithm for Design: Necessary and sufficient conditions:


a) Let the desired Locations of closed loop Poles be AJ ,A, A" The sufficie~t conditions for arbitrarily pole-placement is, the system (I)
b) The correspondry cha Eqn will be must be completely controllable.
(S- ,)(S- , Consider: the state model
) (S - nl = X(t) = AX(.) + B~(t)
o Y(t)=CX(t) . (2)
S" + ,S, + .s- + .... + n = 0 (I) The above model cdn be converted into controller canonical form through the
c) Let the controller gain matrix be transformation .
K=[K, Kr--------Knl. X(t) = f1X(t) (3)
d) Sl- (.11\ - BK) = S".. ,sn' + ,S"" n Where P iii nxn non singular transformable matrix, and assumed as
e) Corresponding equation is P'1 : P12 P'n
S + ,sn" + ,S' + ...... = 0 -------(2) P = p,,'. P'2 P 2n
I) Comparing the co-efficient of like powers of s form Eqn (I) & (2) K/,Ky-------KI/
can be Evaluated and this completes design of state back controller K. Pn, p
Pn,
Example: Design a controller K for the state model
o 1 0 P,
.. X(I) 0' 0 X(I) + 1 u(l)
P2 ; PI = [P" P" P,.l
Such that the system shall have damping ratio as 0.707 & settling time as I sec. Pn
Solution: Taking the derivative ofEqn (3) and substituting for X(t) from Equ(l)
a) Converting the desired specifications as locations of closed loop poles at - 4 j4
)1) = AX + Bu(t) (4)
b) The corresponding cha Eqn will be
(S+4+J4) (S+4-J4)=O Where'A = PAP-', B=PB (5)
S' +8S+32=0 (I) o 0...... 0
c) Let the controller be of the form o 0 1...... 0
K=[K1 K2]. (6)
d) From given state model
. [A _ SKJ = 0
n-t
1 0 0
. 0 0 K, K, o
o -B =PB = . (7)
o
-K, -K,
SI-(.II\-SK) =?' +K, S+K
From Equ.(3),
c) The 'corresponding characteristic equation is
S' + K,S T K, = 0 (2)
x,= Pl1x, + P12X2 + ......... + P'nxn =
(8)
P,x
Comparing the co-efficient of like powers ofS from Equ (I) and (2)
K2=8, K,=32. Taking the derivative
(9)
Hence controller K=[32 8].
x,= P,x(l) = P,[Ax(t) + Bu(t)]
Controller gain matrix K=[32 8] in feed back will have desired specifications. = P,Ax(t) + P,Bu(t)
Comparing (8) and (9), P,S = 0
Dept. of EEE, SJRIT Page 79 Dept. o.liE._Sj81T Page 80
"

Modern Control Theory 10EESS


Modern Control Theory 10EE55
& X2 = P,Ax(t)
Taking again derivative of Equ(l0)
'(10)
.
K [i<,K KJ
i'
. 2. and
o o 0
Hence the corresponding characteristic poly will be
Determine [A - B K J = o o 0
1 SI-lA =B)< = sn t (, tKn )sn-, + ....... t n tK, (14)
and characteristic equation will be - n - K, ; -Kn
'S +( ,+Kn)sn-'t( 2tKn)8'-2 t ntK,=O (15) 5) Determine the Cha equation as
WhereK~K2, ...-:-:Kn can be chosen real numbers arbitrarily. ISI- (A - B KI = sn + ( n + K, )8'-' + + 7Kn =0

Let the desired characteristic equation be 6) Determine the desired cha equation as
'S + a,sn-, + , + an
=0 , (16) sn + a,sn-' + a sn-2 + + an = 0
Equating the coefficients of like powers of S from equation ( 15) and (Hi)
7) Determine the elements of gain matrix K, K,. K, ,.... K"
,

}
a, = +Kn
t Kn =a,- as K1 = an - n

a2 = 2+ Kn_, Kn_, =a2- 2 K2 = an--1 - n ..1

(17) Kn = a, - , and hence


a n = n+K, K, =an- n K = [K,K2. K.l
8) The feedback controller K for original system is
Hence the controller x will be K= KP
K =[an - n an_,- n-t a, - ,] (18) This completes the design procedure
Transferring to original system Design of controller by Ackermann 'sformula:
K :-KP = [an - n an_, - n-t a, - ,]P , We have
The necessary condition is the system should be completely controllable. If the system is
not completely controllable then there are certain states that cannot be controlled by
p~ .'
stable feedback. '
Thus the necessary and sufficient condition for arbitrarily pole placement is the' P= P,A "& P, = [Q,'l[OO 01]
system should be completely controllable in s-plane. ' 'PAn-,
, ,
Steps to design the controller K:
K=[an - n an_1 - n-t a, - ,]P
I) For given state model, test the controllability of the system by determining the rank
of controllable matrix Q" ' (QJ'[OO 01]
2) If it is controllable, transfer the model into controllable canonical form through
similarly transformation matrix P ; where P can be ' = [an- n an_1 -
n-t a,- ,] (Q,)'A[OO 01]
obtained as. a) PI=[OO---------O I]Q,-I (Q,)'An,[OO 01]
P2=P1A
P3=P1A2
Pn=P1An-1
P, (I)
b) P fl, pIA n-., Characteristics poly of A matrix is
181- AI= S" + _,8n-' + 28'-2 + + n (2)
3) Compute A & B as According to Cayley-Hammilton theorem,
A=PAB=PB A"+ ,An-'4 + nl=O
4) Assume the controlierK n-t

Dept. of EEE,SJB!T Page 81 Dept. of EEE,SJB!T Page 82


_Modern Contr9'.Theory lOEE55 Modern Control Theory lOEE55

K = [00 01]Q," (A).-... --------(4)


",. X(t) " Ax(t) + Bu(t)
Where Yet) = CX(t)with
(A) = An t a,An.' + a,A'" t a3An.3 + .:..... t ani (5)
=
u(t) -KX(t)where

& Q, = [B I AB IA'B 1 An'B] (6)


K=[K,K2Kn]
Fromabove relations, the closed loop system is
Design procedure:
I. For given model, determine Q, and test the controllability. If controllable, X(t) '" [A - BK]X(t) (1)
2. Compute the desired characteristics equation as
I. From the characteristics poly of matrix A
S' t a.S'" t t an = 0
I 51- A = S" + 1 sn.' + 2 sn.2 + +n

and determine coefficients a, (I" il" Determine ()(" ()(2 , ()( n


3. Compute the characteristics poly of system matrix A as 2.: Determine the transformation matrix P, which transfers the given state mode]
(A)=A" +a,An'ta,An't +a" into controllable caunomical form.
4. Determine Q.' and then controller k will be K=[O 0 .... 0 IJ Q;'. ct>(A) P,
This completes the design procedure. P= A P, , ;P = [0..0... QI] Q"
Ex. Design controller k which places the closed loop poles at - 4 j4 for system P,An.'
o 1 0
X(A) = X(t)+ u(t) using Acermann's formula. Q = [BIABIA2BI ....... An,B]
1 0 1
Answer: Checkfor controllability 3.. Using the desired location of closed loop poles (desired Egen values) obtain
the characteristics pol y
Q = [BlAB] = 01 Its controllable as I(Q,)=2. (S - 1 )(S - 2 ) (S - nn)= S + a,Sn., + a2Sn.2 +.....an
c 0 determine il, ,il, , an
Q' = 0 1
c 1 0
II. Desired characteristics equation is (S+4+j4)(S+4-j4)
'. 4. The required state feed back controller K is
K1 = [an - a n n_1 - a
0-1 .. 1 - 1 P
82", 8S t 32 = 0 .
Examples. A regulator system has the plant
a, = 8,a, = 32. . a 0 0
32 0 X(t) = 0 0 X(t)+ 0 u(t)
Ill. (A) = A' + a,A + a,l = 0 8
-6 -11 -6 1
Y=[1 0 O]X(t)
6 ~ ~ 0
IV. K = [0 1]
Problems
State regulator design: The state Regulator system is a system whose non zero
initial state can-be transferred to zero initial state by the application of the input u(t). 1) Design a state feed back controller which place the closed loop poles at - 2 j3.464 and-S. Give the block
diagram of the control ccnfiguration
Design of such system requires a control law
Solution: By observing the structure of A and B matrices, the model is in controllable conmical
U(t)=-KX(t) which transfers the non-zero initial state to zero initial state (Rejection of form. Hence controller K can be designed.
disturbances) by properly designing controller K.
The following steps give design of such controller. For a system given by
$I. ISI- A = 0 -1 0
6 S -1 S3 +6S2 +11S+17
11 S +6
Dept. of EEE. SJBIT Page 83 Dept. of EEE, SJBIT Page 84
Modern Control Theory 10EE55
Modern Control Theory 10EE55

Comparing with 83 + ,8 + 28 + a, we obtain ,= 6, 2 = 11, = 17


2. Desired characteristics poly is
(S+ 2+j3,464 )(S+-j3 ,464)(S+5)
;; 83 + 982 + 208 + 60
Comparing with sa + a.s + a2s + a, we obtain
a, =9, a2 =20, aJ =60
Y(t) = Cxtt}i-
3. Hence the required controller K is initial state X(O) are known and
K=[aa- 3 a2- 2 a,-,I X(t) is estimated states and
= [K, K2 K31
= [43 9 31 X(O) is estimated initial states the resulting observer in open loop observer.

Block Diagram: DfOW backs fJjop(m Igop obsersec.c.c.:':__


1. Precise Lack of information of x(O)
2. If X(O) X(O), the estimated state X(I) obtain from open loop estimator will have
continuously growing error and hence the output.
3. Small errors in A,B, and disturbances that enters the system but not in
estimator will cause slow estimate process.
Hence betterto go for closed loop estimator.
Design of closed loop Full-order state observer: Figure shows closed 100fYFullorder
s~ate observer (Luen berger state observer)

K,=43
K2=9
K3=3

Design of state observer:


Design of observer: The device that estimates the state variables with measurement of ,
I

output along with input u(t) is called state observer. I

If all the state variables are estimated, it is called Full-order state observer. If only few
-'--~---.-.--_j
statevariable are estimated (which can't be measured accurately), the observer is called
Reduced-Qrder state observer.
+ Bu(t)
Design of Full-order observer: In this case all the state variables are to be
estimated. a) Open loop observer: Here it is assumed that all the state variables
.. State model is X(t) = Ax(t)
Y(t)= Cx(t)
(1)
(2)
are estimated
Estimator output is Y(t) = CX(t) (2a)
correctly and initial state are also estimated correctly.
i.e For State model
X(t) = Ax(t) + Bu(t)

Dept. of EEE, SIBlT Page 85 Dept. of EEE, SIBlT Page 86


Modern Control Theory lOEE55
Moderfl Control Theory 1:0EE55
. . Y(I) - Y(I) = e[X(I)- X(I)] mis nx! constant gain matrix.
Error 111 output IS (2b)
Differentiating equation (3)
Error in state vector
X(I) = X(I)- X(I)
X = X(I) - X(I)
(3)
= [A-me]X(I) ........ by equations (2 to 3) (5)
from figure X(I) = AX(I) + Bu(l) + m(Y(I) - Y(I) (4) The characteristics equation of the error is given by
-----181- (A - me)1= 0 (6)
If'm' is chosen.properly, (A-me) have reasonably fast roots, then X (t) will decay to
zero irrespective of X(O) i.e X(I) ~ X(t), regardless of X(O). Further it can be seen that
equation (5) is independent of control input u(t).
The observer gain matrix 'm' can be obtained in exactly the same fashion as controller
gain matrix 'K'
Design procedure:
I. Let the desired pole locations of observer error ~" ~2 ,....... ~. then the
roots be corresponding pol y equation will be
(8 - ,)(8 - 2 ) ..... (8 - n) = 0 (I)
S" + a,81-' + a28n-2 + an = 0 (2)
determine co-effients a, ,a, , an
2. Let the observer gain matrix be m
m = [m"m2, ....... mnl'
obtain the characteristics poly equation of the closed loop system with observer as
181-(A-me)1= 0
S" + ( ,+ m, )8"-' + ( 2 + mn_, )8"-2 + ....... + ( n + rn.) = 0 (3)
3. Comparing the co-efficient oflike powers of S from equations (2) and (3)
a, = ,+ mn mn = a, - ,
an = n:+ m1 m1 = an - n

where the co-efficients ()(,,()(2 , ....... ()( n are obtained from poly equation
lSI - AI;, 0
8~+ . ,8n-t + ....... + n =0.
.' 4. The observer gain matrix 'm' will be then
m'= [m"m2, ....... mnlT
Example: Consider the state model
o 1 0 o
X(I) = 0 0
1 X(I)+ 0 u
-6 -11 -6 1
Y(I) = [0 0 11X(I)

Dept. of EEE,Sj61T
Page 87 Dept. of EEE, 5j61T
Page 88
Modern Control Theory 10EE55 Modern Control Theory lOEE55

2) Design an observer; where observer-error poles are required to be located at - 2 j3.64 Reduced-order state observer Required when few of
and -5
state variables cannot be measured accurately. Design of Reduced-
Solution: Model in oberserver conamical form will be
order state observer:
o -6 0 In this design procedure, let us assume one measurement Y(t). Which measures one state
X(I) = 0 0 -11 X(I) + 0 X1(t). The output equation is given by
-6 Y(t)=CX(t) (1)
Where C=[ I 0 -----0]
yet) = [0 0 1]X(I) Partitioning the states X(t) into states directly measured X,(t) and states directly non
I) Desired characteristic measurable X,(t), which arc to be estimated. .,.
equation will be .. . _ X1(1)
i.e X(I) - Xe(l) (2)
(S+2+j 3.64) (S+2-j3.64) (S+5)=0.
=> 83 + 982 + 208 + 60 = 0 Partionionly the matrixes accordly & state equation can be written as
hence comparing with 83 + a.s" + a2s + a, =0
X,(t) = a" a" X,(I) + b, u(l) (3)
Q] =9, Q, =20, QJ =60 (1)
X. (I) a., ae X,(I) b,
2) Let the observer be m = [m] , m, , m, l'
o 0 -6 0 0 rn, and Y(I) = [1 Or x (I) (4)
X,(I)
[A-mc]= 1 0 0 m2
from equation (3)
-'6' 0 m3
X. (t) = a.eXe(I),+ a ;(I) +J'J (5)
o 0 -(6+m,) Knowninpul

[A-mc]= 0 -(11+m2) from (4) Y(I) = X,(I)

-(6+m3) => X1 (I) = Y(l) Also from


Equa,tion (3) X,(I) = al1X,(I) + a,eX, (I) + b,u(I).
181- (A - me ~ = 0
Collecting the known terms.
83 + (6 + m3 )82 + (11 + m2)8 + (6 + m.) = 0
Comparing with
~.. .
Y(!l- al1X, (I) - b,u(l) = a'eXe (I) (6)

53 + ,52 + 25 + 3 = 0 t Known terms


Comparing equation (5) & (6) with
1 = (6 + m,). 2 = (11 + m2), 3 = (6 + m, (II)
X(I) = AX(I) + bu(l)
)
and Y(I) = CX(lt
3) From I and II, we can have similarity as
9= 6+m3 rn, = 3 X(t')- X.(t),
20 = 11 + m2 m2 = 9 A(I'l- ;.:
60 = 6+ m, rn, = 54
bu - a.,X,(I) + b.u(l) (7)
4) Hence rn = [54 9 3]T c = a,.
Y = Y(I) - al1X,(I) - b,U(I>'
Using Equation (7), the state model for reduced order state observer can be obtained as
~(I) = a ee X.(I) + ae1y + beU(I)X,(I) + m (Y(I) + (Y - a"y - b.u - a,,)<, (I (R)
Dept. of EEE, 5J8fT Page 89 Dept. of EEE,5JBIT Page 90
M_o~e_rnControl Theory 10EE55 Modern Control Theory 10EE55

(same as X(I) = AX(I) + bu(t) + m(y(l)- y(I)) where yet) = a,.X. (I) Solution: :
Detining Xe (I) = X. - Xe From output Equation it follows that states X,(t) & X2(t) cannot
be measured as corresponding elements ofC matrix are zero. Let
Xe (I) = x, (1).- Xe (I) us write the state equation as

Substituting for X, (1)& X. (I) in above equation & on simplification,


000 X,(I) 50
o -24 X,(I) + 2 u(l)
X(I) = (a.e - ma,. )X. (9) o -10 X3(1)
Corresponding characteristic equation is
181- (aee - ma., ~ = 0 (l0)
Comparing with desired characteristic equation 'ru' can be evaluated same as m in full- 0 0 0
order observer.
8ee =
1
o ,a., = -24 a,. = [0 1]
To implement the reduced-order observer,
50
Equation (8) can be written as al1=[-10];be= = [1]
2 b,
X.(I) = rae. - rna-, )X.(I) + (a., - mal1)Y(I) + (be - mb ,)u + m y(t) (11)
Let m = rn,
As Y(I) is difficult to realize, m2
Define Characteristic equation of an observer is
x.' (I) = X.(t) - my 81- (a - rlna,e) = 0
8' + m2S + m, = 0
X,,(t) = Xe (I) - m y(t) Desirable characteristic equation is
= (aee - ma.; )X. (t) + (ae, - rna, )y(t) + (b. - rnb, )u(l) (12) (S + 1O)(S + 10) = 0
Equation (12) can be represented by block diagram as shown below. S2 + 208 + 100 = 0
From two characteristic equations, equating the co-efficient of like powers of S
20=m2 & lOO=m"
100
m = 20
Hence state model of observer will be

x ..(I) -- {10 0 _ [100 0 1"X (I) { 0


0 20 Y. + - 24
100 50
20 x {-1 O}]}Y(I)+ { 2 100 1}u(l)
20

Design of compensator by the principle of separation:


Consider the coinpletely controllable and observable system described by He
Exatnple: System is described by nc
o 0 0 50 X(I) = AX(I) + Bu(l) c
o - 24 X(t)+ 2 u(t)
Y(t)= CX(I) the
Let the control law be sta -
1 -10 u(t) = -kX(t) . te
Y\1l,= [0 0 1]X(t). .~ fee
Assume the full-order observer model be
db
To design the reduced-order observer for un measurable states such that the given values ae
will be at --10, -10. X(I) = AX(!) + B)J+ M(y - eX(I))
k
Dept. of EEE, SJBIT co
Page 91 Dept. of EEE. SJBIT
Page 92
Modern Control Theory .lOEE55 Modern cdntrof Theory' lOEE55

ntrollaw using the estimated states will be


U(I) = -KX(I) . (2)
From
Using equation (4) in (Ia)
(5) (3)
m&(2)
X(I) = AX(I)- BKX(I) ,,'
X(I) =
.. , ~
(A.!.BK - mC)X(I)+ mY(I)
= (A - BK)X(I)+ BK(X- X(t)) (6)
Defining observer state error vector as Taking L.T.

X(I) = X(I)-X(t) SX(s) = (A - BK - mC)X(S) + mY(S)


using (6) in (5) mY(s) = [SI- (A - BK ~mC)))S) (4)
X(t) = (A - BK)X(t)+ BKX(I) (7) Taking L.T. of equation (2)
WKT observer error-vector model is U(S) = -K.X(S) (5)
From equations (4) & (5)
X(t) = (A - mC)X(t) (8) U(S)
Equation (7) & (8) can be obtained in vector model as -- = K[SI- (A - BK - mCr'lm
-YeS)
X(t) =(A - BK) BK X(t) =D(S)
(9)
Xct) 0 (A - mC) X(t)
Equation (9) represents the model of 2n dimensional system. The corresponding R(Sy~g) 1)(s) Plant
characteristic equation is ISI-(A -BK)IISI- (A -mC)1 = 0 (10)
Equation (10) represents the poles (given values) of the system, which is union of poles
of controller & observers. The design of controller & observer can be carried by
separately, & when used together, the system is unchanged. This special case of Example: A System is described by
separation principle controller can be designed using . o 1 0 0
ISI- (A - BK)I= 0 and observer by ISI- (A - mC)1= O.
X(I) = 0 0 X(I) + 0 u(l)
The corresponding block diagram is as shown -5 -6 -11
Yet) = [1 0 OlX(I)
1 "'"
Design" co~tI;oller to take place closed loop poles at -I j I,-5. Also design an observer
'1(0
such that observer poles are at -6. -6, -6. Derive the Un compensated & compensated
T.F.

r Solution: S'ystem is observable & Controllable. Using the procedure of controller design
& observer design, the controller will be
K=[4 I I] and observer will be
1
M=[12 25 _72]T
I
I leot'lt",oItf:"T bb5f.T'it y
Transfer function of uncompensated system will be
L _ ;<-CC"1r""""l"': Mu(S)=qSI-Ar'B.
- - - --00\ .
M _ 1
'tSI - S3 + 6S 2 + 11S + 6
Transfer function of compensator: Transfer function of compensated system will be
Now X(t) = AX(I) + Bu(t) + m(y - eX(I)) (I) Me(s)= U(S) = K[SI- (A - BK - mCW'm
YeS)

Dept of EEE, SJBIT Page 93 Dept of EEE, SJBIT Page 94


--Modern
== Control
_<_.
Theory . 10EE55 Modern Control Theory
10EE55
control mode is expressed as pet) = Kp.e(t) + Po.
CONTROLLERS
The performance of proportional controller depends on the proper design of the gain Kp As
Thc~"n:roller is an element which accepts the error in some form and decides the proper corrective the proportional gain Kp increases, the system gain will increase and hence the steady state error will
action. The output of the controller is then applied to the system or process. The accuracy of the entire decrease. But due to high gain, peak overshoot and settling time increases and this may lead to
system depends on how sensitive is the controller to the error detected and how it is manipulating such an instability of the sysiem. So, compromise is made to keep steady state error and overshoot within
error. The controller has its own logic to handle the error. acceptable limits.
The controllers are classified based on Hence, when the proportional controller is used, error reduces but can not
the response and mode of operation. On the basis of mode of operation, they are classified into make it zero. The proportional controller is suitable where manual reset of the operating point is
Continuous and Discontinuous controllers. The discontinuous mode controllers are further classified as possible and 'the load changes are small.
ON-OFF controllers' and multi position controllers.
Integral Controller:
Continuous mode controllers, depending on the input-output relationship, are classified into three We have seen that proportional controller can not adapt with the changing load
conditions. To overcome this situation, integral mode or reset action controller is used. In
basic types named as Proportional controller, Integral controller and Derivative controller. In many this controller, the controller output pet) is changed at a rate which is proportional to
actuating error signa! ett),
practical cases, these controllers are used in combinations.

The examples of such


"
composite controllers arc Proportional _ Integral (PI) controllers,
= s, r..
U)c!t + Po

'Prop')J1ional- Derivative (PO) controllers and Proportional - fntegral- Derivative (PID) controllers. Mathematically the integral controller mode is expressed as pet)

The block diagram of a basic control system with controller is shown in Figure. The error detector compares The constant K. 'is called integral constant. The output tram the controller at any instant is the area
the feedback signal b(l) with the' reference input nt) to generate an error. crt) = ret) _ bet).
under the actuating error curve up to that instant. If the error is zero, the controller output will not
change. The inte,grar controller is relatively slow controller. It changes its output at a rate which is
Controller output -:
(p) dependent on the integrating time constant, until the error signal is cancelled. Compared to
r(l) 0(\) j the proportional controller, the integral control requires time to build up an appreciable output.
Controller
~)- However it continues to act till the error signal disappears. Hence, with the integral controller the
Error steady state error can be made to zero. The reciprocal of integral constant is known as integral time
.. detector
constant T;. j.e., T; =. ilK;.
L.._~ -j Feedback element 1------'
/
Feedback Derivative Controller:
Signal
In this mode, fhe output of the controller depends on the rate of change of error with respect to time.
Proportional Controller:
In the proportional control mode, the output of the controller is proportional to the error e(t).
The relation between the error and the controller output is determined by a constant called proportional
Hence it is alsb known as rate action mode or anticipatory action mode.
The mathemafical equation for derivative controller is p(t)
' .
_ K. ~
- + P"
Where Kais the derivative gain constant. The derivative gain constant indicates by how much
percentage the controller output must change for every percentage per second rate of change of the
gain constant denoted as K. i.e. p(t) = Kp eu). error. The advantage of the derivative control action is that it responds to the rate of change of
error and can produce the significant correction before the magnitude of the actuating error
Though therc, exists linear relation between controller output and the error, for zero error the becomes too large. Derivative control thus anticipates the actuating error, initiates an early corrective
controller output should not be zero as this will lead to zero input to the system or process. Hence, action and tends to increase stability of the system by improving the transient response. When
there exists some controller output Po for the zero enor. Therefore mathematically the proportional the error is zero or constant, the derivative controller output is zero. Hence it is never used alone.
PI Controller:
Dept. of EEE. 5J8fT
Page 95
Dept. of EEE, SJBIT
Page 96

..,
Modern Control Theory lOEESS Modern Control Theory lOEES5
This is a composite control mode obtained by combining the proportional mode and
integral mode. The mathematical expression for PI controller is

rC2J(De(t) x, J "ft)dr , i'"


The PD Controller has following effects on the system.

The transfer function is given by g~ I . It mcreases the damping ratio and reduces overshoot.
2. It r~duc~s the rise time and makes response fast.
3. It r;eduees the settling time
4. The type of the system remains unchanged.
5. Steady state error remains unchanged.
The advantage of this controller is that the one to one correspondence of In general it improves transient part without affecting steady state.
proportional controller and the elimination of steady state error due' to integral
The transfer function is given by
controller. Basically integral controller is a low-pass circuit.
The PI Controller has following effects on the
system.

I. It increases the order of the system


2. It increases the type of the system
3. It improves the steady state accuracy.
4. It increases the rise time so response become slow.
5. It filters out the high frequency noise
6. It makes the response more oscillatory.

PD Controller: This is to note that derivative control is effective in the transient part .~' the
This is a composite control mode obtained by combining the proportional
response as error-is varying, whereas in the steady state, usually if 'any error is there, it is
mode and derivative mode. The mathematical expression for PI controller is
constant and does not vary with time. In this aspect, derivative control is not effective in
, deft) .
P(f'J T(p,(t, 4- IC,~ -e- P"
-the--stearr-y-state part of the response, In the steatly state part, if any error is there,
The transfer function is given by Kt K,s integral control will be effective to give proper correction to minimize the steady state
eITOr. An integral controller is basically a low pass circuit and hence will not be effective in
transient part of the response where error is fast changing, Hence lor the whole range of
time response both derivative and integral control actions should be provided in addition
to the inbuilt proportional control action for negative feedback control systems,

PID Controller:
This is a composite control mode obtained by combining the proportional mode,
integral mode and derivative mode. The mathematical expression for PI controller is

Dept. of EEE, SJBIT Page 97 Dept. of EEE, SJBIT Page 98


Modern Control Theory 10EE55
10EE55

UNIT-6 NON LINEAR SYSTEMS

UNlT- 6
Non-linear systems: Introduction, behavior of non-linear system, common physical non linearity-
saturation, friction, backlash, dead zone, relay, multi variable non-linearity.
3 Hours
Many practical systems are sufficiently nonlinear so that the important features of
Figure 6.1
their performance may be completely overlooked if they are analyzed and designed
A nonlinear system, when excited by a sinusoidal input, may generate several
through linear techniques. The mathematical models of the nonlinear systems are
harmonics in a~dhion to the fundamental corresponding to the input frequency. The
represented by nonlinear differential equations. Hence, there are no ~en'eral methods
amplitude' of the :fundamental is usually the largest, but the harmonics may be of
for the analysis and synthesis of nonlinear control systems. The f;~tjhat
significant implitude in many situations.
superposition principle does not apply to nonlinear systems makes generalisation
difficult and study of many nonlinear systems has to be specific for typical situations.
Another peculiar characteristic exhibited by nonlinear systems is called
jump phenomenon. For example, let us consider the frequency response curve of
6.2 Behaviour of Nonlinear Systems
spring-mass- damper system. The frequency responses of the system with a linear
The most important feature of nonlinear systems is that nonlinear systems do not
spring, hard spring and soft spring are as shown in Fig. 6.2(a), Fig. 6.2(b) and Fig.
obey the principle of superposition. Due to this reason, in contrast to the linear case,
6.2(c) respectively. For a hard spring, as the input frequency is gradually
the response of nonlinear systems to a particular test signal is no guide to their
increased from zero, the measured response follows the curve through the A, Band
behaviour to other inputs. The nonlinear system response may be highly sensitive to
C, but at C an increment in frequency results in discontinuous jump down to the point D,
input amplitude. For example, a nonlinear system giving best response for a certain
after which with further increase in frequency, the response curve follows through DE.
step input may exhibit highly unsatisfactory behaviour when the input amplitude
If the frequency is now decreased, the response follows the curve EDF with a jump up
is changer' Hence, in a nonlinear system, the stability is very much dependent
to B frorq the point F and then the response curve moves towards A. This
on the input and also the initial state.
phenomenon which is peculiar to nonlinear systems is known as jump resonance. For
Further, the nonlinear systems may exhibit limit cycles which are self-
a soft spring, jump phenomenon will happen as shown in fig. 6.2(c).
sustained oscillati~ps of fixed frequency and amplitude. Once (he system trajectories
converge to a limit cycle, it will continue to remain in the closed trajectory in the state
space identified as limit cycles. In many systems the limit cycles are undesirable
particularly when the amplitude is not small and result in some unwanted phenoraena. '.

Fig.6.2(a) Fig.6.2(b) Fig. 6.2 (c)


Dept. of EEE, 51BIT Page 99 Dept. of EEE,51BI1' Page 100

,
,
Modern Control Theory 10EE55 Modern Control Theory 10EE55

When excited by a sinusoidal input of constant frequency and the amplitude is increased ~ Liapunov's Method for Stability: The analytical solution of a nonlinear system is rarely possible.
low values, the output frequency at some-point exactly matches with the input frequency If a numerical solution is attempted, the question of stability behaviour can: not be fully answered
and continue to remain as such thereafter. This phenomenon which results in .a as solutions to an infinite set of initial conditions are needed. The Russian mathematician A.M.
synchronisation or matching of the output frequency with the input frequency is called Liapunov introduced and formalised a method which allows one to conclude about the stability
frequency entrainment or synchronisation. without solving the system equations.

6.3 Methods of Analysis 6.4 Classification of Nonlinearities


Nonlinear systems are difficult to analyse and arriving at general conclusions are tedious. The nonlinearities are classified into i) Inherent nonlinearitics and ii) Intentional

However, starting with the classical techniques for the solution of standard nonlinear nonlinearities. The nonlinearities which are present in the components used in system due

differential equations, several techniques have been evolved which suit different types of to the inherent imperfections or properties of the system are known as inherent

analysis. It should be emphasised that very often the conclusions arrived at will be useful for nonlinearities. Examples are saturation in magnetic circuits, dead zone, back lash in
the system under specified conditions and do not always lead to generalisations. The gears etc. However in some cases introduction of nonlinearity may improve the

commonly used methods are listed below. performance of the system, make the system more economical consuming less space and
more reliable than the linear system designed to achieve the same objective. Such
Linearization Techniques: In reality all systems are nonlinear and linear systems areonly nonlinearities introduced intentionally to improve the system performance are known as
approximations of the nonlinear systems. In some cases, the linearization yields useful intentional nonlinearities. Examples are different types of relays which arc very
information whereas in some other cases, linearised model has to be modified when the frequently used to perform various tasks. But it should be noted that the improvement
operating point moves from one to another. Many techniques like perturbation method, series in system performance due to nonlinearity is possible only under specific operating
approximation techniques, quasi-linearization techniques etc. are used for linearise a nonlinear conditions.r other conditions, generally nonlinearity degrades the performance of the

system. system.

Phase Plane Analysis: This method is applicable to second order linear or nonlinear systems 6.5 Common Physical Nonlinearitles: The common examples of physical

for the study of the nature of phase trajectories near the equilibrium points. The system nonlinearities are saturation, dead zone, coulomb friction, stiction, backlash, different
behaviour is qualitatively analysed along with design of system parameters so as to get the types of springs, different types of relays etc.

desired response from the system. The periodic oscillations in nonlinear


. .
systems
called limit cycle can be identified with this method which helps in investigating the stability
of the system.
. Saturation: This is the most common of all nonlinearities.
driven by sufficiently large signals, exhibit the phenomenon
All practical systems, when
of saturation due to
limitations of physical capabilities of their components. Saturation is a common

Describing Function Analysis: This method is based on the principle of harmonic phenomenon in magnetic circuits and amplifiers.
linearization in which for certain class of nonlinear systems with low pass cha,racteristic. This
method is useful for the study of existence of limit cycles and determination of the amplitude, Dead zone: Some systems do not respond to very small input signals. For a particular
frequency and stability of these limit cycles. Accuracy is better for higher order systems as they range of :ippqt, the output is zero. This is called dead zone existing in a system. The
have better low pass characteristic. input-output curve is shown in figure.
Dept. of EEE, SJBIT Page 101 Dept. of EEE, SJBIT Page 102

" .
Modern Control Theory lOEE55
Modern Control Theory lOEE55
needed to close the relay than the current at which the relay drops out, the characteristic always
exhibits' hysteresis.

Saturation Deed-zone

Figure 6.3 Multivariable Nonlinearity: Some nonlinearities such as the torque-speed characteristics of a
servomotor, transistor characteristics etc., are functions of more than one variable. Such
nonlinearities are called multivariable nonlinearities.

Backlash: Another important nonlinearity commonly occurring in physical systems is


hysteresis in mechanical transmission such as gear trains and linkages. This nonlinearity is
somewhat di ffercnt from magnetic hysteresis and is commonly referred to as backlash. In
servo
-.
systems, the gear backlash may cause sustained
phenomenon and the system may even turn unstable for large backlash .
oscillations or chattering

. Figure 6.4

Relay: A relay is a nonlinear power amplifier which can provide large power
amplification inexpensively and is therefore deliberately introduced in control systems. A relay
controlled system can be switched abruptly between several discrete states which are usually oft;
full forward and full reverse. Relay controlled systems find wide applications in the
control field. The characteristic of an ideal relay is as shown in figure. In practice a relay has a
definite am~t of dead zone as shown. This dead zone is caused by the facts that relay coil
requires a finite amount of current to actuate the relay. Further, since a larger coil current is

Dept. of EEE, SJBIT


Page 103 Dept of EEE, SJBIT
Page 104

"
"
Modern Control Theory 10EE55
Modern Control Theory lOEE55
variables are zero. These points arc called singular points. These are in faet equilibrium points
UNIT -7 PHASE PLANE ANALYSIS of the system. If the system is placed at such a point. it will continue to lie there if left

UNIT-7 undisturbed. A family of phase trajectories starting from different initial states is called a
Phase plane method, singular points, stability of nonlinear system, limit cycles, constructlon of phase phase portrait. As time t increases, the phase portrait graphically shows how the system moves
trajectories.
in the entire state plahe from the initial states in the different regions. Since the solutions from
.
,7 Hours
each of the initial conditions are unique, the phase trajectories do not cross one another. If the
system has non linea; elements which are piece-wise linear, the complete state Jjlace can be
Phase plane analysis is one of the earliest techniques developed for .the stugy of second
divided into different regions and phase plane trajectories constructed for each of the regions
order nonlinear system. It may be noted that in the state space formulation, the siate variables
separatel y.
chosen are usually the output and its derivatives. The phase plane is thus'a state plane where the
two state variables XI and xz are analysed which may be the output va~iable y and its 7.3 Phase Plane
, Method
Consider the homogenous second order system with diffcrcnnai equations
derivative y. The method was first introduced by Poincare, a French mathematician. The
dx
method is used for obtaining graphically a solution of the following two simultane~us equations
of an autonomous system.
This equation may be written in the standard form
....fl(X1'X~;

~f,Cx"x,) where and narc t4e damping factor and undamped natural frequency of the system. Defining the state
Where it f,~X;;.f,) and .t, {,('X"x,) are either linear or nonlinear functions of the state variables as x = x 1 and :\-= X2, we get the state equation in the state
variables XI and x2 respectively. The state plane with coordinate axes x I and X2. is called the variable form as ,
phase plain. In many cases, particularly in the phase variable representation. of systems, take the "
form
- ."t~

These equations may then be solved for phase variables x I and x2. The time response plots of
The plot of the state trajectories or phase trajectories of above said equation thus gives an
x I, X2 for various values of damping with initial conditions can be plotted. When the differential
idea of the solution of the state as time t evolves without explicitly solving for the state. The
equations describing the dynamics of the system are n~lj*ar. it is in general not possible to
phase plane analysis is particularly suited to second order nonlinear systems witli no input or u
obtain a closed form solution of x I, x2. For example, if the spring force is nonlinear say (k ] x +
constant inputs. It can be extended to cover other inputs as well such as ramp inputs, pulse
inputs and impulse inputs. k2x3) the state equation takes the form

7.2 Phase Portraits


From the fundamental theorem of uniqueness of solutions of the: state equations or
differential equations, it can be seen that the solution of the state equation starting from an initial
Solving these equations by integration is no more an easy task. 111such situations, a graphical
state in the state space is unique. This will be true if I,(x"x,) and j, (Xl'X~) are analytic. For method known as the phase-plane method is found to be very helpful. The coordinate plane
such a system, consider the points in the state space at which the derivatives of all the state

Dept. of EEE, SJBIT Page 105 Dept. of EEE, SJBIT Page 106

"
"
Modern Control Theory '. 1(1.EE55 Modern Control Theory lOEE55

with axes that correspond to the dependent variable x I and X2 is callcd'phase-plane. The curve

described by the state point (x ),X2) in the phase-plane with respect to time is called a phase

trajectory. A phase 'trajectory can be easily constructed by graphical techniques.

7.3.1 Isoclines Method:


Let the state equations tor a nonlinear system be in the form
dx2
dxl =-3
r,

Where both t,(-""X,; and t,(,\'"X,; arc analytic. dx2


From the above equation, the slope ofthe trajectory is given by r:di;=-oo
XI

Therefore, the locus of constant slope ofthe trajectory is given by I;(xlox,) ~ Mfl(xl,x,)

The above equation gives the equation to the family of isoclines. For different values of
M, the slope of the trajectory, different isoclines can be drawn in the phase pIane.
Knowing the value of M on a given isoclines, it is easy to draw line segments on each of these
isoclines. . Phase plot
Consider a ~mple linear system with state equations
- x., Figure 7.1

= -~y')- XI
The Procedure for construction of the phase trajectories can be summarised as
below:
Dividing the above equations we get the slope of the state trajectory in the XI-X2plane as
d.1z _-x,-x'_M I. For the given nonlinear differential equation, define the state variables as XI and X2
and obtain the state equations as
;i;. '" x,
2. Detenninc the equation to the isoclines as

For a constant value of this slope say M. we get a set of equations 'dxz '" {(xl'x:) = M
-1
dx, r,
- ... ,_x 3. For typical values ofM, draw a large number of isoclines in XI-X2
(M.;, 1) J
plane
which is a straighi line in the xl-x2 plane. We can draw different lines in the xI-x2 pIane for 4. On each of the isoclines, draw small line segments with a
slope M.
different values of M; called isoclines. If draw sufficiently large number of isoclines to cover the
5. From an initial condition point, draw a trajectory following the line
complete state space as shown, we can see how the state trajectories arc moving in the state segments with slopes M on each of the isoclines.

plane. Different trajectories can be drawn from different initial conditions. A large number of Example 7.1: For the system having the transfer function .'.~,) and a relay with
such trajectories together form a phase portrait. A few typical trajectories arc shown in figure dead zone as nonlinear element, draw the phase trajectory originating from the initial
condition (3,0).
given below.

Dept. ofEEE. SJBIT Page 107 Dept ofEEE, SJBIT Page 108
Modern Control Theory 10EE55 Modern Control Theory 10EE55

Region 3: Q= x, '" -'1

--r
.i...:l;.~v..~
Here u = -I so that on substitution we get x, =- -.\':+1 or r..-~ 1
1..::!'.J..~ ._.~~ u

These are also lines parallel to x - axis at a constant distance decided by the value
of the slope of the trajectory M.
The differential equation for the system is ,,+; -" where u is
given by M 0 113 I 2 3 -5 -4 -3 -2 I

I ,
I

11 -
-!-1 II.>
0 If-l"' ..",
f I 0.75 0.5 113 0.25 -0.25 I -0.33 -0.5
~_~~J
{ -1
tIe'" -1
-t-X,
Since the input is zero, e = r - c = -c and the differential equation in terms of error Region n Region I
will be -11 Region III

;;..f..i- s=o
113
Defining the state variables as X, = e and X2 = ;. we get the state I
equations as 3

.' -5
.' -3
-713
The slope of the trajectory is -2
given by
dA.~ -X ...-JI
dx; - --;;- - 1.1
Figure 7.2: Phase portrait of
Equation to the isoclines is Example I
given by
-x ..-u Isoclines drawn for all three regions arc as shown in figure. It is seen that
.:.t~-~
trajectories from either region I or 2 approach the boundary between the regions
We can identify three regions in the state plane depending on the values of e and approach the origin along a line at -I slope. The state can settle at any value of
=x., x, between -I and + I as this being a dead zone and no further movement to the
origin along the x.-axis will be possible. This will result in a steady state error.
Re ,,= x. ~ 1 the maximum value of which is equal to half the dead zone. However, the
gio
presence of dead zone can reduce the oscillations and result ill u faster response. It,
n
order that the steady state error in the output is reduced, it is better to have as small "
1: dead zone as possible.
Here u = I,so that the isoclines are given by x~ = -.~- J or 1:2 = ,,-. rc
Example 7.2: For the....s.ystcmhaving a closed .1001' transfer function
For different values of M, these are a number of straight lines parallel to the
plot the phase trajectory originating from the initial condition (-1,0).
x-axis.

M The differential equation for the system is


given by
-?,7"-+--:c,-"-~--IO,-----,-----~
i'....

Here u = 0, so that the isoclines are given by x~ = ~ or M = -I. which ate


parallel lines having constant slope of -I. Trajectories are lines of constant slope -I.
Dept. of EEE. 518IT Page 109 Dept. ofEEE. 518iT Page 110

..
Modern Control Theory lOEE55 Modern Control Theory lOEE55
The slope of the trajectory
is given by
dx~ _ -2x~ - 5'''"1 ~ If ..,.A,1

dX1 ...",

-SXt 10
.".1,,'" -;;-::;:-;+ ,~.,_;__?
When~Xl= 0,
"
-Sx, 10 "
-;:;;-:;; 4- :v-:;:; - 0 or X t - 1

ie., all the isoclines will pass through the point x,


= 2, X, = O. When M = 0,
-s 10
x: ---;--\I-i--:;-
When M = 2, When M = 4, When M = 8,
-~ In
x. -""4'\'-4'

_ c: 111
Figure 7.3
X, -~Xl';"~ The isoclines are drawn as shown in figure. The starting point of the trajectory is marked at (_
1,0). At (-1,0), the slope is co, ie., the trajectory will start at an angle 90. From the
next isoclines, the average slope is (8+4)/2 = 6, ie., a line segment with a slope 6 is drawn (at an
-c: in angle 80.5).The same procedure is repeated and the complete phase trajectory will be obtained
x' - W'\j -e- 1ii as shown in figure.
7.3.2 Delta Method:
When M = -2', When M = -4, The delta method of constructing phase trajectories is applied to systems of the form
:C. - (C " ..;.j(x.x.tJ-~
2 Where fL".",t") , may be linear or nonlinear and may even be time varying but must be
continuous and single valued.
S I,'
"\'-iA,-- With the help of this method, phase trajectory for any system with step or ramp or any time
"
"". varying isput can' bc conveniently drawn. The method results in considerable time saving when
When M = -6, When M = -10, a single or a few phase trajectories are required rather than a complete phase portrait.

<; III While appl~n~ the delta method, the above equation is first converted to the form
x: ='4""-4 .'i -+ Cl~[X +
In general, 8(x,f.~f'd~tJJds llpon the variables x, ,. and t, but for short intervals the
<; I,' changes in th,se variables are negligible. Thus over a short interval, we have
x: =fix,-R' fiJ i' ~S(Q' +is a eolil;tant.
Let us choose the state variables as x, = X; ~, - x/lAJ", then
~TL =~X2

12 - -W'/~l + e;
Dept. of EEE. SJBIT
Page 111 Dept of EEE, SJBIT
Page 112
..
Modern Control Theory lOEESS Modern Control Theory IOEE55

Therefore, the slope equation over a short interval is given by


dx: _ Xc +8 7.4 Limit Cycles:
dXl Xl) Limit cycles have a distinct geometric configuration in the phase plane portrait, namely,
With known at any point P on the trajectory and assumed constant for 'a short interval, that of an isolated closed path in the phase plane. A given system may have more than
we can draw a short segment of the trajectory by using the trajectory slope dX2/dxI given one limit cycle. A limit cycle represents a steady state oscillation, to which or from
in the above equation. A simple geometrical construction given below can be used for which all trajectories nearby will converge or diverge. In a nonlinear system, limit cycles
this purpose. describes the amplitude amrperiod of a self sustained oscillation. [t should be pointed out
1. From the initial point, calculate the value of . that not all closed curves in the phase plane are limit cycles. A phase-plane portrait of a
2. Draw a short arc segment through the initial point with (- , 0) as centre, conservative system, in which there is no damping to dissipate energy, is a continuous
thereby determining a new point on the trajectory. . family of closed curves. Closed curves of this kind arc not limit cycles because none of
3. Repeat the process at the new point and continue. these curves are isolated from one another. Such trajectories always occur as a
continuous family so that there are closed curves in any neighbourhood of any particular
closed curve. On the other hand, limit cycles are periodic motions exhibited only by
Example 7.3: For the system described by the equation given below, construct the nonlinear non conservative systems.
trajectory starting-at-the initial point (I, 0) using delta method.
As an example, let us consider the well known Vander Poi's differential equation
J( 4- ; + :.\.~ n
'=

Xi -Xl which describes physical situations in many nonlinear systems. In terms of the Slatevariables
""\~~
- -X., - x; A, - T c,ncf .:t_: - i., we obtain
The above equation can be rearranged as
- x~
""
x:--rx,-!-x .;....~-X,)
So that ,~- x, +."r-x, The figure shows the phase trajectories of the system for > 0 and < 0. In case of > 0 we
At initial point is calculated as = 0+ I- I = O. Therefore, the initial arc is centred at observe that for large values of x,(O), the system response is damped and the amplitude or
point (0, 0). The mean value of the coordinates of the two ends of the arc is used to x,(t) decreases till the system state enters the limit cycle as shown by the outer trajectory. On the
calculate the next value of and the procedure is continued. By constructing the small other hand, if initially XI(O)is small, the damping is negative. and hence the amplitude of x,(I)
arcs in this way the complete trajectory will be obtained as shown in figure. increases till the system state enters the limit cycle as shown by the inner trajectory, When < 0,
the trajectories moves in the opposite directions as shown in figure.

Unstable
limit
cycle

(i) II> 0 (ii) u <0

Figure 7.5
A limit cycle is called stable if trajectories near the limit cycle, originating from outside
Figure 7.4 or inside, converge to that limit cycle. In this case, the system exhibits a sustained

Dept. of EEE. SJBIT Page 113 Dept. of EEE. SJBIT Page 114

:
Modern Control Theory lOEE55 Modern Control Theory lOEE55
oscillation with constant amplitude. This is sliown in figure (i). The inside of the limit cycle is
an unstable region' in the sense that trajectories diverge to the limit cycle, and the outside is a Where, k, = ( 2/ i) 0 so that the trajectories
stable region in the sense that trajectories converge to the limit cycle. become a set of parabola as shown in figure (b) and
the equilibrium point is called a node. In the
A limit cycle is called an unstable one if trajectories near it diverge from this limit cycle. In this
case, an unstable region surrounds a stable region. If a trajectory starts within the stable region, it original system of coordinates, these trajectories
appear to be skewed as shown in figure (c).
converges to a singular point within the limit cycle. If a trajectory starts in the unstable region. it
diverges with time to infinity as shown in figure (ii). The inside of an unstable limit cycle is the If the eigen values are both positive, the nature of
stable region. and the outside the unstable region. \ -( \ \ the trajectories does not change, except that the
7.5 Analysis and ClassifIcation of Singular Points: ~ . J\\i 7',
>~. trajectories diverge out from the equilibrium point
as both ZI(t) and Z2(t) are increasing exponentially.
Singular points are points in the slate plane where x', f: .,rAt these points the slope of the \ \ ,," The phase trajectories in the XI-X] plane are as
trajectory dx)/dx, is indeterminate. These points can also be the equilibrium points of the ('1'........ ""....... shown in figure (d). This type of singularity is
nonlinear system depending whether the state trajectories can reach these or not. Consider a ;".._, - identified as a node, but it is an unstable node as the
lincariscd second order system represented by . r trajectories diverge from the equi!ibrium point.

-
Using linear transformation x = Mz, the equation can be transformed to canonical fonn
:
;
i
(.,""...........---
"
Saddle Point:
Consider now a system with eigen values are real.
distinct one positive and one negative. Here, one of
the states corresponding to the negative eigen value
converges and the one corresponding to positive eigen value diverges so that the
trajectories are given by Z2 = C(ZI)'kor (Z,)kZ2 = c which is an equation to a rectangular
Where, ,and ,are the roots of the characteristic equation of the s~. hyperbola for positive values of k. The location of the eigen values, the phase portrait in
The transformation given simply transforms the coordinate axes from X'-X2 plane to ZI-Z2plane ZI - Z2 plane and in the x, - X2 plane are as shown in figure. The equilibrium point
having the same origin, but docs not affect thc nature of the roots of the characteristic around which the trajectories are of this type is called a saddle point.
equation. Thc phase trajectories obtained by using this transformed state equatjon still carry the
same information except that the trajectories may be skewed or stretched along the coordinate
axes.In general, the new coordinate axes will not be rectangular. jrll
The solution to the state equation being given by

z,lt,- ,,\"z.,(U'
The slope of the trajectory in the z, - z, plane is given by
1:""
(a) Location of cigcnl'l1uc.1

dz: _ l:z, _'!""~


a'Zl ll=l
(b) Saddle
pointin (tl.t,)plane

XI
.'
Based on the nature of these cigcn values and the trajectory in z, - z, plane, tho sihgular
points arc classified as follows.
Nodal Point:
(e)Saddlepointin ("" xv-plane
Consider cigen values arc real, distinct and negative as shown in figure (a). For this case
the equation of the phase trajectory follows as =:
= =J" .Phase trajectories around saddle point

Dept. of EEE, Sj BIT


Page 115 Dept of EEE, Sj BIT
Page 116
Modern Control Theory lOEESS
Modern Control Theory lOEESS
Focus Point: Figure 7.7
dy, = j''')'l = _ 2:!
Consider a system with complex conjugate eigen values. The canonical form of the state dy, =lwv y,
equation can be written as
Centre or Vortex Point: Figure 7.8
[!~]= [a ~iw <1:: .,
Using linear transformation, the equation becomes Consider now the case of complex conjugate eigen values with zero real parts. ie., I, 2 = j

Integrating the above equation, we get .Y,~ +y,; = 1<2 which is an equation to,a
The slope circle of radius R. The radius R can be evaluated from the initial conditions. The
trajectories are thus concentric circles in YI-Y2 plane and ellipses in the XI-X,
dyz -cuYI + aX2 _ Yz - kYl plane as shown in figure. Such a singular points, around which the state
dy, - a)l, + wy, )', - k"z trajectories are concentric circles or ellipses, are called a centre or vortex,

ann &- tan 6 joo


Y1.
We get,
:
lanll -It
tal1l/J - 11 kton{} nr tal1(ll- .t.; ~ t
This is an equation for a spiral in the polar coordinates. A plot of this equation : for negative
values of real part is a family of equiangular spirals. The origin which is a singular point in this (a) Elgen values (b) Center in)'1 )'2 plane (cj Cemer in .tlX2 plane
case is called a stable focus. When the eigen values are complex conjqgate with positive real
parts, the phase portrait consists of expanding spirals as shown in figure and the singular point is Phasetrajectoriesaround vortexor ct!~ter
an unstable focus. When transformed into the X,-X2 plane, the phase portrait in the above two
cases is essentially spiralling in nature, except that the spirals are now somewhat twisted in shape. Figure 7.9
Example 7.4:
1M
D,',terlpinethe kind,of singularity for the following diffcrential equation.
y.+ 3,- + tv - n

.,,
-o.-jtA
Let the state variables be x, - v ami
The corresponding state model is
-"!: .i .

..\';1 - x ..
(b) Ph.. u.nw:rmes!UDl>le b.."lr.I

PhHf!traiettctesaround stal::ft:fotU$ .i-, - -3'1'- 2x,


',At si~glllar ~oints, '\:1 - X::! = nand kr -3,.\:['" l.rF (,

Therefore, the singular point is at (0,0)


A _ [n-7 -:L
1 -

.
,
-/<0
The characteristic equation is I-A =0

. II.2
i.e,
-I
;.+:.1
- n or
(b)Ptluetmjec:tnfieltntable incus
Ph.le tr"je<.t.o1Jes
.round unsteble focus I, 2 = -2, -I. Since the roots are real and negative, the type or singular point is stable
node.

Dept. of EEE, SJBIT Page 117 Dept. ofEEE, SJBIT Page 118
Modern Control Theory lOEESS
Modern Control Theory
..
Example 7.S: For the nonlinear system having differential equation;
. lOEESS
..
.'
Example 7_~:
Determine tlie kind of singularity for the following differential equation.
y- (n.l
, ,
_.!j,2)y +]. _),2 ~ O. find all singularities.
r.;- O.5:i: + 2.- + r2 =0
Defining the state variables as l' = X " 'I' = x" the state equations are
Let the statevariables be x 1 = x ulu.t x, = i-
The,correspondihg state model is
x, := x 2 :

At singular points, ;\,I ,." :Y~ = (l a.nd x~ = -x ~ O.lx. - .1:f -7- x~ =0


.t:; = e-O.5.~'2 - ZX1 - x r
So that the singular points ~, - o'1r",,-' - X, - < _" !.e x_(Xt + 1: - R
At si~gular points, Xl - X, - 0 a...:1 i;

i :e; .:':l=Ol",'-I I So tfiat rhe singuler points y, -On ...d -2"",-,,,; i....,x,(x,.,I.2) _ 0

The singularities are thus at (0,0) and i.e; ~"':l~nor-?


(-1,0). Line'ruizationabout the The singularities are thus at (0,0) and (_

singularities: 2.0). Lineari~ation about the


singularities:

at'df. a:
d!'j - [-(2 ,~ ,
The Jacobean matrix J =
11 1 -'lox~l The Jacobean matrix J =
.;};"a:;- (]

Linearization around (0,0), i.e., substituting XI = 0 and X2 = 0


l ..:.!.1. ..:.:.J..
dNa. d.!:!
...,. ~Xl~

Linearization around (0,0), i.e., substituting XI = 0 and X2 =0


I I
011 . /(0.0) [0
". -:4
1
-u.s.
The characteristic equation is I- A = 0
The characteristic equation is I- A =0
/
Ai .. -1
) - nt
1- r

I
l2 -1
..;+ 0"
1= r
i.e., ( -0.1)+ I = 0 or '- 0.1 + I = 0
i.e., ( + 0.5) + 2 = 0 or 2 + 0.5 + 2 = 0
AHA, - O.S( 11 1 + jv'J.99;
A,.A. - (-O.2~ =i Jl.:i',J'
The cigen values arc complex with positive real part. The singular point is an
unstable focus. The eigen values are complex with negative real parts. The singular point is a
stable focus.
Linearization around (-1,0)

J(-I.O; - r~ 11
1 1
II
Linearization around (-2 0)

I( -7..0; - [~
1 .
_flO;
The characteristic equation will be
The characteristic equation will be
I )1 -'1
-\-01
1- n
1 -1 I
Therefore 2 _ 0.1 _ I = 0 1 -1 ,(+0." - n
Therefore 2 + 0.5 _2 = 0
I. 2 = 1.05 and -0.98. Since the roots arc real and one negative and another
positive, the singular point is a saddle point. I, 2 = 1.19.'and -1.69. Since the roots are real and one negative and another positive.
the singular point is a saddle point.
Dept. of EEE, SjBIT
Page 119 Dept. of EEE. SI BIT
Page 120

... -_.__ ._----

-
.'

Modern Control Theory 10EE55 Modern Control Theory 10EE55

UNIT-8: STABILITY ANALYSIS


'.
UNIT-S
Liapunov stability criteria, Liapunov functions, direct method of Liapunov &: the linear system,
Hurwitz criterion & Liapunov's direct method, construction of Liapunov functions for nonlinear
system by Krasvskii's method. tc}

6 Hours

For linear time invariant (LTI) systems, the concept of stability is simple and can be
formalised as per the following two notions:

a) A system is stable with zero input and arbitrary initial conditions if the resulting trajectory
tends towards the equilibrium state.
b) A system is stable if with bounded input, the system output is bounded.
Fig. 8.1 Global and local stability

In nonlinear systems, unfortunately, there is no definite correspondence between the


Equilibrium State: In the system of equation ,. = rex.
r), a state x, wherej(x,.t) = 0 for all
't' is called an equilibrium state of the system. If the system is linear time invariant, nal11ely./(x,t)~~
two notions. The linear autonomous systems have only one equilibrium state and their Ax, then there exists only one equilibrium state if 'A' is non-singular and there exist infinitely many
equilibrium states if 'A' is singular. For nonlinear systems, there may be one or more equilibrium
behaviour about the equilibrium state completely determines the qualitative behaviour in the states. Any isolated equilibrium slate can he
shifted to the origin of the coordinates, or/(O,I) = 0, by a translation or coordinates. flit
entire state plane. In nonlinear systems, on the other hand, system behaviour for small
S.2 Stabilicy'Definitions:
deviations about the equilibrium point may be different from that for large, deviations.
The Russian ~;thematician A.M, Liapunov has clearly defined the different types of stability.
Therefore, local stability does not imply stability in the overall state plane and the two These are discussed belGw,
concepts should be considered separately. Secondly, in a nonlinear system with multiple Stability: An equilibrium state x, ofthe system .. = f(x, t~ is said to be stable if for each real
equilibrium states, the system trajectories may move away from one equilibrium point and
number
> 0 there is a real number (,/(1) > such that lI.r, - .i<]1pkeS'{I"" t;x", t.,'
for all t to. The real""W)Ue~ .,dependson and in general, also depends on to. If docs not depend
tend to other as time progresses. Thus it appears that in case of nonlinear isystems, there is no on to, the equilibrium state is said to be uni formly stuble'.
point in talking about system stability. More meaningful will be to talk about the stability of An equilibrium state x; of the system of equation i. - Iix, t:
is said to be stable in the
sense of Liapunov il; corresponding to each S( ). there is an S( ) such that trajectories starting in S(
an equilibrium point. Stability in the region close to the equilibrium point or in the ) do not leave S( ) as t increases indefinitely,
neighbourhood of equilibrium point is called stability in the small. For a larger region around Asymptotic Stability: An equilibrium state x, of the system _. - (!;c,!.) is said to be
the equilibrium point, the stability may be referred to as stability in .the large. In the asymptotically stable, if it is stable in the sense of Liapunov and every solution starting within S( )
converges, without leaving S( ), to x, as 't' increases indefinitely.
extreme case, we can talk about the stability of a trajectory starting from anywhere in the Asymptotic Stability in the Large: If asymptotic stability holds for all states from
complete state space, this being called global stability. A simple physical illustration of different which trajectories originate, the equilibrium state is said to be asymptotically stable in the large. An
equilibrium state x,- of the system ft x.n
.It;-<;aid to be asymptotically stable in the
types of stability is shown in Fig. 8.1 large, if it is stable and if every solution converges to x,, as 'r' increases indefinitely. Obviously a
necessary condition for asymptotic stability in the large is that there is only one equilibrium state in
the whole state space, ~

Dept. of EEE, SJBIT Page 121 Dept. of EEE, SJBIT Page 122
Mo~_ern Control Theory lOEE55 Modern Control Theory 10EE55
The above said definiuons are represented graphically in Fig. 8.2
A scalar function Vex) is said to be negative semi-definite in a region if it is negative for all
states in the region: and except at the origin and at certain other states, where it is zero.
A scalar function Vex) is said to be indefinite if in the region it assumes both positive and
negative values, no matter how small the region is.
Examples:

Vex) = C.l, + X,)l Fosit:l1~ semi def'mtte,

Vex) - -(x1'+x~) Negatitle def tnite.


Vex) = -xf- (3x, + 2x,)l /legative cUJfinite
V(x) = -:r) + ,,)2 Nel1C1tivesemi definite.
Vex) = x-:xJ + x; tndefintte.
Fig. 8.2 Liapunov's Stability 8.4.2 Sylvester's Criteria for Definiteness:
Instability: An equilibrium state .\'" is said to be unstable, if for some real number > 0 and any A necessary and sufficient condition in order that the quadratic form xTAx, where A is an nxn
real number > O. no matter how small, there is always a state XII in S( ) such that the trajectory real symmetric matrix, be positive definite is that the determinant of A be positive and the
starting at this state leaves S( ). successive principal minors of the determinant of A be positive.

8.3 Stability by the Method of Liapunov


Russian mathematician A.M., Liapuuov has proposed a few theorems for the study of stability
a" ~ 0,
a~l rp (112/ ~.
ClO?
0, 1"11
t?:.a
a:~

a., au/
If....,
:: ~. 0.......... rl1aT' au
a" lit"
a 1 "1 ;...0

of the system. The most popular among this is ealled the "Second Method of Liapunov" or
0"
a"l (I., Sl......

"Direct Method of'Liapunov". ' This method is very general in its A necessary and sum bent condition in order that the quadratic form xTAx, where A is an nxn real
formulation and can be used 10 study of stability of linear or nonlinear systems. The method symmetric matrix,. be negative definite is that the determinant of A be positive if n is even and
is called 'direct' method as it docs nut involve the solution of tile system diffct1lbti~1 negative if n is odd, and the successive principal minors of even order be positive and the
equations and stability information is available without solving the equations which is successive principal minors of odd order be negative.
definitely an advantage for nonlinear systems. The stability information obtained by
this method is precise and involved no approximation.
First .Met~d of Liapunov: . The first method of Liapunov, though rarely talked about, is e
essentially 3 theorem stating the conditions under which system stability information can be
inferred by examining the simplified equations obtained through local linearization. This
theorem is applicable only to autonomous systems. n
8.4 Sign Definiteness
: il-1"
Let V(x" Xl, Xl, Xn) be a scalar function of the state variables x, Xl, Xl, , x., Then
the following definitions arc useful for the discussion of Liapunov's second method. : a~. -c 0.......... IAI '" 0 :fn If n
~ a'Q
8.4.1 Scalar Functions:
A scalar function V(x) is said to be positive definite in a region A necessary and sufficient condition in order that the quadratic form XT Ax, where A is an nxn real
if Vex) > 0 for all nonzero symmetric matrix, be positive semi-definite is that the determinant of A be singular and the
states x in the region and V(O)~ O.
successive principal minors of the determinant of A be nonnegative.
A scalar function Vex) is said to be negative definite in a region if Vex) < 0 for all nonzero i.e.,
states x in the region and V(O)= O.
A scalar function V(x) is said to be positive semi-definite in a region if it is positive for all all
states in the region and except at the origin and at certain other states, where it is zero. a., l
:> 0..U-21

Dept. of EEE, 5J81T


Page 123 Dept. of EEE. 5JBIT
Page 124
.'

Modern Control Theory Modern ControfTheory lOEE55

consideration at the origin of the state space.


A necessary and sufficient condition in order that the quadratic form xT Ax, where A is an nxn real Theorem I: Suppose that a system is described by - tix.t ; wheref(O.t) ~ 0 for all l.
symmetric matrix, be negative semi-definite is that the determinant of A besingularand all the If there exists a scalar function V(x,t) having continuous first partial derivatives and
principal minors of even order be nonnegative and those of odd orders be non positive, satisfying the following conditions.
I. V(X,I) is positive definite

311 < 0, lau O"I>v, la:1ll


a.::.'l'
a.~ Q:m aUI lau
a",
a'' 1
a:n 2. V(x,t~ Is negat1\edeflnlt.
n:a n
O-DL allla.. a.,
0_1.,

n~! a.~ Then the equilibrium state at the origin is uniformly asymptotically stable. If in addition,
V(x,1) .....00 a-s Uxl! .....00 then the equilibrium state at the origin is uniformly
Example 8.1: Using Sylvester's criteria, determine the sign definiteness of the asymptotically stable in the large.
following quadratic forms A visual analogy may be obtained by considering the surface ~'= ~x; + ~kxi'- This is a
lOxi + x# + + 4-"1X, + 6r,x. + 1x.x, cup shaped surface as shown. The constant V loci are ellipses on the surface of the cup.
Let (,,~, ,g) be the li1ITiiit1:ondition. If one plots trajectory on the surface shown, the

Successive
2l-Y~]
1 1
1 .j.
t IAI:> n

principal
point of the cup which is the equilibrium point.
..
representative point X(I) crosses the constant V curves and moves towards the lowest

minors arel~o 2"> n


1
10""0;

Hence the given quadratic form is positive


definite.

Example 8.3: -''\:1 .


1'x~x!l

A _
-1
[-t
1 _< -1] 1."",- n
-2 ~1~
Successive principal minors are
-I
-3
11 ", n

Hence the quadratic form is negative definite.

8.5 Second Method of Liapunov


The second method of Liapunov is based on a generalization of the idea that if the system has an
asymptotically stable equilibrium state, then the stored energy of the system displaced within the
domain of attraction decays with increasing time until it finally assumes its minimum value at the
equilibrium state. The second method of Liapunov consists of determination of a fictitious energy
function called a Liapunov function. The idea of the Liapunov function is more general than that of Fig. 8.3 Energy function and movement of states
energy and is more widely applicable. Liapunov functions are functions of XI. X2, .X3, ; Xn.- and t.
Theorem 2: Suppose that a system is described bye - {(x.t:' whcrcj(O,t) ~ 0 f~ all t
We denote Liapunov functions V(xt. xi, X3, , xn, t) or V(X,f) or Vex) if functions do not include t O. If there exists a scalar function V(x,t) having continuous tirst partial derivatives and
explicitly. In the second method of Liapunov the sign behaviours ofV(x.l) and its time derivative I:'(x,r') satisfying the following conditions.
give information on stability, asymptotic stability or instability of the equilibrium state under
I. Vr.-.:,1) is positive definite
Dept. ofEEE, SJBIT Page 125 Dept. ofEEE, SJBIT Page 126
Modern Control Theory iOEESS Modern Control Theory lOEESS

2. ~!(XJ' t.~ is ut!'!i:allvt! GQmid"nn.ih~ Let us choose another V(,,) = xl+ 2x;
1-~(0Ct,xc.to).( does not vanish identically in t to lor any to and any xn Then Vex) -' 4x1.1:1+ h,;i,- 4).';'(.(,1+
4X,( -,Y, - x~) -
0, wheJ0(t. X, . tc'; denotes the trajectory or solution starting from XII at tu.
This is negative semi definite function. lfV(,,) is to be vanish identically for t to, then
Then the equilibrium state at the origin of the system is uniformly asymptotically stable in X2 must be zero for all t 10. :. i., - II. Tlu",,i, - -x, - .~: - !l !.~." 1must l!~zero
the large.
This means that V(;~) vanishes identically only at the origin. Hence the equilibrium state
If however, there exists a positive definite scalar function V(x,t) such that V(~.[) is at the origin is asymptotically stable in the large.
identically zero, then the system can remain in a limit cycle. The cquilibriqw;!state at the
origin, in this case, is said to be stable in the sense of Liapunov. Example 8.7: Consider a nonlinear system governed by the state equations

Theorem 3: Suppose that a system is described by x = f(x,t: where j(O,t) = 0 lor all t = -x,
to. If there exists a scalar function W(.r,t) having continuous first partial derivatives and
satisfying the following conditions Let us choose ~'(x) = xr+xi
I. IV(x.1) is positive definite in some region about the origin.
Then vex) =' 2x,x, + Zx,:i";, 'l'\l( -x, +
2. ~-V:"',t; is positive definite in the same region, then the equilibrium stateat
the origin is unstable. = -2XI -I: 1,..1x: - J"'i = -:lxf( 1- 2X1XZ)

LEI. V(x~ """yaU"" ':.[lnlw if (1- 2x,x,l '> R

'"
Example M.4: Determine the stability of following system using Liapunov's method.
Therefore, for asymptotic stability we require that the above condition is satisfied. The

Let us choose ~'(x) = :'f~"" xi region of state space where this condition is not satisfied is possibly the region of
instability. Let us concentrate on the region of state J space wIn:fe this condition is
satisfied. The limiting condition for such a region is.The dividing lines lie in the first and
third quadrants and are rectangular hyperbolas as shown in Figure. 8.4. In the second and
This is negative definite. Hence the system is asymptotically stable.

Example 8.5: Determine the stability of following system using Liapundv'a method.
fourth quadrants, the .
. inequality is satisfied for all values ofx I
region of stabiJity and' possible instability.
and X2. Figure 8.4 shows the

Since the choice of Liapunov function is not

Let us choose V(:l) - xZ..;.. .rj


.'
.'
unique, .
it' may be. possible to choose another
consideration which yields a larger region of stability.
Liapunov function for the system under

Then (~(X) = 2xt,\',,,,, 2x:~ 2x:l""! 2x.,1-Xl - x ..: ::= -7.1::;


.',
This is a negative semi definite function. If Vi x) is to be vanish identically tor t to, then
x: must be zero for all l to. . 3:1 - (I. Thor: :\'1 - -x, - x ...- (l i. f1.'i:J. nUist 7:Je=9'1"0.
Stable qundmnl
This means that ~)ix.'vanishes identically only at the origin. Hence the equilibrium state
at the origin is asymptotically stable in the large.

Example 8.6: Determine: tI\"c stability of following system using Liapunov's method.
"
S,abJequad,.,,,
Let liS choose V(X) - x7 ..;...r.~
-xT!
This is an indefinite function.

Dept. of EEE, SJBIT Page 127 Dept of EEE. Sj BIT Page 128

'.
Modern eory

Copclusions: Example 8.8: Determine the stability of the system


described by
I. Failure in finding a 'V' function to show stability or asymptotic stability or
instability of the equilibrium state under consideration can give no information on
stability.
2. Although a particular V function may prove that the equilibrium state
under consideration is stable or asymptotically stable in the region ,which includes Assume a Liapunov function Vex) =

this equilibrium state, it does not necessarily mean that the motions are unstable x'rx
outside the region . ATp-j. pj. --1
3. For a stable or asymptotically stable equilibrium state, a V function with the
required properties always exists. [
I'll l'11.
[ F,
t:
1'121 o
P..1
[ nI -1.11'' 1'12
-I ~" -I

8.6 Stability Analysis of Linear Systems f... -2P., P." -~, - P,,] ~ [-1
Theorem: The equilibrium state x = 0 of the system given by equation 1: = A x is
LFI! - P':Ji- ?P" 21'" n
asymptotically stable if and only if given any positive definite Hermitian matrix Q (or -2P'2 =-1
positive definite real symmetric matrix), there exists a positive definite Hermitian matrix P
(or positive definite real symmetric matrix) such that A'P + PA = -Q. The scalar P" - PI2 - P22 = 0
function x:' Px is a Liapunov function for the system. 2PI2-2Pn=-1
V(,t} = "'p,, Solving the above equations,
v(~l = x'Px + k'PX = (A.,\}Px";' x'PAx = ~.A' P::: + ,,'FAx PII = 1.5; PI2 ~ 0.5; and
P22 = I
where Q = (A'P + PAl
:. P _ [1.~ 0.5]
O.~ 1.0
Hence, for the asymptotic stability of the system of .f - A", it is sufticient that Q be 1.5 > 0 and det(P) > O. Therefore. P is positive define. Hence, the equilibrium
positive definite. Instead of first specifying a positive definite matrix P and examining state at origin is asymptotically stable in the large.
whether or not Q is positive definite, it is convenient to specify a positive definite matrix
Q first and then examine whether or not P determined from ,.q.1I'is -elso positive The Liapunoy function Vex) =
definite. Note that P being positive definite is a necessary condition. . x'rx
:
0.5' [X(
1.0. Y,.
.tilW::
I. If tI'(~) -x'Qx does not vanish identically along any trajectory, then:Q may = o.S(3xf +'2Xl:C~ + 2x;.)
be chosen to be positive semi definite. . , l'(x! = nS[6., ", + 71',( -.r, - ":) + lx,,,,, +- 4>::t.+x I
2. In determining whether or not there exists a positive definite Hermitian or
real symmetric matrix P, it is convenient to choose Q = I, where I is the identity = -(:::f.+x;)
matrix. Then the elements of P are determined ,fJ'<Jml. JU - _I and the matrix P is
tested for positive definiteness. Jl:xam'ple8.9: Determine the stability of the equilibrium state of the following system.

X]
. [~ ":' -1+}
r-?
.
A'P+PfJ- -T

-? il
.
.- I';'
r -l-j -3
OJ
-{

Dept. ofEEE, SIBIT Page 129 Dept. of EEE,SIBIT' Page 130


"
Modern Control Theory lOEE55 Modern Contrai Theory lOEE55
ExaO:ple 8.U: Determine the stability range for the gain K of the system given below.
4P" + (I - j)P'2 + (I+j)P21 = I
':] [n: '1 0]1 [Xl]z, + ~]0
(I - j)P" + 5P2, +(1 - j)P22 = 0
~x: - 0; -2
Jt -k 11 -1
X
x" .
[1IJ

(I +j)P" +5P'2 +(1 +j)P22 =0


In determining the stability range ofk, we assume u = O.

Solving the above equations,

PI' = 3/8; P12 = - (I + j)/S; P'2 =- (I -j)/8; P22 = 1/4


Let us choose Q -l~ n OJ
n
n
0
1
a positive semi definite real symmetric matrix

O.:'I7~ -O.1:!~ - }u.n~l This choice is permissible since V-:x.l - -x'Qxcannot be identically equal to zero
.' p-
r-0125 + 10.1.25 (t.25
except at the origin. To verify this, note that

P is positive definite. Hence the origin oftbe system is asymptotically stable.

~'(,,) being identically zero implies that X3 is identically zero. If X3 is identically zero,
then x, must be must be zero since we have 0 = - kx, - O. If XI is identically zero, then X2
Example 8.,10: Determine the stability of the system described by
must also be identically zero since 0 = X2. Thus Vex) is identically zero only at the
[~Jl- r-1'
x -: I
-'J'
-J..
[;'(1"
X,.
origin. Hence we may use the Q matrix defined by a psd matrix.

Let us solve,
Assume it Liapunov function V(x) = XTpX
;;1'0 -+ .0.< - =I
-~n -k] ~"
0 ?Zl
n
o
IT 1 -1 .tt

[
-I
-2
."
i'''lr
P.,
fI]
-1
n

-2P" + 2P'2 =-1 i.e., -kp13-kpJJ =0


-2P" -5P'2 + Pn =0 -kp23 + PII-2pl1 =0
-4P'2 -.8P22 =-1 -kp33 + PI} -PI3 = 0
Solving the above equations, PI! -;2p}} + PI! - 2pn = 0
PII = 23/60; P'2 = -7/60; and P22 = 11/60 PJJ -: 2P23 + PZ2 =trn = 0
PlJ -,P13 + P2J - PJJ = -1
:.p=-1 Z3
liO -7
I -7J
II Solving the above equations, we get

23 > 0 and detj P) > 0, Therefore, P, isposTfive'lenfjc.-H~IICe,1he eqUIlibrium P=~


1 [k' + 12k 3kk
lik it0]
state at origin is asymptotically stable in the large. ,0 6

For P to be positivf,kdefinite, it is necessary and sufficient that 12 - 2k > 0 and k> 0 or


o < k <6. Thus fo} 0 < k <6, the system is stable; that is, the origin is asymptotically
stable in the Iarge,

Dept. of EEE,SJBIT
Page 131 Dept of EEE,SJBIT
Page 132
Modern Control Theory 10EE55 Modern Control Theory 10EE55

If f;x) is negative definite. we see that \',xl is negative definite. Hence V(x)is a
8.7 Stability Analysis of Nonlinear Systems Liapunov function. Therefore, the origin is asymptotically stable. If FC \" - /'(x)f(x)
In a linear free dynamic system if the equilibrium state is locally asymptotically s.table,then it is tends ,to infinity as II.,II - ,'r .' then the equilibrium state is asymptotically stable in the
asymptotically stable in the large. In a nonlinear free dynamic system, however, an equilibrium large, .
state can be locally asymptotically stable without being asymptotically stable in the large. Example 8.12: Using Krasovskii's theorem. examine the stability of the equilibrium stare x
Hence implications of asymptotic stability of equilibrium states of linear systems and those of ::11,0or.the system gt ven by ~:i::t - -x, jJ ad ;\:::e- X'I - ::r...- :.~
nonlinear systems are quite different. .
If we are to examine asymptotic stability of equilibrium states of non linear systems, stability .
f(:r) -
[ r _
-):
y '__ .]
analysis of linearised models of nonlinear systems is completely inadequate. We must investigate t "'\">"I ".!,)

nonlinear systems without linearization. Several methods based on the: second method of
Liapunov are available for this purpose. They include Krasovskii's method for "<:sting sufficient The Jacobian matrix is given by
conditions for asymptotic stability of nonlinear systems, Schultz - Gibson's variable gradient
method for generating Liapunov functions etc. .
J(rasoyskii's Method:
Consider the system defined by ,;,- trr), where x is an n-dimensional vector. Assume
that f(0) = 0 and that f{x) is differentiable with respect to Xi where, I = i,2,3, ..... ,n. The
Jacobian matrix F(x) for the system is
I'(,K,} - F'Ct) + F(: ....).
ail ail cfl
aXl

ah cf:
ax: i);<.
afl
- [-'n - I-
'1:h'; + 1_' I -1 -
'n 1
1\';

F(x) - ax! ax: dx"


-? 1
- [1 -2 - 6x;

oin eir. cf. This is a negative definite matrix and hence the equilibrium state is asymptotically stable.
X1 ax.. ch... fT:,,)f(xl - x; I (.~, x-, ~!)' "A ashll ,eA. Thereforetheequilibriu:,state is
Define = r '(x) of- /'(x). wl:el'eFF.(::tl) is the conjugate transpose .of F(x). If the asymptotically stable in the large.
Hermitian matrix f.(x~ is negative definite, then the equilibrium state x ~ 0 is
asymptotically stable. A Liapunov function for this system is ~'(x:- . f(x)f(xJ. If Example 8.13: Using Krasovskii's theorem, examine the stability of the equilibrium state
in addition f'(x)f(':e)"" ". IIxll then the equilibrium state is
x = 0 of the system given by
asymptotically stable in the large.
Proof: r:t".,..)_ [ -3,.,. + x,,'il ]
If !tx) is negative definite for all x 0, the determinant of f is nonzero everywhere )'I-.t2-X,~

except at x = O. There is no other equilibrium state than x = 0 in the entire state space.
Since f(0) = 0, f{x) 0 for x 0, and Vex) =f'(x)f(x1 is positive definite. Note that F(,,) = r -'l
l' _I_::I;:~
I I
I(x) - F(x)i< - p( r)f(r) .
We can obtain Ii' as f'(~) ..... Ff(x) 1 r(:~)
, "
Vex) - f'(x)f(x) .'
+ f'(x)!(x; '"' [F(x)f(_")!'f(x) + {'(x)F(x),fLy)
= [,(x)[F'(x) + F(xjlf(x;
'"'f'(x)f(x)f(x:
This is a negative definite matrix and hence the cq?ilibrium state is asymp.toticallystable.

Dept. of EEE,SIBIT Page 133 Dept. of EEE,SIBIT Page 134


lOEE55
Modern Control Theory
lOEE55
equilibrium state is asymptotically stable in the large. Question Bank
UNIT 1& 2
1) Compare modern control theory with conventional control theory (Jan 2010).

'. 2) Determine state model for given transfer function (Jan 2007)

C(S) 24
". R(S) s3 + 982 + 26s +24

3) Determine state model for given transfer function (June 2007)

C(S) s2 +7S +2
R(S) s3 + 952 + 268 +24

4.) Develop a state model in Cascading form (June 2009)

C(S) 24
R(S) s3 + 982 + 26s +24
24
(8 +2) (8+3) (S+4)

UNIT 3 &4
1) What is STM? Obtain the state transition matrix using power series method (Dec 09)
(Jan 2010)

a) A =[ 0
-I
J
.I
-2 . b)A=[~ :J
2) What is STM? Compute the state transform matrix eAT. (Dec 2008) (June 2007)

. = [1 IJ
a). A I' b).A=[O -I IJ. c). 0
A=[ -2 I]...
-2 -3

Dept. of EEE,SjBIT
Page 135
Dept of EEE. SjBIT
Page 1
Modern Control Theory 10EE55 Modern Control Theory 10EE55
4 ) What is STM? Compute the state transform matrix eAT using Cayley Hamilton Example: Determine the state controllability of the system by Kalman's approach,
theorem. (Dec 2008) (June 2007)
0 1 1 [OJ u(t)
a A= 0 .,. I] [ ao ",Q-2
i;(t) = (J1 x(t) +
a~. A=[~ c).
. [ -2-3
i.

....3
. 1

5) Test the observablity using Kalmans method (Dec 2005)


Example: Consider the system
5) July 2008
x(n = [-02 _OJ]x(f) + [~}(I)
-
Deterimine the STM or system matrix
yet) = [I 01\"(/)

A '" [~
o
~
3
~Il
by Cayley-Hamilton method.
Test the observability using Kalman's approach.

UNITS UNIT 6
1) Explain the concept of Controllability and observability, with the condition for complete 1) Design a controller K for the state model ( Dec 2009)
controllability and observability in the S- plane (Dec 2010) (June 2010) .
Example: Design a controller K for the stare model
2) Check the controllability of the system (Jan 2008)
X(I)= [~ ~ ]!5(ll+[rr(t)
Example: Check the controllability of the system. If it is uncontrollable, Identify the ShIle, Such Ihallhe system shallhnw damping ratio as 0.707 & senling lime as I sec.
which is uncontrollable.
. [-I -I] ~ [I]
X(t)= 0 _2.~t)+ 011(1)
2) Design controller K which places the closed loop poles at -4
Acermanns formula. (Dec 2007)
j4 (or a system using

Ex. Design controller k which places the closed loop poles at - 4 j4 for system
3) Check the controllability of the system by Kalman's method (Dec 2009)
X(A)=[~ ~]X(t)1o[~}(t)using Acennann's formula.
Exomple: Using Kalman's Approach delennine the state controllability of the system
described by 3) Design a full order state observer. Assume the eigen values of the observer matrix at
H3H2Y;Qitll (I) -2 j 3.464 and -5 (June 2010) (Jan 2010)
with XI :; y,x% ;;; )'-11
," - 3""2 -2""'I -"11
, 2 -- ..

,\'1 =Xz +11


4) Determine the state controllability of the system by Kalmans approach. (June 2006)
Dept of EEE. SjBIT Page 2 Dept. of EEE. SjBIT Page 3
Modern Control Theory 10EESS Modern Control Theory 10EESS
UNIT 7

>:(1)=
0
0 0
1
011 X(t)+'OCD'IU(t) 1) What is phase- plane plot? Describe delta method of drawing phase- plane trajectories

6 ,11 6, [,1J (Jan 2010)

Y [1 0 o]X(t}
2) What are singular points? Explain the different singular points with respect to stability
Dc,ign" ,("I<" r""d back controller which place Ih,' do,,,,.1 "><'1' pole'; at 2 j3A64und
5, Give the bk"l\:k diagram nf the contro] configuration of non-linear system (Jan 2010) (Dec 2009) (June 2009) (June 2010) (Jan 2009)( Dec 2010)

4) Design a full order state observer. Assume the eigcn values of the observer matrix at -
3) Explain the common physical Non-linearities (Jan 2010) (Dec 2010) (Jan 2008) (June
2 j 3.464 and -5 (June 2010) (.Jan 2010)
2010)
Example : Consider the state model

X(tl=[~. ~ ~ lX(t)+l~lu "


UNITS
-6 -11 -6 1 1) Determine-the stability of the system. (Jan 2009)
"
Y(t) = [0 0 ljX(t)
Design an observer; where observer-error poles are required to be located at - 2 .i3.64 2) Determine the stability of the system described by (Dec 2010)
and -5 3) PID controller (June, Dec 2010) (Jan 2010)

5) Design controller to take place closed loop poles -I jl, -5. Also design an observer such
that observer poles are at -6, -6, -6. (Jun 2009) (Jan 2007)

Exompl: A System is described by


r
0 1 [o~
X(t) ",.[i .
- 5 - 6 -II.
1 X(t)+I"o,i,u(t)
11 ;
Y(t)=[1
ojX(t)
Design controller to take 1'1,,,,"clos..,1 loop pole, at 1.II. -5. AI,o design au observer
such that observer poles arc ai -6. -6. -6. Derive the Un compensated & compensated
'1'.1'.

"

Dept. of EEE, SJBIT Page 4 Dept. of EEE, SJBIT Page 5

",
MOdern Control Theory 10EES5 MecleFR CeRtFel Theo:Fy

Question Bank Solutions . X3+ 9X3+26 X2+ 24 XJ= 24R


UNIT 1&2 .
X3= - 24 XC26 X2-9X3+ 24R
1) Compare modern control theory with conventional control theory (Jan 20tO)

Comparison: Conventional vs. Modern Control


Conventional Control (Linear)
Frequency domain
Modern Coritrol (Linear)
Time domain analysis
X2"~ =[0 1. OJ[X~ ~OJ
0 0 1 X2 + 0 R
analysis & Design(Transfer
function based)
and design(Differential
equation based)
~ X
3
~24 -26-9 X
3
24
."

Based on SISO models Based on MIMOmodels


Deals with input, output
Deals with input and
output variables
Initial conditions are
assumed to be zero.
and state variables
Initial conditions are
taken into consideration
C = [1 o
oJ[x~X2
X3
Restricted to linear time- Applicable to nonlinear
invariant systems time variant system also

3) Determine state model for given transfer function (June 2007)

~ s2 +7S +2
R(S) s3 + 982 + 26s +24
2) Determine state model for given transfer function (Jan 2007)

C(S) 24
R(S)

SJC + 9S1C + 26sC + 24 c = 24 R


Take in LT
~(S)_ 1
--- -~--~~------
c: + 9 C +26 C + 24C = 24R 83 + 9s2 + 26s +24
Taking in LT
C=Xl
C=Xl=X2
C=Xl=X2=X3
'C=X3 =Xl

Dept. of EEE, SjBIT Page 1 Dept. of EEE. SjBIT Page 2

.'
.'
.'
.usls '333)0 '~d"a
(tH) (f+s)(Z+ s)
tZ
t'l+ s9(: + zS6 + ~ (S)H
tZ (s)~
o1+~~J
a t~J Lo~x
~;]
r~-:-: ] 0~ 1 ~- UI.I0J.I01~llJUI oq 01 SI :11JO .I01m,!LUOllJp~q1
(600, aunr)mJ0.lllUlPIl3SIlJ ul lapom J)IlIS B dopAaa (."
0 tJ'~ xXJ
J!. ;:] co;)
~~t Atz+rXZ - =r~
~ X.[1
J x r _rX =ZX IXi:+ZXL+''X=
IX Z + IX L + IX = (1)J
1x~-ZX=1~
JX Z + IX sL+ IXZS= (S):)
(S)TX
(S);)
1 X 6-9(:- tz- .;
(l)a 0 + zXOJ 1 0 0 J z~
[tX]
t+s o Ix 0 1 0 l~
=-1- lJ ~ l r~ = l.~
r-
L_ ("H) (+8) (Z+s) rX ='lX= l:x
(S)lX J (S)'X T (S)fX --
T
~ tZ
(S)H 'lX= l~
~
IX
SS3:3:01 A.IOcH{l. [O.IlUOJ U.IapOW
SS3:3:01 AJOal{l [O.I:lUO:>urapojq
Modern Control I heory lOEl!55 MOd'eI Il'6oIltl 01 'fheoI Y IDEESS

UNIT 4
1) What is STM? Obtain the state transition matrix using power series method (Dec 09) (Jan 2010)

Example: Compute the STM by power series method given

=[~ 0]+[1 1] [I
2 ,
t:
a)A=[O -1 -21], b)A=[1 0 1I] 1t+ 0
1]1 21 + .....
1
A2t2 A3f2
= I +At+--+--+
a) J(t) .
+-+ ...
3
2! 3! r r
l+t+-+-+
'l .

...
, t3
l r+ l "
=[~ ~]+[~l_12}+[~1 2! 3!
t2
2
t3

t3
1--+-+...
t2 t-t 2 +-+... 1
t3
1+1+-+-+ ...
2! 3!
_ 2 3 2
- 2 (3 3t2 2t3 el
l -t+t --+ ...1-2t+---+
2 2 3
... .r:::
.- [ p
= [e-' +. i:
- te -I

- Dept. of EEE. 5JBlT Page 5 Dept. of EEE. 5JBIT Page6


Modern Control Theory lOEE55 Modern Control Theory lOEE55
2) What is STM? Compute the state transform matrix eAT. (Dec 2008) (June 2007)

a), A =[~ ;J b). A = [0


-1
_121 c). A = [ 0
-2
_13] c). A =[
-2
0 1] =>
-3
[Sf _ A] = [S
2
a). .
I]'
A = [~ I ~ [SI-A]=.
[S-I0
-1
S-J
1
. '[S -1
lOS= -'---.
I
-
1
~ o)(s)
, .
= [SI- Arl
,L i
= s- I
0
- 1
S -I [S -If
_I
s +3 1]
[ -2
.S
.. Hence J(t)
~
=
'. (S+2)(S+1)

b).
,
A=[O .1 ]=>[SI-AJ=IS
- 1 - 2
-1
-t41:-----+2(Sf--=-t-F-02&)J4-J
1 _
..
.
[S+3
-2
1]
S
S+2
=> J(t) = ,t-1 J(t) = :-1 (S + 2)(S + 1)
s -1 ]-1 = (S +!__.)2 (S 1
+ -]1)
=> (t) = LSI - Arl = [I S+2 -I . 2e-I -e -21 e-I -e -21]
[
(S + 1)2 (S: 1)2 = [ - 2e-t + 2e-2t - ' + 2e-21
(1+ t)e-I
(t) =-1 (t) = [ _ ie:

Dept. of EEE, SIBI'J"II'


.' Page 7 Dept. of EEE, SIBI'!'
Page 8
.'
...
Modern Control Theory lOP:E55 Model II COlIll 01 'PheOI Y IeEESS

(Jan 2006)

1) Find f(A)=A10 forA=[O 1]


-1 -2
Now characteristic equation is IAI- AI = O. 1
-2
J
-1
1 A+2-
= 0 => (A+l)2 = O.
-~~.J
Hence, Eigen values are ~ = -1, ~ = 0, ~ = -1.
Since 'A' is of 2x2, the corresponding poly function is aD -2al
a) J [-9
10
-10J
11
ICA) = AlO = ao + alA 4 ) What is STM? Compute the state transform matrix eAT using Cayley Hamilton theorem. (Dec
2008) (June 2007) ...

=> f(AI) = ~IO = ao +al~ 2). Find S:rM by Cayley Hamlton method, given:

i0
=> (-1) 10 = ao - at 1I) A =[1
0 :] b) A=[O
-I
_I..,
-.J
1 CI A=
L- 2
_13]

I=> ao -at = 11 a) Consider A = [:1 :]


Characteristic equation is IAI - AI = 0
Since it is case of repeated Eigen values, to obtain the second equation
differentiating the expansion for.f(A)on both sides (i.e. Eq 1), = '[A-lo -I]
A-I
=:> A, = landA, = I. Since A is of 2x2 second order system. hence,
-

d )10 I e"=ao+a,A (I)


"dX[tt. 1 .i=-l= at =:> eA' = ao +a,A at A = A,
will be eAt' = ao + alAI
I
=> lOt ,1=-,= a, =-10 => e' =ao +a, (2)

Hence, ao = I + at = 1-10 = -9

Dept. of EEE,Sj8fT Page 9 Dept. of EEE,Sj8fT Page 10


..
.l3... 14

C(S) = 82 +7S +2
4(8) Xl s-1 s-1
~=
= '8+"-:- =
1 + 4 s-1 1-(-4s-1)
X2

.. .
C(t) = Xl + 7 Xl + 2 Xl
24 -1 1 s-1 1 s-l, 1

R(S~ ~X3
-2
'0'0
X X2~Xl '
X3 ..
-3
' 2
-'I,
, OC(S)

Xl =X2-4 x t
X2= X3- 3 X 1
3. Cascadingform
X3= -2X3+24V
tfJ:!edenominator ofTF is to be in factor.fonn

-_
C(S) _. __
R(S)
2_4
s3 + 982+ 265 +24
_
c= [1 0

24
_ (s +2)(.5+3)(st4)

1
(s +2)
X (8) -L., X2 (8)
(S+3)

[xj [~4 1 OJ
X2
Xl
0 -3
0
1
() -2
[~l ~Ol
X + Q R
X3 24
.15 ..
16

Consider the state model


X(t)= AX(I)+Bu(t)
Algot;.ithm for Design: Y(t)=CX(t)
(I)
(2)
a) Let the desired Locations of closed loop Poles be ~, ~ ........1.
. b) The correspondry cha Eqn will be transformation
""
The above model can be converted into controller canonical form through the

(S-AJS-A2) ...... (S-An)=0 . X(t)=.px~)


(3)
"
::;:>. S" +01Sn-l+02Sn-2+ +c, = 0 (1) Wher[;,~jsp~:n ~,~~ ~:gu1lar transformable matrix, and assumed as
c) ~t the controller gain matrix be
. .; K=[Kl K2---------Kn}.
P = ~~,' ~~~ ... ~~~
, I d)'ISI-(A;..BK),,=sn.t~'IS":"I+~2S~2+;'~'''~n
Pn, Pn2 Pnn
e) Coire~p~~ilingequation is. ,',
sn:+ 131Sn-1
+P2Sr>-2 + ";"'~n =0 ------(2)
P, = [p" P'2 ... P,n]
Comparing the co-efficient of like powers of s form Eqn (1) & (2) J(J,K2,-----:::K~
f)
can be Evaluated and this completes design of state pack controlled<i Taking the derivative of Eqn (3) and substituting for X(t) from Equ( I)
.' Example: Design a controller K for the state m'o~~I" ,'" .' '.... ~ ~. X(t)= AX + Bu(t) (4)

.. X(t)=[~ ~]X(t)+[~}(t): Where A=PAP-', B=PB (5)

0 0...... 0 1
Such that the syst~~ 'shall have d~~ping ratio,as 0.107 & setlling time as 1 sec:
Solution: .. ," ...... ,.,': ., " ,. ,
.'. 'a)' Ct:mvefting thed~ireri specifications as locations'of closed loop poles at - 4 j4
=[_:. -L '-~ _:. (6)

b)" The corresponding cha Eqn will be -.


(S+4+J4) (S+4~J4)70
, ~S2 +.M;+32=0 . ..
., ,",.
-B=p.,.n --.----- .(7)

(1)
,',

. t)te~ th~con~oller be of the'fonn ' i "

. . ','K"[K'
= l' 'K2l-' . '.~~:_'.,-
.. J;' -:-::--;:-:',7"" ',' . ":" From Equ.(3),
oX From given state model " . x, = P l1x,+P'2X2+ +P'nxn= P,x
Taking the: derivative
.,,"[A;-:~~lJ[O.1]:_[ 0'" J
:OJ. .r X, = P,x(t) = P,[Ax(t)+ BU(t)]
, ,\'.:,. : ,.ll0, 0. ...K1;: K2 . ",. ,"
= P,Ax(l)+ P,Bu(t)
From Equ(4)
(8)

.- x=x
2+0 (9)
Comparing (8) and (9), P,B= 0
& x 2 =P,Ax(t) (10)
Taking again derivative of Equ(1 0)
18

VTUJe.
.
'. VTU~
Learning Learnfng
x = P,A[AX(t)+ Bu(t)] ----------------------------------------------
Hence the corresponding characteristic poly will be
=P,A2X(t)+P,AB andfromEqu(4) ISI-(A-BKI=sn +(0, +Kn)S'-' + ....... +0. +K, (14)
and characteristic equation will be
x=x.+o=> x. =P,A2X(t) & P,AB=O
Sn+(a, + Kn)Sn-, +(02 +Kn)S .......... +on +K, = 0 (,1_5)
Similarly xn = P,An-'X(t) & P,An-2B =0
Where K"K" ..... K. can be chosen real numbers arbitrarily.
Taking again derivative
Let the desired characteristic equation be
P,An-'B=1

l
sn +a,sn-' + ....... +an =0 (16)
Thus,
Equating the coefficients of like powers of S from equation (15) and (16)

1[ 1 a, = a, + Kn => Kn =a,-o,
- r P,X
P,AX

X = P,A-;'_'X =

With P,B=P,AB=P,A2B=
P,
P,A

p,~n-,
X

.... P,An-2B=0
, (11) a, = a, + Kn_1=> Kn_,=a,-o.

an = an + K, ~ 1<, =an -an


} (17)

Hence the controller K will be


& P,An-'B=1
K"'[an~an .. a ...,-a ..., .. a,-o,j (18)
FromEqu(4) Transferring to original system
o P,B K'" KP!: [a. -a n" a...,-o n-, .. a,-o,lP
TIIC necessary condition is the system should be completely controllable. If the system is
o P,AB
not completely controllable then there are certain states that cannot be controlled by
st'abl~feedback.
B=PB= .
o , Thus the necessary and sufficient condition for arbitrarily pole placement is the
system should be completely controllable in s-plane,
o P,An-2S
1 P,An-'B Steps to design the controller K:
I) Forgiven state model, test the controllability of the system by determining the
=>P,[BIABIA2BI .... An-2 An-'Bj=[0 0 - - 0 1] rank of controllable matrix Qc.
2) If it is controllable, transfer the model into controllable canonical form through
Defining o, =[BI A2B I A2B 1. 1 A"-'B] similarly transformation matrix P ; where P can be obtained as.
=>P,Qc =[0 0 - - 0 1] " '.a) 11=[00----0 IJQ;'
Post-multiplying both sides with Q;l ~,A ,
P.1=P,A2
P, = [0 0 - - 0 1P~' Pn=P,A'"
Under this transformation, the control law will be U= -1Ot) = -KX(t)
Where, K = KP-' = lK,K2K, ..KnJ
Substituting u(t) = -KX(t) in Equation (4) b) P=[~:A
P,An-'
1
X(t) = [A- SKjX(t)

t:-~
3) Compute A & B as
0 ....

:_fltl
A=PAP-t
0 1......
(13) B=PB
4) Assume the controller K
-0n-,-K. -o,-Kn

5
4
.. 19
20

VTU_2
.
Learnrng
K = lK,K2....KnJ and
K= [0001)0, -'<p(A)-------c-----(4)
1 0
010 Where
Determine tA_SKJ=[ ~_
cp(A)= A' +a,An-' +a2An-2 +a3An-3 +....... +8nl (5)
-an-K, & Q, =[SI ABIA2BI.......An-'B] (6)
5) Determine the Cba equation as
Design procedure:
ISI-(A-SKI=sn +(a. +K,)Sn-' + +a, -K. =0 I. For given model. determine Q, and test the controllability. If controllable.
6) Determine the desired cha equation as 2. Compute the desired characteristics equation as
S" +a,S"-' +a Sn-2+ +a. =: 0 sn +a,S"-' + .........+8n =0
and determine coefficients a" a,.: a,
7) Determine the elements of gain matrix K.K,.K2 K.
3. Compute the characteristics poly of system matrix A as
as K, =a.-an <Il(A)= A"+8,An-' +a2An-2 + .......+8.
K2 = an-,-an-, 4. Determine Q;' and then controller k will be K=[O0 .... 0 I] Q;'. <1>( A)
K. = a, - a, and hence This completes the design procedure.
K=(K,K2 KnJ Ex. Design controller k which places the closed loop poles at - 4 j.4 for system
8) TIle feedback controller K for original system is
K=KP X(A) = [~ ~ ]X(I)+[~]u(I) using Acermann' s formula.
This completes the design procedure
Answer: Check for controllability
Design of controller by Ackermarm's formula:
We have
0, = [BI ABJ=[~ ~] Its controllable as f(Q,)=2.

P=[::A j& P, =[0;'].[00 ... 01j ~O-' =fL1o OJ11


P,An-' c

II. Desired characteristics equation is (S+4+j4)(S+4'j4)


K = [a. -a. ..an-,-an-, ... a,-a,jP ~S2+aS+32=0
~8, =a.a2 =32.
III. <Il(A)= A2 + a,A + a21 = [32
0 0a]

N. K=[P 1{~ ~r02 ~]=[32 a]


= [00 01jO;'[(a,-a,)An-'(a2 -a2)A-2 +
Characteristics poly of A matrix is
+(an -a.),]
.
,(1)
State regulator design: The state Regulator system is a system whose non zero
initial state can be transferred to zero initial state by the application of the input u(t).
lSI-AI = S +a,Sn-' +a2S-2.+ ..+I1. (2)
Design of such system requires a control law
According to Cayley-Hammilton theorem.
U(t)=KX(t) which transfers the non-zero initial state to Zero initial state (Rejection of
A +a,An-' + +a.I=O disturbances) by properly designing controller K.
~ A' =-a,An-'- .........._a.I (3)
The following steps give design of such controller. For a.system given by
From equation (1) and (3).

6 .' . 7
" "21 22

VTUJe
.
Learntng
X(I)= Ax(l)+ Bu(t) 2. Desired characteristics poly is
Y(I)= CX(t)with (S+2+j3.464)(S+-j3.464)(S+5)
u(l) = -KX(t)where =:;S3+9S2 +20S+60
K =[K,K2 Knl
Comparing with S3 +a.s" + a,s + a3 we obtain
From above relations, the closed loop system is Q, =9, a2 =20, Q3 =60

X(I)= [,1\ -BK]X(t) (1) 3. Hence the required controller K is


1. From the characteristics poly of matrix A K=[aa-03 a2-02 a,-o,]
ISI-AI=sn +o,S"" +02sn-2+ .......+on = [K, K2 KJ]
Determine al,az, aft = [43 9 3]
Block Diagram:
2. Determine the transformation matrix P, which transfers the given state model into
controllable caunomical form.

P=[::A
" P,A""
l; P, = [0..0...01 1 O~'

Oc = [BI ABI A2BI .......A""B]


3. Using the desired location of closed loop poles (desired Egen values) ~btai!l the .'
characteristics poly "
(8-1I.')(S-1I.2).....(5-1I.n)=sn +a,Sn~'+828n-2+ .....an "
determine a1, a2 , a"
K,=43
4. The required state feed back controller K is K2=9
K = [an-onan_,-on_,.....a, -o,p Kl~3
Example: A regulator system has the plant

X(t) =[ ~ ~ ~
-6 -11"-6
lX(t)+[~lU(t)
1"
Design of state observer:
Design of observer: The device that estimates we state variables with measurement of
output along with input u(t) is called state observer. -
Y = [1 0 O])(t) H all the state variables are estimated, it is called Full-order state observer. If only few
statevariable are estimated (which can't be measured accurately), the observer is called
Design a state feed back controller which place the closed loop poles at - 2 j3.464 and Reduced-order state observer.
-5. Give the block diagram of the control configuration
Design of Full-order observer: Inthis case all the state variables are to be estimated.
Solution: By observing the structure of A and B matrices, the model is in controllable
conmical form, Hence controller K can be designed. " a) Open loop observer: Here it is assumed that all the srate variablesare estimated

1.

"
8 -1
ISI-AI= 0 8 ~1
16 11 8+6
I~ 8' +682 +118+17

"
correctly and initial state are also estimated correctly.
i.e For State model,
X(t) = Ax(t)+Bu(t)
Y(t) = ex(t);
initial state X(O) are known and
Comparing with S +0,82 +02S+0., we obtain 0, = 6,02 = 11,0. =17 X (I) is estimated states and
--5(0) IS estimated lrutial states !he resulting observer in open loop observer.
8

9
24

Differentiating equation (3)


.~(t)
X(t~~ . L:_I - '. X= X(I)-X(I)
A = [A-mc)X(I) by equations (2 to 3) (5)
~(t.)
The characteristics equation of the error is given by
!SI-(A-mc)!=o. (6)

A
If 'm' is chosen properly, (A-mc) have reasonably fast roots, then X (I) will decay to
';((t) zero irrespective of X (0) i.e X (t) = X (I), regardless of X (0). Funher it can be seen that
equation (5) is independent of control input u(t). *"
Draw backs of open loop observer. The obserVer gain matrix 'm' can be obtained in exactly the same fashion as controller
I. Precise Lack of information ofx(O) gain matrix 'K'
2. If X(O)i:X(O), the estimated state X(t) obtain from open loop estimator will have De!ligT)procedure:
continuously growing error and hence the output, I . Let the desired pole locations of observer error roots be fJ" fJ" ......fJ" then the
3. Small errors in A,B, and disturbances that enters the system but not in estimator 'corresponding poly equation will be
will cause slow estimate process. .
(S-I3')(S-132) ....(S-I3,)=0 (1)
Hence better to go for closed loon estimator.
~ S' +a,S~-1 +a2Sn-2 + ..... a, = 0 (2)
Design of closed loop Full-order state observer: Figure shows closed loop FuH orcter-
determine co-efflents ai' i12 , .. all
state observer (Luen berger state observer) .
Z... Let the pbserver gain matrix be m
m'=-,im"IJl., ....... mnlT
obtain the characteristics poly equation of the closed loop system with observer as
I~HA-mc)I=O
S' +(0, +m,)Sn-' +(0. +mn_,)Sn-2 +.......+(0, -rn.) =0
=:;. (3)
3. Comparing the co-efficient of like powers of S from equations (2) and' (3)
I a, =01 +rn, ::::)mn =a1-u1
I
I an =On -rn, ==> rn, =an -an
L_____
I m I
I where the co-efficients a" a, , a. are obtained from poly equation

"-=- S~A~E-
:B~E:V:;- - - - - .J
ISI-AI=O
=:;. S' +o,sn-l +.......+0,=0.
4. The observer gain matrix 'm' will be then
State model is X(I)= Ax(l) + au(l) (1) m=[m"m2, ....... m,lT
Y(I)= CX(I) (2) Example: Consider the state model
Estimator output is V(I)=CX(I) (2a)

=:;. Error in state vector


=
Error in output is Y(I)- V(I) C[X(I)- X(I)J (2b) X(I) =[ ~ ~ ~ ]X(I)
-6 -11 -6
+[~lu1
X(I)= X(I)- X(I) (3)
Y(I)= [0 0 1)X(I)
From figure ;(1)=AX(I)+Bu(I)+m(Y(I)- V(I) (4)
'rn is nx 1 constant gain matrix. Design an observer; where observer-error poles are required to be located at - 2 j3.64
and-5

11
.'
..25 26

Solution: Model in oberserver conamical form will be Reduced-order state observer

~I)'[~0~~]X(I)+m
Required when few of state variables cannot be measured accurately.
Design of Reduced-order state observer:
In this design procedure. let us assume one measurement Yet). Which measures one state
X,(t). The output equation is given by
Y(t)=[O 0 1]X(I) Y(t)=CX(t) (l
1) Desired characteristic equation will be Where C=[1 0---0)
Partitioning the Slates X(t) into Slates directly measured X,(t) and states directly non
(S+2+j 3 .64) (S+2-j3.64) (S+5)=0.
measurable X,(t). which are to be estimated.
=> 8'+98'+208+60=0
hence comparing with S' + a,s' + a,8+ a3 = 0 . _f
Xl(I)]
r.e X(t)-~:e.e(~I)~ _
('I
a, =9, a2 =20, a, =60
Partionionly the matrixes accordly & state equation can be written as
2) Let the observer be m = [m" m2 ........ m. l'
X~(I)]=(al1 a,.][X,(I)]+[b']U(I)
0 0 -6] [0 0 m,l [ X.(I)
[A-me]= 1 0 -11 - 0 0 m2J a., aee X.(t) b.
[
o -6 0 0 m,
and Y(t) =[1 0G:\::] (4

[A-mel=[~
o
~ :(;~::'!)l
-(6+m3)
from equation (3)
X. (I) = a .. X.(I) + a.,X(I)+ boo (5
KnownlnpUI

~181-(A-mc~=0
from (4) Y(I) = X,(I)
~ S3 +(6+m3)8' +(11+m.)S+(6+m,) =0 => Xl (t) = Y(t) Also from

Comparing with
Bquation (3) X, (I)= a" X,(I) + a,.X. (I)+ b,U(I).
Collecting the known terms.
S3 -I'O,S2 + o.s + 0. =0
0, =(6+m3).0. =(11+m.),03 =(S+m,)
Y(I)- a" X, (I)- b,u(l) = a., X. (I) (6)
(II) Knownlerms
3) From I and II. Comparing equation (5) & (6) with
9=6+m3:::>m,=3 )(1)= AX(I)+bu(l)
20 =11+m. :::>m, = 9 =
and Y(I) eXIt)
SO=6+m, :::>tn, =54 we can have similarity as
X(t)~X.(I)
4) Hence m = [54 9 31T
A(t)~a ..
bu ~ a.,X,(t)+ b.u(t) (7)
c=a,.
Y = Y(I)-a"X,(t)-b,u(l)
Using Equation (7), the state model for reduced order state observer can be Obtainedas
~.(t) = a )<.(I)+ a.,Y +b.u(I)X,(I)+ m(Y(I)+ (Y -allY -b,u -"-,.:>:.(1) (8)

12 13

:
... 27. . ..~ 28
I
I (same as X(I)::A)I)+ bu(l)+ m(y(l)- y(l)) where y(l)::a,.X.(I)
! ~~~ b d
Defining X. (I):: X. - Xe : From output Equation it follows that states X,(t) & X2(~)cannot e measure , ~s
corresponding elements of Crnatrix are zero, Let us write the state equation as
~ ~.(I):: X.(I)-~.(I)
I Substituting for X. (I) & ~. (I) in above equation & on simplification, X'j :: [01 00 -24
)(, J
0 l[X,(t)]
X,(t) + [50]
2 u(l)

I X(I)::(a.. -ma,.)X. [ X 3
0 1 -10 X3(1) 1
Corresponding characteristic equation is
ISI-(a .. -ma,.~::o (J a.. =[~ ~J.ae, =[-~4J. a'e =[0 1)
Comparing with desired characteristic equation 'm' can be evaluated same as in full-
order observer.
I To implement the reduced-order observer,
Equation (8) can be written as
au = [-.1o.1~e = [520]b, :: [1J

X.(I)::(a .. -ma,.)X.(I)+(a., -ma,,)Y(I)+(be-mb,)u+mY(I) (I


Let m =[::] ..
I As Y(I)is difficult to realize, Characteristic equation of an observer is
I Define ISI-(a -ma,.)I=O
X: (I):: X. (Il -my =>S'+m,S+m,=o
Desirable characteristic equation is
~ X.(I)::X.(I)-mY(I) (S+ 10)(S+1 0) = 0
::(a .. -ma,.}X. (I)+(a., -ma,,)Y(I) + (b. -mb,)U(I) =>S'+20S+100=0 . ,
(12 From two characteristic equations. equating the co-efficient of like powers of S
Equation (12) can be represented by block diagram as shown below. 20=m2& lOO=m,.

~m=[1;~] ~
Hence state model of observer will be

><.,(1) = {~ ~].~[120~JrO~X.(I)+{ _~4]_[1;~]X{-10JJJY(t)+{520]_[1;~})U(t)

Design of compensator oy the principle of separation: .


Consider the completely controllable and observable system described by
,
X(t) = AX(I)+ Bu(l) (Is)

Exam:~::rrmt ~eij::~[~o}(,) Y(I)= eX(I.......


) ~~_
lei thecoiitrollaw be
u(l) = -kX(t)
(I)

(2)
lo 1 -10J 1 Assume the full-order observer model be
Yel)::[0 0 1JX(I) k(t)=AX(t)+Bu+M(y-CX(I . (3)
To design the reduced-order observer for un measurable states such that the given ~alues Hence the state feedback control law using the estimated states WIll be
will be at-IO. -10. . U(I):: --KX(t) (4)

14
15
..30

VTU)2:
Learn~n
--0-_
Using equation (4) in (I a) Taking LT.

)1)= AX(I)-BKX(I) . SX(s)=(A-BK-mC))S)+mY(S)


= (A-BK)X(I)+ BK(X- )1)) (5)
., ::::>mY(s)=[SI-(A-BK-mC)]X(S) (4
Taking L.T. of equation (2)
Defining observer state error vector as
X(I)= X(I)- X(I) U(S)=-K.X(S) (5
(6)
using (6) in (5) From equations (4) & (5)
::::> U(S) =K[SI-(A-:BK-mCr']m
)1)= (A-BK)X(I)+BKX(I) (7) -Y(S)
WKT observer error-vector model is =D(S)
X(I) : (A-mC)X(I) (8)
Equation (7) & (8) can be obtained in vector model as
R.(S~g)
D (s) Plant
~(I)]=[(A-BK) . BK I~(I)] (9)
[ X(I) 0 (A - mC) X(I)
Equation (9) represents the model of 2n dimensional system. The corresponding Example: A System if described by
characteristic equation is ISI-(A-BK)IISI-(A-mC)I=O (l~)
Equation (10) represents the poles (given values) of the system, which is union cifpoleS:
ofcontroller & observers. The design of controller & observer can be carried by: .' )1)=[ ~ ~ ~ lX(I)+[~l(l)
separately, & when used together, the system is unchanged. This special case of: _-5 -6 -11 1J
separation principle controller can be designed using . Y(I)=[l 0 ojX(I)'
ISI-(A-BK)I=O and observer by ISI-(A-mC)I=O. Design controller to take place closed loop poles at -I jl, -5. Also design an observer
such that observer poles are at --6, -6, -6. Derive the Un compensated & compensated
The corresponding block diagram is as shown T.F.

'1(t)
Solution:,System is observable & Controllable. Using the procedure of controller design
& observer design, the controller will be
K=[4 I I]and observer will be
M=[12.~. -71IT
..
r Transfer fynction of uncompensated system will be
Mu(S)=qSI-Ar'B.
, 1
1 MUIS1 S3+6S2+11S+6
I Co"t"olllf"T ObSe:rve'Y l-(_ Transfer function of compensated system will be
L 1 Compew s,,for
Me(s)= U(S)=K[SI-(A-BK-mCJr'm
Y(S)
Transfer function of compensator: M S~ S~+11'gS+618
e( )- S3+19S2+121S+257
Now X(I)=AX(I)+Bu(I)+m(y-cx(I)) (1)
U(I)=-KX(I) (2)
From (1) & (2)

X(I)= (A-BK -mC)X(I)+ mY(I) (3)

16 17
.3L.
32

.. , ....":(2.-' .'
" ,':
VT~
Le~rnfn~
TakingL.T.
Solution of State Equations
SX(s)= (A-BK-mC)X(S)+mY(S)
After obtaining the various mathematical models such as physical, phase anc
~ mY(s)= (SI-(A -BK -mC)jX(S) (4) canonical forms of state models, the next step to analysis is to obtain the solution of stat,
Taking L.T. of equation (2) ------equation.Flom die solution 01 tlie stale equation, -the transient response can then be
U(S)= ;"K.X(S) obtained for specific input. This completes the analysis of control system in state-space.
(5)
From equations (4) & (5) The solution of state equation consists of two parts; homogenous solution and forcer
solution, The model with zero input is referred as homogenous system and with non-zen
~ U(S) =K(SI-(A-BK-mCr'jm input is referred as forced system. The solution of state equation with zero input is callec
-ViS)
as zero input response (ZIR). The solution of state model with zero state (zero initia
=D(S)
condition) is referred. as zero state response (ZSR). Hence total response is sum of zm
andZSR.

R(S~~) a) Zero Input Response (Zffi):


o (s) Plant
- . Consider the n-th order LTI system with zero input. The state equation of such. systcn
with usual notations is given by
X(J)=AX(J)
Example: A System is described by
.(1)
"
with x(O)=xu
X(I)=[~ ~ ~ lX(')+[~}(') .:.~:";'
(2)
-5 -6 -11 1 Let the solution of Eq.(l) be of the form
Y(I)=[1 0 O)X(I) X(I)=c".k (3)
Design c~troller to take place closed loop poles at -I jl, -5. Also design an observer where e" is matrix exponential function defined as
such that observer poles are at -6, -1;, -6. Derive the Un compensated & compensated
T.F. ,;" A'I' A'I'
~.. = T+AI+--+--+
2! 3!
...... . (4)
Solution: System is observable & Controllable. Using the procedure of controller design and k is-a constant vector.
& observer design, the conrroller will be
K=[4 1 IJ and observer will be Differentiating Eq. (3);
M=[ll 25 _72]T
X(I) = Aea'k (5)
Transfer function of uncompensated System will be
M.(S)= C[SI-Ar1B. ~ k = (e" r'X(IO)= e-A' xeD) (6)
M _ 1
ulS) - S. +6S"'2-+-1-1S-+-6 Hence, X(I) = eA' e-M X(IO)

Transfer function of compensated system will be = eAU-'O) X(IO) ('7\


JJ
Mc(s)= U(S)=KfSI-(A-BK-mC)]-'m At 1=0(zero initial condition),
YeS) .
M (S)- S2+119S+618 ~ x(t) = e" x(O) (8)
c -S'+19S'+121S+257
"
From Eq.8, it.is observed that the initial state x(D)=xo at 1=0 is driven to a state X(I)at
time 't' by matrix exponential function e'", This matrix exponential function, which
transfers the initial state of the system x(O) to arbitrary state X(I) in 't' seconds, is called
STAlE TRANSmpN MATRIX (STM) and is denoted by ;(1).

.
:
"",

rt

..

(01_ 'I); =
.......+~~("z+'ty+[=("z-'ir/A..~-'t~
,!.."I+ 'I) t'z+ 't)~
,a oJ iz
[ ,a; ,a = .... + +(OI-'I)V+[=(OI-'I)'"
(1_ 'I),Y 'I'
... i z iZ
+--;-+-+1+[ ....+ +('I-'I)Y+I=('I-'I)'" 'WUd
(" '(.1 ('I-'I),V 'I' ,#'
Z ... i iZ ('I)r('I- 'I); = ('I)r
[ "'+,+,1+1 +-+-+1+[ 1=
r ,I z (0')r(01- 'I); = ('I)r
"~'! ,ll, 01 ,II, wOlJ pUll ,II, 01 ,0), wOlJ UOll!sU1!Jl01 [Bnb:lS!! (OI)r(O,- 'I); = ('I)r
..... +~ [I Otl[1 0J+[I 0J= '. "101 ollIIoll uO!l!sU1!Jl:ll{l
.;)., '(SUQ!l!SU1!Jl
[B!lU:lnb:ls
,1, 1 IJ 1 1 <l I
J? J:lqwnu.1lOIU!p:lp!AlPoq UIlJsosscoord U0!l!SUlIJI ;)IBISIBl{lS:!Hdw!A)J:ldoJdS!IlL)
i'l
.
......+_+_1_. -+IJI+/=(I);

(q : (01_ 'M = (01_ '1);('1_ 'I); '(17
,I,Y ,I,Y'
('1+ '1);=
,_dl- . ,_dl- .......
+~~('t+~y+[=('t)/!(~~
[ l_a1 ,_al+ ,_a ~) {1+ 1)~
J=
tz+
i iZ
....+-y;-;;+--y;-;;+ 'W+ 1=('I); pue
"'+__-_+17 ,,- 1+1- . ,I,V, I,V
z:
(....r z 1
Z
r ...+ --Z1
'",
1 iE iZ .
[ ".+_+ I_I .,,+ + Z .... +-,-+-,-+ 'W+I=('I); :joOJd
,I z J -;I-I ,',Y ,I,V
:('1+ 'lltP= ('I)('Ij .(
.... +~~ [z- I-]+~ [z- I-]+I[Z- I-J/I 0J- (I) ,_; = (1-);
, ,I 0 ,I, 1 0 1 lo I -
,_; l{l!A\S:lp!Sqioq jjUJAld!I(DUI-:IJd
1=(1-);(1);
'(H; pUB(I); jjU!Ald!llnw
....+~-~+W-I=(I-);<=
,I,V ,I,V
.... + --iZ + IV + 1 = (I); J~P!suo::>.joOJd
,I,V
: (l-ltP = (I),_; ,(Z
'[=(0)$ OIU!sllns:!J 0=1jjU!llll!lsqnS
(1);=
i iZ
....+--+--+IV+[= <va
,I,V ,I,V
'U0!l!olPP Ql{lwGij SMOI\OJ JOOJd/=(0)$ .(~
:(1):;:, Xl.lllIW U0!l!SUII.IJ. 31lllS JO S3!lndo.ld
6UIUJIt)'cq
\!) -:
~n~A
-. .
1 .~
V
35
36

VTU~
LecirnTng
Example: For system matrix A =.[ 0 2 ] show that the STM is
-2 -5 b). A= [ 0 1] =>[SI-A)=
-1 -2
[S
1 (S+2)
-1 J
4...
3
1 ...,
-e --e
3
-e
2 _, --e
3
2
3
""'1 S+2
-2 _,
[ -e +-e
3
2
3
...
,
1 ...4
-e
3 3
-e -" J => (I)'= [SI- Ar' = [~ -1
S+2
J-' =
[
(S+I)'
-1
(S+I)
I 1
I (S+I)' (S:I)2
2).Inverse Laplace Transform Method:
0 + I)e-' le-' ]
Consider the state equation with zero input as (I)=I(t)=
X(I)= Ax(I); [ -ie:
(I-t)e-'

X(IO)=x(O)

Taking Laplace Transform on both sides.


c). A = [ 0 I]
-2 -3
=> [SI - A) = [S -] J
,
2 S+.'
Sx(s)-x(O) = Ax(s)
~ [SI - A)x(s) = x(O)
Premultying both sides by [SI-Ar'.
=> SJ
r -
h-' _[S -I
j - 2 S+3
J- [
S+3
-2
- (S+2)(S+I)
S
IJ

xes)=[SI -Ar'x(O)
Taking Laplace Inverse on both sides.
X{I) = :.e-'[SI-Ar'x(O)
.'
Hence.(I)
[S_+/
= (S + 2)(S + I)
~J
Comparing the above example with
X(I) = eA' x{O)
It shows that
eM = STM = (i) =:.e-'[SI - Ar'
. .
=> (I) =.I(I) =;..1(S+2)(S+I)
[S_+23 ~J
~ (I) = ..,[SI -Ar'

Example:
Obtain the STM by Laplace Transform (Inverse Laplace Transform) method

:~:r:J~b)A"[~l _1,J. 0) A"[_O, I,J


3. STM by Calley-Hamilton Theorem:
This method is useful for large systems. The theorem states that "Every non-
singular square matrix satisfies its own characteristic equation." This theorem helps for
evaluating the function of a matrix. . ....
a). A=[~ :J~[SI-A)=[S~l S-~IJ For rum. non-singular matrix A the matrix poly function [(A) is given by
f(A)=aol +a,A+a,A' + ....+a,A'-'
[ 0 S-IJ
s -I 1 1 = (I)
~(s)=[SI-Ar' = S-I -I] -"'-_-.--=-
[ OS-I [S-I)' where ao.a,......
a, constant coefficients which can be evaluated with eigcn values of
matrix A as described below.
=>(I)=.'(S)=[~ :.']
Step]: For a given matrix. fo,:," its characteristic equation IAI - AI ~ 0 and find
eigen values as A" A., ..... .4.
L 9
6-=01-[= '+1= 0 ':I,u:lH
'~I 0 ]+[(/-I)'~ 0 J:
[ ,"1,''1 0 (I-I)," 0[-='v='-I.r01';::
[: ~]'+[~ ~]o= '='- I [o,rl.1:!p
.([ ba ':I'!l S:lp!S rnoq uo (rJfJoJ uo!s~dX:l:;l1p SU!lIl!l=mp
V'+[o:. ",a=ell,p
uOflBnoo PUO:l:lS:lip u!1lJqo 01 'S:ln[1lA!!:lSm P:lIe:ld:ll JO :;SeJ S! Il :Y.IU!S
,{q U:lAf.1S! w.LS :l~U:lH
(I-I),a: 'zJ- 0 <=1
lG---~
,d; - ,d = ' - ,d = 0 eEl pus ezl 'sb3 UlOid '- 0.0= 0'([-)';::
(E) IV = ,a1 'r'zJ+ 0= o,y (1)/';::
=
l': YII1'= rr~1 (I) r'D + 0 = o,r = (r!J
''Y:Y jjU!JnI[jsqns puu 'Y01 iocdsar tll!M (I) 'b:;I SU[je9U:lJ:lJJ!O
S! u0!lJIll1J A!<:'dSU!pUOdS:lllOJ:l1p 'ZlClJO S! .v. :lJUlS
(Zl IV + v = ,3 <=
'[- = l''0 = 1"[ - = y :1m S:ln[1lAU:lSm ':lJU:lH
y'v+o= ''ra :lq_mM
l' = Y Ie y'+ 0 = It'd <= '0= ,([+r) <=o=~+1f [1<=
(ll jI- r
y'+ 0 = rr"
. 0 = Iv - rd S! UOflunb:L:l!lS!l:lI:ll!.l1lqJMON
I-Y 0]
':l~!!:lq'W:lIS,{SJ:lPlOPUO~:lSlZJOS!~~JU!S'I: 'rPUI1I=1'<= [ [_ L-i"- =
[l[- I;]=V 10Jo,v=(v)! PU!.d(l
0= Iv- I S! uonenbe ~!lS!l:lI~ll.IBq:J :sa/dum:q
(I),p=
[~ ~] = V J:l;!SUO:J (e
,_.v+....+ v'+ [0 = (vl!
u0!1J!ll\j U! ..... ''''0 SIU:lpgP-OJ:l1p :lJn)!lsqns:~
[: ~]:v (n
. ..... '' ' '0 SlU:lJf.JJ:I-OJpug pUll :In[1lAU:IS!3:Slip Su!sn,(q
UO!lllnb;jIU:lPU:ld:lPUl:lUOu!1llqo u:lql P:lIB:ld:lJ:l1BS:ln[1lAU:lS!3::lWOSJI :<Z aso:;)
H OI]=[IZ-O '-]= .....,' ''zJ.o 10J:lA[OS
[01- 6- 'v 0 ..... + ,'r' + 'r' + 0 = ('rl/ = ,..a
-'l_- '_]+[0 0 J=
[ ' 0 0 ..... +,1"+ 1"+ 0 =(1')/ = ",d
.....+, y'+ y'+ 0 = (y)/ = 'I'''
'SIl suoQllnb"
v' + [oV = o,v: (vl/ <= ~no"uel[nw!S .U. UllOJ U:llp '1Ju!lS!P:Im S:ln[1lAU:lS!:I[IBJ1:(["so:;) ~
"
8E _-_Lt
39
" . 40

vru~
.
LearnIng
=[~ ~,']
b) A = [ 0
-1 -2
1 J; characteristic equation is IAI _ AI = 0 ~ /A1 -1 '
A+2-/
-0

~4,=-I,A,=-l.
For second order system, Deterirnine the S1M of system matrix

eh =ao+a".t (I) 2 1 4]
A = 0 2 0 by Cayley-Hamilton method.
.
~ e""=ao +a,4, [o 3 1
::)e-'=ao-a,; (4,=-1) (2) Now characteristic equation is.
Differentiating Eq. (1) with respect to A and substituting A=A2=-I
al =Ie-l IAI-AI =IA~2 A-_I2. -04 =0 1

hence ao =e-'(l+I) fromEq. (2). o 0 A-I


The S'IM is given by (I) = e" = aoI + A Eigen values are A, = 2,.~ = 2. A, = 1
On simplification, Correspondipp function will be
e"" =ao'+a,~ +a,4,' (1)
(t) = [ (I+I)e-'
_, -;. ..,
::)e" f a. + 2a, +.4~, (2)
te
-r (!-t)e
Differentiating Eq. (1) with respect to 1'-1 and substituting A,=2,
c). A". [ -2
0 1 ] characteristic equation is
-3
IAI - AI = O. Oil simplification
le,2r = at + 4a2 (3)
::)/A2 -!I=o~4,
A+31
=-I,A, =-2. and e'" = ao +a,A, +a,A,'
Eigen values are distinct The corresponding functions are, =ao+a, +a, (4)
From Eqs. (2), (3) and (4), solving for ao,a" a.,
e""=ao+a,A, (1) ao = 2te' _3e2t +4e';
e" =ao-a) (2) a, =-3te" +4e" -4e'
And e"" =ao+a,A, a2 =te21 _e2f +e'
::) e-" = ao - 2a, (3) HenceS1M (t)=..a.I+a,A+a,A'
From Eqs. (2) and (3) solving for ao and a,.
ao = 2e-' -e-" and
re" 12e' -12e" +13te" -4. e' +4e"j
=1 0 e" 0
l 0 -3e' +3e" - e'
Hence the S1M will be
(I) =aoI + a,A. On simplification,

8
9
42

VTU
-----------------,------_._-----
LearnTnc
Solution of Non-homogeneous State Eguation X(I) '" [
-I 11
JX(I) + JU(I)
[Ol
-I -10 10
Consider the state equation with forced input u(t) as
X(I) '" Ax(I) + BU(I) ;
y(l) ",[I O]x(I);X(O) ",0
(I)

X(I.)"'X.
Solution: The state equation solution is
~ X(I) - Ax(I) '" BU(I) X(I) "'eA'x(O) + J eAe'-<)Bu('t")dr (I)
Pre-multiplying both sides by e-" ,
, Since x(O)=0,
e-A' [X(I) - Ax(I)] '" e-" U(I) (2)
Consider, X(I) = J eAeH) Bu(r)dr
~[e-" X(I)]
dl
~ _Ae-A,X(I) + e-A' X(I) = f (I-r)Bu('t")d't" (2)

~ e-"[x9TO-!i.x(I)] (3) Now, the state transition matrix (I) can be evaluated as
hence Eq (2) can be written as eA' =(I)=.:c,[SI-Ar'
~[e-"x(l)l'= ,,"'U(I)
dt =[1.0128e-." -0.0128e-" 0.114e-" -0.114e-" J
Integrating both sides with time limits 0 and t -O.l14e- Q" +0.114e-" -0.0128e-a" +1.012e-o,o
e-'" X(I) I:", j e-A<Bu(r)dr 1.0128e "-') -0.0128e-"(o-') 0.114e-o,(o-,)-0.114e-'(o-') ]
~(I-r)= [ -0.1I4e <O-<) +0.1I4e-,e,-,) - 0.0128e-O,,,-<)+ 1.912e-o,e,-,)
Hence

" X(I)';" J, (I- }O


r OJ'10drr)

=[9.094 -10.247e-o" + 1.153e-"']


Pre-multiplying boih sides by eA' , -0.132+ 1.151e-:" -1.01ge-"
X(I)"'~)~+ jeAe'-<lBu('t")d't" :. y(l) = CX(I) = [1 0]x(1)
VR ,,-.__ ~_~ =9.094 -10.247e-" + 1.153e-o,,;
ZSR where, a,=1.1I25, a2=9.88
I ~ + J
X(I) '" (I)X(O) (I~'t")Bu('t")d't". Exampl~ 2: Consider the system

I If the initial lime is instead ofI. 0 then, X(I)=[ 0


-2 -3
1 ]X(I)+[O]U(I)
1
1
'1
X(I)"'(I-I.)X(I.)+ J
'
p(I-'t")Bu('t")d't" (4) , y(l) ~[I:'t~;I);X(O) =[ I'J
'. -1
The Eq (4) is the solution of state equation with input as U(I) which represents the
change of state from X(lo) to X(I) with input U(I). Solution: The state transition matrix (I)
(I)=.:c1[Sl-Ar'
Example 1: Obtain the response of the system for step input of 10 units given state inoa.,I,

. I-'
$ .
s -I
.
=.:c 0'
[2
"
S+3.

I 10 11
I
iL__~.
44

Solution: State transition matrix


4 _, -;_e
-e 1 -4, 2___._--e
-e 2 -4,]
(I) = 3 3 3 3
[ -2 e-t +3.e-4J .!.e-' +ie- 41
- 3 - 3 3 3

X(I) = (I)X(O) + j (/- -r)Bu(-r)dT

Hi _, -e -2, --e
-e 4 _,,]
_ 3 3
- [ -5 e-I +e-21 +~e-41
3 3
and yet) =5e-' - e-"

1 '""
="2\,;-e _?, _".
tr-e."

= !(l- e-2'l)
2

Ext;;mple3: *(/)=[ -2 -52 ]X(/)+ [O]U(/)


1
y(/) = [2 l}x(/);x(O) = ~ 2t

13
'.

.. 45."". 46

VTUg
Liarn7n
Controllability and ObGervabillty Independent 'if C matrix, tjte controllability of the system is frequently referred to as the
Concept: controllability of the pair [A, B).
Consider the typical state diagram of a system. Example:' Check the controllability of the system. If it is uncontrollable, identify tile state
which is uncontrollable.

X(I)=[~I ~~]X(l/+[~}(t)
Solution: First, let us convert into diagonal form.
. 1).1 ~ _/A.;I) , 1 1_
-nt- O. A~~-O
The system has two state variables. XI (t) and Xi(t). The control input u(t).effeclS =>(A.+ I) [A.+ 2)=0
the state variable XI(t) while it cannot effect the effect the state variable X2(t). Hence the
state variable X2(t) cannot be controlled by the input u(t). Hence the system is
=>A' +3A+2=O
uncontrollable, i.e., for n" order, which has 'n' state variables, if anyone state variable is => (A. + 2)(A. + 1)= 0
uncontrolled by the input U(I), the system is said to be UNCONTROLLABLE byinput => A.=-2,A =-1
u(l). "
Eigen vector associated with ..I. =-2
Definition:
For the linear system given by -2. II => _11J
-L
VI
X(I) = AX(I)+ BU(I) 1 001
Y(I) = ex (I) + Du(I) Eigen vector associated with A.= -I
is said to be completely state controllable. If there exists an unconstrained input vector -1+1' 1 1=>10 11
u(t), which transfers the initial Slate of the system x(to) to its final state x(tr) in finite time
f(tr-to) i.e. fr. It can be seen if all the initial states are controllable the system is completelj
1 o -1+2 0 1

controllable otherwise the system the system uncontrollable. .


Methods to determine the Controllability:
I) Gilbert's Approach
2) Kalman's Approach.
Gilbert's Approach:
It determines not only the controllability but also the uncontrollable state variables, if the
pJO" t[~,:]
it uncontrollable.
Consider the solution of state equation
X(I) = AX(I)+Bu(t);X(I.) = X(O)
.
=>p"AP=fo
L-l
11-1
I 0
-Ill olJ
- 2 I

as
~[Q'-2J[1 IJ=[-20-1 0]
j
X(I) =eA1 X (0) + ,,'(1-<) BU(1')dT. Assuming without' loss of generality thatX(t)=O"the
I'~IIO

solution will be
o ~
. P-IB_['O 'JIJ_'[ 111
-I I 0 -IJ
- X (0) = j e-M Bu(t')<i1'
As,or1 B vector contains zero element, the system is uncontrolled and state XIii) is
o uncontrolled.
The system is Slate controllable, iff the none of the elements of B is zero. If any
element is zero, the corresponding initial state variable cannot be controlled by th~ input
u(t). Hence the system is uncontrollable. The solution involves A, B matrices and is

14
.41 _ 48

VTU)e
LecifnTns
2) Kalman's approach:
This method determines the controllability of the system. Verify the result with Gilbert's approach.
Statement: The system described by Solution: Kalman's approach: Here,
x(t) = Ax(I) + BU(I)
Y(I) = Cx(t)
is said to completely state controllable iff the rank of controllability matrix Qc is equal to
order of system matrix A where the controllability matrix Qc is given by, .
BIA2BlAB
Q, = [B lABIA2BI..... IA"-IB].
o
i.e., if system matrix A is of order nxn then for state controllability
p(Q,)=n
~Q<=[: -3
1

where P(Q,) is rank of Qt.


'.
Example: Using Kalman's Approach determine the state controllability of the system
described by . = Order of system.
ji+3y+2y=u+u (I) Therefore, system is ~tate controllable.
with x, = y,x2 = y-u Verification by Gilbert's approach:
x2 =-3x2 ~2x, - 2u Transferring the system model into canonical form with usual procedure.

~
i, =X2 +u

[0 1Tx,] [1] 1 [~ 1
X, ]
[ x2 .:: -2 -3..._x, + -2 U(I)

l
2(1)= 0 -Io,
o 0 -2
0 Z(I) + -1[."(I)
_l_

r
:=)A= [ 0 1 ] ,B= [ 1 ]. ,_:. 'I 2
-2 -3 -2
=,[~
Now AB=[ -20 1
-3 -2
I]=[-2]
1
4
Here, B
Observability:
-1 ~ has no zero element in any row, hence system is controllable. ....

Concept:
~Q, =[BIAB]=[ 1 -42] A system is completely observable, if every state variable of the system effects
-2 some of the outputs. In other words, it is often desirable to obtain information on state
variables from-the measurements of outputs and inputs. If anyone of the states cannot be
IQ,I= 1-21 -21
4 =0 observed from'the measurements of the outpits and inputs, that Slateis unobservable and
system is not completely observable or simply unobservable.
hence rank p(Q,) is <2 and system matrix A is of 2x2. Therefore system is not Consider the state diagram of typical system with state variables as x, and X2 and
controllable. y and u(t) as output and inputs respectively,
Example: Determine the state controllability of the system by Kalman's approach.

X(I) =[~~
o
~lX(I)+[~}(I)
-2 -3 1
u~~.~(')

""--~
J
-1

16
17
50

VTU~
Ledrn1n!
On measurement of y(t), we can observe XI(t)but we cannot observe X2(t)by
measuring out y(t), hence state is not completely observable. . 1.1=0~p(!'.'<2
Definition: 'j; 2. ~o, system is unobservable.
Order of system
A system described by Example:Show.that the lystem
itt) = A.%(t)+ Bit(t) .
yet) = Cx(I) + Du(t) is said to be completely observable iff with measurement of output
yet) over finite time interval t.::;t.$t(along with input u(t); ~Io the initial state x(lo) can be
estimated. .
i(l) '"[ ~ ~
-6 -II
~
-6
lX(t) + [~Jl(,)
I
Explanation: yet) =[4 5 t]x(t) is not completely observable by
Consider the output equation I) Kalman's approach
yet) = CX(I) + Du(t)
2) Gilbert's approach
Assuming D=O. y(t)=Cx(t).
Solution: Kalman's approach
All the state variables x(t) can be estimated with measurement of yet) provided C
matrix do not contain the 'zero' element. If any element of C matrix is zero, the .
corresponding state cannot be estimated and hence system is unobservable.
Kalman's Altproacb:
The system described by the model
A=
[
0 I 0] ~AT =[0
0
-6 -II
0 I
-6
I
0
~~I~l
-6
i(t) = Ax(t) + Bu(t)
yet) = Cx(t) + Du(t)
is said to becompletely observable iff the rank of observability matrix ,p. is equal to the
C=[4 5 I]~CT =[:j
order of system matrix A where,
. =[CT::?ATCT:AT'CT ... AT-'CT)
For n'" order system, rank of
i.e. p(.)=n
,p. must be n. ~A'c"[}"c'rl
It involves A and C matrices. The pair A, C is observable.
Example: Consider the system ~ . =rC:i--A;t--A~-~T1~I.I =0
i(t)=[:-02 ~J(t)+[~}(t) 5 -7 5
I -I -I
y(t)=!1 O]x(t)
Test the observability using Kalman's approach. ~ p( 9.) < 3 and order of system is 3. Therefore system is unobservable.

Solution: Here Gilbert's approach:

A=lo'-2 0];C=[I 0] Transferring the system model into observable canonical form with usual
procedure, the output equation will be
.. -1
=
yet) [0 - 2 - 2]z(t)
As C matrix contains the element '0' the corresponding state Zt cannot be
~ ATCT =[-02 ~II~]=[ -02] observed:Hence the system is unobservable.

.. =. =[CT ATCTl=[~ ~2]


18
19
"

.51. S2

VTU~,
LicirnTng VTU.Ae
'.
Lecirn7ng
CONTROLLERS
The controller is an element which accepts the error in some form and decides the proper Integral Controller:
corrective action. The output of the controller is then applied to the system or process. We have seen that proportional controller can not adapt 'Withthe changing, load
The accuracy of the entire system depends on how sensitive is the controller to th~ error conditions. To overcome this situation, integral mode or reset action controller is used.
detected and how it is manipulating such an error.. The controller has its own Jof:jc to In this controller, the controller output pet) is changed at a rate which is proportional to
handle the error. 'Ihe controllers are classified based on the response and mode of actuating error signal e(t). Mathematically the integral controller mode is expressed as
operation. On the basis of mode of operation, they are classified into Continuous and pet) = K, f e(t)dt + Po. The constant K, is called integral constant. The output from
Discontinuous controllers. The discontinuous mode controllers are further classified as the controller at any instant is the area under the actuating error curve up to that instant.
ON-OFF controllers and mulliposition controllers. Continuous mode controllers, If the error is zero, the controller output will not change. The integral controller is
depending on the input-output relationship, are classified into three basic types nanied as relatively slow controller. It changes its output at a rate which is dependent on the
Proportional controller, Integral controller and Derivative controller. In ID8DY practical integrating time constant, until the error signal is cancelled. Compared to the
cases, these controllers are used in combinations. The examples of such composite proportional controller, the integral control requires time to build up an appreciable
controllers are Proportional - Integral (PT)controllers, Proportional - Derivative (PD) output. However it continues to act till the error signal disappears. Hence, with the
controllers and Proportional- Integral- Derivative (PIO) controllers. integral controller the steady state error can be made to zero. The reciprocal of integral
The block diagram of a basic control system with controller is shown in Figure. Th'; error constant is known as integral time constant T;. i.e., T; = IlK;.
detector compares the feedback signal bet) with the reference input r(t) to generate an Derivative Controller:
=
error. e(t) ret)- bet).
In this mode, the output of the controller depends on the rate of change of error with ....
Conlroller oulpul respect to time. Hence itis also known as rate action mode or anticipatoryaction mode.
(p)
The mathematical equation for derivative controller is P(t) = Kl ":;') + p . Where K,
I{l) e(l)
Conlroller ..
I
I--;_-,-l Processto
is the derivative gain constant. The derivative gain constant indicates by how much
be controlled percentage the controller output must change for every percentage per second rate of
~)- change of the error. The advantage of the derivative control action is that it responds to
E_ the rate of change of error and can produce the significant correction before the
detector magnitude of the actuating error becomes too large. Derivative control thus anticipates
L/-,,-- -I Feedbackelemenl 1-------' the actuating error, initiates an early corrective action and reur's to increase stability of the
system b}' improving the transient response. When the error is zero or constant. the
Feedback
signal derivativeconttoEer output is zero. Hence it is never used alone.

Proportional Contretlerr
PI Controller:
.
This is a composite control mode obtained by combining the proportional mode and
In the proportional control mode, the output of the controller is proportional to th~ error integral mode. The mathematical expression for Pi controller is
e(t). The relation between the error and the controller output is determined by a constant
called proportional gain constant denoted as Kp. i.e. pet) Kpe(t). = . pet) - Kpe(t) I s, J e(t)dt 1.1'0
Though there exists linear relation between controller output and the error. for zen! error
the controller output should not be zero as this will lead to zero input to the system or The transfer function is given by 1(. I i
process. Hence, there exists some controller output Po for the zero error. Therefore
mathematically the proportional control mode is expressed as pet) Kp.e(t)+ p.. . =
The performance of proportional controller depends on the proper design of the gain Kp.
As the proportional gain Kp increases, the system gain will increase and hence the steady
.state error will decrease. But due to high gain, peak overshoot and settling time increases
and this may lead to instability of the system. So, compromise is made to keep steady
state error and overshoot. within acceptable limits. Hence, when the proportional
controller is used, error reduces but can not make it zero. The proportional controller is The advantage of this controller is that the one to one correspondence of proportional
suitable where manual reset of the operating point is possible and the load changes are controller and the elimination of steady state error due to integral controller. Basically
small. . integral controller is low-pass circuit.
The PI Controller has followin!-effects on the system.

15
16
,53 S4

I. It increases the order of the system


2. It increases the type of the system
3. It improves the steady state accuracy.
4. It increases the rise time so response become slow.
5. It filters out the high frequency noise
6. It makes the response more oscillatory.
PD Controller:
This is a composite control niode obtained by combining the proportional mode at
derivative mode. The mathematical expression for PI controller is
de(t)
pet) = Kpp.(t) + K..~ + p. This is to note that derivative control is effective in the transient part of the response as
error is varying, whereas in the steady state, usually if any error is there, it is constant and
The transfer function is given by Kp + Kos does not vary with time. In this aspect, derivative controi is not effective in the steady
stare part of the response. In the steady state part, if any error is there, integral control
will be effective to give proper correction to minimize the steady state errcr. An integral
controller is basically a low pass circuit and hence will not be effective in transientpart of
the response where error is fast changing. Hence for the whole range of time response
both derivative and integral control actions should be provided in addition 10 the inbnilt
proportional control action for negative feedback control systems. I!J!'

Example: The figure shows PD controllerused for the system. Determine the value of Td
such that the system will be critically damped. Calculate the settling time.

ThePD Controller has following effect. on the system.


I. It increases the damping ratio and reduces overshoot.
2. It reduces the rise time and makes response fast.
3. It reduces the settling time
4. The type of the system remains unchanged.
(1+ SId) 4
5. Steady state error remains unchanged. Sol. : G(s) H(s) = 1
s(s+ 1.6)
In general it improves transient part without affecting steady state. (1 + sId) 4
PID Controller: C(s) 7(;+1.6) (1+sId)4
R(s) 1 +(1 + sId)4 s2+1.6S+4Id s+4
This is a composite control 'mode obtained by combining the proportional mode,
s(s+ 1.6)
mode and derivative mode. The mathematical expression for PI controlleris
Comparing denominator with standard form,
pet) -I(pe(t) + KI J s(t)dt + Nd !!.~~t)+ P, "'~ ~ 4, ron = 2 and 2E, "'n = 1.6 + 4 Id

The transfer function i. given by K. +.; + K.s .. ~ = 1.6+ 4Id


4
Now system required is critically damped, i.e 1; = 1
1 = 1.6+4Td
4
.. 4 1.6+ 4Id
.. .. Id 0.6 and settling time = _4_
~ "'n
" _4_= 2 sec
Is
. 2x 1

18

"
ss
56

VTU)e
LicirnTn.s VTUX
LE~'cirnTn!
Chapter 6 response follows the .curve through the A, B and C, but at C an increment in frequenc
NON LINEAR SYSTEMS results in discontinuous jump down to the point D, after which with further increase i;
frequency, the response curve follows through DE. If the frequencyis now decreased, th
6.1 introduction response follows the curve EDF with a jump up to B from the point F and then th
response curve moves towards A. This phenomenon which is peculiar to nonlinea
Many practical systems'are sufficiently nonlinear so that the important features of their

I
systems is known as jump resonance. For a soft spring,jump phenomenonwill happen a
perfonnance may be completely overlooked- if they are analyzed and designed through shownin fig. 6.2(c).
linear techniques. The mathematical models of the nonlinear systems are represented;by
nonlinear differential equations. Hence, there are no general methods for the analysis lind
... i
synthesis of nonlinear control systems. The fact that superpcsitlon principle does 110t
apply to nonlinear systems makes generalisation difficult and study of many nonlinear
systems has to be specific for typical situations. .
! 6.2 Behaviour or Nonlinear Systems
I
i The most important feature of nonlinear systems is that nonlinear systems do not obey the
principle of superposition. Due to this reason, in contrast to the linear case, the response
of nonlinear systems to a particular test signal is no gnide to their behaviour to other Fig.6.2(a) Fig.6.2(b) Fig. 6.2 (c)

-I
I inputs. The nonlinear system response may be highly sensitive to input amplitude. For
example, a 'nonlinear system giving best response for 2 certain step input may exhibit
highly unsatisfactory behaviour when the input amplitude is changed. Hence, in a
nonlinear system, the stability is very much dependent on the input and also the initial
state.
When excited by a sinUSOidalinput of constant frequency and the amplitude is increaser
--from-IoW-vliJues,the output frcijiiency-aCCSom,q)oih[exactly matches wit}. the inpu
frequencyand continue to remain as such thereafter. This phenomenon which results in ;
synchronisation or matching of the output frequency with the input frequency is caller
frequency entrainment or synchronisation.

I Further, the nonlinear systems may exhibit limit cycles which are self-sustained
oscillations of flxed frequency and amplitude. Once the system tmjectories converge to a
limit cycle, it will continue to remain in the closed trajectory in the state space identified
as limit cycles. In many systems the liurlt cycles JI1'Ccundesirable particularly Whenthe
6.3 Methods of Analysis
Nonlinear systems are difficult to analyse and arriving at general conclusions arc tedious

I amplitude is not small and result in some unwanted phenomena.


However, starting with the classical techniques for the solution of standard nonlineai
differentialequations, several techniques have been evolved which suit different types ot
analysis. It should he emphasised that very often the conclusions arrived at will be usefu
for the syseem under specified conditions and do not always lead to generalisations. The
commonlyused methods are listed below. _

I Linearization Techniques: in reality all systems are nonlinear and linear systems are
only approximations'of the nonlinear systems. In some cases, the linearization yields

I
I
useful infonnation whereas in some other cases, linearised model has to be modified
Whenthe operating point moves from one to another. Many techniqueslike perturbation
method, series approximation techniques, quasi-linearization techniquesetc. are used for
Iinearisea nonlinear system.
Phase Plane Analysio;:This method is applicabte to second order linear or nonlinear
Fignre 6.1 systems for the study of the nature of phase trajectories near the equilibriumpoints. The .-
A nonlinear system, when excited hy a sinusoidal input; may generate several hannonics system b.ehaviouris qualitatively analysed along with design of systemparameters so as

I in addition to the fundamental corresponding to the input frequency. The amplitude of


the fundamental is usually the largest, but the harmonics may be of significant amplitude
in many sitUations.

Another pec;]liar characteristic exhibited by nonlinear systems is called jump


phenomenon. For example, let us consider the frequency response curve of spring-mass-
to get the desired response from the, system. The periodic oscillations in nonlinear
systems called limit cycle can be identified with this method which helps in investig"ting
the stability of the system. .
Describing Function Aaa]ysls: This, method is based on the principle .of harmonic
.linearizationin which for certain class of nonlinear systems with low pass characteristic.
damper system. The frequency responses of the system with a linear spring, hard spring . This method is useful for the study ofexistence of limit.cycles arid determination'of IlIC

I and soft spring are as shown in Fig. 6.2(a), Fig. 6.2(b) and Fig. 6.2(c) respectively. For a
hard spring, as the input frequency is gradually increased from zero, the measured
amplitude, frequency :md'stabilfty of these.limit cycles. Accuracy is better for 'hfgber
order sYstemsasthey have better low pass characteristic. .

I 2
l
58

VTlve
LearnTng

~jtc:---
L1apunov's Method for StabDlty: The analytical solution of a nonlinear system israrely ,
possible. If a numerical solution is attempted, the question Of stability behaviqnr can nOI
be fully answered as solutions to an infinite set of initial conditions are needed: The
Russian mathematician A.M. Uapunov introduced and formalised a method which 8Jlows
one to conclude about the stability without solving the system equations. .
6.4 Classification of Nonlinearities "'-- ~...
The. nonlinearities are classified into i) Inherent nonlinearities and ii) Intentional '~"
.
nonlinearities.
The nonlinearities which are present in the components used in system due to the inherent
imperfections or properties of the system are known as inherent nonlinearities, Examples
---- :~.-.
Figure 6.4
are saturation in magnetic circuits, dead zone, back lash in gears etc. However iii some
cases introduction of nonlinearity may improve the performance of the system, make Ihe Relay: A relay is a nonlinear power amplifier which can provide large power
system more economical consuming less space and more reliable than the linear system' amplification inexpensively and is therefore deliberately introduced in control systems. J\
designed to achieve the same objective. Such nonlinearities introduced intentionally to relay controlled system can be switched abruptly between several discrete states which
improve the system performance are known as intentional nonlinearities. Examples are are usuaIlY.'lff, 'full forward and full reverse. Relay controlled systems find wide
different types of relays whiel, are very frequently used to perform various tasks. But it, applications in the c\lDtrolfield. The characteristic of an ideal relay is as shovn in figure.
should be noted that the. improvement in system performance due to nonlinearity is In practice a relay has a definite amount of dead zone ns shown. This dead zone is caused
possible only under specific operating conditions. For other. conditions, generally by the facts that relay coil requires a finite amount of current to actuate the relay. Further.
nonlinearity-degradesthe performance of the system. . since a larger coil current is needed to close the relay than the current at which the relay
drops out, the characteristic alw.aysexhibits hysteresis.
6.S Common Physical Nonlbiearities: The common examples of physical
nonlinearities are saturation, dead zone, coulomb friction, stiction, backlash, different Multivariable Nonlinearity: Some nonlinearities such as the torque-speed characteristics
types of springs, different types of relays etc. .. of a servomotor, transistor characteristics etc., are functions of more than one variable.
Such nonlinearities are called multivariable nonlinearities.
Saturation: This is the most common of all nonlinearities. All practical systems,' when
driven by sufficiently large. signals, exhibit the phenomenon of saturation due to
limitations of physical capabilities of their components. Saturation is a common
phenomenon in magnetic circuits and amplifiers.
Dead zone: Some systems do not respond to very small input signals. For a particular
range of input, the output is zero. This is called dead zone existing in a system.' The
input-output curve is shown in figure. .

_lion
Figure 6.3
Backlash: Another important nonlinearity commonly occurring in physical systems is
hysteresis in mechanical transmission such as gear trains and linkages. This nonlinearity
is somewhat different from magnetic hysteresis and is commonly referred to as backlash,
In servo systems, the gear backlash may cause sustained oscillations or chattering
phenomenon and the system may even turn unstable.foriarge backlash. . .'
.'
59 60

Chapter 7
This equation may be written in the standard form
Phase Plane Analysis
7.1 Introduction X + 2(<<.I"x + '''~x = 0
where; and (I). are the damping factor and undamped natural frequencyof the system.
Phase plane analysis is one of the earliest techniques developed for the study of second
order nonlinear system. It may be noted that in the state space formulation, the state Defining the state variables as x = x and x = X2, we get the state equation in the state
_ variable form as
variableschosen are usually the output and its derivatives. The phase plane is thus a state
.. plane Where the two state variables X, and X2 are analysed which may be the output
variable y and its derivative y. The method was first introduced by Poincare, a French
X1
Xl =.'(2

= -2{WI:'~:2-Wf;Xl
ma!hemadcian. The method is used for obtaining graphically a solution of the following
two simultaneous equations of an autonomous system. These equations may then he solved for phase variables x, and '2. The time response
riots of x" X2 for various values of damping with initial conditions can be p!otted.. Wh~n
x, = f,(x,.x2) the differential equations describing the dynamics of the system arc nonli~ear, It IS In
Xz = 12(>'1':<2) general not possible to obtain a closed form solution of x" X2. For example, if the spnng
force is nonlinear say (kjx + k"x3)the state equation rakes the form
Where x, = h(x1,,,,) and x2 = f.(x"x2) are either linear or nonlinear functions of the
state variables Xl and X2 respectively. The state plane with coordinate axes Xl and X2 is Xl = ~:z
called the phase plain. In many cases, particularly in the phase variable representation of
systems, take the form ' .
X2 - _Lx
- M -~x
M - !2x
2 1 fo." J
Xl = Xz
Solving these equations by integration is no more an easy task. In such situations, a
x, = f,(x"x,) graphical method kpown as the phase-plane method is found t? be very help~l. The
coordinate plane wiThaxes that correspond to the dependent vanable x, and X2 IS called
The plot of the state trajectoriesor phase trajectories of above said equation thus gives an
idea of the solution of the state as time t evolves without explicitly solving for the state. .' phase-plane. The curve described by rhe state point. (;;"X2) in the ph?se-plane with
The phase plane analysis is particularly suited to second order nonlinear systems with no respect to time is called a phase trajectory. A phase trajectory can be easily constructed
by graphical'techniques. ..
input or constant inputs. It can be extended to cover other inputs as well such as ramp
inputs, pulse inputs and impulse inputs. ' 7.2.1 Isoclines Ml!thod:
7.2 Phase Portraits
From the fundamental theorem of uniqueness of solutions of the state equations or
. ,

differentialequations, it can be seen that the solution of the state equation starting from an
Let the state equations for a nonlinear system be in the form
x, = flxvxll
x: = f:_ (x1'x2)
initial state in the state space is unique. This will be true if fJ(X"X2) and h(x"x2) are'
analytic. For such a system, consider the points in the state space at which the derivatives Whereboth i,(X,~'t2)and [o(x,.x,) are analytic.
of all the state variables are zero. These points are called singular points. These are in From the above equation, the slope of the trajectory is given by
fact equilibrium points of the system, If the system is placed at such a point, it, will
continue to lie there if left undisturbed. A family of phase trajectories starting from .' dx, ~ hex "x,) =M
different initial stales is called a phase portrait. As time t Increases, the phase portrait d_~, f,(x"x,)
graphically shows how the system moves in the entire state plane from the initial states in Therefore, the locus of constant slope of the trajectory is given by
the different regions. Since the solutions from each of the initial conditions are unique,
!he phase trajectories do not cross one ano!her. If the system has nonlinear elen)ents f2(x"x2) = Mf,(x,,x2)
_which are piece-wise linear, the complete state space can be divided into different regions The above equarion gives the equation to the family of isoclines. For different values of
and phase plane traJectoriesCOnstructedfor each ')f the regions separately. M, the slope of rhe trajectory, different isoclines call be drawn in the phase plane.
7.3 Phase Plane M9thod Kno",ing the value of M on a given isoclines, it is easy to draw line segments on each of
Consider the homogenous second order system with differential equations
d2x dx
, .
!hesejsocIiR<;S_,
.
Consider a simple linear system with state e_quatJOns
M at' + f dt + kx =_o

Dividing the above equations Weget the slope of the st<te trajectory in the X,-X2plalle as
.61 62

VTU~ VTU_X; ..
Lecirn~ng LearnTng
3. For typical values ofM, draw a large number of isoclines in x,-x2 plane
4, On each of the isoclines, draw small line segments with a slope M,
5, From an initial condition point, draw a trajectory following the line segments with
slopes M on each of the isoclines.

For a constant value of this slope say M, we get a set of equations Example 7.1: For the system having the transfer function .r.'~1) and a relay with dead

-1 zone as nonlinear element, draw the phase trajectory originating from the initial condition
x2=(M+l)Xl (3,0).
.'
which is a straight line in the XI-Xl plane. We can draw different lines in the XI-Xl plane
for different values of M; called isoclines. If draw sufficiently large number elf isoclines
to cover the complete state space as shown, we can see how the state tdjectories: are
moving in the state plane. Different trajectories can be drawn from different iIijtlal
conditions. A large number ..r such trajectories together form a phase portrait. A few
typical trajectories are shown in figare given below. .
The differential equation for the system is i:" + C = II where u is given by

+1 ife> 1
,< = 0 ll- 1 < " <; 1
{-1 tfe<-1

Since the input is zero, e = r -e- c = -c and the differential equation in terms of error will be
e+';=-l1
Defining the state variables as x, = e and X2 = ;, we get the state equations as
Xl=X2

'{:2:- -X2-U

The slope of the trajectory is given by

dxz = -xz-u = !vI


dX1 ;'(2

Equation to the-isoclines is given by


-Xz-lt

.~?- ]I! _.~~~ _

We can identify three regions in the state plane depending on the values of e = x"
Phase plot' Region1:e=x.> 1
1
Figure 7.1 Here u = 1, so that the isoclines are given by x:z=~ or .x ..
.:.
=-
M-l

..
,
The Procedure for constructlon or the phase trajectories can be summarised' as
below:
For different values of M, these are a number of straight lines parallel to the x-axis .

I. For the given nonlinear differential equation, define the-state variables as X, and Xl
and obtain the state equations as
x, = /"(X"X2)
2; Determine tbe equation to the isoclines as
Region2: e= -1 <x, < 1
dx, = 1("1'x2) = M
dx, X,
63 ....
64

VT~ .'
Licirn'fng
Here u = 0, so that the isoclines are given by x2 = ~ or M = 1, which are parallel lines
having constant slope of 1. Trajectories are lines of constant slope .1. . The slope of the trajectory is given by
Region 3: e = ", <-1
dx! = -2x,- 5:<1+ 10 = M
Here u = ~1so t hat on su bsutution
" we get xt, = -~.+1
M or %2 == M+i
1
dx! X2
-r-Sx1' 10
These are also lines parallel to x - axis at a constant distance decided by the value of the :. .":z:::: M+""7. i' M + ?
slope of the trajectory M. .

'. When xj

-SX1
e

+~
O,

=0 c>r Xi =2
M+2 M.+2
ie., all the isoclines will pass through the point x, = 2, X2 = 0.
WhenM",O,
-5' 10
"'=27"1+"2
s=o WhenM =2,
1/3
1 -5 10
3 "2=4""1 +4'
-s
-3
,
WhenM=4,
-7/3 -5 10
-2 "'=5"1 +5"
WhenM = 8.
-5 10
"2 =10.11+ 10
Figure 7.2: Phase portrait ofExarnpl" 1
WhenM=2,
X2. == 00
Isoclines 4rawnfor all threbegioDs; are as shown in figure.' It l~ seen that :trajetOries
from either region I -or 2 approach 'the b"onnllazy between the regions and appro.!:]; the WhenM=4,
origin along a line at-I slope: The state-"lIt)setlleatany value ofx, between-t and:+1 as 5 10
this beinga dead zone-and-no:(urther-movement-to the origin along the x,"axis will be ~'(2- "2.:.tr; 2"
possible. This will result in a steady state error,.the maximum value of whieh-is.equal to
half the dead zone. However, the presence of dead zone ean reduce the oscillations and WhenM=~:
result in a faster response. In order that the steady state error.in the output is !'Muced, it'is '5 10'
better 10 bave as small a dead zone as possible. _ - x2 ="4%1:"4
Example 7.2: For the system having a closed loop transfer function _.. " , plo; the WhenM=10.
phase trajectory originating from the initial condition H,0). +21+5 : 5 10
x2=8""-8'
The differential equation for the system is given by
x+2X+Sx= 10
Let x = xtandi:::: x2
Then, Xl = x2
X2 = -2r2 - 5x, + 10
.. 65 66

VTU~
..... (J)
Learning
Therefore, the slope equation over a short interval is given by
dx. Xl +15
dx, =--;::-
With 1) known at any point P on the trajectory and assumed constant fora short interval,
~e can draw a short segment of the trajectory by using the trajectory slope dX2/dx, given
m the above equation. A simple geometrical construction given below can be used for
this purpose. .
1. From the initial point, calculate the value of o.
2. Draw a short arc segment through the initial point with (-0, 0) as centre, thereby
determining a new point on the trajectory.
3. Repeat the process at the new point and continue. .

Example 73: For the system described by the equation given below, construct tile ".
trajectory starting at the initial point (I, 0) using delta method.
:Y+x+x' =0
Let x= X1C1"dx = x2 then
Xl =X1

Figure 7.3
X, = -x" -Xf
The above equation can be rearranged as
The isoclines are drawn as shown in figure. The starting point of the trajectory is marked
at (-1,0). At (-1,0), the slope i~ 00, ie., the trajectory will start at an angle 90. From.the x, = -(x, +x, +x~ - x,)
next isoclines, the average slope is (8+4)/2 = 6, ie., a line segment with' a slope 6 is drawn SOthat 8 - x~ + xI - -.
(at an angle 80.5").Thesame procedure is repeated and the complete phase trajectory will
b~ obtained as shown in figure. At initial point 6 is calculated as 0 ~ 0+1-1 = O. Therefore, the initial arc is centred ai
point (0, 0). The mean value of the coordinates of the two ends of the arc is used [0
7.3.2Deha Method: calculate the next value of 0 and [he procedure is continued. By constructing the small
The delta method of constructing phase trajectoriesis applied to systems of the form arcs if!this way the complete trajectorywill be obtained as shown in figure.
x+f(x,i,t) "=0
Where f(x,x. t) may be linear or nonlinear and may even be time varying but must be
continuous and single valued.
With the help of this method, phase trajectory for any system with step or ramp or any
time varying input can be conveniently drawn. The method results in considerable time
saving when a single or a few phase trajectories are required rather than a completephase
portrait.
While applying the delta method, the above equation is first converted to the form
x + "',,[x + c5(x,.t,t)]=0
In general, c5(x,:i, t) depends upon the variables x, x and t, but for short

.. changesin these variables are negligible. Thus over a short interval, we have
x + "'n [x + 15] = 0, where IIis a constant.
Let us choose the state variables-as XI = X; x.- Xl..;,., then
Xl = CUn%:
Xz - -Wn(AI + .:)" Figure 7.4

12
"
.6.7 _
68
.'
VTU)e'
VTUg
l.ecirjnTng ....
Learnrng
oscillation with constant amplitude. This is shown in figure (i). The inside of the limit ...
7.4 Llmlt Cycles:
cycle is an unstable region.in the sense that trajectories diverge to the limit cycle, and the
Limit cycles have a distinct geometric configuration in the phase plane portrait, namely, outside is a stable region in the sense that trajectories converge to the limit cycle.
that of an isolated closed path in the phase plane. A given system may have more than A limit cycle is called an unstable one if trajectories near It diverge from this limit cycle.
one limit cycle. A limit cycle represents a steady state oscillation, to which 01' from In this case, an unstable region surrounds a stable region. If a trajectory starts within the
which all trajectories nearby will converge or diverge. In a nonlinear system, limit cycles stable region, it converges to a singular point.within the limit cycle. If a trajectory starts
describesthe amplitude and period of a self sustained oscillation. It should be pointed out in the unstable region, it diverges with time to infinity as shown in figure (ii). The inside
that not all closed curves hi the phase plane are limit cycles. A phase-plane portrait of a of an unstable limit cycle is the stable region, and the outside the unstable region.
conservative system, in which there is no damping to dissipate energy, is a continuous
family of closed curves. Cased curves -ef 1J.i.lcind are Dotlimit cycles because none of 7.5 Analysis and Classification of Singular Points:
these curves are isolated from one another. Such trajectories always occur as a Singular points are points in the state plane where "', = "'~= o. At these points the slope
continuous family, so that there are closed curves in any neighbourhood of any particular of the trajectory dx,ldx, is indeterminate. These points can also be the equilibriumpoints
closed CUrve. On the other band, limit cycles are periodic motions exhibited only by of the nonlinear system depending whether the state trajectories can reach these or not.
nonlinear non conservative systems. . Consider a linearised second order system represented by
As an example, let us consider the wen known Vander PoI's differential equation
d2"
dt' -P(l-x')dt
dx
+x=o
t!~]=.~ ~J[;~J
Using linear transformationx?7fft the equation can be transformedto caoonicalform
which describes physical situations in many nonlinear systems.
In tenus of the state variables "1 -" ~.,..l"2 - i,we obtain
[~lJ 0 AO][~']
z, = [)" z _,
i'1 = %2 Where, A, and A, are the roots of the characteristic equation of the system.
:t, = If(l-xDx, -x, The transformation given simply transforms the coordinate axes from XI-X, planeto z,-z,
-- --plane-lfaving the same origin, bui- does not'affecCthe nature of the roots of the
The figure shows the.phase trajectoriesof the system for )l> 0 and )l < O. Incase of)l > 0 characteristic equation. The phase trajectories obtained by using this transformed'state
we observe that for large values of 11,(0), the system response is damped arid the equation still carry the same information except that the trajectories may be skewed 0:'
amplitude of X,(I) decreases till the system state enters the limit cycle as shown by the stretched along the coordina.e axes. In general, the new coordinate axes will not be
outer trajectory. On the other hand, ifInitially x,(O) is small, the damping is negative, and rectangular.
hence the amplitude of lI,(t) increases till the system state enters the limit cycle as shown The solution to the state equation being given by
by the inner trajectory. When)l < 0, the trajectories.moves in the opposite directions as
shown in figure. . z,(t) = ei,.'z,(o;
z,(t) = e1,z,(U)
~2=Y
The slope'of the trajectoryin the z, - z, plane is given by
dz, _ A,Z, _ taue
dZ1 A.171

dz, _ (~)(dZl)
Z2 U1 Zl)
Unstable
limit
.'. h.(z,) - G:)lltC"l) (II" ", - t"(Zl/'h.,
cycle
Based on the nature of these eigen values and the trajectory in z, - 2, plane, the singuiar
(i) u>0 (ii) )l < 0 points are classified as follows.
Nodal POint:
Figure 7.5
A limit cycle.Is called stable if trajectories near the limit cycle, originating from outside 'Considereigen values are real, distinct and negative as shown ill figure (a). For this ease
or inside, converge 10 that limit cycle. In this case, the System exhibits a sustained the equation of the phase trajectoryfollows as z, = c(z,)".
7.0

VTu2
LearnTng
Where, k, '" O..,iA,) ::: 0 so that the trajectories
become a set of parabola as shown in figure (b) and'
the equilibrium point is called a node. In the; The slope

r""'" original system of coordinates, these trajectories"


appear to be skewed as shown in figure (c). .
.If the eigen values are both positive, the nature of
dy: _
dy: -
-Cd}'1
0')"
+ 0']'2 Yz -
+ wy-; F Y, -
kYl
kyo
the trajectories does not change, except that the ,
trajectories diverge out from the equilibrium point Define ~ = tan", {md ~ = tan 9
as both z,(t) and Z2(t)are increasing exponentially.
The phase trajectories in the XrX2 plane are as We get,
,
shown in figure (d). This type of singularity ill Ian 9 -k
identified as a node, but it is an unstable nod";as the ton 'II = 1 + k tan 9 nr bn( II - 'II} = k
trajectories diverge from the equilibrium point.
Saddle Point:
,
Consider now a system with eigen values are real,
. This ~s ~!' eQuation for a.spiral in the polar coordinates, A plot of this equation for
negative values of real part is a family of equiangular spirals. The .origin which is a
singular point in this case is called a stable focus. When the eigen values are complex
distinct one positive and one negative. Here, Oneof conjugate with positive real pam, the phase portrait cohsists of expanding spirals as
(dI __ ' .... the states corresponding to the negative eigerivalue shown in figure and the singular point is an unstablefocus. When transformed into the
converges and the one corresponding to positive eigen value diverges so that She x,-x, plane, the phase portrait in the above two cases is essentially spiralling in nature,
trajectories are given by 'I., '" C(Z,ykor (z,tz,'" c which is an equation to a rectahgulir. except that the spirals.are now somewhat twisted in shape.
hyperbola for positive values of k. The location of the eigen values, the phase portrait in y,
1., - l!:! plane 'and 1n the x, - x, plane are as shown in figure. The equilibriumpnlnt
around which the trajectories are of this type is called a saddle point. . " , -a:Jfi) 'Ii'"
:

tj"
(a) Ei!cnvalues (b) PhIa<!transec:IOfiu.stablcfacus

Phase tlajectories around hilb!e focus

.
u-jro

Figure 7.7 (b)Phaxlrajccloritsunllllble rocus


Phase trajectories around unstable focus
Focus Point:

.. Consider a system 'with complexconiugete eigen values. The canonical form of the state
equation can be written as Centre or Vortex Point:
Figure 7.8

[~1]"=[" 0
%2
+)I>} o .: ] [~lJ
7-:)6) 42 ..
Consider now the case of complex conjugate eigen values with zero real parts,
ie., A,,:l.2= jro
,Usinglinear transformation, the equation becomes

.'
.'
,71 72

VTU.Ae VTU)e
.. ,.
LearnTng Learnmg
_ 2 10.
x2 - -Xl + O.lx, - X, - '3X2

Integrating the above equation. we get y! +


yf = R2 which is an equation to a circle of At sU;gular points, :i:1 = x2 = 0 ctIld "= ,,; -x, + 0.lx2 - xi - - x~ = 0
radius R. The radius. Rcan be.evaluated from the initial conditions. The trajectories are
thus conc:mtric circles in YI-Y2 plane and ellipses in the XI-X2 plane as shown in figure.
So that the singular points x2 = 0 and - x, - x1 = 0 t.e.,x,(x, + 1) = 0
Such a singular points. around which the state trajectories are concentric circles or i.e., Xl =0 or-1
ellipses. are called a centre Or vortex.
The singularities are thus at (0,0) and (-1,0).
Linearization about the singularities:

Ot. B"]

+
,
The Jacobean matnx J

= [!h. !h.. = [-(1 +0 2x)
D;;rl 0.%1

x, 8:r a~
1

Linearization around (0,0), i.e., substituting XI = 0 and X2 =0


(a) Eigm values (b) Cen_ in 11- 12 plane (c) Center in A',-

Phase tralectories around vortex or center


Xl plane
/(0,0) = [~1 0.1
1 1
Figure 7.9
The characteristic equation is III-A I= 0
Example 7.4:
Determine the kind of singularity for the following differential equation.
11 ,,=~.ll-o
y+3y+2y = 0 i.e., A(AO.I)+I = 0 or A2- o.a + I =0

Let the state variables be ,T, = Y and x 2 = j. ""AZ = O.S( 0.1 f j{3Jj9)
The corresponding state model is The eigen values are complex with positive real part. The singular point is an unstable
focus.
Xl:: x~
Linearization around (-1.0)
X2 = -3x2 - 2x, I
At singular points. X, = x2 = 0 and x, = -3x2 - 2:<:, =0 : Ie-1,0) - [01 1 ]
0.1
Therefore: the singular point is at (0.0) The characteristic equation will be
A_[O -2 -3
1] A -1 1
.1-1 A_ 0.1 - 0-
The characteristic equation is IJJ - A I= 0 Therefore A2- O.IA 1 = 0

. I;'
I.e, 2 A+3 =0
-1 1' Or
AI. 1..2 = 1.0~ and -0.98. Since the roots are real and one negative and another positive. the
singular point is a saddle point.

AI. A2
node.
= -2, -I. Since the roots are real and negative. the type of singular point is Example 7:6:
Dder:mineih?_1tind <lhingularity for the following differential equation,
Example 7.5: For the nonlinear system having differential equation: x +.o.~~+';Zx + x2 = 0.
y- (0.1 - ~ j.2)y + y + y' = 0, find all singularities. Let the ~tate variables be ", = x and x2 = x

Defining the state variables as.v = X" Y = x2 the state equations are The corresponding state model is

Xl =X2 Xl =%2

X:z = -O.SX2 - 2r h- xi

' ..
.73 74

VTU~
Learnfng
At singular points, x, = x. = 0 and %. = -o.Sx, - 2X, -:rI =0
So thattbe singular points ". = 0 and -2x, -xi i....,x,(x] + 2) = 0 Chapter a
i.e. x,=O or-2 STABILITY ANALYSIS
The singularities are thus at (0,0) and (-2,0). 8.1Introduction:
Linearization abollt the singularities: For linear time invariant (LTI) systems, the concept of stability is simple and can be
formalised as per the following two notions:
a) A system is stable with zero input and arbitrary initial-conditions if the resulting
trajectory tends towards the equilibrium state.
b) A system is stable if with bounded input, the system output is bounded.

Linearization around (0,0), Le., substituting XI = 0 and X, = 0 In nonlinear systems, unfortunately, there is no definite correspondence between the two
notions. Th~ Iinear autonomous systems have only one equilibrium state and their
behaviout aliout the equilibrium state completely determines the qualitative behaviour in
the entire statep)ane. In nonlinear systems, on the other hand, system behaviour for small

The characteristic equation is III-A I= 0 deviations about the' ~i1ibrium point may be different from that for large deviations.
Therefore, locpl stability does not imply stability in the overall state plane and the two

I" I concepts should be considered separately. Secondly, in anonlinear system with multiple
2 -1 =0
J.+OS equilibrium states, the system trajectories may move away from one equilibrium point
and tend to other as time progresses. Thus it appears that in case of nonlinear systems,
i.e., A()..+ 0.5) + 2= 0 or)..' + 0.5)..+ 2= 0 there is no point in talking about system stability. Morr meaningful will be to talk about .".
the stability of an equilibrium point. Stability in the region' close to the equilibrium point
,1"..1. = (-V.2S 'f J1.119;
or in the neighbourhood of equilibrium point is called stability in the small. For a larger
The eigen values are complex with negative real parts. The singular point is a region around the equilibrium pomt, the stability may be referred to as stability in the
focus. large. In the extreme case, we can talk about the stability of a trajectory starting from
i.~:,:y;;;'h~..:. ..V...:An'lOp~~~'"
'~i~t~ ~~b~""~pa ....,"" t!l~i-.'~;l:r!; ,,",urn-J 5~ob41.~-i.d&ii.iiy,A ~ilJt}Jkphysical
Linearization around (-2.0l
illustration of different types of stability is shown in Fig. 8 1
I( -1.,0) = [~ -~sl
The characteristic equation will be

L~2 A ~~.51 =.0


Therefore)..2 + 0.5).. 2 = 0

"1,"2= t..)9 and -1.69. Since the roots are real and one negative and another positive, the
singular point is a saddle point. . [c)

Fig. 8.1 Global and local stability


.75 "-
.
---.- .76

VTU~ VTU~
..
Learnrng LiarnTng
Equilibrium State: In the system of equation x
= f(""t), a state z, wherej{'i<,t) 1= 0 for 8.3 StabiJ.ity by the Method of Liapunov
all 'I' is called an equilibrium state of the system, If the system is linear time invariant,
namely j{x,t) = Ax, then there exists only one equilibriwn stale if 'A' is non-singular and Russian mathematician A.M. Liapunov has proposed a few theorem. for the study of
there exist infinitely many equilibrium states if 'A' is singular. For nonlinear sjrstem~, stability of the system. The most popular among this is called the "Second Method of
... there may be one or more equilibrium states. Any isolated equilibrium state can be
=
shifted to the origin of the coordinates, or /(0.1) 0, by a translation or coordinates:
Liapunov" 'or "Direct Method of Liapunov". This method is very general in its
formulation and can be used to study of stability of linear or nonlinear systems. The
method is .called 'direct' method as it does not involve the solution of the system
8.2 Stability Definitions: differential equations and-stability information is available without solving the equations
. .
The. .~===.'.::..:.=!:.::'=.:::::.......
stability. These are discussed below.
~"'..!,!~,
~:::::.-:.~;
~..:.:. =.!;;--=.
:.:~:-==!~. :!"..: =!'!'~--=~:
:j~~ of
.
which \s definitely an advantage for nonlinear systems.
obtained by this method is precise and involved no approximation.
The stability information

x
Stability: An equilibrium state x, of the system = lex, tj is said 10 be stable if f6r each First Method of Liapunov: The first method of Liapuoov, though rarely talked about, is ,IW
real number s c- 0 there is a real number o(e,to) > 0 such that OXo :s; (; imp)i~s. -"'.11 essentially a theorem stating the conditions under which system stability information can
1I1P(t:xq,to) -",.11 :s; 6 for all t2: to The real nnrnber S depends on & and in general, also be inferred by examining the simplified equations obtained through local linearization.
a
depends on to If does nOI depend on to, the equilibrium state is said to be uniformly This theorem is applicabi unly to aUtUnOHWUS systems.
stable.

An equilibrium slate X, of the system of equation x=


f("" t) is said to be stable in the
8.4 Sign Definiteness
Let
, "
V'(Xh X2,'X.3
.
Xn) be a scalar function of the state variables Xl, X2, X3........ Xn.
sense of Uapunov if, cOJT~sponding to each S(s), there is an 5(0) such that trajectories Then the following definitions arc useful 'or the discussion of l.iapunov's second method.
starting in 5(0) do not leave S(S) as t increases indefinitely. .
8.4.1 Scalar Functions:
Asymptotie Stability: AD equilibrium state x, of the system x-
{(x,!) is said 10 be
asymptotically stable, if it is stable in the sense of Uapunov and every solutioli starting A scalar function Vex) is said to be positive definite in a region fl if Vex) > G-for all
within S(Ii) converges, withoul leaving S(s), to x, as 't' increases indefiuitely. . nonzero srales x in the region nand V(O) ~ O.

Asym;;>!ctlc Stability in the Large: If asymptotic stability holds for all statee from A scalar function Vex) is said to be negative definite in a region n if Vex) < 0 for all
Which trajectories originate, the equilibrium state is said to be asymptotically stable in the
nonzero states x in the region nand V(O) = o.
large. An equilibrium state x, of the system :it =!(""~)is said to be asymptotically A scalar ful!ction Vex) is said 10 be positive semi-definite in a region n if it is positive for
stable in the large, if it is stable and if every solution converges 10 x, as '1' increases all states in the region n and except at Ihe origin and al ce!'.ain Other stales. where it is
~-'::"'::"~~]':;:":",~,,,, '"---] -'''~~~n :......-Ju.y:.....
...o~:.:..:~:;
;.: ~ :!'..:.. !~~
:~6 .... ~Ui. zero.
there is only one equilibrium slate in the. whole stale space. .
A scalar function Vex) is said to be negative semi-definite in a region n if it is negative
The above said definitions are re~resented graphicallyin Fig. 8.2 for all stales in the region n and except at the origin and at certain other states, where it is
zero.

/::--~'>'t::(;s 1I.(t~I< Ill(ojll;'6 A scalar function Vex) is said to be indefinite if in the re~jon n it aSS1.1rnt"~
hOlh n, ...;th,~

I ?;::/ y~II<~ and negalive values, n~ matter how small the region fl is. -
Examples:
.

x: +-'i!
\~
Vex) - - Positit?e definite.

)((~ ) Vex) = (Xl


Vex)
+ xz}"
= -(xi + xi)
- Pasi!;;"esemi definite.
- Negative definite.

.oil ~.~ (b)


Vex) = -xf-
Vex) = -:x,
(3:1:,
+ x,)'
+ 2x.)' - Negative definite.
- Negative semi definite .
- Indefinite.
Fig. 8.2' Uapunov's Stability .'
8.4.2 Sylvester'fI Criteria for Definiteness:
instability: An equilibrium state x, is said 10 be unslable, if for flVrne real nwnbei 6 ,. 0
A necessary and sufftcient condition in order that Ihe quadratic form xTAr, where A is an
and any real number Ii > b, no matter how small, there is always a .taIC ... ;". ::;(~ ,,,.!.
0)," real sym'l'etric mR!rix, be positive definite is that the determinant of A be positive
thaI the trajeclory starting al this 8tale leaves S(6). :
and Ihe successive principal minors of the delemlinant of A be pO.,ilive.
.. 1.7 78

i.e.,
Example 8.2:--xi - 3x~ + xi + .J.x,x, + 8x,x,

A necessary and sufficient condition in order that the quadratic fonnxTAr, where A is an Successive principal minors are
nxn real symmetric matrix. be negative definite is that the determinant of A be positive if
n is even and negative if n is odd. and the successive principal minors of even order be 1> 0; I~J<: 0
_' positive and the successiveprincipal minors of odd order be negative.
Hence, the given quadratic form is indefinite
i.e.,

au < c, tau
au a.:1
"22
>0

aiz "13
r- 1 -11
rQu
S1
all
a2Z a:, < 0...
au a"
IAI > 0 :f n Is ."en and IAI < 0 If IIis odd. -- l-~-2 ':1-11
Successive principal minors are
A necessary and sufficient condition in order that the quadratic.formxTAr, where A is an
nxn real symmetric matrix, be positive semi-definite is that the determinant of A be -1 < 0,
. 1-11 -3-
11-" 0
singular and the successive principal minors of the determinant of A be nonnegative.
i.e., Hence the quadratic form is negative definite,
...
all :::: la nl~1
0, a.,
ll (J

~
1\
v, laa"u
au
au
a",
a"
4:3 ~
au,
an
0....._, r"
"21'
::
anI
ai
a!.

".2
... a
...
'1n =0
1R

ann
I 8.5 Second Method of Liapunov
The second method of Liapunov is based on a generalization of the idea that if the system
,~ .:.:: '':::Y=";::':~:;:.!~)':::.!;!: ":""'l_':!:~~::';:-''Z::~~;:.. :!-.:::: :.~;: ::~:::-:~ :::::-0:" :: ~!:.:.,.-.~-.-:~-
displaced within the domain of attraction decays with increasing time until it finally
A necessary and sufficient condition in order that the quadratic form xTAr, where A is an assumes it', minimum value at the equilibrium stale, The second method of Liapunov
nxn real symmetric matrix. be negative semi-definite is that the determinant of A be consists of determination of a fictitious energy function called a Liapunov function. The
singular and all the principal minors of even order be nonnegative and those of odd orders idea of the Liapunov function is more general than that of energy and is more widely
be nOD positive. applicable, Liapunov functions are functions of Ail 1\.2. A3 , .. An. and t. \V(. ~":"ii\Jt.:,
i.e., Liapunov functions Vex,. x,.
X3 xn t) or V(X.I)or Vex) if functions do not include
...
r"
t explicitly. In the second method of Liapunov the sign behaviours of V(X.I)and its time

r
at2
a11 :So 0,JaQll a" 12: V.
a12
,,>, a", a" S u.... ..... au: Qi!:2
... ainl
a=;",
derivative b( x, r) give information on stability. asymptotic stability or instability of the
2> 2: aOl 0131
l1 a:rz a.. ...
=U equilibrium state under consideration at the origin of the state space.
On, all2 Rnn Theorem I: Suppose that a system is described by x = f(x.t). wheref(O.I) = 0 for all t.
If there exists a scalar function V(x.t) having continuous first partial derivatives and
Example 8.1: Using Sylvester's criteria. determine the sign definiteness of the following satisfying the following conditions.
quadraticforms
L V(X.I) is positive definite
10xi + xi + 4x;+ 4x,x, + 6.~,x,+ 2X2X,
2. V(x.t) is negative denllite .,.

...A=[~!3 1 4
~J I.e. IAI > 0
Then the equilibrium state at the origin is uniformly asymptoticallystable. Ifin addition
V(..,.t) ... 00 as IIxll ... cc then the eqUilibrium state at the origin is uniformly
asymptotically stable in the large.
Successiveprincipal minors are
A visuai analogy may be obtained by conSideringthe surface i' = ~x~ + ~kxi. 111isis a
10> O' 1210 21>
1 0 cup shaped surface as shown. The constant V loci are ellipses on the surface of the cup.
Let (rf. :r:) be th" initial condition. If one plots trajectory on the surface slJown.thc
Hence.the given quadraticform is positive definite. " representative point X(I) crosses the constant V curves and moves towards the lowest
poinl of \.he cup which is the equiiibrium poim.

"
80

VTU,2
I ;.:..:...:to'Ioc;>.......,
'.,.~~~.u ; n. '~
Example 8.4: Determine the stability of following system using Liapunov's method.
x1=-x -x:z
J and Xl=Xl-X~

Let us choose Vex) = xi +x~


Then V(x) = 2x,"I +. 2x,x, = 2x,( -x, - x,) + 2x,(x' l - x~)

= -2Y7 - '2:x.x~ + 2x.x .. - 2x~:;:; -2xt - 2:r~


,,,. This is ~e~a.tivedefinite. Hence the system is asymptoticallystahle.

.
Example 8.5:' Determine the stability of following system using Liapnnov's method.
x.=.t .. cm-.d:i-,,=~x.-., ..
Let us choose Vex) = xi + xi
Then vex) = 2x,x, + 2",*, = 2x,", + 2xi -x,- x,) = -2x~
r-"''''-:o!'UP co!",",!,Apfin,tp fnnrtion. Tf V{Xl is '0 he' vanish identicallv for t ~ tr. ~h~!l
'Th;r 'co.,
x~';"~~;be'z-;;rofor all!;:: to. ... x, = O. Ther. x, = =
-x, - .t, 0 i.e.x,must be Z lO.
This means that Vex) vanishes identically only at the origin. Hence the equilibrium state
at the origin is asymptoticallystable in the large.

Example 8.6: Determine the stability of following system using Liapunov's method.
Xi = Xi. and x~= -X2 - x:
Let us choose V(~) = xr + x;
Fig. 8.3 Energy function and movement of states
Then VCx) = 2x,x, + 2x,x, = 2x,x, + 2x2: -x, -xD = 2x,x, - 2xi' - 2,,:x,
~ yl'''' J - - - ;... J .-_ , , .." _._.}\ .. , _: .. ~. ~ _
This is an indefinite funr.tio~
O.. If there exists a scalar function V(x,t) having continuous first partial derivatives and
satisfyingthefollowing conditions.
I. V(x,/) is positive definite
-;-.r~...:::~ :..;,~~Z.:.:.:==:~:!:~::!~.:-
Let us choose another Vex) = xi + 2x?

This is negative semi definite function. If Vex) is to be vanish identicallyfor t;:: to.then
..
3. V(0( t; xo,to),t) does not vanish identically in t 2: 10 for any 10and any Xo 'f 0, X2must be zero for all t 210. :. X, = O. Then ;(.,= -x, -,rJ == 0 i.e'''lntltstbe zero.
where 0(t: x.,to) denotes the trajectory or solution starting from Xo at Ij). __ This means liIat 1'(,,) ,.nishes identieltlly-elliy-at-th~rigin. Hence the equilibrium state
4l i..il~Vligill is 4~)'mv\ui.t\;cUJy~idUIt;ill Ult ii1I~~.
Then the equilibrium state at the origin of the system is uniformly asymptotically stable in
the lar~e.

.. If however, there exists a positive definite scalar function V(x,t) such that ll(x,t) is
identically zero, then the system can remain in a limit cycle. The equilibrium state at the
origin, in this case, is said to be stable in the sense of Liapunov.
Example 8.7: Consider a nc.nlinearsystem governed by tlle state eqllations

Let us choose Vex) ~ xi + xi


Th~I),!"d!L30'<;lI!'pn.<e
that a system is nescrihed hy .r=:f(-;:r. t) where.n:O.t);: O.forall t>
to. If there exists a scalar function W(x,t)-bavingcontinuous first partial derivatives and Then VCx) = ::lx,x1+ 2",x, = 2x,( -X, + 2xix,) + 2,.,( -x,)
satisfying the following conditions
= -2x; + 4x~x:!- 2;t~
= -2xr( 1- 2X1X2)- 2x~
I. W(x,t)is positive definite in some region about the origin.
i.e. Vlx) IS lIegatil'e dellnlte il ll- 2x,x,1 >0
.J ,~ ,\ ~_.~ ~_
,'. " .- r-"_'- -_
J.~ . '. !.. d .
ou -
__
'_ _ .-0"'- ~.-. ~_ ..'1---
_ .1.. , ,',,,.,' . _,.
"".:..:.~
.:'.a'_ ." ,..~._
origin is unstable.
... 81 82

Le'orn7ng-
Therefore, for asymptotic stability we require that the above condition is satisfied. The He~~e, for th~ asymptotic stability of the system of x
= Ax, it is sufficient that Q be
region of state space where this condition is not satisfied is possibly the region of posmve definite. Instead of first specifying a positive definite matrix P and examining
instability, Let us concentrate on the region of state space where this condition is whether or not Q is positive definite, it is convenient to specify a positive definite matrix
satisfied. The limiting condition for such a region is (1- 2X,X2) > O. The dividing Q ~~st and t?en examine whether or not P determined from A' P + PA = -Q 'is also
lines lie in the first and third quadrants and are rectangular hyperbolas as shown in posrtive definite. Note that P being positive definite is a necessary condition.
Figure, 8.4. In the second and fourth quadrants, the inequality is satisfied for all values of
XI and X2. Figure 8.4 shows the region of stability and possible instability. Since the Note:
choice of Liapunov function is not unique, it may be possible to choose another Liapunov

.. function for the system under consideration which yields a larger region of stabiliiy.
I. If Vex) = -x'Qx does not vanish identically along any trajectory, then Q may be
chosen to be positive semi definite.
2. In determining! whether or not there exists a positive definite Hermitian or real
symmetric matrix P, it is convenient to choose Q = I, where I is the identity matrix.
Then the elements of P are determined from A'P + PA = -/
and the matrix P is
Stable quadrant tested for positive definiteness.

Example 8.8: Determine the stability of the system described by

[!;J = L~.: ~;]


Stable QUAdrant
Assume a Uapunov function Vex) = x'rx
.
ATp+PA=-T

[ 01 -1
.
-'~] [1'P"11 p",?
1'12J.L~11 p"J [0 1] [-1
Lp." p,; -1 -1 = 0
I

Conclusions:

I. Failnre in finding a 'V' function to show stability or asymptotic stability or in~tability


PH -.p" -i'''J
2P" - 2P12
= [-1
0
.~~~:.::;::!~~~~=
~~:~
?~~~~~~~~~~~~!'::'~ ~ ~, .-:~~'~.J"~M;"''' ....,."t\"J.iJ.;ta_,. '
2. Although a particular V function may prove that the equilibrium stati;' und';' -2P12=-1
consideration is stable or asymptotically stable in the region n, which includes this PH-P,,; =
P22 0
equilibrium state, it does not necessarily mean that the motions are unstable outside'
the region n. . ., 2Pri";2P12F-l
..,. Per a st~b!.: ~: ~j'~y:otic:ill)' stable equilibrium ..i:h t!':.e~.:..;~l~':'~
state, 01 'V function .~
properties always exists. Solving the above equations,

PH =' 1.5; P" = 0.5; and P" = 1

8.6 Stability Analysis of Linear Systems :. p= [~~ 0.5]


1.0
Theorem: The equilibrium slate x = 0 of the system given by equation x ~ Ax is
~,('~.,JJ.'J .l'tDhlP ;~ _,rI -onh ...:H"._m"".." """ . "nco;'f:.1P' "A,..:f;l";"""J.J....,..,.,,;t;~n .,,~~:.,. () lor
1.5 > 0 and det(P) > O. Therefore, I' is positive define. Hence, the equilibrium state at
positive definite real symmetric ;"atrlx), there exists a positive definite Hermitian matrix. origin is asymptotically stable in the large.
P (or positive definite TeIIJ symmetric matrix) such that A'P +PA = -Q. ~ scalar
function :x' p" is a Liapunov function for the system. The Liapunov function Vex) = xTpx
'~(1''\ = ......p\. .
Vex) = [x, x,] !~;~!]l:~]
Vex) = x'Px+x'Px = (Ax),Px +x'PAx = x'A'Px +x'PAx = x'(A'P + PA)" = 0.S(3x; + 2x,-", + 2xD
t.e. V(x) = -x'Qx. where Q = -(A'P + PA) IspositlL'e
.. + 2xi-x,- + ax,x, + 4x,(
definite . Vex) = 0.5 [6x,x, x,) -x, - x,)]

,
L.__

.'
"
.83
84
~~~~.-------
VTU~
LearnTng
=-(xy+xi)
23 > 0 and det(p) > O. 'Therefore,P is positive define. Hence, the equilibrium state at
origin is asymptoticallystable in the large.
Example 8.9: Determine the stability of the equilibrium state of the following system,
Example 8.11: Determine the stability range for the gain K of the system given be~ow.
-1-fl [X']

A'P+PA=-/
-3 J x2

~
:i'] =
~;
'1",
[0 01 -10]["'.. ]+ ~)~
=k
.0 -'2 1 ~2
a
[ttl

-2
[-1+J -_1+11 W11 Pl1l
J lP21
+ [Pu
p.. p,:] [ -2+j -1-fl=[-1 0] In determining the stability range of k, we assume u = O.
3 P., P., -1 -3 J 0-1
4PIl + (1 - j)P'2 + (1+j)P'1 = I .
Let us choose Q =
[000]
a positive semi definite real symmetric matrix
(1- j)PII + 5P" + (I - j)1>22
'" 0

(I + j)PII + 5P'2 + (I +j)Pn" 0



1
This choice is permissible since Vex) = _xT Qx cannot be identically equal to zero
except at the Origin. To verify this, uore that
(I - j)Pd + (I + j)P21 + 6P22 '" I
Vex) = _rT Qx = -xi
Solving the above equations,
Vex) being identically zero implies that k3 is identically zero. If X, is identically zero,
P" = 3/8; P" = - (I + j)/S; PJ:i'" - (I -j)/S; P22'" 114 then X, must be must be zero since we have 0 = - kx, - O. If X, is identically zero, then x,
0.375 -0.125 - }0.125"] must also be identically zero since () = .,. Thus vex) is identically ..ero only at the
+
... P = [...0.125 jO.125 0.25 J origin. Hence we may use the Q matrix defined by a psd matrix.

r
P is positive definite. Hence the origin of the system is asymptotically stable.
Let us so! VC, ATp+PA =-/

oj Ell P"][
a
P") + E"
-kl Pl~ PIZ. 1 0

Example 8.10: Determine the stability of the system described by


~.]_ [-1
[x~ -2' [X'J
~
-2
-1
p".
H
P2~ P23
p" P3~
PZl
:11
P22
Pn
p"
p"
0
0 -2
-k
01
0 -1
1J
= 0
0
0 0 J
1 -4. z X

Assume a Uapunov function Vex)= XTpX i.e., -kpl3-kpl3 =0


A7p +PA =-/ -kP23 + PlI -2pn =0
-k P33+ PI2 - PJ3 = 0
-1
[-2 r- [P'.'
-4. P,., P"
P"] + fP11
lP.,
i'p..1Z][-11 -2'
-4..
= [-1 OJ
0-1 PI2 - 2P22+ PI2 - 2P'2 =0
PIJ-2P23 + P22- P2' = 0
-2Pu + 2P" =-1
P23- r + pl, =ps = -J
-2PII -

-4P" - SP22 I
5P12 + P" = 0 .
=- Solving the above equations, we get

Solving the above equations, 1 [k 2 + 12k 6k 0]


p=--- 6~ 3k k
PII = 23/60; P" = -7/60; and Pn = 11160 12-2k 0 k 6

1 [23 -7J
:,P=;SO--7 11
For P to be Positive definite, it is necessary and sufficient that 1: - 2k > 0 and k > 0 or
o < k <6. Thus for 0 < k <6, the system is stable; that is, the origin is asymptotically
stable i~ the large. "..

. '
.85. 86
" ,
VTU)C
VTU~ LearnTng
LearnTng
If f~x) is negative definite. we see that Vex) is negative definite. Hence V(x)is a
Liapunov function. 'Therefore, the origin is asymptotically stahle. If Vex} = [,(x)f(x:'
tends to infinity as 11;< II _, "". then the equilibrium state is asymptotically stable in the
large.
8.7 Stability Analysis of Nonlinear SysteJJl'l
In a linear free dynamic system if the equilibrium state is locally asymptotically stable,
El'ample 8.12: Using Krasovsleii's theorem, examine the stability of the equilibrium state
x = 0 of the system given by Xi = -Xi and X, = x, - X, - x~

..
then it is asymptoticallystable in the large. In a nonlinear free dynamic system. however.
an equilibrium state can be locally asymptotically stable without being asymptotically
stable in the large. Hence implications of asymptotic stability of equilibrium states of
linear systems and those of nonlinear systems are quite different:
The Jacobian matrix is given by
If we are to examine asymptotic stability of equilibrium states of non linear systems,
stability analysis of linearised models of nonlinear systems is completely inadequate. :We
must investigate nonlinear systems without linearization. Several methods based on:the
second method of Liapunov are available for this purpose. They include Krasovskii's
method for testing sufficient conditions for asymptotic stability of nonlinear systems.
Schultz- Gibson's variable gradient method for generating Liapunov functions etc. .
KrasoyskU's Method:
lex) = F' ex) + F(x)
Consider the system defined by x = f(x). where x is an n-dimensional vector. Assume
that f(O)'" 0 and that f(x) is differentiable with respect to Xl where, I '" 1.2,3,.....n. The
Jacobian matrix F(x) for the system is
oh ah ah
a;; aX2 ax. = [-12 -2 ~ 6xd
Ok 8f2 0/.
FCr) = I)x1 I)X2 I)xn This is a negative definite matrix and hence the equilibrium state is asymptoticallystable.
, '
fT:x)f(x) - 'fr t (Xl' x: "D' ,00 a.II~1I , <G. Therefore the equilibrium state is
0/. !!b. af. asymptoticallystable in the large.
:x.. iJx., AX ..
Example 8.13: Using Krasovskii's theorem, exarnine the stability of the equilibrium state
Define F(x) = rex) + F(x), wherer:x) is the conjugate transpose of F(x). If:the
Hermitian matrix P(x) is negative definite, then the equilibrium state x = o is x=Oofthe system given by .r1 = -3x, +', ami i:, = x,- x, - xi
asymptotically stable. A Liapunov function for this system is vex; - f(x)f(x). ff in
addition /,(x)f(x) ... 00 as Bxll ... 00, then the equilibrium state is asymptotically stable
in the large.
fnlllf;
If F(x)is negative definitefor all x f. O. the determinant of P is nonzero everywhere
F(x) = [-;_J -1~ 3x~1
except at x = O. There is no other equilibrium state than x = 0 in the entire state space, rex) - F'(x) I P(x)
Since f(O)= 0, f(xl f. 0 for X f. 0, and Vex) = f'(x}i(x), is positive definite. Note ihat
/(x) = F(x)x = F(x)f(x) . .

jI
w~can obtain V as

.' Vex) - /,(x)[(",) + /,(;0;)/(;0;)


= [F(:r)f(x)J'f(x) + f'(x)F(x)f(x)
= {'(x) [F'C<)+ F(x)Jf(x)
= f'(x)P(x)((x)
= 2 [-6 2]
--:2-6x?'
This is a negative definite matrix and hence the equilibrium state is asymp.'oti~allystable.

-------_._._--. __ ._-- .
"
"
'>
L J o
(;:)1
'1'
f xix - '''-] ,., .
. : ',,~x- 'x_ = '~pu" 'x = 'f Aq UIlA!8=ISAs ~IIIJoO =x
" "leiS ';'n!,qmn~ "I{IJO ,u!l!quis ~ "UfW8l<~'="I{I S,!p[sAOSlU){SU!SO :"1'8 ;ldwBl<:!l
'~IIJe( "I{IO! "(qBls A((1r.I!10IdUlAnS! "11118wnllqmnlr.l
'00 ... IIXIISI; OCI ... ,(;1' - 'x - TX) +.F"+ 'x_) = (x)j(x;./.I
.:
'"IIJe( "III D!"Cquls AnUQ!lOIdw.{ses!
"leis wn!'4!l!n~ "I{I :UOp.t;l'U, '00 ... UXls" 00 ... ("X;" _. '1'_) + .(~x) -= (x)j(X;./.1
.oIiI' "(qels.A((lr.l!10Idw.{SB S! ~Iels WDflqmDOO"Ill QQU"I{pue XfJlew "lfO!l"P ""fleliIlD e Sf S!I!,L
. [IXZ- 'x1XZ-j =
'x'XZ- 0
[{:"- z:~!XZ- T-] + [fX- TJ = .
:J 0 'x'X1.-t- n
(x).:/ + (x) .:/ = (x)1/
. J

You might also like