You are on page 1of 101




  

.0/21436587

!

"
"

7IB

#%$
9;:


'&

<>=
?@9A7
JBK?:

"


(

)*

+-,

&

/CBD=
?EF?G7H1G1G7

?5D/LB-?GM%.

NOQPSRUTUP VWYXZ[Z[X
\!]P_^`Yacbacb
dfegOihQOQjgj_TlkmXnoqp

rts!uwvyxzvy{!vf|{ }~yx{fS rtsyvyx{!!!~xuyvyxsvf!{yuf} }!xUvyxs!uU} {!u!u~{!


_UqYrt
w G

  
 

:7;<: !#"%-$&=?(> ')*,+-"./+-@ 01$2"%04BA 35B+-CD6')E$7')@G89F0 >HJI


:7; :7; -;<: 6I-= QE>= D ?= BEI-@= ER 6;NI-= ;M;N;O;O;N;N;N;N;O;OK;N;N> ;O;OL;N;N= ;O;O;N;N;M;M;M;N;N;N;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;N;N;N;O;O;O;N;N;N;M;M;M;N;N;N;O;O;O;N;N;N;N;N;N;;;
:7:7;; -;-; P S= T?@T= I ;O;N;O<= ;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
S
=
T
T
@
I
V
D
?
=
7
:
;
-;
U
:7:7;; UP YY 2A I B[CZ D V@GF >HJKI \ Q@T=B> K2>=E;NI L= ;N;O;N76;MD D/;N7] \2;OOC ;N@ ;NM;OR ;N;N;O;O6;N;NIK= ;O;O;N;N;M;M;M;N;N;N;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;N;N;N;O;O;O;N;N;N;M;M;M;N;N;N;O;O;O;N;N;N;N;N;N;;;
:7:7;; ^Wa`Y A = BC[D b 2=?VD @GF >HJI 4> <>D K> <=L= BI-;N= ;M;N;OD ;N;NB= ;O;N;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
:7;e_ Sf = ;M;N;N;O;N;O;N;O;N;N;O;N;M;N;O;N;N;O;N;O;N;O;N;M;N;N;O;N;O;N;O;N;N;O;N;M;N;O;N;N;
gihM-;<0):s'1jkr ')%+T'1f Q6lD #8nmo;N+K;N"#;Op(p ;N;O;N;O;N;N;O;N;M;N;O;N;N;O;N;O;N;O;N;M;N;N;O;N;O;N;O;N;N;O;N;M;N;O;N;N;
-;-; P tY A > BC9D @ u@ ?=wv -&\7I I NLx= 7Io@-;OI ;N;N<R ;Oz;Ny ;M;N2IK;O= ;N;N;O[A ;NB;OC6D;N;O;N;M->;N;N<= ;O;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
-;-; PKPK;<; : Y| B= ?>6-\ \7I 2= I-= 6I <R !@TI}J= I -\~;N@GF;NI ;ON;ND ;O;N?=;O;N;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
-; U -; UQ;<: 6IK= |E r 2@G= F I 6NI D 6= B= ;O;N;N;O;N;M-;N\7I ;O<;NC= ;N;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
-; W -; IW-B;<:= | I !@ F 9;OR ;N= ;OO;N@G;NF I ;ON;ND ;M;NB=;O;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
-; ^ S-; f W-; = | ;N;MI !;N@T;NI;O@T;N> ;O=B;ND ;O;N;N;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
aPK!;<:+T') 01'?(= T@TGI "#jkJ');NG"%;N8 ;O;N;O;N;O;N;N;O;N;M;N;O;N;N;O;N;O;N;O;N;M;N;N;O;N;O;N;O;N;N;O;N;M;N;O;N;N;
PK; aPK; 2-;=?<:D D ?= BI-= 7K=BD@ R}@GF I2= ND ?= ;N;O;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
PKPK;; -;-; P | 2K=?D @ D }@G?F = I ND ?= ;O;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
PK; P PK; -; U u| @ K@ 9R 6=?\ 6D @ 2BI-I = 2;N=?;OD ;N;N6I ;O;N@ ;O;N;O;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
P
Z TUj ` TUP V^V OQ]PS` T`[` `V
[
T`
S^V OQ]PS`YhQOiP ^O T`
NqTR VT `TV 8^ V ORT` g^P_` n
R
bj ^V OQ]PS`Y` hiT` TR VT `
d ] SOV`RU^hQ^O T
km^ V ORT`
d ] SOV 8^ V OROQTUh
] S` tT`j_^RTTUP TUP
jS^ gP
TUPS` T ghQT gT !TRV T `
`V
T`
S^V OQ]PS`hQOiP ^O T`Yeg] ] PgT`
^PS` ] 8^ V OQ]P_` h
TUP V^O T`Y` hiT` 8^ V ORT`
`V
T`
S^V OQ]PS`hQOiP ^O T`
o T RUOQRUT`

P
T T jghQT
`V
T`YV O^P gh^O T`
k V eS] gT T
^ S`` ]
KjSO !]V j4] hiT`` `V
T `YhiOQP ^O T`
V ^ V OQT`j4] hiT`YjgO !]V`YP ShQ`
^`` OiP ghQOiT TUVRU^hQR gh
^P
gPgT 8^ V O RT
^RV T `
SPgT 8^ V ORT Pg]P
` OiP ghQO T
^`YjS^ VOQR ghiOQT `
X V T`^jgjghQORU^ VOi]!PS`
^hR gh Th OiP T ` T
SPgT 8^ V ORT
^hR gh
UV T
OQPS^P V
o T RUOQRUT
P V ] SRV OQ]P
]
T ` 8^ V OROQTUhQhiT`YTVRU]P OiV OQ]P
gPgT 8^ V ORT
Z[^jgj4TUh`` hiT`Pg]
T` !TR V] OiThihQT`
]
T` 8^ V OROQTUhQhQT`
]P OiV OQ]P
gPgT 8^ V ORT
]P OiV OQ]PSPgT TUP Vj4] [h^Pg]
T T SRUhiO OQTUPgPgT
NOVT``T gTR]P !T TUP_RT gT`` gOVT`

*:7:
:(:(PP
::UU
:X:(^W
::(c_
2d-:
g*7Wq
2^2^
2{2c
P7P d
P7P7PP
P7P2UP
P9_
P9P9__
P7P7{c
UJUQd:


  

-PP-;;eUW Y f &] = ?>u@ ;N;ND ;O> ;N;OT;N@ ;Ou;N@ u;Mv ;N&;NI ;O;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;;
a35*')% 89p $2+TX9p 8J +-#p Kjk+-')*%p/QX%*Q%+-018Jp
UK;L: SUQ;<= :7!;<: S= ! 2= 7\ BI-=EI u;M@-;N= ;N;O;N;O;N;O;N;N2;O= ;N1F 2;M= <;N\ ;O;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;;
UQUQ;<;<:7:7;; P SS== !! BBI-I-=E=EII u2@-I = [Z ;O;N;N;O;N;M;N&;O= ;NF 2;N= <;O\ ;N;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;;
UK; UQUQ;<; -;:7;<U:Q@T= @ B&= =?$=?# > E@ ->K= L@ "= ;M&;N= &;ND ;O;OC ?;N;N= ;O;O;N;N;O;O;O;N;N;N;N;N;N;O;O;O;N;N;N;M;M;M;N;N;N;O;O;O;N;N;N;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;M;M;M;N;N;N;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;;;
UQUQ;; -;-; P Y A f BD CD &%-=?>6\77=D L] K> ;NL= ;O;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;;
UK; P UQ` ;= PK;<: [b 2=?D B= 72= = 22\ \ ;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;;
UQUQ;; PKPK;; P `= = [7b \ 2=?D @ @ wvM2I = &D Z Y L@ 6-= D L@ ;N;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;;
UK; U f = ;N;N;O;N;O;N;O;N;M;N;N;O;N;O;N;O;N;N;O;N;M;N;O;N;N;O;N;O;N;O;N;M;N;N;O;N;O;N;O;N;
q 'WT;L:
(
%+-*0 )!pB8t= Tp @T+ I 89$&+-0);N8 ;O;N;O;N;O;N;M;N;N;O;N;O;N;O;N;N;O;N;M;N;O;N;N;O;N;O;N;O;N;M;N;N;O;N;O;N;O;N;
WTWT;; P E> B[>I =-, E@\7> F->= 2<ITA f ;N;O;N?;M= ;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;;
WT; U YW-L; UQD ;<: BIK. @ >/# ;N;O;N;O;N-= ;O-;N= ;M<> ;NB> ;N;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;;
WT;eW W-W-| ;; UQW-;;<6: I !@S` =-> R 2=?C6D uI-=N@!F @ > KwL= D v -6= = -\@G7F I = BAJND ;ND > ;OBB= ;N=LHJ;OI ;N[;NA9D;O;O;N;N> ?;M;M= HJ;N;NI ;O;O0;N;N%-;N;ND ;O;O> ;N;NT;O;O@ ;N;Nu;O;O@ ;N;N;M;M;N;N7;N;N] ;O;O;N;N;O;O;O;N;N;N;O;O;O;N;N;N;;;
W-W-;; W-W-;; P |] J6R =?6R =?\ ;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;;
WT; ^ W-| ; ^K;<6: I !@ 2 I = @R XAI-= L\ -= ;N-;O= ;N1;O% ;N;O;N-I;N;O;N;M;N;OB;N>=B;N> ;O;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;;
?9>6R =?> = ;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;;
W-W-;; ^K^K;; P >> TT@@ uu@@ --II
WT; _ SW-W-;;eI ^K_T;;<U: ?>6D= \2&= =z2H7I}I *@ > ;N-VI ;OD ;N> ;M;NT;N@ ;OB;N2 >=B;O> ;N;O;O;N;N;N;N;N;N;O;O;O;N;N;N;M;M;M;N;N;N;O;O;O;N;N;N;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;M;M;M;N;N;N;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;;;
WT; { W-;ef _T; = > ;NT;N@ ;O2;N;O;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;;
3 35+T')$289p %54%')896
^-;L:^K;<:7B= ;<:T@TI . >/# p;N+;OQ;Np(;O;O'(;N;N8' 7*;O;O8Jp;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;;
^-; ^K^K| ;<; 2-;:7= ;<: B>= f D 7I @b 2;O=?D ;ND ;OO?=;N@ ;ME;N&@T=?;N=B/> >;O# ;N;O;O;N;N;O;O;N;N;N;NLR ;O;O;N;N;M;M;M;N;N;N;O;O;O;N;N;N;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;M;M;M;N;N;N;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;;;
^K^K;; -;-; P &= I-= K7= I -Z D= ?= LR &=?=B> ;OB;NA9D ;O> ;NB= ;NH7;OI ;N;M;N&=E;O=;N;N;O7;N= ;O9 ;N;O;N@ ;M&\ ;N;N;O;N;O;O;N;N;O;O;N;N;;
^K^K;; -;-; UW LR B= :9 @ 2<b D ;O;N;MO;N@ ;N2;O\ ;N;O;N;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;;
V^ gOQhQOV T hQ^
o T RUOQRUT`

Veg] T T

^ _` `

d ] yTR VOi]!PS`] V eg] ]P_^hQT`


d ] yTR VOi]!PK`
gPgT
]!OVTj_^`` ^P!VYjS^ h ] O !OiPST
d ] yTR VOi]!PK`
gPgT
]!OVTPSTjS^`` ^P VjS^!`YjS^ h ] O !OiPgT
d ] yTR VOi]!PK`
gP ` ] S` tT`j_^RT
km^V OQRUT` Tj ] yTR VOi]!P
k ]!OiP
T`YRU^ `hiOQP ^O T`
TP V O _RU^V OQ]P T`Yj_^ ^ V T`
`V T`OQPSR] j_^ V O ghQT`
o T jShiT
T` ` OQ]PhQOiP ^O T
^PS` ]
^V OQ]PS`] V eS] ]!PS^hQT`
km^V OQRUT`Y] Veg] !]PS^hiT`
b V eg] ]!PS^hQOQ`^ VOi]!P T
^
Re O V
^PS` ]
^V OQ]PS` Tn] S` TUeg]!h gT
o T RUOQRUT`
P V ] SRV OQ]P
P V UV` Th ^PS^h ` T` j_TR V ^hiT

Z ` ShV^ V` UP ^
O OihQOiV T`
SPSOVOi]!P TVj ]j O UV `
e ]
T T T ` e ] OQP
^hQR gh T` ^hiT `Yj ]!j T`
SPgT 8^ V ORT`
V O gT
d OQPSROQj_T
hiO OiPS^V OQ]P `
UV O gT
]!P !T TPSRT
b S` T ^ VOi]!PS`
^hQR gh TRT V^OQPS` TR V T `Yj ]!j T` ghQT`Yj gO`` ^S
P RT`OiV
g]V OQTUP V TZ[^ hQTUO e
k UV eg] T gT`j SOQ`` ^PSRT`OV UT`
k UV eg] T gT`j SOQ`` ^PSRT`OiP T ` T`
ZT 8^ ST`
d SOQ`` ^PSRT` ] gj UT`TV
Veg] T
Z
V ^ V OQ]P T`j gO` `^P_RT`OiV T`
k UV eg] T
Z
o T RUOQRUT`
SRV OQ]P
SPSOVOi]!P
o T jShiT`
^ ^!R V O`^ V OQ]P T` 8^ V ORT`
_PgOiT`Yj_] `OiV O T`
k O` T`] S` ]
T gT R^ `
N^hiT `Yj ]!j T`j_] `OiV O T`
dq^ hQT``] S` 8^ V ORT`R^ ``
V O ST`jS^
km^V OQRUT
g] OiP_^PSRUT gOQ^ ]P_^hQT
dO ]V`j4]!` OiV O `

Veg] T T\!^!R] gO

T`

P V ]

^jSj_] V hQ^ O^ !]PS^hiT

UUJP
q
U9U9WW
UJUJ^^
UTUT__
UTUJ{_
UJUJcc
UJW2cd
W-W2P:
qQW7q W
W7W2^W
W2W2{{
^7^7W2cdd
^K^K::
^^
^^7P
^7^7PP
^2^2UU
^2U
3*
^9^9__
^9^7{_
^7^7{{
^7^7cc
_&d

    

&
?
=
B
=
>
M
G
@
F
I
N
D
B
=
K
^
;
-;
^

t
>
9
@
u
@
A
^K^K;; UP  EHJI |7@T= HJI ;O;N9R ;N6;Of ;N;M;N;N;O;O;O;N;N;N;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;M;M;M;N;N;N;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;N;N;N;O;O;O;N;N;N;M;M;M;N;N;N;O;O;O;N;N;N;N;N;N;;;
^K^K;; UQUQ;<; :  2=?D 9R H7I f ;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
HJI @
^K; UQ; P 
;N;N;O;N;O;N;O;N;M;N;N;O;N;O;N;O;N;N;O;N;M;N;O;N;N;
i_T;<: !. #"%*$&>(= ')* 2 ] 0 <B > +%;O')j ;N;O')p(;N+T;O'1Q;N ;N89;O ;N%';M)jk;N;O89%;Np;N'1Q;O ;N4%;O%;N')8 ;O;N;M;N;N;O;N;O;N;O;N;N;O;N;M;N;O;N;N;
_T_T;<;<:7:7;<; : . *>= E&@] 6ITBf > b E@ *<D >= B> 2] ;N;N;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
_T_T;; P t_T| ;<:7> 9; P R 9f @ 2 BV> I @ ;MuHJI;N@ ;N;O=?C6;N\ ;O;N@ ;O;Ou;N;N@ ;N;N;O;O>6= ;N;N;M;M;N;N;O;O;N;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;M;M;M;N;N;N;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;N;N;N;O;O;O;N;N;N;M;M;M;N;N;N;O;O;O;N;N;N;N;N;N;;;
_T; U ._T; LUQ= ;<: > @ T @
u @ @ L= ;O;N;M;N;O;NI-\2;NIK;O> ;N;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
_T; W _T_T;; UQW-;<; : LD | > B= T@ 2uI @ E>\@ <B= = B> ;O;N;N;M;M;N;NI-;O;O\7I-;N;N> ;N;N;O;O;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;M;M;M;N;N;N;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;N;N;N;O;O;O;N;N;N;M;M;M;N;N;N;O;O;O;N;N;N;N;N;N;;;
_T; ^ S_T; f W-; = | ;NB;M= ;N;N;O;N-;O>6;N\ ;O;N?> ;N;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
35J #!%89p 'J+T(8' 7Q89p
{K{K;<; : DD >> TT@@ uu@@ wv &I 2] Z Y ;OL@ ;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
{K; P {K| ; PK9;<: R 6=?\ E> BI M@ VV\7D > -> >= T@ ;N;NB>6;O= ;N;M<R ;N;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
{K{K;; PKPK;; P || 9R<f =B@T\ I
@ D E> @ NT@ = &f V= f ;O;N;O;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
Z[^RUOiPgTR^ T
gPgT 8^V OQRUT
k V eS] gT T
eg]hQT`
]PSRV OQ]PS` S^ ^ V O gT`RU]P T T`
]P_R V OQ]P_`R]P !T T`
]
T`YThihQOijgV O ST`
]P_R V OQ]P_`YTUhQhiOQjV O gT` g^PS` 2
R
O

TP!VOQ^ gOQhiOiV
O
TP V O^ gOQhiOiV TUV[]jVO 8^hiOiV
]P_R V OQ]P_` T
]O` O
TP!VOQ^ ghQT`
gTUh gT`
!hiT` gT O TUP VOQ^V OQ]P
]!P T OiV
k V eS] gT` T gT`RTUP VT
O TR V OQ]P T
T YV ]!P
TV O TR VOi]!PS`R]!P
UT`
k Veg] T T
T YV ]P
k Veg] T T` gO TRV OQ]PS`RU]P
UT`
bjgV O O`^ V OQ]P
` ] S`RU]P V ^OQP V T`
]P V ^OQP V T` !^hQOiV `
]P V ^OQP V T`OQP ^hQOV `
o T RUOQRUT
^
^

UV g
e ] T gT\!^!R] SO
UV g
e ] T gT
^ S`` TO Th
]!P T TPSRT T`
UV eg] T`OiV ^ VO !T`
Z ` ghiV^ V UP ^h
]P T !TUPSRUT T`
UV eg] T`TV TUh^ g^V OQ]P
eg]O
R] T 8RUOiTP V gT ThQ^ ^V OQ]P

_&_&dd
_T_T::
_&_ P
*_2qW
_7_7__
_&_&{{
{7{ d
{{7P
{7{7^^
{7{7{c
*
c7c2UP
c2c2UU
cJc9W_


  

  
 

:7:7;<; :| H77IDw] -> LK= > L= ;O;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;


:7:7;; UP 2I = BL= > N?> = --=?> > <= ;O;No;O@G;NF I ;O;NB;NA ;O?C6;ND ;M;N;O-> ;NL;N= ;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
:7; W Y A BCD 2D L] ;O;N;N;O;N;M;N;O;N;N;O;N;O;N;O;N;M;N;N;O;N;O;N;O;N;N;O;N;M;N;O;N;N;
-;<: @ /D > T@ u@ wv 2I ;N;O;N;N;O;N;O;N;O;N;M;N;N;O;N;O;N;O;N;N;M;N;O;N;O;N;N;
UQUQ;<; : == "" BBI-I-=E=EII u2@TI = [Z ;N;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
UQUQ;; UP =?>6\7= K> L= ;N;O;ND ;O;NBI-;N=B> ;O;N;M7I-;N= ;O;N;N;O;N;O;N;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
UQUQ;; ^W `vM= = &D [bZ 2Y =?D -D @ o@ ;O;N;O7I;N;O;N;NL@ ;O= ;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
UQ;e_ ` = [b 2=?D o@ 7I L@ = ;M;N;O;N;N;O;N;O;N;O;N;M;N;N;O;N;O;N;O;N;N;O;N;M;N;O;N;N;
W-W-;<; : @@ ?2HJ\ I E@ wv = -@G\ F I 2= ND ;O?;N= ;N;O{ ;N;M{ ;N2;O= ;N2 ;N;O@!;NF ;O-;N=BC ;O;N
^ ;M ;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;M;O;N;N;O;M;N;N;O;O;N;N;N;N;;
^K^K;<; : b 7I OI H7?I > 2@T= LHJHJI I O@ ;N;O;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
LHJI u@ ;N;O;N;M;N;O;N;N;O;N;O;N;O;N;M;N;N;O;N;O;N;O;N;N;O;N;M;N;O;N;N;
^K; P 
_T_T;<; 
: | 7I-<\7=?= ] E@ LR 2I E\2;N= 2;O@ ;N;N;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
9R XfR ;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
_T_T;; UP 
_T_T;; ^Wa. L= E@ 9R f O @ *>= @TI 2] \7= 7@ ;M;N;O;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
_T_T;;e{_ Y LI -\ =?> &] V\2= 2@ LI ;O;N;M;NLD ;O;N;N;O;O;N;N;O;O;N;N;O;O;N;N;M;M;N;N;N;N;O;O;N;N;O;O;N;N;O;O;N;N;N;N;O;O;N;N;M;M;N;N;O;O;N;N;N;N;;
{K;<: . > 2D }@ D B= ;O;N;M;N;O;N;N;O;N;O;N;O;N;M;N;N;O;N;O;N;O;N;N;O;N;M;N;O;N;N;
_^ V OQ]P_`hiOQP ^O T`
gOQPS^OQ` ]PS`hQOiP ^O T`
X V T TUj ` TUP V^V OQ]P
SP
` `yV
N^ O V hiOQP ^O T
`V
TOiPSRU] jS^V O ghiT
]

V^j4T

Th^

UV eg] T T

^ S``

gPST
]!OVT
gP ` ] S` wT` S
j ^RUT
T` T j_]
2
f (t) = x1 + x2 t + x3 t
T` ` OQ]PhQOiP ^O T
^
Re O V
^PS` ] 8^ V OQ]P Tn[] S` TUeg]!h T
^PS` ] 8^ V OQ]P Tn[] S` TUeg]!h T
d

T hiOQP ^O T

] yTR V Oi]!PK`
] yTR V Oi]!PK`

gOQ` gT` T T ` e !] OiP


gOQ^ ]_
P ^hQOQ`^ VOi]!P
gPgT 8^ V ORT
]!PSR VOi]!P _^ ^ VO gT T
R2
W] ghiT gPSOV TUhQhiOQjV O gT
]PSRV OQ]P
TUhQhQOijVO gT gT 2
R

t = t 1 t5

jS^

] _T` TPgO T^ -TUV ^ OQTUP V


j O ^jgegT TV` TRV OQ]P
g
]PSRV OQ]P R]!P T T
]PSRV OQ]P R]!PSRU^ !T
]PSRV OQ]P R]!P T T O
TP!VOQ^ ghQT
O TR V OQ]P_` T
T YV ]P
TUV
^ OQTUP V
dfhQ^P-V^P !TUP V
TUV ^ OQTUP V
M
]h V OQ]PS` ^hiO`^ ghQT`TV` ]h VOi]!P-]!jV O 8^hQT
RU]

j4]!` OVOi]!P gTh^ 8^ V ORT

^j `

::
-::XW
J_
UJUT^_
UJUJ{c
W-W :
W2P
^7^JdW
_T_&P:
_U
_&_&^^
_&_&cc
{K{7P:
{9{7c_
cJW

      

E
  
     

: tt>> 99@@ uu@@ wwvv &&II


UPW tY I-> ] 29= B@ I u@ V| @ L=
k V eS] gT T
k V eS] gT T
^RV ] O` ^V OQ]P
S`V OiV VOi]!PS`
k V eS] gT T

X;NR;O;O;N;N;O;O<;N;NR ;N;N;O;M;N;N&= ;O;M;N;N;O;O;N;N;N;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;O;O;M;N;N;N;O;M;M;N;N;N;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;O;O;O;N;N;N;N;N;N;O;O;M;N;N;N;O;M;M;N;N;N;O;O;O;N;N;N;N;N;N;;;


 JR 6= ;M;N;O;N;N;O;N;O;N;O;N;M;N;N;O;N;O;N;O;N;N;O;N;M;N;O;N;N;
 A ;O;N;N;O;N;M;N;O;N;N;O;N;O;N;O;N;M;N;N;O;N;O;N;O;N;N;O;N;M;N;O;N;N;

^ S``
^ S``^ TRjSO !]VjS^ V OQTUh

LU
O TR VT` OQP !T `T`
eg]hQT`

2{2c
KPP :
_T:

:d

    



  


  






!

"

#$%

&')(*#

+-,.+

/103254769809:;=<);=>@?A:B8DCB098D8FEG8;IHKJL098MCONP69QSRB<T;=>.?A:58MU.>@:569<->V4I098

| @T>=
]!PS`O

BA ?C6D N@ >HJI

]!PS`hiT` `yV

T T

9I

S^ VOi]!PS`9

OiPSRU]PgP gT`

2x1 x2

= 1

?= 7I-R | F 2HJI6=M>HJI @ &V= F @ -6=?IT> f}9@T@ = <= I ONNR x @T= D I-O= @ EH7I F F
x1 + x 2

@ LD &= <C ?y ; ; 7]LI

= 5

x :7;<: y
x :7; y

]OiV T T h T`jS^!RT 9
WYX[Z.\S
]_^@O X[ZAT]aPS`c` bdOiZ@]!XfPSeg` X[h.bjikbl]_mk`
nj` op]Zrh q@bfV stOQX[]ZuP
ec`ivT XTV ow]y]xz`{Z}|zT:~ 9h e_OQ^ P V gT T ` TR VSOi^]!VP Oi]!P T` TUgj T ` TUP V]!T OgVTPg` T 9
8
^
]!OiP_`
T hihQT`PST
R2
`]!OiTP VYj_^ ^hQh hiT` bP-] V OQTUP V[OROGhQTj_]!OiP V
R T`V} 9 gO ThQT T R V T
x1 = 2  x 2 = 3 


2
x=
3

T

R2

xR L= #K\2IK= :2;L: y ;
!]O

}> 6= BA ?C6D 7I b 7=BD OR 2=

bP R OiVhiT` `yV
T`] S`hQ^
SZ@sz]_^.\ZA]a`cbdZ@XfegX[h@bdivbf]_mv`njopZrq@bfstX[ZYecivXSqmkopmv``{Z}|z~



 

2
1
1
x1
+ x2
=
.
1
1
5

I Gb &BI= E@ LC6D ~Bx= R 2IKLR = 6#K= \2IK= :2


;  y ; @GF I 2Dw]
 89j +0)8  1 r f 6D N@ [A BCD }@ <D
-P ;
h ^ gV g]PSRV ] T YhQT`RU] T ROQTUP V`
gPKV ]O `O
T !
] O
T
P
T T

gPgTRU]

jghQT T` `V T TP gO

T TR V] OQTUhQhQT

-> <= N@ N@ 6I-f R I-= HJI !@

SOiPS^OQ` ]PDhiOQP ^O T T T

TR V T

gO g]PgPgTP V

TUP_`OQ]P

2x +y
4x 6y
2x +7y

7\| > o-2>\7HJ= > I ->=D >HJI BI uLR @T== -M=?I > 2I @T}= 6I= ; B= @ @ L<= C oD FHJI

+z
+2z

=5
= 2
=9

@ 1F<D LI oI ; oHJI @TuIT= f @TI /BI A BCD@ <D ; 2I ;




e_^ gT
S^V OQ]P Tj ` TUP V T gP jgh^P Tmh T` jS^RUT
h T` S
j ^RUT
jghQ^PS`8` TmR] Sj_TP!V
. T
R3 ]_~aZ~
0xyz
UP ^hiT TUP V` gO ^P V gPST ]OiV T bP O ^ gThiTjgh^P ^
O T PS`OQ]P_`TUVh^
]!OVT SPgT gO TUP_`OQ]P
ofP UP ^hGRTV V T ]OiV TRU] gj4T ^hiTV ]O` O T jgh^P
TP gP
j4]OQP V ` ]h V OQ]P gPgO gT
` `V
T

:7:



  6 

    
 

X2

(2 3)

X1
5
1

 

:2;L:  HJI

-> <=

S^V OQ]PS`YhQOQP ^O T`

(1 5)

(1 1)
(2 1)

 

:2; | 7Dw]
]

K> L=

gOQPS^OQ` ]PS`hQOiP ^O T`

  

 



      


R 6IK= @ 6ITf LC6D

6= u-H7=?> I

oP T O
TOQP V T j V^ V OQ]P
!TRV T `YR ]!hi]!PgPgT`V TUhQhQT S6
T %

=

RN

]P RegT RegThQT`R] T RUOiTP!V`

@GF I 2D/]
gPgTcRU]

(x, y, z)

K> L= u@

:(P

gOiP_^O`]!P-hQOiP ^O T T`


2
1
1
5
x 4 + y 6 + z 0 = 2 .
2
7
2
9

4%%'(')* 1? )!p9 jk8p(')Q"%0)'18J 


 !#"%$'&("*),+.-0/1!23+%4 5687 9:
7 6;< = 86'>?3!".>@

>A87 0B
CD
FE!
F3"%GH 8>@IF".>@
! 


+-,KJ

L N0 M

;I09R 478 0Y; JL<T;=4I>OMY098DCB<A:B8

Rn  n 1 

1F O@ ER 6IK= =?>

T`V[h T` jS^!RT T` !TRV T

UTUh`9

x=

Rn

2D
;;

RU]

j4]!`^P V T`

6=

bPKPg]VT ^

x1

NR 6I-=E@ 2D
;

P
 4%%'(')*  gQSR/+-p(8t$7+-#*%')G"%8
T;F;='9U(VXWF) 4Y@WF-6Z-0+ [01\4]  7 
!'&B^ U 8`_@@a"b? '
c
c 8>@
C"=daO>@&e;> K
C"bf>@
C"f"b>F"bOf
XN' gU h $'&(e8_FF" 
6I @ NH7>I <>D 6F > 6= wL= @@ }D ] <C= }I LHJH7II 2D D 2}I I 2Dw<> ] NR 6I-= N-I > L= <= @ ~; ` R 2I u6I-R = ~@ 6IK=w@ ]
]_~aZ~

hQT TR VT

TRU]

j_] ` ^P V T`

xi i = 1, . . . , n

` ]OiV

xn

x Rn

Rn

ei i = 1, . . . , n

T` h TP V` gT8hQ^ S^!`TR^Pg]!PgO ST`]!P!V^ S` ` Of^jgj_Th ` TR VT ` gPgOiV^O T`


] V !TRV T
T
Rn
j4T gV ]P_R ` R O T T 8
^ PgO T gPSO gT UR ]
T gPgT RU] SOiPS^OQ` ]PHhQOiP ^ O T T` TR VT ` T h^ S^` T
R^Pg]!PgO ST

x = x 1 e1 + + x n en .

i 89jk+TG"#8 {)
j
X` k".9
l*'m;< n;o e
Xd
X>8"b".>@
]b;G@apU?(q.aO>@& &(e>@
jg.?I" '
6 r:!p.'s
d_?,a,"b@K 8ONOa?U?9O 
t6u3vfuSt

wyxmzo{F|}F~ nDQ8{ <n<X}<{*

R 2F = 7@-@ ;TY

/Dw@ I ITf R 6IK= &@ =I

L=

E@ ITf *>6=

^ OiV QO ]PKTVhQ^
ShVOijghQORU^ VOi]!P-j_^ gP
` R ^h^O T`]!P!VYhQT` T
!TRV ] OQTUh 
] OiV
TV
T
!TRV T ` T
] PK^
!
x
y
Rn 

R

]P ^

x+y =

x =

;;

x1 + y 1
xn + y n

;;

x1
xn

D]j

@ O] M@ I

^ VOi]!PS` T S^` T S^PS` gPKT` jS^RUT

:6U



tu3vNu3v

  6 

    
 

{F D~%}Q8C| |~ {!

] K> L= @
7D DwI --= >TD @TI L% = I
K= T@TI L=
@ MI }=B> ; -= T@TI L=

TDj ]
gP

R]

?>

7I LI

SOV ` R^h^O T8T`yV gPgTD^jgjghQOQR^ V OQ]P SOihQOiP ^O T T


g^PS`
Pg]V UT
] Ijgh S`
Rn R n
R
< , >
TUP V T
x y
xT y = x 1 y 1 + + x n y n .
gOiV[` R^h^O T T T`yV ]!PSR gP TUh Tj ] gOiV[` R^h^O TT`V`
V O gT
x y

Tj ]

2I-=

d]

x y

TUV

gT` !TR VT

[A9D > ?= HJI

xT y = y T x.

@ ER 6I-= @

xT 0 = 0,

` T

TV

Rn

x T ei = x i ,

]!PK^ %

xT (y + z) = xT y + xT z,

(x)T y = (xT y)

89jk+-XG"%8 { g
!".9k'DU`&'&(D
X>8"b"3U>?
;=>8 NH_@@a"b? N
C 
@"
5 4%''1Q {L~X%*Q%+-01'F
I"A88j 8? _@@a"%@ '


  

?"o;>  #a' k O


X 0 
8 R >@
C"d>?"3rX>,lF>@
*FS
y

0 Rn

x y=0

tu3vNu

|}8{*~SC<

64=?R > r L>6D u-D = B= @ w6D D B= =I-=?> &] =2It@ @ B= [b <2= ?= D = -\7; > u-D > ?<== <\ @ = -=?@ >
-> L= N@ @
[I <R

; ?=; [b 2D =?6D = B=

PST 8^ V ORT
T`V gP
V^ ghQT^ Tc`RU^hQ^O T` ^P `YTP
hQO !PgT`TV
R]!hi]!PgPgT` T`
^ V OQRUT`
mn
m
n
` T TUP Vj OiP_ROQjS^hQT TUP V9 Tj ` TUP V T T`V ^PS` ] 8^ VOi]!PS`hiOQP ^O T` T
^ P_` m bPKPg]V T ^
n g
R
R
a 
hQT` Uh
TUP V` ThQ^
^V OQRUT
^ 8^ V ORT
Tj ` TUP V T[h^V ^PS` ]
^V OQ]ijP
A  i = 1, . . . , m  j = 1, . . . , n
A
hQOiP ^O T T
g^PS` m ` SO ^P VT&%
Rn
R

x Rn ,

y = Ax y Rm

TV

6I &I F > = <= N@ E@ 6ITNfo@ D LC6= [I <R


2I
2= N@ ND B= 2=B=?> ;
2 I K@

 J8 j +%018 { g Y
D B= @ K> &=

BY = b 7=BD

yi = ai1 x1 + + ain xn ,

NR 6IK= <\ w@
i = 1, . . . , m.

O]PFPg]VT
Qh T`cR]hQ]PSPgT` T
UT V
hQT` !TRV T
A  j = 1, . . . , n 
A
A  i = 1, . . . , m
V ^P_` ] 8^ VOi]!j
P j4T V^ S``OG` R O T T` gT
D
^PgO T`Y` iSO ^
P VT` %

y=

n
X
j=1

S^P

m=n

xj Aj

yi = ATi x,

]PKjS^ hQT T 8^ V ORTRU^

]!OV[h^

^V OQRUT

T !TRV T

]P Vh O

^ T jS^

T`V

1
5

2 1
1
1

i = 1, . . . , m.

LI o@TI BA ?C6D

T`yV` ]h VOi]!P

` `yV

= 1

x1 + x 2

= 5

?= 7I-R2> LI &I ; = ?= 7I-R BI-= #K\7I-= 2: ; P 


| F @ R I-=
7D DwI &ITf #K\2I-= :7;<: :2; T;

R]

gPgT`^

T`

2
3TUV

V ]

h^

]PgP UT jS^

2x1 x2
T`V g]PSR hiT TR V T

A

UT

A=

NR 6IK= @ 1F LD 2\ 2=

` hQO !PgT` T

jgh S`KeS^ V

bP

TV ]

T `
h^

-b 2=?D

hQT`KOiP ]

^V OQ]PS`

 



      


:XW

RN

(1 5)

(2 3)

 

:7; P VI B= N= -=B>
DX gV T

Tj `TP V^ VOi]!P

@ OD B=

BI LR Y

@TI BA BCD x :2;L: y Zzx :2; y

` `V

@ OR 6I-= O@

T` 8^V OQRUT`


` ]OiV
gT` TR VT
]!OV
A B
m n
x y
` gO ^P V T` %

` T

-= K= L> ?> O> L>6D

]!P^KhQT` j ]j O V ` Uh

Rn 

L=

TP!V^O T`

A(x + y) = Ax + Ay

u@ D ?= L@ B>

^ 8^ V ORTO TP V OiV


bP
^ ]P_R

In

wD B= &=?=B> @

T`yVhQ^

^V OQRUTR^

r ND B= N@ &\  B>
4%%'(')*   [35+T6'1$28t+-#p+ *p98F
F".K.aO "bH
PgT 8^ V ORT O^ ]!PS^hQT

&

(A + B)x = Ax + Bx
Ax = A(x), R.

b 7=BD

T ]P VhiT`RU]hQ]PgPgT` ]

w]

LHJI M@

TUP VhQ^ S^` TR^Pg]!PgO gT T

2=?= K@ I

-\ 6D E@GF >

x Rn .
Pg]V T
RU] T `j4]P 9 gP ReS^P !T
A = diag{d1 , . . . , dn } 
In x = x,

Rn

TUP V

RegThihQT


]#;!;D& ".K3aH".?
!b;=>?G#m 7 
XD& ".K3a G'9U A U

x :7; P y
D S?= ] 2= VHJKI @TI~HJI D ?= -= 6D = -= 97@-I-I= L\ L= @ Vx 7: ; P y @ @ x M@ 2I-= K@ @ L\;
@ y ; = 6D &=zHJI OH7I
o@ Nx :2; P y ->6= XR O@-I K= T@TI L= ;
 4%%'(')*  qQ[35+T6'1$28np)!jkJ6'1G"#F8  0
X& F".K.aOa?KG"6 I"b  &(G?".K.S
q>@
j
 U>?K

AT

y T (Ax) = (AT y)T x, x Rn y Rm .


hST`V gOiTP8TUP V TP
gT[hQTj T OiT qj ] gOV` R^h^O T g^P_`
T`V g^PS` m TVhQT` TR]!P g^PS` n bP
R
R
8
^
_
j
]

i
h
O

g
P

T
[
`
Q
h

T

`

R
!
]
i
h
!
]
g
P
g
P

T
`
T
TUV ]!PSRj4] R]!hi]!PgPgT`hiT`hQO PgT`
] P!V Tl^hQ] ` gTch^ 8^ V ORT
!
AT
A
gT
bP T 8^ gT SThQ^Pg]V^ VOi]!P S^PS`
T`VR]!e TUP V T ^ TR RTUhQhQT Kj ] gOiV`RU^h^O T
A
AT = A

t6u3vfu

aij = aji

{FD ~%}



|}{!~S\~S<

- = 6D -= 6T= @TI 6I D B?>6= = ITf @T2I =?= K@@ OR9I u@ 7D 7D t6@ f B@> 6I-f

Tcj ] gOiV 8^ V O ROQTUhR] T` j_]!P 8


9 h^DR] j_] `OiV OQ]P T T
hQTj T OQT RU^hQR gh` iO T

j_!
] OiP V T gT Th^ R] jShiT OiV 0%

C = AB cij =

n
X
k=1

aik bkj

-> L= ; B= 2IKR

^jgjghQOQR^ VOi]!PS`hQOiP ^O T`

i, j

bP V ]

Th 9

x :7; U y

:^



  6 

    
 

  

54%''1Q { 3 + ?
#;F;='9U nZ 7 >#;G'F".>@
TGUG& 
o"I OH 7 
B;CO>F ! I" #a' k O c 
Cd&(
". ;C9.a"3U>?
j I_@Ue 7 
Xd F I".>@
@" 7 
X!^ ".I"SF"3U>?





TV

}= 6R @





D ?= 7I-=VI 7D D

P S]j T OiTP V ]PSR:9 TUVV T 9 y]

b F]_~aZ

gPSTc`]

LI = 7I

-= T@TI @ w@ 6ITf 2D/]-=

TUP
h gO ^ y] V^P VYhQTj ]

gOiV T gT KPg]

T`

#R V@GF I -@T= T>/#@TI L= O7@ DwN]-@ = 6wI-@Gf F R *>6= 6I-= E@ -> -\2I 6LI-= = 2I-= @  O?@ I 6= -= 9; @-I x :7; U y M@
=?F> 7=?@TL=I w@ }@GF I [A ; BC6D R  -=B= > L= :LI 9 nHJI 9I ;  B=?C > 6R2>  b >(HJI <R &I M@
2I-= -= T@TI D B=
-= K= L> ?> BI LR

s := s + a b.
TRU]V
gP
j ] gOiV` R^h^O T T T
TR VT ` T hi]!P ST
T`V ]PSR T
S]j_`
n
n
X TRcRTV V T
SPSOVOi]!P hQTPg]
T
]j ^ VOi]!PS`P RT` `^O T`j4] T TR V gT Qh Tj ] gOV
YT`V T
h ] T T 3 S]!jS` bP T ^ jgh S`[hQ]OQP gTcRUTlR] V V ` UhQT
T`yVTP ^OiV
gO ^hiTP!V^ mR] V gThQ^
n gP ` `V
` ]h V OQ]P
T hQOiP ^O T
OQPSRU]PgP gT`
n
d] hQTj ] gOiV 8^V OQRUOiThG]P
hQ^j ]j O V ` gO ^P V T
(AB)T = B T AT .

54%''1Q {  6 7Q8Jp8F D 7 


C_?'''m 7 
XD& "3p3aea' pOG# c
X>8"%G#
07 '9Um 8k"bKse"%'9Ue

A1

c "='7 
F3D& ".K3a q>@'

B@G= F 9SBR > 6F > = ?2IKI @ ; @ 1?F =f T; R @ =B= D ?= 2= 69I R 6= = 2I-O=zHJI I -= 7] L?C6= D b 7<> B= D @ 1F L\2C]-= -/\2I L-C6> = <= /!FHJI 6=

AA1 = A1 A = I.
V T Th T O`yVTUPSRUT Th^ 8^ V ORTlOiP T ` TcT`yV gP j ] gh
TlRUh Th ^h
T OQP ^O T gOq` T ^
V ^OiV ^
ReS^jgOV T
b P T ^mTP>jS^ VOQR ghiOQT j4]

g]OYhQT`V ^PS` ] 8^V OQ]PS`l`OQP ShiO T `P ]P V jS^`


OiP !T `T

+A,

G?AR58c098F2 <eMu0 09:A09:5C5476 2 <)4 RB:'09:B80KJBU@0 CB0A0NM ;=09R54I8




2-I > Z L= 1F 2@-@R 7= S@ DwI /I 6&D/=E] I ~b 6=?D > <= 7; I-= Q>= u> L>6D <= N@!F I
-> <= @GF I 6Dw] @ OR 6I-= @
7I Z
-\ Dw]K@-M=B> @ 22= I ?> 2D/]
}SR2=>= bVI n6RD 6I-HJ= I @ V&] = 6f 6I D 2I [Z
;H7I F 6Dw] @ ; R I-= @
HJI V> <>D I-R ?I = /=B@T> > 6%= H7I &= QH7I 6I 2I = 2D 7C IB= [Z nu@ @ MHJI 2I Z @ ;Q` 2I
>6\ 2:7I ; D N\2> ->6= M6I I-=E&@ I B= /R 6; I-=

2
I
[
Z
\
K
@
B
=
>
&
=
;
F
7I 6= HJI @ u@ <D
T;
i 89jk+-XG"%8 { L (
X>@& ^?Oj 8(lFG'
XG'F"b? Kd;=@F" @"3A;CIAl'
\ Q(Uy :&('
*S>@
6_@@a
UD>8 bb;o8aOD
l
\ OGn;o 
O#"7 
!'&B^ Ue 8O "b9d
r
S F

T`yV gP TUPS` T ghQT T


8j_] chQT`]!j ^V OQ]PS` Uh
TUP V^O T`
gP
PI` ] _` wT` S
j ^RUT TRV ] OQTUh T
Rn
T` jS^!RT hiOQP 
^ O T h ^ gOVOi]!P-TUV[hQ^
ShVOijghQORU^ VOi]!P
jS^ gP `RU^hQ^O T
 T V] VT`hiT`YR] gOQPS^O`]!PS`hiOQP ^O T` gPDTPS` T ShiT T !TR VT ` T
TUP_`T ghQT g
T`VYhQT `] S`
S
Rn
T` jS^!RT TUP !TUP
j ^
S
%
Pg]V
S
lin{S}


lin{S} = x Rn | x = 1 x1 + + n xn , i R, xi S, i = 1, . . . , n .
bP
$O #ST ^ROQhQT TUP V gT
T`yV SOiTP gP ` ] S` wT` jS^RUTTUV ST
lin{S}
0 lin{S}
d TUPg]!PS` SP TR VT
T
jghQT
TPS` T ShiT T` TRV T `
T
V ThQ`
2 j_^ T T
T

u
R
u
=
(2
1)
y
R2 ] S`
1
gT
T`yV gP 1 TUh STUhR]P ST T`yV gPm
`] S` tT`jS^!RT T
] 

2 hiTc` ] _` wT` jS^RUT

y = u1 

R 
lin{u1 }
` T` h
TUP V`j_T TP 
V ,V T R OiV`jS^ hiTc` T ShjS^ ^ V T
T`yV
]!P OiV gTh
^ 
T

a
]

\
.
Z
V]_mv`
`
lin{u1 }
^hQ:
T 9
T`yVhQT P ^ VT
T
u
lin{u }
Z[!^ y] V]1PS` 8^OQP!VTUPS^P V gPF^ gV T !TR 1VT
T8` ] S` wT` jS^RUTTUP !TUP
jS^
u2 = (1 1)T
{u1 , u2 }
T`V[h T`jS^!RT
V
]


V
U
T

P
V
Q
O
T
g
G
O

T
y
`
V

T
g
O
U
T
_
P

`
Q
O

]
P
R2


(4 2)T

{u1 , u3 }

u3 =

y = u1 + u3 = ( + 2)u1 .

j7 >

"

$#

 =" H &(


!S>@

lin{u , u } = lin{u }



=
&= R9I HJI &?I = <7= I [7Z DwF ]-= Dw@ ]}-\2\ > @ KK>6@-M= =B\2> > -I-2>6= = = 6I-&= I BIB= Q>= ; 6IK}= @ HJI!@ F <D
@TI D 7ID [Z &=z@ ;Jr ?> 2I [Z
BI C@ 2I [Z \2> ->6= ; *I
B>N@ O] D 2I
T
@
->
K@ ~=?> B; I BI LR Ob 2I-= uI D A -= HJI ~@ 6= R I-=
1

\2> K>6= I-= ;


7D ] D
L= D K@->Z

bP ^
gT
hiT
Pg]
T T UP ^ V T `cT`yV` gj OQT
9 h^ O TPS`OQ]P ` ORT V^OQPS` UP ^ V T `
^jSjS^ V OQTUPgPSTUP V^
`] S` tT`jS^!RTTUP !TUP
jS^ [hiT`[^ gV T` bP gOV
Oih`[` ]P V

ow]a`{ hrik]aX[Z@T\GVZ.` `cTlb Pg ] hdeZ.` T'
iv& `b%

. ^PS` hQTR^`R]!P!V ^O T h TPS`T ghQT T` P ^ VT `[T`yV

w
o
a
]
g
`
r
h
v
i
a
]
[
X
.
Z

\
.
Z
c
`

b
a
]
`
d
h
c
e
@
Z
`
v
i

`
b
i(.Z

`] S` tT`jS^!RT
P-` ] S` tT`j_^RTj_] ` ` gTTP P ^h gPgT OQP #SPgOiV T S^!`T` 8^O`V ] gV T`RUT` S^!`T`f]!P!V

h^ 6, T R^ OQPS^hQOV h'
` ] S` tT`j_^RT
 ^  ]a\GZ@`)r]_mk`
T ` ghiV^V` gO ^P V ] PgOiV gP ] !TUPj ^ V O gT T V T`yVT c` O
TR V T `` ]P VhQOiP ^O T TUP VOiP
k
j4TUP g^P V`

+ *p')')*1

   
 

  



_@@a"%@ 'D 8

  

R n v1 , . . . , vk

:_

   

>@
C"=9
XG#?9& 
C"9
\ 8GS;
\ 
X"INS c ?"6'? U&('
C"S c

D9 x?= /H7<II Z D0L=,6HJ@D I LD(y ; 2I n@GFI Dw] 2/I @ [Z LI Mu@ @ R


7HJI I-r = 7I D B= @ 9 }@TL>/\ # F <D &\ N@ S= &-= =?>

6IK=I M@ 6=MR &= -> @L= D d x M7I @T[> Z K@ 9I /HJI y


?= V[I b 2=?D B= [b 2=?D 2D D KN> R L= @ 6I-= @ @ ;

1 v1 + + k vk = 0 1 = = k = 0.

hT`VRh^O
gTV] V TUP_`T ghQT Tjgh S` T
!TRV T ` T
T`VhQOiP ^O T TUP V j_TP g^P!V RT gO

n
Rn ^ OQ^P!V gT
]!P!V T STch^ O TPS` Oi]!P
gP ` ] S` tT`j_^RT gT
`] S` tT`jS^!RTP gh
n T`V gP TUP V OQT
R
{0}
h SO
T
n Rn
PgT 8^V OQRUT
hiO PST`TV
RU]hQ]PgPgT` TUj ` TUP VT gPgTV ^PS` ] 8^ V OQ]P Qh OiP ^O T T n g^PS` m
A m
n
R
R
d] YV ] V
T n ]P
_PgOV[h O 8^ !T T
jS^ Yh^cV ^PS` ]
^V OQ]P
RU]
T ih T !TR VT
T
V TUh
x
R
x
A
y
Rm
gT

y = Ax =

n
X

Aj Rm , j = 1, . . . n.

Aj xj ,

2I %; [Z| F u@ @ F 6-Dw\ ] K~@T=?@ > &= @ HJI /F > @= <R 2I L> b 2.=?mvD s PZ lecizqr2ZBIK]a=M\GI i.x Z 6@ =
;
i 89jk+TG"#8 {$  i +- L"#%8jk+TX'1$28F !>@I" 
XN& F".K.aO
 N'
l 8
X>8"%G
O#"*U
X>@& ^?O&  &  F 8fa>@>@
!
X6 8 9
XGO O'&(
X"!
\ G ;='
\ 
C"b  m7 O#"CKS:U
X>@c & ^?O&
j=1

T-` ] S` wT` S
j ^RUT T
TP TP
jS^ hQT`R]hQ]PSPgT` T
T`V 
^ jgj4TUh
Rm
A



T`V ]P_Rch TPS` T Sih T T`
T
V ` ] S`h^ ] T
j4]
m gO` R O !TUP 
Im(A)
y
R
Ax
n
R

mn

Dl:
XOf9
XG#?9& 
C"09
\ 8GS;
\ ?
C"% 
jB >@
\a
A

~@->/#

. ThQ^

-=?> 6>@

SPgOiV OQ]P
j R TP V T

<= N=?> BI b K@ 2D

rang(A) min{m, n}.

]!PDVO T hiT

` ghiV^V

@ B>

T
P ]V
S
A
SPFRUT V ^OiP
T
x

 &  c

rang(A)

BI LR

]!P g^ TP V^h` gO ^P V

dim (Im(A)) = rang(A).

+-,

EG8;=HKJL098DC N}69QRB<T;=>@?-:58MU@>.:569<A>@4I098 5?-JL? A


 H9:5098


4%%'(')*  ? )!p9 jk8


,aO>@
\ &('& ^?dO#"
C  

%Qj  X9#8F 0
(%!"b$&  7 G@:"3U>?
!69
CGO?9O O#"n 3"6ZZ8/ -n4Dp!
@ Y LI }E@-D I ?B= A ?C6D N@GF >HJ@-I I BA ?C6D -t> x)L@ = 2D 2\7-C > <= 6D 2=B=?> Xy ; LA 1F 6D/]
x :7; W y
<=VHJI d 7I 2IK= LI ;
 + *p')')* g 7 
!'&B^? 8'>?3!".>@
!H !B !#"%$'&(d99
XGO O q  #smO#"
'> bb;oaA_?,a"%>@KU
  6'> bb;oa O#"n;F;='G-6ZoWo1 8 c
X>8"%G



LF I oDw]@ ~Ex @ :2;eWSy R  I-= 7= 2I 2\ 2ITLI f 9I  2I d HJI 6D/]  @ ; R I-=

. F I VD  LC6= \2> ->6=


VI 2I [Z R 2=   B> ]_~aZ ~


]!OV
h^ 8^ V O RT
F` `yV
T g]PSRjS^!`P RUT`` ^O T
A
mn
gT`` 
] h V OQ]PS`
` y` V
T
S^ ViO ]!PS`YhQOiP ^O T`eg] ] UPgT `

TP!VRU^

UT

X[P_^h ` ]P_` h TUPS` T

ghQT

Ax = 0.

hT`VRUhQ^O

gT

T`yVYV ]

y]

`` ]h V OQ]P

R
A
ker(A)
oP T 4TUV ` O
TUV
`]!P V` 
] h VOi]!P T
T`yV^ S``OG` ]h V OQ]P 
^ OiP_`O gT
x
y
x+y
x R
SPgT 8^PgO T P ^hQT h TPS`T gQh T T` TRV T `] Veg] !]PS^
SP ` ] _` UT PS` T gih T
T TR V T
S
T`yV SPK` ] S` wT` jS^RUT !TR V] OiTh g
P ]V

S


S = x Rn | xT s = 0, s S .

oR2>= $6# F = 6=HJ I N@ H7I 2I ; 2I Z


:%

bP

wR 2= I ?= = -=?> B> @ ~@ 6I-f D LC6= O@ [Z

O ST ^ gT
S = (lin{S})
bPF` ^j4T ]!OV !
] PSR STlV] Vc` ] _` wT` jS^RUT !TR V] OiThj_T V ,V T
VOiP_R V T`

Tj ` TUP V

T T

8^PgO T` O`

:{

2D D
L2\ D D
9I J8; j %+ 018 @ {L
R]



  6 

    
 

  

2I 6DwDwLD ]] &M\ O@@ @ 7Dw<I ] D B= @GMF Ib 2=?-D B>A > <B= CD 4&= @GF I -> L7= Dw]-2= D ?y 7; \2C @ wRx A &I-I = @ x wD B=@ 4R @ I-=
 E@ >HJI zy ;
| F 6@TDw>6=] NN@ @ <I E@ F >(HJI @ NR 76D I-= 2u\2C @ B= 2LI}C6D ] 2D

T[TPS`T ghQT gTR] gOQPS^OQ` ]PS`hiOQP ^O T`


gPPg]
T#SPgO T TRV T ` T`jS^!RT gT` TRV T `
R]hQ]PSPgT`]
O 8^ T Th^
^V OQRUT ]
T jS^ [RUT`R]!hi]!PgPgT`
R] TTPS` T ShiT T``]!h gV OQ]PS` gPD` `V ThQOiP ^O Teg] ] UPST Pg] ^ ThQ^ 8^ V OR T g] P VhQT`
hiO PgT`R]!P!VOiTPgPgTP!VhQT`[RU] T ROQTUP V` gT`
S^V OQ]PS`

P gh

]P_`O
T`V ]PSRh T PS` T

]P_` g^PS`
hiT8jgh^P
T` TR VT
R3
L S^ VOi]!P-eg]
ShiT T`[`]!h gV OQ]PS` T h

L = {x R3 | Ax = 0},

D| 2I [Z K> L= 6OD R 2; K= . @T> K@ L=ODx V@ u-@ > LD L= @

A=

` ]!P!Vh^-V ]O`O
] PgT
]
x3 = 0 

0 0 1

TRU]
gOQTUP

j_] ` ^P V T

x3

T`yV

zI y ; ?= -= -Q\ @ K@T2=?= > 6f &=VD @ ITfo@ R > -I L>= Z

T` ] S` tT`j_^RT !TR V] OiThT`VRh^O T TUP V T O TPS` iO ]!P


TUV[j_T V} , V TTP TP
jS^
TUP V`hQOiP ^O T TUP VOQP j_TP g^P!V` Pg]!P-R]!hiOQP ^O T` g^PS`RUTR^` bD
P j TUP jS^ T T
TV
]!PSR
(1 0 0)T
(0 1 0)T

T
gTc`T` Uh
jghiThiT` TRV T `

1 0
B= 0 1
0 0

L = {x R3 | x = Bz, z R2 },

@@ ~= 6D x -&=z\2HJI IK[ZE@-= H7MI I MVR R7I Z 26=IK= L@ \ R V@ <\ 2= OzDy G@ BO= @ 2<= D 7\ 2= :  27IF \LD &\A O&9I @ ; 7I R ; }6I-@ =4L= @ 2; = 4=HJI VRF LD &6\I-=
  +4Qp('(')*{L !>?3" 
XD& F".K.aO

]

bP T 8^ gT SThiT !TRV T qhiO PgT gT[hQ^ 8^V OQRUT


T`V] V eg] ]!PS^h V ] V !TR VT
T
b RUT TR VT
A
L
T
U
P
!
U
T
P
T
g

P

`
]
S
`
w

T
`
S
j
!
^

R
T
!

R
V
]

Q
O
U
T
h

T

O

T
S
P
`

Q
O

]
P
h
O
8
^
!
T
g
T

b
P

O

^

^
Q
h
]

` g
T h O 8^ T
T
R3 ` ] S` tT`j_^RT TR V] OiTh gT`hQO !PgT` T`V[] V eg] !
AT
T
]
S
P

^
Q
h

T
^
g
P
]

^
AT


mn


!
?
!

Ker(A) Im(AT ),
Ker(AT ) Im(A),

Rn
Rm .

L= G@ 2I d
2= 7\ &ITf 6= f B>
&I | -B= = -UQ= <; > B> \7> 7D > B= LHJI =
E@ LD = LR E@ 7H I B= 7I d
u@T> K@ HJI u@TI}= -\ @ ;
@
@
 8Jj +%018 { $ Y
D B=
[I <R
^

T`j ]!j O UV ` U] UV O gT`GR]!PSRT S


P ^P VhiT`GjS^O T` Tf` ] _` T ` jS^RUT`4] V g
e ] ]!PS^
ReS^jgOiV T
T` O TPS` Oi]!PS` T `j4TRV O T` TRT` _^ V T `] S` T` jS^UR T`PgT j_TP TUP V gT

dim Ker(A) = n rang(A), dim Im(AT ) = rang(A),

dim Ker(AT ) = m rang(A), dim Im(A) = rang(A),

]!OV[h^

^V OQRUT

22

1 3
2
6

T

Rn

Rm

;
,,SF A 2I @ 2I ED/I E@ 7I ED/; I V@TI}R I-=
,SF
L\ 2I
;
, A 2I @
DwI V@ D/I V; @
-\ ;!. @ 6ITf LC6D
| EHJI B= 7I d7 = K> L= 6D @ EQ@T@T= > KE@ @ K; Y
;

g^PS`

^P

` SO ^P VT

A=

bP ^

S^PS`

` T ]P VGT jghQ]OiV T`

rang(A) = 1
T` jS^RUT RU]hQ]PgPST`]
RU]P V OQTUP VYV ] S`YhQT`
ghVOijShiT`
TR V T
Im(A)
(1 2)T
T Pg] !^ T
RU]P V OQTUP VhQT`
ghVOijShiT` T
T
A
(3 1)
T` jS^RUThQO PgT`Y]
R]!P!VOiTP VYhQT`
ghiV OQjghiT` T
Im(AT )
(1 3)T
T Pg] !^ T

R
!
]
!
P

V
i
O

T

P
[
V
i
h

T
`
g
i
h
V
Q
O
g
j
Q
h

T
`

T
T
T
A
(2 1)
T` S^V T`] S` T` jS^RUT``]!P V T` ]OiV T` gT 2 O]!PKRe_^P !Th^ T O
TR]!hi]!PgPgTTUP
hQT`
R
(3 7)T 
R]!hi]!PgPgT`q`]!P!V^hi] `hQOiP ^O T TUP VqOiP Uj4TUP S^P V T`TV
^PS`RUT[RU^!`
rang(A) = 2
Im(A) = Im(AT ) = R2
TV
T
Ker(A) = Ker(A ) = {0}

  

 


 

1    

 

:(c

    

O47<A:B8v?)4 JL<T;=>@?-:58 69U@6KJL09:;=<A>V47098D8R54 U.098 JL<T;47>OMY098

+-,

4%%'(')* 
Q;F; "3'
!Sg3>?p& F".>@
yG'G'&('
C"I O( 8Oe9 l
Xjq9OI;=,a,".I_@& 
C"d 8 a>@>@
!
XSs
=7 
CD& F".K.aOH
XHa>?&B^?9
* 9>@
8d"3>?9d"3'
!Sg3>?p& F".>@
! #3_O?
C"%
h &(8 F :I3"."3 ;CU>?9
T.a "3HU>? 8
T@ =B7  
Cl:D
XOl:A
Xq Oq9b; OXI; a>?\Ua>?>@
F
X>@
!O
XsKsn;o 
j#a' k O
X>@

C 
h ;p&BF"IF".>@
8e 8? B9 l
XAq9OI; Xa>@>@
!
XSs 
h
T{!~SD\~ xD|=
{Fz<8 }|0}F


x y r B= K\2bI 7=B<CD = Xy ; /> <>D


x y r B= 6?=9 \ 2[bI 2=?D x)= ;> L9 >6D @T=
B= [b 2=?D 9 D B=
 89j +0)8  q

<=

-\

V= -\u@!F I VD B= wx &F I ?= [b 2=?D


(L@ y = &BI-=M?= > I ; D L\ ?= /x= > L>6D ; <= 7z] yM>HJJI I LR 2I 9/D I HJI 6= 6D ,D D &Z

PST[V ^P_` ] 8^ VOi]!P h


Pg]P ` iO P gQh O T

TUP V^O TPgTReS^P Tj_^`hQT ^P

OQO

PgT8V ^PS` ]
^V OQ]P Uh
UT P V^O T` hQT`chiO PgT` T` j
V OQRUT
!^ SRegT
T`j
] OVT jS^ gPgT 8^ V ORT Uh
!
V ^PS` ] 8^ VOi]!P hQ^ 8
^ V OQUR TO TP!VOV

gPST 8^ V ORT

Y -\ 26=@K@ E@ 6I-f &I 4B@ = ITf -= 62D ] LC6= L\



6I R7>6= # 6=EHJI

bPKj4T V

O _T

gT

A0 = EA 

XR

^ TR

HJI 1F

^V OQ]P

RU]hQ]PgPST`
gO ^ V
ghiV OQjghiOQT chQ^ 8^
TUP V^O T] V TP Sl
T TP ^jSjghiO S^P VhQ^
T

1 0 0 2
A= 1 2 0 1
2 1 3 4
O4]!PD^ OVOi]!PgPgThiT` T j T O T`hQO PgT`fTUV gTh ]P-OiPS`R O T[hQT
Re_^P !T YhiT` T K^ gV T` !
] P
] VOiTP!V

R T`V gPgTV ^PS` ]

= LR =?> BI [IK= -= 6D LC6= <\


` ghiV^ VY` h^j T

O ThQO !PgT`^P_`

2 2 0 3
A0 = 1 2 0 1
2 1 3 4

1 1 0
E= 0 1 0
0 0 1

~%n6}8| 6  .D CnSn

R | F 6IKI=EI; [&>(= H7LI=6f x D O; @ ; @ ; B@ = [b 2] =?D 2=


F 2=z@T= DwI = L\ &=
7I-= ; 2I
= D 6= L\
 89j +0)8  3 <R
K= D LC6=

> L2>6=?D D > @ <= EHJIy ; SB= F > L>6[D b 2=?D OHJI I !@ B= N@GF[I b 2=?wD D 6= B= :
LR =
LR x y ;
 ?I ~@
&= 7D D M@ L\ @ <\ wD I L> &=
O@ D ?= BI LR

T`V gPgTl` STUPSRUT gTV ^PS` ] 8^ VOi]!PS` Uh


TUP V^O T` gOV ^PS` ]
T
T P !TRV T
gPgOiV^O T R ^
Th^ S^` T ] V eg]!Pg]
UT gT
U
h
U
T

P
V
Rm
T`yV hQT
dq^ T T jghiT ` ]OiV
h^DR]!hi]!PgPgT09jgO ]V T TUV
hQTljgO ]V
As
ars
g
e
mkb
]
h ]
T
ghiV OQjghQOiT [h^lhQO PgT r jS^ 1/a
j_] V ] gV i 6= r  T jShQ^!RT fhQ^crshiO PgT i jS^ hQ^l`] T Th^hQO PgT i TUV
ais
dfO !]V ]!PS`Yh^lj T O TR]!hi]!PgPgT ThQ^ 8^ V ORT` gO ^P V T

1 1
1
A = 1 0 1
2 1
3

gPgTcRU]hQ]PgPgT
gPgT
^ V OQRUT
gO ]!OV` TV ^PS` ]
T UT P
bP T 4TR V gT g^ PS`
ars 6= 0
gTh^hQO !PgT

ShVOijghQO UTjS^

&d
XR



^ TR

a11 = 1

2D D <R ; }@ @ MDwI

RU]

TjSO !]V

bP ]!OV ]!PSR

=

ghiV OQjghQOiT

\ 2I

    
 

&= D B= O> L>6D

9 !^ SRegTjS^ h^

^V OQRUT Uh

  

<=

TUP V^O T

1 0 0
E = 1 1 0
2 0 1

N=?> BI

TV[hQT

  6 

` ghV^ VT`V

1
1
1
A0 = E A = 0 1 2
0
3
5

L=4HJI @ N2I D ?= LR XR BI LR <b BI-= w@ &\ 9I I ?= B[>b HJ2I=?D = @ ND ?L=R &\ F


@ ?I-?> > ;
D ?= O> <>D L= L> &I LR &\ M@ JC6D

BY I-=


h T`VRh^O
4
gT ` O_V ] _`fhQT`jgO ]V`f` SRURUT``O `f` ]P VPg]PP gh` gPST` gTUP_RT T
jgO ]V^ !T`T 4TR V `


n
` hQT`
R]!hi]!PgPgT` Th^ 8^ V ORT^ !TRYhQTjgO ]V` fh^ O^ !]PS^hiTYV ^PS` ] T ^h^ 8^ V ORT[TPh O TUP VOV
n
O
T`VhQ^ 8^ V ORT h T
P V^O T^!` ` ]RO UT ^
jgO ]V^ !T T h^
T R]!hi]!PgPgT ]!PK^

Ei
i

@GF }I K= D LC6= MD > T@ 2IK= I = 1F 9R 6= O@GF I ND ?=


] gPgTj T O T

UV eg] Tj4]

In = En En1 E1 A
[RU^hR ShiT h OiP !T `T
gPgT 8^ V ORT

BF= @ L@ ?7>OI-@= B6>R ; 6 I uD= F 9F?R =9R= = ;TY 9F@GR F I= EM6=R9D = ?*B= HJ= I [b H72I [=?ID K @ V-&@G= I 2F 6\7 I = B<I <R R6= D JI LR F w&E\ D = ?=
@/BI-I =VITf @ D 2D ?<= R &f \ B>M@ [I ; Lb I @ -=?>6bI >=D = B= K4@TD =D > T@ LI E> =B@ 2IQ]K@ I <> 2I V\7D > ->= ?= BI <-R6> I

&L= @ <C B> [I-= 2= uD HJI Z


B=?> <\ 2 = &\ -D @
; ] B> 2I

A1 = En En1 E1 .
V
T TRV gT hQT`jgO ]V^ !T`fTUPDj_^ ^hQh hiT` h^ 8^
. ]PSRj_] RU^hQR ghiT fh OQP T ` T gPgT 8^ V ORT OQhG`

V ORTO TP V OiV ^ 8^ V ORT19cOQP T ` T `TV ^PS` ]
Tj ] T` ` O !T TUP VTPDh^ 8^ V ORTO gTUP V OiV ^hQ] ` gT
h O TUP VOV gT OiTP VYh OiP T ` T
OihT`yV ^O gT
 T _^P K^ SSR ^gPSPD`jShQTO !RU]^!VY` P SUh4P P T^`yhSV TUVTUPSP RU]RTP ` V ` OVTRhQTUTVY`^V ]h !R ] ^ O!Ve T TT
^ gPgT R] jghQT OiV T
i
O

h
4
j
T


V
^
V
V
U
T
Q
O
P

O(n3 ) 
O(2n3 )
T
8^ V ORT`
bP-h gOGj
T ^chiT`
UV eg] T` V O T`^ -ReS^jgOV T ` gO ^P!V S^` UT`ThihQT`^ S``O
nn

`
T`[jgO !]V^ T`Y` SRRT` ` O ` Th^ 8^ V ORT 8^OQ`Yjgh S` ] S`yVT`YTUV ]!OiP_`R
] gV T _`T`

+A,

E8F;=HKJL098MC N}69QR5<);=>@?A:B8DU@>@:B69<A>V47098


@ K@ D 6D/L\ ]-= ; 6= 9w@-> = L= F 46Dw@-I ] [MA @ BCD @ -> <= LI I


R@TI BY 6A I-B=C@ D I D B=
x :2; ^ y
#R MHJ@ I K2@ I F = -R= 2L@ ] LC6D wV@ I 12F ] f V@ w@GF I@!F LI b 2D  D = ; ?= VHJI F 6Dw] w@ <ITZ
Y2I  b 2=?D I <I 2= 6 I <C= @TI [; A BC6D
 Nx :7; ^ 7y D ; D 7=  2I <I N@ 6I-f@TI BALI ?C6D O@TI I BA 6F ?> C66D= L=
 F 6Dw] @

L
I

F
7
]
&
M
=
I
B
=
n
T
@
I
2
I
d
;
.

-A> &I}L= ;*@ Y G&I = ;QN<C R &= <> B@ > B= -> ITfL= b 7x)R=BD LO=#K\2\2> 2IK&D = = > ?:2F 7= ; U= HJLy \I ; 2HJF I EQI@ R N2&I @ = [Z  vivXV]_h.bdR h )Bow=?]aI2`g= hVikI ]aX[; Z Ob7&I D .mvs u @GPZ F 2lec] izqrZ
i `{Z H7I ~@ <D
 = L=
V
>
B
w
>
T
@
>
#
2
I

=
@
>
F D 7I-=OI R &= <> B> I -> N<R = &= <> 2B=> K> 2L\= x)@ 7I-=NHJf I -\2=> 1<KDF >6=6= Dw}] 7u@GDwF @ I ]-= /2@ I <I } @ \2=?E> @TMI @ R BA L]?2C6= D = ?>  ; Y
oR @ (y NHJI
@ <D
7D D
 }@->/#
gPgT 8^ V ORT
]P VfhQT`hiO PST`fRU]P V OQTUPSPgTUP VhQT`R] T RUOiTP!V`
]!OV
A
mn
TR VT
T m R]!P V TUP_^P VfhQT` TR]!P
T
T bPReST RegT
R O Th TPS` T
R
` ` V
T

D` `V ThiOQP ^O T[TUV gP


b
ShiT T`
T n ` ]h V OQ]PS`
x
R

Ax = b.
X ^P V TPS] S`j_] `T hQTj ] gh
T Tch T O`yVTUPSRUT
gPgTl` ]h VOi]!P
]P V ]!PS` gTh TPS` T ShiT gT``]!h
V OQ]P_`
S^P -OihP T`yV[jS^!` O T T`V gP
] yTUV T
!
^

`
4
j

R
V

^
i
O
Q
h
i
O
T
Rn
]!OV 0 SPgT`]!h VOi]!PcjS^ VOQR ghQO T
` `V
T
Xhi] ` V ] gV T`]!h gV OQ]P ` `yV
Tj_T Vf` R O T
x
` ] S` h^ ] T
f
o

P
T
4
U
T
c
V

R
]
T

T
V
`

]

P
V

T

`

]
h

V
Q
O

]
S
P
`
` `yV
T
x = x0 + y y Ker(A)
x
x0
]P^
!
]
S
P
R
h

T
S
P
`
T
S
i
h
T


T

`
`

]
h

V
Q
O

]
S
P
`
`
]

V
Q
O
U
T

P
V
S
j
^
g
g
P
l
T
V


^
_
P

`

h
^

V
i
O
!
]
P
`
]
_
`

T
`
S
j

^
U
R
T
A(x x0 ) = 0
Pg] ^ T
hTUP ^ ]P_R hQ^ ]
T ] V O gT TV S^P
^ OiT ]P R]!PS`V gOV SPgT ^ OQhihQT
] yTUV`
A
b
hQOiP ^O T`jS^ ^hQh hiT`TUP V TT
]O
T
bP-hQT`^jgj_ThihQT T`
]







O SPgT ^ O UV hiOQP ^O T jS^!` ` Tj_^ h ] O OQPgT R T`yV gP ` ] S` wT` jS^RUT !TR V] OiTh


WOiTP SThQ^ gO TUP_`OQ]Pm^OV UV
SPgOQTj4]
R O T h^ UP ^ V OQ]P
gP ` ] S` T`j_^RT TR V] OiTh ]!P
h T jShi]!OiTj_]
gPgT ^ O UV chQOQP ^O TcjS^ ^PS^hQ] !OiTcj_]
T j O T hQTlPg]
T gT T ` TlhQO _T V
O

T
y
`
V
g
g
P
T
^

O
U
V

Q
h
i
O
P


^
O

T

!
]
S
P
R
g

T
h
U
T
_
P

`
T
g
Q
h
T


`

`
!
]
h
g
V
Q
O

]
S
P
`
m
`

y
`
V

T

`
V
V = {x Rn | Ax = b}
Pg]!P O T VTUhQhiT gT
]!P
SPgOiV`^ gO TUP_`OQ]P
R]
T
V = {x0 } + Ker(A)

Y !I BA ?C6D 2D 7\2C
O SP
` `yV

T eg]

2I 7I-= I

<I

x 1F 2= L\ (y  !F

R9= 2I-=

dim V = dim Ker(A) = n rang(A).


UPST ^lV] y] ` SPgT`]!h VOi]!P h ] O OQPgT RTP T`V[jS^`

^Oj4]

\2> K>6= ;

hQTRU^!`

UP

^h

 

-:

  

#9Q@ 9jk8 {) A !#"%$'&(H9


XGO O q  s;=>?K$, 8Aj&(>@9
! 
CA'>?3F"3U>?
p c @"@ '&(
X"Np c
= 6D &=zHJI HJI @ w@ K<D @ 6F f -= LD ~; @ tF @->@TI ~M@ HJI
; Kw= 7@T] > &9}] H7I ?>
2
I
}
2:7; W IKy =V; H7I V@
9I
BA BCD = -= ?H7I 2I 7I-=
<I  xR <=#K\7I-=
LI LI HJI &= ;*| ; Y B= @ LI LI  1F LD  2\ Nk@ A @ &I @ HJ&I = B= w@ [b@ 2@ =?DL= D -\ JR 96I = OB@ A ?C6D [A B?C> D @ oI 2I! 2I-=<Iw@

F]_~aZ~




b
Im(A)
bP T 8^ gT gTRUTV V TR]!P OiV OQ]PF` T j O T g^PS` h T`jS^!RT T`R]!hi]!PgPgT` m bPF` ^OV
ST
R
hQTc` ] S` T`j_^RT
T`V T gO TUP_`OQ]P
bP TUP
gOiV gT` O
hQ^ j ] S^ gOQhQOV
Im(A)
rang(A)
rang(A) < m
j4]
ST
` ]OiV g^PS`
T`V[P ghQhiTTUV[hiT` `V
T` T ^lj T` STV] y] `` ^PS`Y`]!h VOi]!P ]!O
T
b
Im(A)
dq^ R]!P V TD`O
]P OiV gT
T`yV T ^P jghiTOiP hQT-` `yV
T-^ ]PSR8V ] y] ` T`
rang(A) = m
A
` ]h VOi]!PS`
O T8jgh S`
hiT8PS] !^ T
T`V T O TUPS` OQ]PFP ghihQT TVhQT` `V
T ^ gPST`]!h VOi]!P
m=n
A
SPgO gT
TV V T` ]h V OQ]PKT`Vh O ^ T T
jS^ h^lV ^PS` ] 8^ VOi]!PDOQP !T `T T
Pg]V UT
b
A
A1

x = A1 b.

I

; D B= D ?= &=?=B> &=?=?@ > = -\ 9R = <] 9R 6= <] ; L> @ 2IT2f I B= -HJI b 7=BD B= [b 2=?D
V]a` xzstow]_^@XZ
@ ;
i 89jk+TG"#8 {q <
C(a>@
o 3"3U>?
QG, I_ U
C"b c
CG,aOp'?9O`?" # '?
C"% c ;=>8  `A%!"b$& A 3"m
C
>@IF"3U>?
]O#"
x :7;e_ y
. ]P_R`T ghiT`hiT` 8^ V ORT`qR^
`
] P V
X[hjxzstow]_^@XZ
gT
Rn

T` T ^P jghQTUOQP8`]!P!VqOQP T ` O ghQT` bP gOV^ S``O gTRT`V ^PS` ] 8^ VOi]!PS`


T` 8^ V ORT`RU^ UT `Pg]!P-OQP T ` O ShiT``]!P!V[^!` ` ]RO UT`Y^ V ^P_` ] 8^ VOi]!PS`




>

rang(A) = rang ([A | b]) ,

 "<Ud& ".K3a
>^"%'
C 
' O>8F"b?
C"oUAa>?U>?
F
X

]_@'K` 8d"%>8F"%fg. O>@

07 [A
9C|b]"o?O87 >?
(?I" ma' .a,(n U+ 1) ;C9.aK3"%'&('
C"0'7 
C_?''' 7 
X & F".K.aObN@A" UdOG>@IF".>@
AI"bG'"33_?
=7 
j F"b$&(N9
CGO?9On;='K&(@" 8H"b"bfk a>?
\ I".>@
q   Ssa>?& & '9 ;='K&(@" 8ea' .a, U  '
l( 

$#


A

 V
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 


 
 
 
 
 
 
 
 
 
 
 
 
 
 
 


 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 



 
 
 
 
 
 
 
 
 
 
 
 
 
 
 



 
 
 
 
 
 
 
 
 
 
 
 
 
 
 



 
 
 
 
 
 
 
 
 
 
 
 
 
 
 



 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 





 
 
 
 
 
 
 
 
 
 
 
 
 
 
 



 
 
 
 
 
 
 
 
 
 
 
 
 
 
 



 
 
 
 
 
 
 
 
 
 
 
 
 
 
 



 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 



 
 
 
 
 
 
 
 
 
 
 
 
 
 
 



 
 
 
 
 
 
 
 
 
 
 
 
 
 
 



 
 
 
 
 
 
 
 
 
 
 
 
 
 
 



 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 





 
 
 
 
 
 
 
 
 
 
 
 
 
 
 



 
 
 
 
 
 
 
 
 
 
 
 
 
 
 



 
 
 
 
 
 
 
 
 
 
 
 
 
 
 



  
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

  
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 


 O

Ker(A)

 

:2; U 2= L> ?> -> L= &% .


DN^ O V hiOQP ^O T

^PS`

Ker(A) + {x0 }

+-,




034=Mu>#Mu098

8J$2')$78 {) Y

]OiV

A

I ND B=

SPgT 8^ V ORT

=B> =

X0

Rn  Ker(A) = {x Rn | Ax = 0}

mn

; B= 6=EHJI
k ]P V T

ker AT
d

ImAT

Dw] ;

RO`T hiT`YT` jS^RUT`YR]!P!VTUPS^P VRUT`YTPS`T

ghQT`

gT

= (ImA)

= (ker A) .

TV

V = {x Rn | Ax = b} =



  6 

    
 

               
              
               
              
               
              
               
              
                

:2;eW Y A BCD

 

2D L]

`V TlOiP_R]

Im(A)

jS^V O ghQT % . ^P_`

b = Ax

Y VD

  

Rn  b
/ Im(A)

;.

6I B= 2IKR 6=

]!PSR]!P PgTcj4T VV ]

T

x Rn

%HJI

V Th

gT

]!OV 8^OQP V TPS^P V

1 2 0 1
A = 0 1 1 0 .
1 2 0 1
T
T V
. ]!PgPgT hiT``] S`d T` jS^RUT`
A
ImA  ker AT  ImAT
ker AT

N= -\ @ ;
] 87$7')$28k g D ; B=
2 gThT`VhiT ^P

S^!`T

^ 8^ V ORT

= 7I
wT@ 2I E= K=B>

2\ N@ ~]

f -| = <2D D D = D ?= V } 7@ =B= K@

o j O

tD/I

a1
a2
3
a
a4

D ?=

&=I wD B=

a1
a3
2
a
a4

H7I G=B>

?= b 7=BD

T [hQ^ 8^ V O RT
R] T` j_]!P g^P!VTTUV[hQ^ 8^ V ORT
SO ^hQOQ` TRTV V T V ^PS` ] 8^V OQ]P
A0
P
TUP VjS^!` ` T V ]!P T

1
1
a
a 2a3
a2 9
a3 + 3a4

a2
4
4
1
a
a a
o j O T [hQ^ 8^ V ORT
gO ^hQOQ` TRUTV V T V ^P_` ] 8^ VOi]!P
00 R] T` j_]!P g^P VTTV[h^ 8^ V ORT
P
TV
gO ^hQOQ` TUP VhiT`V ^PS` ] 8^ V OQ]P_`l` gO ^P V T`
. UV T OQPgT 8hQAT` 8^ V ORT`
P  P
P3
8^ V ORT
TUP
gO T h OQP T ` T gT 1 2
T
T

1 0 0
1 3 0 0
1 3 3 0
1 3 3 1
0 1 0
0 1 0 0
0 1 2 0
0 1 2 1

P
P
P
T =
0 0 1
0 0 1 0 3
0 0 1 0 2
0 0 1 1 1
0 0 0
0 0 0 1
0 0 0 1
0 0 0 1
]

f -T;= < D = > D =BD ?= 6= D 2=??= = K@


D ?= P @T>(@TI L= F 9R = M@ ;

9 hQ^

{ei }1i4

a12 a13 a14


a22 a23 a24
.
a32 a33 a34
a42 a43 a44
]P
ghVOijShiOQT
jS^ gPgT 8^V OQRUT
ofPmPg]V^P V i hQ^
A
P
a

a11
a21

A=
a31
a41
d] Re_^P !T [h ]
T T`hQO PgT` T
A
TX R]
TP!VjS^!` ` TV V} ]P T

<\ 2: ;  @ 7I- = 7D D-\ 6= F 7=?@-= u@ L@ \ @


i

LHJI

RUO T`` ] S` TUj `TP!VT hiTj_^`` ^ T Th^ S^!`TR^Pg]!PgO gT

A = {ai }1i4

hQO !PgT

D HJ?I = E=B> HJI B= > B= [b 2=?DB= b 7=BD BI LR ; BI-=


`

hQ^

0
0

0
1

 

  

8JY $2')$78 {L . I 72I I NF 6@f N= R 6I-= -> L= D


]!OV

HJI N@ ;

^PS`YV ] V[h T T RUOQRUT 


] P
Pg]V T
h^ S^` TRU^Pg]PgO gT T
{e , e }
R2
SP
RU] gS
j hiT T !T R VT `hiOQP ^O T 1TP 2VYOQP j_TP g^P!V`:%
{u1 , u2 }




u12
u11
.
, u2 =
u1 =
u22
u21

r }R I-= @ 6F > 6=
LI B= 6= =?> BI E@ EH7I
P TRV T

K@T]> K@

T

bPKOQhih S`V T ^lhQT`

R2

` R OiV

Jy @Qy XR R 6I-=

x = x1 e1 + x2 e2 = x01 u1 + x02 u2 .
ST`V OQ]PS`^ 9 Y^ TRhQT` TR VT `

` ghiV^V` T`

2: ; ?= =HJI F
T; t@T>(@TI L=
P-; 9R 6= 6= =
UK;| I 6=
WT; HJI K@

u1 =

2
1

u2 =

1
1

EI MD B= MHJI F f
6I V> = <=

b @
2I b 7=BD OD B= ;
-=?> 6>@ P
1F JR 6= O@ ;
ob }@  V@ E> <>D E@ ;
BI-=
&Z BZ

T`yV gPST 8^V OQRUT


] 

(u1 u2 ) = M (e1 e2 )
M
oP
gO T
TUV
TP ]!PSR VOi]!P T 0 TUV 0 ` ] S` ]
T 8^ V OROQTUhQhiT
x1
x2
x1
x2
P T ` T YhQ^ TUh^ VOi]!P-j R TP V T ` ]OiV
h OQP !T `T T
M 1
M
^hR ghQT
]PSRV OQ]P T
TUV T` h
TUP V` T
0 2 TP
kx k
x1 x2
M
X
gTUhQhiTRU]P gOVOi]!PK`
TV
^ V t]!P
u1
u2
k ]P V T

^-;

bP
j_] `T

9_ ; 2 I
{-;V=Y

2P

gT h ]!PDj4T V R O T

u11 = cos

TUV

k x0 k2 = 2 k x k 2 .

u12 = sin

;. > =BD 6= D B=


V T

OQPgT hQT` 8^V OQRUT`

M+

TV

6= ;

gT h ]!PDT jghQOROiV T ^

EH7I

VTUhQhiT`

ST

k x0 k2 =k x k2 .

ER I-= 9R &= &=


}@ R EI-H7= I @ 2=z@ F 7] K> &=I BAJD > B= ; &== B= 62= = H7I 9 /@T= MF 2!@ ] F -\ 2=/; I
6=
; | I 6=
; @T>(T@ I L=
;

gTUh`[` ]P VYhiT` TR V T

`OQP

^ OQ^P!V`jS^

M+

TV

M
] OiV

hQT TR V T
TKRU] ] ]PgP UT`
TUV
k ]!P V T
ST
` ] VOiTP!V jS^ gPST
x
x = 1
x = 2
M x
]V^V OQ]P T
TV ST
` ] V OQTUP VYjS1 ^ gPgT ` 2UV OiTjS^ ^jgj4] V lhQ^ +]!OVT
^P hQT
bP

M x
/2
TV
^hR ghQT
TUV

o
P
g
O
T
U
T
V
Pg]VT ^
1
M+ = R
M = S/2
R
(S/2 )2
R1
S/2

U



  6 

    
 

  


  

JG,.+

: 0

#1

)

0KJ*2BU@0

BA BCD O@ P >(HJI

]!OV[hQT` `V

T gT

S^ VOi]!PS` 9

&

!



9I

OQPSRU]PgP gT`

2x 3y

x T;L: y
x T; y
x T; P y

= 3

4x 5y + z = 7
2x y 3z = 5
^
Veg] T
hiO OiP_^ V OQ]P T
^ S`` ]
UV eg] T DjgO ]V R]!PS`O`V T9 V OQhQOQ` T hQ^cj T O T
S^V OQ]P
j4] RU^hQR ghQT
TUP ]!PSR VOi]!P T`^ gV T` ^ O^ ghQT`j gO` T T jghQ^!RT fRTUVV T ^ OQ^ ghiT g^PS`fhiT`
_^ V OQ]P_`
x
` gO ^P V T`
TV V T UhQO OQPS^ VOi]!P-` Tj4] ` gOV^ TR
g^PS`hiT`PS] !TUhQhiT`
_^ V OQ]P_` ` ^ h^cj T O T S`
y
9 h ] V TP!VOi]!P SPgT
S^V OQ]P&9 gPgT[` T ShiTOQPSR]!PgP gT bP T ]!P!VT[^hQ] `TUP T jgh^ U^P VhiT` ^ OQ^ ghiT`
R^hR gh UT` g^P_`YhiT`
S^ VOi]!PS`^ !^P VY` T O 9 h UhQO OQPS^ VOi]!P %
O ]PS`
T h
S^ VOi]!P
1%
x
3
x = (1 + y)
2
Z[T jgh^ ]!PS`
g^PS`YhiT` T
T PgO T`
_^ V OQ]P_`
fjS^ [` ]PKT j T`` Oi]!P
x

2uIKD = > 6TI @ O6= @GF > L~D b @ @ Ov 2&II B= x S2RI 2D = &> ] T@ -MI @TI4@ LR = zD y = wI R &= 62= ] -@ = 6D <C=S>(>H7HJI I
HJBI I!LF RI LF> 7] E;-@ | ~O@G> F >I<D HJI V>HJI XA O2II-= 6B=?I R 6I XR F > <D @ 9I ; =26I-D R (> H72I = =6xD 2ITb -= 6D LR C6&= = (y 2] I Z
` L= @ F >(HJI x T;L: y
x T; U y
6D
@ E@ 6I-fo@ = LC6= >(H7I Nx T; y Zzx T; P y &= f -= x -; U y
x T;eW y
x T; ^ y
` L= @ F >HJI x T;eW y@ 2I-R 2I BA BCD 6%
x T; _ y
6D  @ F >(H7I x -; ^ y %
x T; { y
9R = @ R &= 2]
\7
= &ITMf @G>F HJ> I LD Nx -; { y  x T;=B_ D y -w> x ;T; U y %  BI 7= [IK] ?I
y+z

O ]PS`

Z[T

gTh

jgh^ ]!PS`

^jge_^` T
!RT ^

S^ VOi]!P

g^PS`Yh

TRUTPg]

y = 1 z.

_^ V OQ]P

UhQO OQPS^V OQ]PDT`yVV T


S^ VOi]!PS`

= 1

2y 3z = 2.
!T^ -` `V
T

QO P UT
TV

5z = 0.
bPDT TRV gT^hi] `fhQ^` S`yVOV V OQ]P-TUP
`TPS`OiP T ` T gT`

^ OQ^ ghiT`

(2.8) z = 0

(2.7)
(2.4)
bP T 8^ gT
9 gPST V^j_T g]PgP T h UhQO

gThihQT
S^V OQ]P 8
9 RU]P OiV OQ]P gOiTP ` 
gTRTUVV

y=1
x=3
OQPS^ VOi]!P
gPST ^ O^ ShiT 4
j T V` T ^O T g^PS`YP O
T
S^ VOi]!PKRU]P V OQTUPgPSTh^ ^ OQ^ gQh TTP gT `yVOi]!P

HJI O}>= JH 6I D &=zHJI  NH7I F K@ I N>  ] u@ -= - > HJI F > <D N>(HJI }@!F I NR 2= &] R 6&I = 2]Ob L= }uHJ@ I
7W

F LD; 7=

j_] VT

&^

  

J,'J

E8F;=HKJL098 ;47>@<A:ARBU@<A>V47098


BCD B= 2= -<\\7I <= 6; = I 2I [A &B= C6&D \2= ?= -B\7I I LR L= ;-HJr I


2=B=?rr > Oo@ BAD ?C6B=D > <B>bf= XVD ]_iv-` \7xzI stopik<2]a= X[I Z [VI sQec@ >h@= XV&]_6\ Z.I-st= X[Z x= =?x>=
> L>6D V@ &\ 2ITf
JI zy ;
V

     

 

 
 

BA BCD uB@G= F > -<D \2I L= I [A BC6D ?= u@ [b 2=?D


;2I <&R I6&D =@ BI-BI] zy BI 9I &=?;= LC6= x BIy I6=

bP R]!PS`yV^ VT ^l^ Kj_^ ^ ^jSegT` gO ^P V gThQ^ jSeS^` T


UhQO OQPS^ VOi]!P
RU]PS` O`yVT 9V
T] O !OiP_^hGTUP SPm` `V
T V O^P gh^O T
Pm` `V
T V OQ^P gh^O TT`yV SPm` `V
T`VV O^P ghQ^O T
PST 8^V OQRUT
T` j4T R VO !T TUP V

blXV]_ik` xzstopiv]aXZ ]a`@h.XV]_Z.stX[Z
RU^ UT ]!P!V[hQT` h
TUP V`` ] S`Yh^ O^ ]!PS^hQT T` j ^ T` ` S` ` ]P VP gh`
P` `yV
T
V O^P ghQ^O T ` Sj OQT -`T ` ] Vj_^ D` S`V OiV VOi]!P^ O T ]!P `
Uh
TP!V` O^ !]PS^
Pg]!P
P ShQ`
aii

a11 x1 + a12 x2 + + a1n xn

a2n x2 + + a2n xn

= D ?B= A Z
D ?=
7I

^PS` ] T YhiTc` `
T ]!P V[hQ^ 8^ V ORT
T`V gPST 8^ V ORT

gjgj4]!` T ^V ] S`8hQT`

= b1
= b2

ann xn = bn
bP R]
TPSRT
^ 4] Dj_^ R^hR ghQT
g^PS`h
S^ VOi]!P
d gOQ` 9 h ^O T T
]P
j4T VR^hR ghQT
x
n
x 
g^PS`Yh
_^ V QO ]P
TV^OiPS` O T` gnOiV T S`
9
T gO ]PgS
P Th ^h ] OiV e n T ` gO ^P V
xn1
n1
x1

@ 7D D F >(H7I N@GF &] 2=z@ &= !I @ 6= BI @ I ?HJI!F >(F HJI ;Q| uHJ; I #I @ 1F F@ Lu\ 2@ = -D [I LR 6I ; I 6=
x T; c y
x -;<:(d y
n@ = 6D O2=?@ HJI H7I I @
OI ~@ LR ;
@ 1F L\ 7= KD
xn

xk

bn
,
ann

n
X
1
bk
akj xj ,
akk
j=k+1

bP T 8^ gT
T`V !
] PSR T

STlhQTR^hR gh T

wx N\ &=z@ MHJI

` ]OiV

= -. D
OVe

xk

_]jS`TV

gPgT O OQ` OQ]P

T R] VV ]V^h Th ^h ] OiV e T

n(n 1)
,
2

6=?D E@ LI 2I @ \2=?>(y
 +p8J %'87!'1p'1Q%pz
E@GF I BA ?C6D B= -\2I <= Tb>= 6I-=   BI u@ BI-] BI E@ L=

]PKPgT ^ T

^PS`YhQTRU^!`
TT`V

gThQT`VT

SP
` `yV

TRU]V T h ^h !] OVe



nk

1+2++n 1 =
T ` Tjgh S`YeS^ V T

n2 
2
T V OQ^P ShQ^O TOQP


x1

xk

x -; c y Z x -;V<@:(d y ; F <\ 2= -D M@ BI-] BI


J,

R] V T

k = n 1, . . . , 1.

T T` S`V OiV VOi]!P

^ 4]

k = 2, . . . , n.

qT`yVhQT

LHJI @GF > LD

gT[h^V TReSPgO gT

hiO

F L\ &Z
x T;L:2: y
x -;<: y
9R 6=

]PKT TRV gT gT`[` S`V OiV VOi]!PS` O TR VT`TUVYh ^h ]

x T;L:2: y Z x -;<: y OD6,D OHJI LI @ BI-] BI

Y6 ; B?GC50CB0 <ARB88?AR
:B69<A>V47098

LR &\ ?; = S@GF &] 2=z@ HJI

OQT

b1
,
a11

k1
X
1
bk
akj xj ,
akk
j=1

k ]!P!V ]!PS`
jgO ]V^ !T

CBR
OiP_^ V OQ]P

gTRUTUh gO T` S`V OiV VOi]!P-OQP T ` T

2B> A?); 2O?AR 4U@098 8EG8;=HKJL098&U.>

@-> = 2I T;L: 7=B= K@69NI *>6= ~@


R OiV T^

R] T` j4]P

gPgT]j

^ V OQ]P T

J_
XR &= Z : x LT;D XR y ; = .F >HJID0@ ,6D 1F >HJI> x T;LD P y ,; 6= x -; yN@ @ = 6x R T; P
yu 6= 9tBR IKb >ML= I 69}b LR 2L= D 2D \ O@ @ 7D D F (> -H7= I 6@ D <CF =>(,H7I x T;L: yu,Dwx I T;x L: yuN<Dw> @ I 2y=u<>Z
I
-= 6D LC6= <\ 7D D <\ N@TI LR ;
i 89jk+TG"#8tFg )  a r*8 I"bG'"3U>?
c 7 GUG& 
C"f 8DkBaO>@>@
F
Cm 8?
!NU`l:
CH !e;C3_?>8"f 8>?3" ?".O

X>@
j
C  
1

 

Qq    @ :0s 


 
 

       

hQO OQPgT
T-h
S^V OQ]P
T OQTUP V
^O Th^ ` ]
T TKh
_^ V OQ]P
ghiV OQjghQO T-jS^
x
^ !TR
T
T hiO OiPST
T
T OiTP!V
^O TDhQ^ `]
T gD
T h
_^ V OQ]P
ghiV OQjghQO T
x
j_^
^ TRh
S^ VOi]!P
bP
^ 
] PSRT 4TR V
SP-jgO ]V^ T T Qh ^lj T O T R!
] hi]!PgPgT UR TUhQhiT T TP
x
gV OQhiO` 
^ P VYh^ j T O ThQO !PgTR] T hQO !PgT
jgO ]V

Oe".?
*Sg3>?p& "3U>?
!DGUG& 
C"I?9OD\@a"S8G#D# U &  ".K3a>@
C" o,a,"SGd'
B;o ' $' 
'@a>?
\ A&(&B^?O 
 UAEF
8D'7 G'99&A9
*F".>@
q9p 6"b>F"n ;o K'`^?'
 s >@
>F^ ".'
C"N
]%!"b$& `"3pU?
Fl* U?9D_@@aNUO
c
;CI_@>8"IN#NkB U@lF>@
* U 

?>6= ?= : % b 7=BD

[I

LR

V@T> 6=

<Z @ 7I 7I-= 1F f D u@TI T;L:2;

T`YV ^PS` ] 8^V OQ]PS`` _RURT` ` O T`Y` ]P V R OiV T`RO gT``] S`j_] h T T
V ^ VOi]!P


(2) 3
0 3
2 3
1
4 5
2 1
1 7 = 0
1
1
1
2 1 3 5
0
2
V ^ VOi]!P
%


2 3
0 3
1
2 3
0 (1)

1
1 1 = 0
1
2 1
0
2 3 2
0
0
. ^PS`hQTR^` P ^h ]!PD^ g]PSR9h UV^j4T Th ^h ] OiV e T SPgT 8^V
k

RU]hQ]PgPST` hQ^ T PSO TRU]hQ]PgPgT TUj `TP!VThiTl`TR]P
T
T m` `V
j T O T`YRU]hQ]PgPgT``]!P VV O^P gh^O T`` gj OiT T` R #
T

?>6=

jShiT

0 3
1 1
3 2

0 3
1 1
5 0
OQRUT (k) gT
hQO !PgT`TV
A
n
n+1
TV ^PS` ]
]!P V[hiT`
k1

4= \2> <-C=>6= /N@ = K=B> F > @ Q1@ F D L\ 7Dw= ]--= Du@TI I BAD BCD B= B= [b 2=?@ D >(y@ <\
u
x
~
@
K= D LC6=
?= K\2I L= BI *>6= I-= Nx b ; K\7I-= -;<: y ;

 (k) (k) 
A |b
=



(k)

akk

T;L:  @ /D > T@ u@ uv 2I
7I <R
= 6D  D @ <\&9 >6x = 2IK= 2HJI ~> <>D w@ y &=
<\
<\
L\
 

V^j4T

Th^

UV eg] T T

^ S` `

x [I [>

JI y

bP
TV ]PSR ] ReS^ gT h TP V Th^ R]hQ]PSPgT
`] S` hiTDjgO !]V (k) ` gjSj_] ` 8Pg]!PFP Sh
k
akk
jgh^ ^P VYhQ^ hQO !PgT
j4]
jS^
i
i = k + 1, . . . , n
hQO !PgT

hQO !PgT

(k)

i+

aik
(k)
akk

hiO PST

k.

TP

&{
S F > L>6D
Uh

TP!V

(k)

aij

2I-=

j4]

  
i = k + 1, . . . , n

TUV

j = k + 1, . . . , n + 1
(k+1)

(k)

(k)

aik

     

 

@ 6R

 
 

T OQTUP V

(k)

a
(k) kj
akk
^
O`T 9y]
T h^FhiO PgT
T SOiT V ]!PSR
]jS` TUV
_
O O `OQ]P . ]!PSR
h V^j4T
RU]VT
i
nk+1
k
S]!jS`TV
O OQ` iO ]!PS` bP-TP
gOiV[hQTR]gVV]V^h T h 
^ h !] OVe T T
^ S`` %
(n k)(n k + 1)
nk

7I-= @

aij

L\

= (H7I@ LR = @ ;

= aij

: @ <R @ F ; <\ 2= -1D F > N@ uv &I

}@->@TI

n(n 1) + (n 1)(n 2) + + 2 1 = n2 + (n 1)2 + + 22 + 12 (n + n 1 + + 2 + 1)


S]!jS`
1
1
=
n(n + 1)(2n + 1) n(n + 1)
6
2
TV
O OQ` OQ]PS`
1
n(n + 1)
2
bP O ^ gT hQ^ RU] jghQT OV T hQ^
Veg] T T
^ S` `YT`yV gT 1 3  +
n
^h ] OiV e T
UhQO OQPS^ VOi]!P T
^ S``T`yVj ` TUP V S^PS` 3h ^h !] OVe T
T` TRU]P
T
T8T`yV
`V ]R
g^P_`h^ T PgO TRU]hQ]PgPgT T
TUP gPgT 8^ V ORTV O^P
hiO OiP_^ V OQ]PDV ^PS` ]
Th^
^V OQRUT
A
A
ShQ^O T` gj OQT T
T` `yV
TV OQ^P ShQ^O T` gj OiT T`VTUPS` gOiV T ` ]h DjS^ [` S`yVOV V OQ]P
.
h
j
b
r
i

e
Z
z~
OQP !T `T

@ L= HJI 2D f ?>u@ D > T@ u@ wv 2I


S F>OL@ \ 7= KD @ 6=@GF >LC6<= D O@ @ v &; I F > LD -=?>
\2JI R 6= <= [x I *>6= 6I-= y ~; x  y ; BA ?C6D B= -\2I
h.bdiecZ ~
' 0 QQ' #jk8  > T@ u@ wv &I

z~ *" oy ]a\]a`givbf]_mv`
 +-')+K8 '8
 Q"#

 *" 
 +K'8
'') 1 ')* "#* " Q "#

k UV eg] T gT

@ LR

@ % %p
?B> = @ [b 2=?D F <\ 2/= D -D B= 2: ; oI OKD@ D ?=6D/]-=B= TZ
<= BI *>6= I-= BI N=?> LI 2= [IK] ?I

^ S``

k = 1, . . . , n 1
i = k + 1, . . . , n
j = k + 1, . . . , n + 1
aik
aij aij
akj
akk

 ~h .amvoystbl]_mk` s  Vbj^.\GZAbfXV]_iv` xkstopik]aX[Z




*" 

')  * "#

xn

 (

n,n+1

+-')8

ann
k = n 1, . . . , 1

n
X
1
xk
ak,n+1
akj xj
akk

vfu
NuSt

j=k+1

}{F|}z n~ 0xmn{ 0xD~ n}Ff S

Y ?= P <y R t9= I6Dx -= LHJI  BI >6R I 6= &I =BD/I <R


> L>6D 2I LI  7I /@-= ; }@ -\7I O\2> ->6= 6D
' *K(@ + *8Q+-70 I [ZD ?6= =?DwI }] <\ @T= ~xR <=  7LI-\ = ; -;<: y L=

XVwR @ @ }ITIf R
LI !\7=

> I-L>6= D 2] <I B= 9I &=?D b ;


B= B>\
K@O> L>6D uR I-= 2] <I

OhiTDjgO !]VcT`yVP gh TUPIj ^ VO gT ]!P


OVT ^m^ _` ` OfhQT`cjgO !]V` T ^hiT l^ S`]!h ST8V ]j j4TVOVT R


R eS^jgOV T
]P hQT T jgh^RT TUP T TRV S^P V gPgT j_T
V^V OQ]P^ TR gP Uh
T P!VKPg]P P ghjS^
OhQT`

Uh
TP!V`[` ] S`Yh gOGTV ] 98`^
]!OVT bP O`yVOiP gT P ^hQT TUP V T -` V ^ V QO T`1%
 87
bPj4T
VTfhQO !PgT`TVR]hQ]PSPgT`j_] Reg]!OQ` O hQTfjgh S` ^P Uh
T P!VTUP ^hiT ^ S`]!h ST

g^PS`Yh^ `] S` 8^ V ORTTUP S^!`9
]!OVT ]!O
O
%


n
o
(k)
max aij ; i = k, . . . , n; j = k, . . . , n

 

Qq    @ :0s 

1


 
 

TUP

bPPgTj4T
[^ S` ]h gT

6=?DwI MHJI

' QQ+ }*R8 +6+T-I X= 2'18J] 0 LI

 *7

^hQT

VT

L\

2I

       

LR

LI \2= K@ > <>D

gThiT`hQO PgT`` ] S`fhiTjgO ]VTUPKReg]O` OQ`` ^P VfhiTjgh S`


n
o
(k)
max aik ; i = k, . . . , n

^P

2c

h TP V

\72= D K @ 2=> BL>6= D B>\ VB2@TI-IKI =u= I LR LR 2\ &\ @ 2= 7y ;DwS]-F = L\ L2I = 4I-D VB>@GF 7> D <&D = &= <I 4>@ 9I-v D 72D>6I = LLHJHJI I XwR x  u= = HJI 66= = @ EV@T@TI I LR <I
 N> @ ~@ 6= LC6=
&; = -=?> ?>O@ F L\ 2= -D T; K@oD Dw]-=
O@
<R &=
' *0 *K')%jk8}g > T@ N@ wv &I XR

 z~ *"#ow ]a\S]a`{ivbf]_mv`
 +K'8
Zrq cZ@Xq cZ sSe{] vmvb
 *" 
+-'8
'
' 01Kp 
' ) '1 * " ' 
W9!' Z@XV\Sstbdivbf]_' mv` 01Kp
@ D ?=
' ),6=?!Dw' I 6= L\
WY]*" mk bji xZ
 +-'8 +-'8
 Q"#

'') ) '1Q "#* " Q "#


^c`V ^ V OQT jgO ]V^ TjS^ VOiThST`Vh^jgh S` V OQhQOQ` UTRU^ fhQ^jSh S` RU]Pg] O gT hQ^ TRegT RegT jSh S`
Uh
TUP Vl`
SPgTDhQOQ`V T T
Pg]
T`cR]gV T
R] jS^ ^O`]!PS` P
O gT` RT gO ]PgPST 3
p
p
n /3
RU] jS^ ^OQ` ]PS`j4] fhQT[jgO ]V^ !TYV ]V^h
^h ] OiV e T
UhQO OQPS^ V Oi]!P T
^ S`
` ^ TR TRegT RegT jgO ]V
j_^ V OQTUhT`yV[j ` TUP V S^PS`h ^h ] OiV e T
T`TR]!P T
T T` V`V ]R
g^PS
` h^ T PgO T RU]hQ]PgPST gT
^P

k Veg] T T

^ S``^ TRjSO !]VjS^ V OQTUh

k = 1, . . . , n 1




cp |akk |, ip k
i = k + 1, . . . , n
|aik | > cp
cp |aik |, ip i

i =
6 gkV T hQT`YhQO PgT`
dpT

ip

TV

ThQ^ 8^ V ORT



i = k + 1, . . . , n
j = k + 1, . . . , n + 1
aik
akj
aij aij
akk

 ~ h @amkowstbf]_mv` s  Vbd^@\GZ)bfXV]_iv` xksto iv]aX[Z




*"#

')  Q "#

 (

n,n+1

xn

+K'8

ann
k = n 1, . . . , 1

n
X
1
xk
ak,n+1
akj xj
akk

vNu
fu3v

j=k+1

T|Q8~S n p~ o{ \} C|S\D D {F|





 .D

' QQ+ *8(K(+-0


Y  9 F B>= @ D > T@ u@ uv &I XR <R

|}{!~SC


 *7

h OiV ^V OQ]P

gThQ^

Veg] T T

^ S``^ TRjgO !]VYV ]V^h


o
n
(k)
max aij ; i = k, . . . , n; j = k, . . . , n = 0

P2d
x)@

  

 

     

 
 

7I 4> <>D @ 7I [ZD ?=


9I zy 6I ~=?D 6=4HJI = -\ @ wD B=
[A >\ BC6D !F ;Y EF @ f LI wI t; > L>6D
@TI K@}D 6D/]-= /@ >6= O@ 6>=  2=
 '87*K(+ *8 +%+-((')890
Y
LD 6I HJI I, 6BHJ=I I D K=VH7I  BI-=?D = 6=H7IuHJI@TI LR BA ?C6D !9FI -; K> = 7L= ] &D ] 6D @T> K@ N@ @ <I ;!` -2= I 6D b LC6=  ;9|
i 89jk+-XG"%8nFg g 0B&(G@".rC> ( 8 Ke@"N "%" ! ;C3_?>8""b>"I?
C n;F;o ' 9K'
C" 8>?
\a a>@& &(Hk
&('9@"."%GKl: ;> da' .a, UNU ?
lj 7 
XD& F".K.aO 

g]PSRV ] S`hiT` h
UT P V` ThQ^`] S` 8^ V O RT`]!P!VP ghQ` ]!PDj4T V[^
 m` TR]!P
T`V !^h9
OQ
h T OQ`V T gP Uh
T!
P V (k)
k1
bi  k i n 
hQT` `V
T P ^ jS^` gT ` ]h VOi]!P

gThQT ^P ThQ^


^ V OQRUT
A
T O TUP V T ] ^ hQ] `


o
n
(k)
max aik ; i = k, . . . , n = 0
]PDj_T VY` T ShiT TP VY^
T
STh^cR]!hi]!PgPgT
T`VhQOiP ^O T TUP V j_TP g^P VT T`
j T O T`
TUh^
k
k1
O jShiO gT gT
TV gT hiT` `yV
TP ^
j ] S^ ghQT TP!V jS^!` T8`]!h VOi]!P
] V T ]O` ]PPgT
rang(A) < n
j4T VTP UV T` 
ST ` hQT V T`yV
jgO ]VYV ]V^hGP gh

<HM ;=09R5478

J,

@ *D >2 = >6I D K@L = ;T|


6I , B= ; o= K=B>
-=
7D

C N}RB:B0 JL<);4I>#Mu0 :B?A:'8=>@:  R5U@>.H34I0

LBI >6= I-= 2= [%A @ BC6D -= D -> <C=L= =B> E=?<> I 2IK@T= 9MX\ R2=?@ 6E= D0,6D SD B=
?7> =B= &= I K@ uD \ &?=z= @ 6=o> uL>6b D 2= L= }HJI @ @ uC6= D }@ ?= F L@;
<R &\ t@ kD B=
1F > ;Y
tR
@
x
[
I
y
;

S^P ]P^Yjgh S` OiT `` `V


T`hQOiP ^O T` 9 ` ]
O
TP V` ]Pl^OQP V ,VhQ] ` gTh^j T O T `]!h gV OQ]P
TUP
]O T
ThQ^lR] T` j_]!P &9 ^ T hQ^ ^RV ] O` ^V
j T V UV T TUj `TP!V -j_^ gPgT 8^ V ORT Uh
4
TP!V^O T
R]!hi]!PgPgT
ZTj TPg]P_`8hiT jgO !]V^ T gTmhQ^
^V OQRUT
9 h
A(k)
R] j_] ` ^P!VT`Y` ]P V

b
P
^


]
S
P
R

U
T
P `
(k)
(k)
ik = aik /akk
]

Ek

/D B= M> <>D

bP ^ ]PSR

]V ]!PS`

<= [I LR

T`V[h^ 8^V OQRUT h

-=?C

^j `

n1

@ #@ LR
B>tHJI
6I-= @

&2\KHJ@I ![D I <R Dw]-&= \ b


&=~I 7I Z
@

Tq^ TRh^
T 8^V OQRUTqTV T`` TRU]P g` T
T`
!^ gT hQT`qRU] T ROQTUP V` T`jgO ]V^ !T`` SRRT` ` O `
OQ]P
gTh^ 8^ V ORT ofPDT TV ReS^ gTjgO !]V^ T
LU

gO[PgT O T gTKh O TP V OiV
gT
jS^ SPgT `] S`

V^j4T
k
Sjgj_] ` ^P V

]OiV

(k)

akk

k
6= 0

hQT !TR VT

T

Rnk

]P VDhQT`

A(k+1) = Ek A(k)

TUP V^O T` gO ^P V T

LR 2\

jgO ]V^ T`

Ek =

D ?= B= -\7I <= [I *>6= 6I-=

hQ^ 8^ V ORTV O^P

;;;

E=?>6> = <R

/=

A(n1) = En1 En2 E1 A.


ghQ^O T ` gj OQT T
TV
R O !]PS`h^ TUh^ VOi]!P
A(n1)

x T;L:P y

x T;L:P y

1
A = E11 En1
U
bP
O$#ST gThQ^ 8^V OQRUTOiP T ` T
^h^ 0, T ]
T gT
^ TRYhQT` Uh
TUP V` T[h^` ] S` R]hQ]PSPgT
E 1
E
ReS^P ` T`O PSTTV gThQT`j ] gkOV` 1 1 ` T TRV gTP VY`k^PS`RU^hQR gh_TPD^RR]!hQ^P!VhiT` !TR VT `
k
Ek Ek+1

TV
g^PS`hiT`fR]!hi]!PgPgT`
TV
bP8j_
T V ]!PSR R O T
] 

T`V gPST 8^ V ORTYV O^P ghQ^O kT

k
k
+
1
A
=
LU
L
OQP k+1
OiT T g]P V[hiT` Uh
TUP V` O^ ]!PS^ 8` ]P V ^
9 TUV[hiT` Uh TUP V``] S`YhQ^ O^ !]PS^hiT ` ]P V

~R2>-= \2> @HJI L\ ND B= HJI 9R -= = 9@-I ND 6D V6b 7F =B D VBHJI I XR 6I > L>6D @ 2R I [Z 6I-=
Tb>6= I-= @ O@ > L>6D V@ &\ ;&I-f I E4>6@ \ &ITf > 6= : L= > L>6D 7I I V@ D &\ B= B= -\7I <=

>@L>6] D 6=?R  4&\@ NHJI 2=?N= > L>6; D K@ ; O@ D 2\ ?= &ITf @ 4@ 6EI-=R 7I-R ?= = ~= -&\7= > NO@ b L= 2= 6D

lij = ij .
b S` T ]!PS` gT8hiT` Uh
TP!V`Pg]!P OQ^ ]!PS^
T
j4T !TUP V , V T ^P ` O TR V T UT P V 9
h^
jgh^RUT T`
L
Uh
TP!V` gT
UR ] T`j4]P S^P V` ^ 8^ V ORT
T`V ]!PSR TR] T V TYjS^ ` ^ ^!R V] OQ`^ V Oi]!P
TVhQTRU]V
A
A
LU
T`V ]R ^ !TT`yV[TP 2
n

KP :
2x1@ I-vMR = & I BA 9 ?C6D }b -z> y ; 2<= =  x1HJ7I I-6=EI =B> , B7= IK@T=?= t> @ LI &= u=?> LI LI = H7@ I M@ ITf B= [A -B\7CI D 2= ?= K*\2yI  L2= I

=?> 2I E@!F 2] 7=?@
KI
7=
' *0 *K') %jk8o 
x +K'8 @TI}R 6I-=E@ 6=?DwI ?y
 *"# 

Zrq cZ@Xq cZ sSe{] vmvb
 *" 
+-'8
'
' 01Kp 
' ) '1 * " ' 
W9!' Z@XV\Sstbdivbf]_' mv` 01Kp
6=?DwI 6= L\
@ D ?=

 '),!'
WY]*" mk bji xZ
 +-'8
 

 j
7  
      

  
  

 

RUT FRUTVVT ^RV ] O` ^V OQ]P


gO[PgTmRU]VT ]PSRKjS^!` g
j h S`RegT
STKh^V O^P ghQ^ O`^ V OQ]P
V ] gV
PS] !T^ ` `yV
ThiOQP ^O T
4
j
T
g
V
U
V

`

]
h
8
S
j
^

h
^

`

]
h

V
Q
O

]
P
g
T

T

`


`
V

`
V

O
^

P
g

h

^
O T`
Ax = b0
]P_RTP
S]jS`

P
T

T
V
_
j
]


`
]

T
O(n2 )
]!P

` ] gV

LU x = b0

^ _]

Ly = b0

j gOQ`

U x = y.

^RV ] O` ^V OQ]P


LU
OQPgOVOQ^hiO`^ V OQ]P
(i) = i i = 1, . . . , n
k = 1, . . . , n 1


!TR VT

T`j4T

V^ V OQ]P_`



cp |akk |, ip k
i = k + 1, . . . , n
|aik | > cp
cp |aik |, ip i

i =
6 gkV T hQT`YhQO PgT`
dpT

(k) = ip

TV

ip
(ip ) = k

ThQ^ 8^ V ORT



i = k + 1, . . . , n

Z@\e{ow] a.i.x Z Z-opi qrmkopmv``{Z




"

aik

ik

ecivXAo Z -qrm Z  q@]_Z.`cb 

ik

Q m "#] uqrikbl]_mk` Z )ow]yxz`{Z @st]  `+- mk'`c8 beci -Z.`{qrmvXZh.bjhAow]yxz`{Z  e{] vmvb
'') ) '1Q "#* " Q "#

LR JI !F = B=?> I D B= 7I @ b 2=?D
2 I K@ &I 6I
O
I

J
H
I
  6F 6f @ 6I-fb 2 =
;
|> MHJMI I LD D LHJBI = MH7I ?= K\2I L= Tb>= 6IK= ox= K= T@T; I BI *@ >6= @I-IT= (f~y D B= -= T@TITb> = 6IK= Kx7> = =
D B. = O@ 2\ O@GF I;K| F ?= F B@>\ @?> 2L=R &=
7I-o= D 7I ?= ; ~@ 6=?DwI

F ?>6=  6I V> = L=
b  E@ *>= =BD/I
6I-R , ?= O=?> BI-D > E@ D B=
2]
@T> 2D
\7> ->= BI <R ;


akk

(



j = k + 1, . . . , n + 1
aij aij aik akj

b 2= ;
; [L=I 6*D >6= 6I-=I zy
@ L\ :9

S^P ^ SR gPcjgO ]VqP ShP T`yV TUPSRU]P V


j_T Vf` T
TUVV T`] S`hQ^ ]
T
TUVqRUTV V T ^RV
A
LU
T`yV gPgO gT oPT TV ` OQhT OQ`V T T
^R V] OQ`^ VOi]!PS`
TUV
T
]!P ^-^hi] `
L U
L2 U2
A
L U
T gO_O jghQO gT ST 1
gOiV gT 1 T 1
^V OQRUT`fOiP
OQT T` T` j 1` g1j
1 TVhQTj ]
L
L
1 = U 2 U1
2
UV^P!V gPgT 8^ V ORTV O^P gh^O TcOiP
OQT T T` j ` gj OiT T
RT`j ] SOV`` ]P VP RT` `^O T
8^V OQRUT gOQ^ ]P_^hQT
T`yVh O TP!VOV cRU^
j_] YV ] V
(l ) = (l ) = 1
i
^PS`hiT8RU^!`
SPgT`yV ^V OQT T jgO ]V1jSii^ V OQTUh 2 `ii
O
T`VhQ^ 8^ V ORT T j4T
V^ V OQ]P T`
Pk
h OV ^ V OQ]P
]!PKj4T gV R O T
k
A(k+1) = Ek Pk A(k) .
ofP ^OV hQT` O
TP V T`[j_T
V^V OQ]PS`Yj4T !TUP V V T `
UT` S^PS`Yh^
^V OQRUT
TUV[]PK] VOiTP V[hQ^

R]

j4]!` OVOi]!P

UP

P = Pn1 Pn2 P1
^hiT ` gO ^P!VT

] O` ^V OQ]P

= L 2 U2
OQT T`
TUP V gPST
hiO PgT`

  

c ;Gp@ U c "%'9UO

     

 
 

%9 K
X?9& jk8t"3pg3a1  ".K6k >
 l*6 "%>8U?F9O"%& 9
Fg3G".Kp3@a O
X>?
e"bS9
Al* $'O6 7 >?# :; > c H98"%>88Fk" "b  @
X"D= &
XF".& K.aO"3np3 8aC ;=".'KKk &(
Fl*"b U".?9>@O



 


 g   bP^

lii = 1

Tb>= 6I-= ; ; = 6D D &=zHJBI = VHJI 2= @ HJI kD ?= ;


6IK=@@ E@ b=B<\ D/I 2= >R ?I ; ;KXY R2= = = 2= o@TI L\ <R
LR B= N= = 6I B> BI-= K@}D 6D/]-= 2= V@

P A = LU.

4] ?= K\2I L=
?= @ *>= 6M=?DwR > I
6L\ =?7Dw= I KD UK; @
V@ L=  9R 6=

bP ]!P V T ^ hQ] ` gTmh^ 8^ V ORT


E
L =
n1 Pn1 E1 P1 A = U

T

`
V
g
Q
O
U
T
8
P
V

O

^
P
g

h

^
O

T
Q
O
P
Q
O
T

b
P
T 8^ gT gT S^ PS`RTRU^`
|lij | 1 
P (En1 Pn1 E1 P1 )1
^h ] OiV e T
]!P V T-hQT` O
TP V T` UV^j_T` gTKh^ ^RV ] O` ^V OQ]P
^ TR TRegT RegT HjgO !]V
LU
jS^ VOiTh oPKTUP V T]!PK^lhQ^ 8^ V ORT
TVhQT !TRV T
gT`j_T
V^V OQ]PS`
ofPK` ] V OQT hQT`
 ^AhQ] R`]P hiTV`YOiThiP!O VYPShQTT``
A

^RV T `
TUV
T h^ 8^V OQRUTTUV
hQT`Yj4T
gV^ VOi]!PS` T hQO !PgT` TUP V gTUhQhiT`
O
L U
gV^ VOi]!PS` g]O TUP 
=j T
TV
]P V V j4T
V UT` T`j4T
V ,UV T Tj_T R V T`[` hQT` TRi]!P
ThQ] ` T
i
j
h^ `]!h VOi]!P T
^h ] OiV e T
Ly = b qmk`@~

2b = SI-F = ;L\ 7= KD ?=B> @ P D /D B= B=D


=B> <I V> ?> @ 6=?DwI ?> ;
' 0 QQ' #jk8  Y IK] ?I
z~ {s Vbf]ablstbf]_mv` ]aXZq.bdZ
 *" 
 +-'8

S`yVOV V OQ]P_` O TR V T` OiP !T `T`

&

)

Ly = b

x1 b 1
k = 2, . . . , n
k1
X
xk b k
akj xj

')  * "#

j=1

 ~ {s Vxbf]ablstbf]_mv` ]a` v Z.X @Z


&

)

*" 

')  * "#

Ux = y

+-')8

ann
k = n 1, . . . , 1

n
X
1
xk
akj xj
xk
akk

vfu uSt


"

xn

j=k+1

T|yx |={}F~p\ S~So{!




35+T')$289p~p)!jkJ6')G"%89p
BI . ux <b b ; ; f =  (@ y ; 6I/b F > 7== <=

; 7D D 6f B=?>Oo@ @ 12F \ L\ 7= -D

2= @ <R

^PS`8RUTKR^`
j4T V` R O T
]
T`Vh^
^ V OQRUT gOQ^ ]P_^hQT-R]!P V TUP_^P VhQT` jSO !]V`
U
U = DLT
D
` SRURUT``O ` bP ^ ]!PSRhQ^ ^RV ] O ` ^V OQ]P
jghiT OV gTh ^h ] OiV e TT`V^hQ] ` T 3
T ^ R]
A = LDL
n /6
S]!jS` R
T T RUOQRUT

35+T')$289p +-%#89p
@@ *>| = D ?= V@ ;# E D B= y ;!2| = BMAJb D D > BB= = LHJ@ I~D 6?=?= R V=uHJH7I I O2b IK= 2D 7I-I-D = = O@ = ox@ =?> }] &Q=?@ \ n; I-@G=EF >@ HJNI ] Q7@ =
?>6= , V7@D 6f B > 6= wD ?= x ; b 6I-= y 7I wb 2=?D M@ 2] &I 9 L\
35+T')$289p~p )!jkJ6')G"%89p/% 4%%')89p + *p')'87*89p
XR ~| @ D LBR = BI = <b > BIKB@ = L> D &I ?= b ;^-; ob 2= [C(@ I I }b F  7= ?I 6= @ L= I H7D I

T h^
O
OQP!V
TV[h^

T` ]P V T` 8^V OQRUT``


UV O gT`V TUhQhQT` gT
j_]
T`V[hQ^ h^ T
T S^P T
a =0
|i j| > p p
8^ V ORT
T`
^V OQRUT`OiP VT OQTUPSPgTUP ij
VR] ^
TP!V g^P_`h^ OQ`R VOQ`^ VOi]!P
S^V OQ]PS`
p<n
TP V OQTUhQhiT` hT`Vl^hQ] ` ^RUOihQT T
]P V T
SThiT` ^RV T `
T`j4TRV TUP Vh^ S^P T
b P ^ ^hi] `
LU
V T `yV]R T h^ 8^ V ORT TUV[`T` ^!R VT `
`] S`hQ^ ]
T 
T V^ ghQT^
hiO PST`TV
R]hQ]PSPgT`
LU
n
p
R] jShiT OiV T`yVTP
S]!jS`
2
np /2

T` 8^V OQRUT` ` T ]!P V UV O UT`8^


ReS^jSOV T
^ TR T`cjgO ]V`c` SUR RUT``O `c`V OR V T TUP Vcj4]!` OVO `

ohQhQT`8j4]!`` TUP V gPgT ^!R V ] O `^ V QO ]P gPgO ST


LDLT
^ ^RV ] O` ^V OQ]PFj_T V` T TR V gT O TR V T TUP V`^PS`



 

  
   

y^ <R ; 2\ &= L@

1

=BD

jSO !]V^ TjS^ O TP V O$#_RU^V OQ]PKV T

J ,
G
vNu fuSt

=BD

T:9V T

TTUP

n3 /6

&= F <\ 2= -D N@ |

S]jS`[jS^

h ^h !] OVe

T T

eg]hQT`

7P P
B=

 AnxRb ; ReS^jgOiV T

R ;4I098 <)2B2BU@>#Mu<T;I>@?A:B8

T|S\D  .~S n<{!  3






|}{!~SC

@D 1F <C9= R V6= BR9I I ~LR -@G=?F >I 6>~@ ]D D BD >?= [IK;= HJ2 I /I b VK@=?> 7= LI ] w@GF I -@ B> A -?C6D DD ?=NK@ > 0L% = -6>I = 
| I 6=  b 6I-=
@ K> L=D ?= 0%
E> 2IQ@T=
[
A
B
6
C
D
]
HJI N&@ = ; M@ LI
ZCD ;  O@ 6 I ; OD
@ B=?I r BI-= N-&x= = b ; 6I Vf L6>C6=HJ= IOL@R (y ; K7@ I-= 2D D 6D/D ]-= EI @ B>[A BD CD 4H7I -> L= [I b 2=
 9 <R 6= 2D LC 6D
 D > T@ @ @ v 2I [Z 7=?@ NH7I

I -= 6I >@ 6f =u@


Z C6D wR 6I-=O@
B= 6=MH7I =?> \2!= F H7I
[A BCI D @ S2b= 2D > I-B=?= >

bP^ j R T
TP!V gTfh^ ` ]h VOi]!P
gPl` `yV
TfhQOiP ^O TfPgTP RUT``OiV TjS^`hiTYRU^hQR gh T jghQOQRUOVT
gT8h OiP !T `T
gPgT 8^ V ORT
S^P
]!P ^ 4T` ]OQPFP ^P ]OQPS` Th^
RU^hQR ghiT
]!PFj_T Vcj ]R gT T8h^
8^PgO T` gO ^P V T _^` UT` hQ^ ^RV ] O` ^V OQ]P
gThQ^ 8^ V ORT
LU
^hR ghQT hQT` ^!R VT `
ThQ^ 8^ V ORT
LU
P A = LU
Z ` ]
TlhiT`
` `V
T`hQOiP ^O T`
] 
T`VhQT
T !TR VT
ThQ^
n
LU xi = P ei
ei 1 i , n
i
S^` TRU^Pg]PgO gT T

^
`

]
h


V
i
O
!
]
P

T

`
[
V
Q
h
^
T
U
R

]
Q
h

]
g
P
S
P
T
g
T
Rn
xi
i
A1
TRU
] VV ]V^h^jgj_^ TUP VT`V gT 3
S]jS`
km^O`]!Pmj4T V
]P V T
ST
3
3
 RT 9h^
n /3 + n = 4n /3
`V SRV T jS^ V OR ghQO T gT`` TR]!P g`
T
T` T`[` `V T`YhiOQP ^O T`` SRRT` ` O ` hQTR]gV UThGP T`V ST
gT 3 _]jS` R T T RORT
n
PgT^jgj ]RegT
gO ^hQTUP V TR] ^ TP V V OQhQOQ` UT 8^OQ` SO4PSTjS^!` ` T[jS^!`fjS^ hQTR^hR gh T` ^!R V T `
T`yVh^
Veg] T OVT gT
^ S` ` \] g^P SO RU]PS` O`yVT jgO !]VT R] jgh VT TUP VhiT` `V TjS^ ^ UV
LU

LR

b B6I-I = 7] 6=?R 6=HJI LC6= E@ b  LHJI9 ?= b 7=BD19=


 [A BI B6C6= D &I = <[C A 1B9CD E2= @ <&=E\ @
;
D B= @ ?> LR &\ -> <= 9 ?= [b 2=?D o@
D ?= @ ?> ;
Ax y = 0.

bPjgO ]V TYRTV V T

]O`q` qhQ^R]!hi]!PgPgTTUP V O T T ^ U]P V ^PS` ]


T hQT` `V
TYTUP gP ` `V T O^ !]PS^h
b

D
P
4
j
T
g
Y
V
]
S
`
T

T
g

T
U
R

T
V
V

T
V

R
S
e
g
P
O
g
T

R
]
!
S
P
`
Q
O

`
V
T
c
T
4

T
R
V
S
T
Y
U
T
P-jS^ ^Qh h hiT jS^ VO 
T h^
x A1 y = 0
8^V OQRUTO TP!VOV hiT`YjgO ]V^ !T`P RUT`` ^O T` h ^cV ^PS` ]
^ V OQ]P T
TUP
hQ^ 8^ V ORT O TUP VOV
A

vNu fu3v

T|S\D D  z\}o{ ~p| }






4u] @  wH7HJI I V=o?=BD @TC > &=zLDH7LI = &2] = &f = &= -= =O@K7=DwL> ]-?= > 6SI > 2!@-I = @ @ 7I-= ; -> L7A @-= > @ =BD /D vM>B=7D > B= SR @@T> 6>66I-==?=uD @!F I
b@ 7=BMD R DwI I-= -N> HJLI = R B2I-I =oI : 2I-= 6Dw] R@ 6I-R = M@G6F II-= HJ] I 7= -\ 7@ =BD > <\ ;!| F &2I HJI R =BD/LI-I D @TI
K@-=>Z -2=B== D L> ?L>> LM> @TI *C@-V@ > >6\ =B-D \ x 2KI @T=?> L\ &= -@ =?C zR y &I= 6I--= = u9@-@ I @ ; LR XR ; ] 2= D > = T@ }@ = v 2I = &F K[Z = Z @ L=
  +#'17(9p %" %7(8JXj ')%+-
, E@T> 6=?D
@-> K@ -> L= D @ ; 7HJI  L\ 9 [> 2HJ&I =?>6D b EH7;XI F F D/BI I HJI OI L\ &=

u
@
>

B
=
D
V
w
D
I
<
>
&
=
@
;

P
, u@T> =BD
K
\
N
@
L
\
6
?
=
w
D
I
u
@
6
I
f
L
\
;

-\2I x)@LC6= ;

;
Y
?= K\2I L= 

WOQTUP gTqV `GO j4] V^P VjS^ `T`GPg]


T S` T` V OQhiO`^ V OQ]P_`TUPXPS^h `TfTVTP
U] UV OiT gO TUP V OQTUhQhQT
TUV gOQTUP ST T 8^ _^ ghQTjS^ `T`j ]j O V ` UV ]!PgPS^P VT` S^PS`fhQ^ Ve U] OQT T` 8^V OQRUT` hQT UV T
OiP_^P V
T `yV O ROQhiT 9
#SPgO TV 9KT jghQ]OiV T S^PS` hQT8RU^ T T8RT8R] ` T V T OQPS^P V T`V hQ^ ^hQT
gPST
]
T
ghiV OQhiOQP ^O T `
gPTPS` T ShiT T
!TR VT ` gOReS^P T T ` O !PgT 9>ReS^ gT j_T
V^V OQ]P
n
gT` TR V T `TUV gO ^ V
j4]
hQT`
!TR VT `
SPgT S^` Tc] Veg]Pg]
T
T`yV^ S`` OhQT ]h
T
n
wjS^ ^hih Uh UjgOQj T8TP TP
8jS^
!TR VT ` g^PS`

b
P

`
T
4
]

g
P
T

R

O
9


^
g
j
_
j

T
i
h
T

Q
h

`
j
Q
O
S
P

R
Q
O
S
j
^hiT`
n
n
Rn
j ]!j O V `
V T
OQPS^P V T:
V 9 g]PgPgT hQThiOQTUPT``TP V OQTUh^ TRchQ^
Veg] T gT
^ S` ` R T`V 9 O T hQT


V T
OQPS^P VT`V ^h ^ `O PgT j ` ^ Kj ] gOV gT`YjgO ]V`

T

UV T

OiP_^P V

Uj4TUP lhiOQP ^O T TP V TReS^ gThQO PgTY` jS^


TP!V h ` TUPS` gOiV gT
det(A+B) 6=
oPKT TV lRe_^ gT ]O`
] P
!
ghVOijShiOQT gPgT hiO PSTj_^
UT V
det(A) + det(B) det(aA) 6= a det(A)
hiT V T
OQPS^P VT`V
ghiV OQjghQO j_^
]PSR
a
a
det(aA) = an det(A)
T UV T
OQPS^P V[ReS^P T T`O PST ` O]!P-j4T
VT T DhiO PST`

det(I) = 1
T`yV` OQP ghQO T
det(A) = 0 A
g]PSR
det(AB) = det(A) det(B)
det(A1 ) = (det(A))1
T
det(A ) = det(A)
O
T`VV O^P gh^O T
T = (tij )
n
Y
det(T ) =
tii .
i=1

P&U

7(8JXj )' %+- <"%%8jk+T6'1$28 <QX#8 g


I @-Io@T> =BD @GF I ND ?=

TR^hR gh

UV T

OQPS^P V

gPgT 8^ V ORT

gOGj4T

TV T

V T

22

E]

9I
%

T`yV gOQTUP RU]PgP

x -;<:U y

D 1F JR 6= O@GF I ND ?=

OQPgT T jghiOROiV T

 
 

     

 


a b
= ad bc
c d
TUP V[h OQP !T `T
gPgT 8^ V ORT

det

uHJI 6=?D @ u@-> =BD 6= 6f

RT

  

22

x T;L:(W y
b 2/=?DwH7 I I }\7M> E-@ = >= K| @ = &LD D K==OHJ@ I &N] b 27=?I DwI 7I-=~= @ x -T;=VL:69U@ @-yLI DZz<x = T;L:(W y 2I B=?C N@&= ND ; ?= OBI= u@GF 62f D 6D K@Tf I ?> 22IKf IT= fnb 2D I I = 
@TBI-> =N6I =?D ~D @GF I ~M@ D :(d2?=d x &= ub 2B=?=?DwI I @ | =2&= D 6= Q*@ b &(I y ; R 6I }-=?D C > :XWTUJ@d2~d @ 4@ LR 6I
!F -= HJLIHJNI @ 6I 6= uK@T@ > 6=?D
-=?C LR &\
1


1
a b
d b
=
.
c d
a
ad bc c
^ UP ^hiO`^ V OQ]P T` ]
ghQT`
^ RU^` gT` 8^ V ORT`
UR ]P SOVc^
nn
]
ShiT` gT
^ T
gT Pg] S`PgT Tj ] gO ]P_`jS^!`OQRUORU^ ThihQT` ]!P!V gPgT8RU] g
j hQT OV T
RT SOhiT` TUP KO j ^V ORU^ ShiT`Yj_]
T` O TPS` Oi]!PS`YV `[j_TUV OiV T` X V OiV T
T T g
j hQT j4]

UV T
OiP_^P V
gPgT 8^ V ORT
jS^ hQ^ ]
ghQT gT ^ T Oih ^ gV9j4T -j `
20 20
`
gPgT 8^ReSOiPgT T
k OQjS` ` ]OiV
OQPS`V SR VOi]!PS` jS^ `TR]P T
X !TRhQ^
UV eg] T
108
R] V[P T`V gT T
`

R
!
]
P


T
`

3 105
oP
j ^ VO gT ]P
RU^hQR ghQT ^chQT VT
OiPS^P V^j `YjgO ]V^ !T %


b 7= x ;

det(A) = (1)p

LR



uii

7Dw]-= @ 6=?DwI
T Tj4T

BIK> &I 2I-= u@

i=1

] hQT`
c`]!P VhiT`jgO ]V`TUV
hQTPg]
u 1 i n
p
^RV ] O` ^iiV OQ]P

J,

n
Y

^ T S` T`
j_]!PgTUP VOiThihQT
[RU^hR ShiT [hiT
^P_` TRU^hQR gh
T`jgO ]V` hiT

V^ VOi]!PS`T 4TR V UT`l^ IRU]

034=Mu>OMY0

87$7')$28 g1 ' p(p89j %01+ *8o%8}89pp(KX(p@ :2;  | I = b 6IK= r @ D B=


^hR ShiT qhiT` ^RV T

T[h^ 8^V OQRUT

` Th^

[I LR

` gO ^P V T

t@T>(@TI L= b I-=

oP

gO T hQT` ^!R V T

LU

2 1
0
0
1
2 1
0
.
A=
0 1
2 1
0
0 1
2
gPST
^V OQRUT`
V O gT
A n n

@!F I ND B= [A9D > ?= HJI


aii

= 2

ai,i+1 = 1
aij = 0, j > i + 1.
T``] V` T 0, Tchi]!P gT
TUV TcRU]PS`V^P V T T ^O T
n+1
L
T
T V
OiV ` ThQ^Re_^ PgT
eS^ gTcPg] T
T`yV ^``]RO
i
T``] V`TV[]P
PgTRU]PS` O T gThQT` Ujgh^RUT TUP V`Yhi]!P OiV gOiPS^
TP!V
Pg] T
RU^PSO gT
. Th^ TUh^ VOi]!P
i

]@ L2= I L\2T;:>  9 ] 2I F f#-LNfT@-> C6@ = &IT= ft@ 7= IT= f f7B= ?= >6ED @ wB> D @ D @TC6= M-\2HJI I I-=;!| @T>2MHJI@ 6D 6IK@ u-@\ uBIK= @ @ L2> I-IT= 9f IT@  I uBAb 76D/=?C6] D L> ;
uT@ > 6D V@TI KI @ ; /= D > LHJI
bP RU]PS` O T
4] V
4] VTV
`^
O O T`Thi]!PKh ^ T T`
bP
Pg]VT
hQT UjShQ^!RT
ui

<= N] }@
 7= &I 6IK@

]PKVO T hiT gOQh^P T`T 4] V`^ KPg] T

f=

k
u,
L

k
k
(ui ui1 ) (ui+1 ui ) + fi = 0.
L
L

^!` ` T gh `
k
gPgT ] RUT
fi
` `yV
T

 

PJW

  

&IT?f = f B=?[>6A D BCBD> V@!F >(H7I


; Mb 2=?D
7
I
@ HJI F 62f D }@-= I ; K= E@ @ = 7Dw]-= }@
BA ?C6D N@ V= 2= ;

I ED B=
K> L=

I ~R I-=
?= > LI @TI

bP
^ ^ KT V
OiV `
 u = uV OQ]P_`=`] 0S`qh^ ] T
k TUVV TRUT[` `V T 0 _^ n+1
] 

T`V gPST
^V OQRUT
T V gP TR V T
Ax = b 
A
nn b
gT
g

T
h
!
]
P
T
S
j
i
h

R
i
O
V
T

^
Rn
oPHVTUPS^P!VDRU] jVT Hj ]"#Sh T
g]PgPgT hiT Pg]
T T S]j_`lP RT` `^O T`09hQ^ ` ]h V OQ]P
A
` `yV
T T` T` ` ] V`

8J$2[')I $7L8R gFg  53 +-6')$78t#8'10 8JX@ ` = -\7I 6= 2= uD > T@ @ Mv &I  ND ?= M@ L] 6=

33

O^P

` gO ^P V T

>6= # 6=H7I M@-> =BD


N

O _T

ghQT jS^ fh^

SThQT

V T

E@

OQPS^P V T

H=

1
2

1
3

1
2

1
3

1
4

1
4

1
5

!^h4^ j ]

1
3

A (n n)

jS^

aii
aij

^ _` ` h^ 8^ V ORT TnOih 4T V

>6\ 2I -= T@TI @ <R BI

T`V

D 8J$2B=')$78 gFL   !%"#2')= j +T6')$78 7*8J$289"# #+K#p

h^ 8^ V ORT

Veg] T gT

<b ;-| 6I 6= 1F 9R 6= @ ;

gOiV T`jgO !]V`` SRURUT``O `

Rn

= 1 + a2i + b2i
= a i a j + b i bj ,

]!OV

`O

TV

b

^hQR ghQT h OiP !T `T gT

@ 6I-fMR 6I-= G@ ; u@T> #


T

!TR VT

Q]Jyy f -= T@ LD> 6L= =  D VIBBI=o=b 6-IKo= =9b9 -@ I -@ > =B}D  @ 6= ; @ ;  = <=  oI  <\ ; 2= -D =?>

i 6= j.

^ o j O T h^
^V OQRUT
TUP 
] PSRV QO ]P T
T V gT
A
In
aR O bT agTH
bT
8bP
` O TKT TRV gT hQT
j ] gOV
P ^h !] OVe
n
Ax x R
S]j_`
] 

T`V gP ^RV T
V T
QO PgT
O(kn)
k

` T

Rn

bP

-= T@TI

SPgOiV

^hiO` ^P VRT


j ]

gOiVTP

P2^

  

 

     

 
 


  

g:;4I?GCBR M

,.+




)#1)



(

;=>.?A:

6@ = I-= <2\ Dw2I =]K= -DD @GF NQL@T>C6=>= = K= u-@ => L>6@D = -2L=BIK= > = @ 6= K> 2= 2Dw6I]KB= = = B=?= > ITBf > @TI 1F&=MI DwB7]= =?@ @ b 6=BIK> = ;G| 6HJ=?I!R2FHJI L=N62I I =BZ
=> K=B> -6=?= > D L> ; 2I-= 2D -= Q@T= ?=BI BIK= N@ 7I [Z Dw] N@ ~@T= u@ V=B>
L@T>= =
EHJ I F 2= -D > BI H7<IR =-?=I-=?>=B]*<> > 2= /I =?> OF LI =?V>oHJ@GI BF I >u@ B?AV>2F @ BCD 2D-> D -> <= f LI 2I 62f ] <\
6I L>
 B>
,HJI L\ 9I-D 7D >6= D H7I 6ED @-> =BDOb 6= HJI 2IK=HJI -= ?HJI -BI \2I LC6&= D D NF -= 2F-@
?= LC6D
> 6F LI &=z@ &= = I V<C@ = D =%HJBI = LHJB>I N@ > <>D %@ =?B>= [I LR 2ITfu; @ 6ITf K= D LC6= #HJI
T`c^h !] OVe T` R OV` g^PS`RT-R] ` TUVcTUP jS^ VOQR ghQOiT cRT
IRe_^jgOiV T
]P VcOQP V T TPgO gP
RUT V^OiPmPS]
T
]!j ^V OQ]PS` Uh
TP!V^O T` T`yVOiP UT` 9 ,V TlV ^OiV UT`j_^ gP ] OQPS^V T
eS^ gT]
gOiPS^V T ^ gPgT 8^PgO Tcj ]!j T T Tj `TP V T hiT`PS]
T` UThQ`TV h TUP_`T ghQT gT` TUh`
Oihqj4T gV
TUj `TP!VT YT`V#SPSO h^8Rh j4] R] j TUP
T h^8`yV _R V T TcRUT`] S` tTPS`T ghQT Th^
]!OVT T` TUh`

UV^P!Vh^ j RO` Oi]!P 8^RegOQPgT
^ OiV e UV O STTUP
j RUOQ` Oi]!P #SPgOQTTVh^ ^hQOiV T` ]PSP UT`OiPST g^RV T`[Pg] S`[] ghQO !TUP V 98R]!PS` O
T
hQT` gT`yVOi]!PS`` gO ^P!VT` TUhQO T
` 9h^ ` ]h VOi]!P
gP ` `V
ThQOQP ^O T
%
=b
`O A TUV b ` ]P Vqj_T V `jS^ gPgT j_TUV OiV T S^P VOV  R] TUP VqhQT`qAx
` ]h V OQ]PS`T ^!R VT`
TVRU^hQR gh UT`
x
` ]P VTUhQhiT`^ TRV UT`
xgc T`O PSO #ST P
O ST TUP VhiT ^OV gT
T`yV[j T` gT `OQP ShiO T
`O b / Im(A)  R] TP V V T OQPgT x j4] A gT Ax `]!OV` `^ TUP V j ]RegT gT b
bPl` ^ V V^ T ^YORO 9 ]!PgPgT
gTh gT` h TP V` T Uj4]PS` Tf^
T j T O T` gT`V OQ]PS` h^V ]!OQ` O
T

UV^P!Vjgh S`j_^ V OR ghQO T TUP VYV ^OiV UT g^PS`YhQTReS^jgOiV T ` gO ^P V

,KJ


?)4 JL098DJL<T;47>OMu>.09U@U@09810Y; uM ?A:BCB>r;=>@?A:C N}RB:50 JL<T;47>OMY0

Nu3vfuSt

|xDxm<S 8{ <y 6{ < <X}6{!~ 0S 0




?> @T> # BI-=I


2ITf r ?= 7&=Bf D 2uD R BI2L= R % I ub
2I-= 2I
:2;
2IK= 2I 7I L=
T;
7I-= 7I
P-;
 89j +0)8}F1
 D ?
*
&B
F !e;CO>F ! I"6Oa?U?9 c
^

PgTcPg]
V !
] OQ`^

OQ]

T !TRV ] OQTUhQhiTT`yV SPgT


T`` gO ^P V`

]!PSR VOi]!P Pg]V UT

k.k

SPgOQTl`

uR 7=

[b

SP T` jS^RUT TR V ] OQTUhTV`^ VOQ` ^O`^P V

j4] YV] V
TUV
k x k 0
x
k x k= 0 x = 0
j4] YV ] gV
TVV ] V`RU^h^O T
k ax k= |a| k x k
x
a
j_] YV ] S`
k x + y kk x kk y k
x, y

Rn

xT y
v
u n
1
uX 2

T
2
k x k2 = x x = t
xi

"N
XD
X>?p&(  m7 O#"=UA
X>@K&(D?ap9. :U
F
X c km;CIaO>8 ?& &('
C"n'&e;C>OFG 
O#"U`
X>@K&(e ! &  yqU>
X>@K&(d 80oa rX ^O\a rX?_ c >
X>@K&( l s
k x k = max {|x |}


i=1

1in

P9_

P2{

  


k x k1 =

n
X
i=1

|xi |

O#"U`
X>@K&(

 

   

  


l1

 UOd".O>@kf
X>@K&(6;COG,aOG, 8
X"%f>@
C" 8da 6;o "3.a, 9UKD 8Of
X>@K&(

lp k x k p =

n
X

|xi |

! p1

S9 F ->6\  ?>  ?= -\7I T@ L>6= D 2=??= = Q@ T@ > 2I oo@ I F =?-> >BI\ B>o<bD Q@2&= D @ 1BF I LR <A t@b K>6\ B>@ @
*0)%87 %
i=1

OQP ^hQOV V O^P gh^O T RU] T `j4]P g^P V T T `V gP ` ghV^ VKO j4] V ^P V Th ^ PS^h ` T ]!PSR VOi]!PgPgTUhQhQT
Fk OQP ] [` OTUV` ^
] PS`yV 
!
^ V OQ]P
RU] gQh T gTKh OiP !^ih OiV
]P g^ UT P V^hQTK` gO ^P V T OiV T
OiP !^hiOiV
n
X
1 1
|xi yi | k x kp k y kq .
+ = 1)
p q
i=1
b P ] _`T !T ^ !^hiT TP V ST g^PS`

V ] V T`hQT`cPg]
T`c` ]P V
SO ^hQTUP VT` S^PS`chiTD` UT P_`]
Rn
T -Pg]
T `
TV
OQhGT O`yVT T KR]P_`yV^P V T`Yj_] `OiV O T`
TV
`^ V O` ^O` ^P!V
k . ka
k . kb 

(p, q > 1 /

@ ITf 2] 7=B=BD R 6= >\ D wH7I @ f u@ 6IT7f I

2=?D LR u>(H7I <R

k x ka k x kb k x ka ,

 6{ 0

bP
RT`Pg]

SPgOiV 8^OQP!VTUPS^P V T`PS] T`` h T `jS^!RT T` 8^ V ORT`R^ T`


bPlT O T gTjSh S`
(nn)
T`
O SUT P V gPSTR]!P OiV OQ]P` gjgjgh
UT P V^O T OiV TRU]P OiV OQ]P gT[Pg]
T

T

2I-=

j4]

x Rn .

fu3vNu3v

|}{!~p\~ <p <

[wb @

$

7/=BD@->/# R2>= D $# SI %@ K@ 2=?D BI [I-L=>6D F L= @  @ %D ?= K@ &=?@=B> 2=?D p*; %" pzj f "%L\ 04('8@ +0)')$7<+TI '*7QHJ8I

gT

I 2I-= 6>6=R @ LI 6= 7=BD  E@ 4O@GD F I B= B= p(" b 74 =BKD %Q%#9-89>p &<=TI f [I-2= =?D 7=BR D V2@G= F I R  @ I-=  F 2=B= BI -LR\ 6= % 2I-=
d]
VOihQOQ` T

^h gT qhQT`T TV`


T`YPg]
T` T

k AB kk A k k B k

gPgTYV ^P_` ] 8^ VOi]!PlhQOQP ^O T` fhQ^Pg]


T
gP TR V T
]P8` ^ ^P !T ^j4]
^V OQRUT`
^ -Pg]
T` TR V] OiTih hQT` g^ PS`YhQT` TUPS`` gO ^P V

k A k= sup

k Ax k
= sup k Ax k
kxk
kxk=1

R 2= 2= @T> = OI 2=?D ; BI-] t7==?@ ?= 7-I-> R 7I-@T= > 27=?I D w;R I [I 7= /w@!F I I B> 2=?@D @GF 6I @ K2> =?D L= ;
] 6=?R
2-I = 7=BD
:7; [I Z @ ; BI @ 1, B= -= M@  D  @ XR BI @
2I-=I
9I
-; &= 2D B>N@ KC6= MI ?>  BI
  +%')J9p~%89p %QXj 8Jp p(" Q#*%#989p
:7;
-;
 8Jj +%018} g
 kD
X>?p&(6& F".K.aKUn#!^>@ 8>?
F
XG# k
X>?p&(f@aK3 '
F
C O#"
c
>
O#"Ud;C3:fl:?
\ m_O?@n;C>#;COd 8
apgCa rX#;   
x6=0

] 

/#SPSOV gPgTlPg]
Tl` _] g]PgP T 9h^PS] T TRV ] OQTUhQhiT V OQhiO` UT g^PS`hQTlRU^hQR gh T`Pg]
T`
kAk
TR V] OiThihQT`
TUV
bP TV ] TlhQ^ /#_PgOVOi]!P _` gThihQT
gS
P TPS] T
^jgjghQORU^ VOi]!P hQOiP ^O T
kxk
k Ax k
j_] YV ] V
bP ^ ^Qh ] `h^ ThQ^V OQ]P
k Ax kk A kk x k
x
b S` T ^ V OQ]P_`%
hiT ` SjRUO T`` S` g]OiV UV Tlj O` S^PS` n 8^O`RU] tPSRO T^ TRchiT ` gj S^PS` n j4]
C
R
TUV
l1 , l2
l
jS^ h^ R] jS^!ROiV 
T h^ `jge T SPgO V hQT` gj-T `yV^VVTUOQP!Vj4]
gP
P ]PKP gh
g
x

hQT`Pg]

T`

k A k= inf {/ k Ax k k x k}
k I k= 1

k A k2 = [max ] 2

_@Gp9EX(AH
X>@K&(H& F".K.aKUH#!^>@ 8A>?
FA
XG#c OH 
X>?p&(O
X
X
?"
k A k = max
|a | k A k = max
|a |

>@

max
1

ij

ij

l1

@"

'>?
X"e 8>@
F
CG#;o?

j7  
  
P7c
 kA
C>@K& d?ap9. :U
F
XeG?"I?
C"f  ap9U a?3a ' >@
I X;COG'g3$D>8F_?'
C"=k`
X>?p&(H 8DUB".8aOm>8
c

X>@K&(e 8 FO>^'
FI

  

     

 



k A kF = T r(AT A)

 21

XX
i

12

a2ij .

6@"p"bD
X>?p&(
7 "6#!^>@ 8>?
F
XG# Fa
X
X>?p&(H_@@a"%>@KU 

6I VR7>6= # =EH7I  2I-=EI ND B= 2= 7\

bP
j4T V

O ST

ST

j4]

SPgT 8^ V ORT ] V eg] ]!PS^hQT

k H k2
k H kF

Rn

NHJI

VTUhQhiT

H i.e.

gT

H T H = HH T = I

y

]!PK^

= 1

=
n.

@"=m_O U? K;CO>O;\O  '';COG,apkGDF(a rX#;CI".O  


89jk+TG"#8)  9U
'
C".O
N=B> [I [I LR ED B= 1F I ?> -= HJI N@ 2=?D D B= %
#9Q@ 9jk8
) !>@I" 
C "
X>@
CK_@&(K p& b^?U ".K3ap'9U !^>@ 8>@
F
CG#f@" 
X & "3p3aD"%'9U 
 U>?KfU`& ".K3a
 

 g g 
&@T= >6= 2=?D [A BC6D BI-] 77=?D @ 7\2-C > ;*| 7D D ;G F > =
 <= 6D
>


@
-\7I LC6= ;
i

T

` ghiV^V[` gO ^P V

k A k2

]P V T h V OQhQOV j ^ V O gT T`YPS] T` 8^ V OROQTUhQhiT`

k.k
A=I +E

k E k< 1

RU]PS` O ]PS`hQT` `V


T eg] ] PgT
hf` R OiV
TVc^OiPS` O
Ax] =0T
x]!+
Ex = 0
RU^ hQ^Pg]
TT`V` _] g]g
P P T
Pm^8P RUT`` ^O T TP!V
k x k=k Ex kk E kk x k
k E k< 1
TV
T`V ]!PSRPg]P
`OQP ghiO T
x=0 A


Nu3vfu

Tn  %~ }F~Sn


BI-]  V?IIK@ 6= BIK!=BR ] 2=


K= L> 6I % u@ > = L=

G@

|0}{!~pC

LI N@GF I BA BCD @GF >HJI

V OQ]PS`hQT` ^ O^ VOi]!PS` Th^[` ]h V OQ]P


` gOiV gPgTj4T V S^V OQ]P %

bPj4T V ]!PSR R O T
x = A1 b
j O UT`

gP` `V

@GF O=

K> L= !HJI K@

S^ VOi]!PS`GhQOiP ^O T`

Q@D Dw]-=

S^P

hiT`TR]P

> 6= XR w@ 2=?D [IK] 7=?@ ->

Ax = b A(x + x) = b + b
] hiT` ThQ^V OQ]PS` R OiV T`^ TR T` Pg]


7H I B>
  +#'17(n)
".>@
F
CG#

@ 1F 6=?= 6I-=N= <R

2=?D [I-=

<> $2*#%'(')* @ /D B=

K= 2Z

T` ` _] ]!PgP T` ^jgj ]

k x kk A1 kk b k
k A kk x kk b k
TUVc]PFj4T V R O T h T`yVO 8^ VOi]!P T8h T T
TUh^ VO !TTP Pg]
T8`
TUP ]P_R V QO ]P gT8hQ^
j4T V
x
TUh^ VO !T`
%
b
k x k
k b k
k A kk A1 k
kxk
kbk
^ _^P V OiV

T

`

V

^
S
j
_
j

T
h


T

h
^


h
^
8
^V OQRUTT`yVPg]V T
k A kk A1 k
(A)

= <R 6BI -I /= > = L= F <D

k@

B>

6= BI-=?]

S^V OQ]P

  (A) 1  63:DU a>@


o 3"3U>?
O#" l:?
\  ;\3U & F".K.aOH"D 3"%m&   aO>@
\ :
c
C
;
]_~aZ ~ IN%!"b$&  Ax = b "
!"I!^? 
c
 (A) = (A )
;> m"b>F"6Oa?U?9 a 6= 0 
(aA) = (A)
 8 H "f
XD& "3p3ad>?"3rX>,lF>@
* U (H) = 1

U7d

  

fu3vNu

6I L@ K@  }R2>6= BM=?C JH I L> &I-f R 6IK= -= K= f B= ,6D S@


@ 2= NHJI

gT`O

^hQT

BA9D > B= H7I

`j ]j T`qT V

T`V`

(A) =

V O ST

T` T

 (AT A)
  (AT A)

A

   

Tn D ~%}F~  0n}xmn { | 6{ 0 \S~ ~S<




^RU]P gOVOi]!P8T`VqV `hQO UT[^


T _RhQO OQTUPSPgT ]!P
O$#ST gT&%

T` ] V T

 

  


7=BD VI [>

TVf` OSh^ Pg]

2=?D

T VOihQO` TT`VfhQ^Pg]

 21

 (A)
  (A)
T`yVRU]VT -TVOQhT`V[j4]!``O ghQT

6ITf
L] u@GF XA = i e{XV]_mkXV] @ N=?>@TI L=
= ?HJI N@GI F #=B@ = 6IK= ; R I-= f u@
hMG"#'10)'%+ * 8 
 
@GF | XF A 6w=uI @GF >HJID > <]-= T6@= -= 2\2@D /@ LHJI ~7I HJI !F  u>6R uL@ @ 9tD D ?= ?= ;! Sb 2I 6I-R9?== 7;%I-RY =u@ -= wD B=
HJI
@ &\
 D B=
F > = <R %
(A) =

TR^hR gh ThQ^
OQ` gT
T T

^hiT

T g^RV T T

(A)

T` `^ T

T

gO ThiT

T`V gPgT
UV eg] T-j ^ 8^ V O gT gOP T`VcjS^`
O gTUP V T
TUVV TTP ] T
T
]P j OiP_ROQj_TT`yV
T `` ^ !T
gOQhQO T chiTj4]O g` 8
T V ] S`hQT`lR] T RUOiTP!V` Th^ 8^ V ORT
h ^ VcV ] T T` 8^ V ORT`
UT V
VTUhQhiT` gT
h^ 8^ V ORT
O^ !]PS^hiT`
1
(1)
D(1) = (dii , 1 i n)
D(2)
(D(1) AD(2) ) << (A)
1 ` R O ^P V
D(1) AD(2)
!
(1)
dii
(1)
(2) 1
D AD
= aij (2)
djj
bP `] V^hQ] `
(
1
D(1) AD(2) y = D(1) b
D(2) x
=y
TP T`V[jS^`V] y] ` ^!ROQhiT TV[j_^`V ] y] `YT 8R^RUT

}=B> 7I 2=

2I 7I-= b 
7I 2IK=

| !F
i + k#89jk89/')J+T' 
D 6D/]-= ; I [I &= f =uDHJI O=?> 6= [B> I-=?] oD @-I OI &ITOf b 6=?= 2I-= = M@GF &=?= K@
bPj_T Vc` Sjgj_] `T
gT hQ^Kj4T V
T b

P ^lj_^ T T jShiT ^hQO`

7= ~H7I BI-=

S^ V Oi]!P
gT^
T T `
^ ]!P O`PgT8j_] VT
TUP 8
^ RegOQPgT gPgT ^!R V] OQ`^ VOi]!P

Q@

ST ` hQT8`TR]P

/=?> LI 6f 6D [A BC6D
}R2>= $# M2\2= > K>6= 6D V@
E| H7I VR N=?>I-= L@TI 6I L> I -= BI F =B> I-= b ;9I ; I 2I-=

;
7I
Lc Uc = A + E

TV[]!P ^

` ]h DT g^R VT

TUP VhQT` `V

(A + E)xc = b
b P

O ST UP ^hQT TUP V g^P_`RTRU^!` SThQT ` O


RU^hQR gh
P T`yV[jS^!`YP gh
r = b Ax
d]!` ]PS`^hQ] ` (0)
T` ^hiT `OiPSOVOQ^hiO`TP V c gP j ]RT`` cS` R ` O bPmR^hR ghQTj4]
TV (0)
x = xc
r = rc
V ] V
k0

= r(k)
(A + E)e(k+1)

(k+1)
(k)
x
= x + e(k+1) c

r(k+1)
= b Ax(k+1) c
oPm` gjgj4]!`^P V gTh T T
^ ]P Oj4] V TT` ` TUP V OQTUhQhQT TUP V` hQ^ ` ]h VOi]!P T`` `V T`hQOiP ^O T`
]P
j4]!` T

BI

@GF F <=

]
h ]!PDVO T

VHJI 1F 6=?= 6I-=V@GF &=?= K@ 2=

6D BI-= =?> LI o@ [A BCD -> L=

x(k+1) x(k) = (A + E)(1) r(k)

e(k+1) = (A + E)(1) A(x x(k) )

x x(k+1) = (I (A + E)(1) A)(x x(k) )

 
d] `]!PS`

 

 





 

G = I (A + E)(1) A = I (I + A1 E)1 

@ 7] JI  7I-= 7I

]P
^ g]PSR ] V TP

j_]

x x(k+1) = G(x x(k) ) = Gk+1 (x x(0) )

YI

7= GHJI 2IK= I 2=?D BI-] 2=z@ ->

gjgj4]!` ]PS`^hi] `

!HJI

T`yVVTUh

<F I6f ;Q>=

T j
jSh S`

gT

gTqj4]

kGk <

gPgTqPS] T` 4] ]PSP UTq]!P ^OV

TUV

-= 2I-R VH7I F I 2I~@ ITf B>=


!T

gPST[]

L@TC= [A BC6D BI <R

Z.X[q.]_qZ T  hQ Tiez` egow`]_V qrivbf]_mvT`` g O

bP
R]!PS` O

2=

^hQ] `

k1

G=

(A1 E)k

k=1

k

(x x(0) )
xx
1
T OiV ^V OQ]PS` TRTj ]RUT`` S`j4T TUP V,UV TOiP V T`` ^P!VT` 8^O`jS^!`


(k)

OQTUPSRUTj ]

kA1 Ek = < 1 

YV ] V

UQ:

@ -= [I 6IKR

B= ?>6=

^P!V %

10x

7x
(S) :
8x

7x

+
+
+
+

@ 6= BIK=B]*>N]<I  x P T;L: T; c/P7&P-= ;L:MP7d-; c y ;


 = I 7] = 6DLI &=zHJI 6ZR I 2I =| I 6= <f-y ; K@

7y
5y
6y
5y

+ 8z
+ 6z
+ 10z
+ 9z

+ 7w
+ 5w
+ 9w
+ 10w

=
=
=
=

32
23
33
31

; I 6= <I XR I K@ D Dw]-=
@ nD B= -@ I [A BCD x kI 6= 7=BD @

g]P Vh^`]!h VOi]!PDT`yV^jgj_^ TUP V T %


Z TR^hR ghQT hQ^`]!h gV OQ]P-^ !TR gP-` TRU]P T

T
x=y=z=w=1
j4T V
T
^hR ghQT lhQ^ R]!P OiV OQ]P T-hQ^ 8^ V ORT >` `V T ]!P V OQhQOQ` T ^mh^mPg]
T gT
2 ST T 8^ gT !] S`
] _TPgO S`YTV[]!P S`V $O #ST ^8RUT ReS]O

,

>r;=098=80 CB0 YM ?A: A


 034 A
 09:BMY0
CB098D8RB>r;=098

@7I<= r  XR 7MI-@ R HJOI <= @ LN@ R I $B# > 6u= @ 6F -[= I /6B=?@Z BI Z L@ I @GF L\ 7=LI K6I D L}> @TI 9 -= 77] H7LC6I D ?=;? >6= }@ @ L= HJ9I!9R F I R6=?6\ =?\ BI2I  2F  BZ @ 9&Z
 9R 6=?\ ER =
B}I @ O@ MJ=BR > 6=?\
@ 7=BD OD B= NH7I
K@T> K@ 9R u=B\ @TI  @ <f @  R = d-2; =?DSF M>HJ@ I LR ;
 4%%'(')* F1   8t%8t$7Q 7*87 *89#$78 6>?
!p. 8G>?
!N
C I"bm 8fOG#9
 a>?
C_@'plD_?''

X_O?@  
;F;='9UDZ5C5:4A 8DaO>@
C_@SlF'
\aOf 8fkd I"b
;CIl'
\ H'
C".'
"b'0

PgT T` O R ghiV ` T h^-RU]PS`V SR VOi]!P


^h ] OiV e T`T`VhQT8R]P V !hiT T hQ^KR]!P T TPSRT R T`yV
gO T j_] ]!O O TP V O ST `OhQ^-` SOVT T`` ]h V OQ]P_`RU^hQR gh UT` ReS^ STOV ^ VOi]!PmR]P !T T ] mj_^` TV `O
] gO ^ TR gTUhQhQT OiV T` ` T` ^jSj ]RegT V tThihQT gThQ^ ` ]h V OQ]P Kj ] gh
T bP O ^
gPgT` gOVT
gT
{xk }

R

]
P
!
T

T

T

`
`
4
O

h
c
^
`
g
i
O
V
T

T

U
T

h
`
U
R

]
P

T
!
T
S

^
S
P
`

T

`
g
O

^
Q
h
U
T
S
P
RUT
Rn
x Rn
r =k x x k
R
gT`YPg]
T
]P V T STh^ Pg]V OQ]P TR]!P !T TPSk RTT`VYkOQP j_TP g^P!VT
Reg]O T h^ Pg]
T S^PS` n
R

{rk }

lim sup

|rk+1 r |
= < +
|rk r |p

{rk }

p>0

A @ HJI 6D ?I V7\2I-> 7=!@ D I > B= [H7I I S\2> L2I D ?= > 7?I-7= RI-HJ= I I D ; ; < <I > <ND = 9XR A 6=?\ @ S= JX-RA >6=?M\<= @ ;E| JF R 6=?-\ =
@ d LI &= f 6D 9R 6=?\ 2IK= BI = @ /x &= My @ ; F &9I R B==B\ &= [I LI 6= -> &I-L= f MHJI -K= @ /@ : OHJ<I I
9R =B\
~x &= 6f D
y;
I K@
&= N@ 9R =B\ HJI 2@-= H7I x &= 6f 6D
y;
k

^>` OV S^ VOi]!P T hQ]OQPh^Ijgh S`KR] ^P V T T`V


^jSj_Th T R]!P T TPSRT hQOQP ^O T
T`yVKhiTRU^`
p = 1
V g
j O gT TP!Vj_]
gPgT` SOVT ] V O gT

Y
^
Q
h
O
i
O
V
T

T
y
`

V
i
h
T

^

!
]
P
g
f
T

R
!
]
P
!T TPSRT
r = ak , 0 < a < 1
TUV g^PS`hQTRU^` U] V O ST ]PKV ] T S`VkT TP V
. ]!PSR jgh _`[hQT ^ !]P gTcR]!P !T TPSRTT`V[j ] ReST 


a
gT
jgh S`h^cR]!P T TPSRTT`yV ^jgO T ]PDj_^ hiT TRU]P T !TUPSRUT[` gj4T hQOiP ^O T S^P
RT gO_T`yV

= 0
hQTlR^`jS^ T T jghQTcj4] h^D` gOVT
^
g
V

T
S
j
^
V
g
j
h
S

`
i
h
c
T

V
^

T
y
`

V
j

R
S
e
T

T
.
r = (1/k)k

 jSh S`h^
RU]P T !TUPSRUTT`yV[hQTUP V T jS^ T T jghiT k
rk = (1/k)
]PKjS^ hiT TRU]P T !TUPSRUT S^ ^V O ST jS^ T T jghQT
k
2 _^P
p = 2
r k = a2

  
,

S;=<


>@U@>r;=6 CB0 U@<&JL6Y; B?GC50$C50

 

   

  


<ARB88

G-@ >F I [A L= BC6R9D D I O-@G=?> F >HJHJ>(I I@ 6D D D B=-1> F <K= I ;JHJQI b 2@TI InD2-] 2\7I-I6R=?LR C6= =4;HJI!| KF IF@ D }&IK@T6R >D 6=?D [KIK@ = ~HJI 26D] D BB> I-= @ L\ o$# LIHJI
-\7I @T> &= 6=??D>nHJI K@ Q@T6= F ~R K6= = d tHJI@ Kd-@ ; 2= K6@ f R D = F # D B= 2= OH7I K@ XR = ~>\ &R9 2: ;
<Z @ BI 7I % 9R 6=
2= <I &\7= XR oI D  B=
BAJD > B= LHJI @ F 6f D
bP ^ mj R T
TUP V h OQP$ gTPSRT
8^
gP
` `V
T
S^ VOi]!PS`hiOQP ^O T` h ^ VY] S`
P RT``^O T TP V gTKhQ^ 8^ V ORTKT`V S^!`OY`OQP
` OiP gh^ OV
S^P
OQh ` ^jgj ]RegT T
d^ DT
` ]P
VT
OiPS^P VV TUP
T !T `
S^P
V TP
n
^ ` OiV S^V OQ]P OiP !T `TKT`VTUPSRU] T
jgh _` _^ ^P V
RO T``] S`

A=

1 100
0 1

100
1

b=

8^O`[` O

b=

^O`RU]P OiV OQ]PSPgT TUP V` h^D`V^ gOihQOiV Tlh^D` ]h VOi]!P


T T
gP 8^ ^OQ`YRU]P OiV OQ]PSPgT TUP VYPgT `O PgO STjS^`
ghiO T
T`VhQT VT OQPS^P!V gO
T` T
RTUVVT S^!`O
T jghiT hQ^ 8^V OQRUT
^ TR
]!OV
(n n) aI
a = 101
T `h OiP _PgO ^hQ] ` STD` ^
RU]P OiV OQ]P T`V T !^hQT
T
^ TR gPST
^V OQRUT
Pg]P `
UV O gT g^PS`8h T T jghiT

100
0

x=

x=

0
1

100
0

x @T> 6y =?; D @ ] -= >\ 9 :  7I-=


K@ @ D B= B=?C D &I-R
2@T4IKI}D = -= &>6I-D R6C%@ &F 9/QA @ 2= D &= = = 6f @GuD F I @T> D ?= ;-` 2-I > B>6b = 22I-\7R > -> = ??> =BC #9I-@ D >6?I= LHJI 9VM>R @-I LI6BI-6A =R ?C6D [IK, =B= 2OI b 2 = 6HJD I Z
B&I D <R > 2= 6= <\ K@ 2I @ D ?= ; ; 6I 2=
 = ?I 6=/4@!I F LI B=-6\ = D ~b /@GF B> I-=uI nx f p(6$2D +K0)') By =?C
<D &%
T

VT OQPS^P!V T

T`yV gOQTUP`

!^h

j_]

V^P Vh^R]!P OiV OQ]P TRUTV V T 8^V OQRUT[T`VV ` 8^

^O` T

> 104
T 8^
^O`R]P OVOi]!PgPgT TP V
gPgT 8^ V ORTT`V` ] !TUP VV ` O ROQhiT
^h gT TVq` V] V h^ gT`
V OQ]P
T
gT
K^jgj4] V T
T`yVT UhQOQR^ VT
] VT ]O` RT V^OQPgT`Y` OV S^ VOi]!PS`j4T !TUP V V T ^RUOihQT TP!V
R]!P V ] P T` R T`V hiT8RU^!` jS^ T T jghi
T ]hQT` e UV ] UP OV `P
O gT` ` `yV
T8^jgjS^ ^OQ`` TUP V
` gO ^P!VhiT`hQO !PgT`c] IhQT`lR]!hi]!PgPgT` bP 4
j T gV^hQ] `T 4TR V gT gP>ReS^P T TP V
RegThihQT
TV
^ hiOQ] T h^mR]!P OiV OQ]P Th^ 8^ V ORT bI
P ` TR]P VTUP V T ^KORO
OQhih S`V T cRUT ^OiVl`
gP>T T jghQT V `
` O jghQT

(S) :

10x1
x1

+ 100000x2
+
x2

= 100000
=
2

Ir 7] ?= > <I LI 1F  -@ = x XLd-= f ; d2LD d}:7;@Td7I d y [;*A Y  BCx D :7; d7Dwd I :7; d7&d= y -] D &> I KL= HJ2I ID LC6?= = uLI K>(HJH7I-I > [9b ?= 2=I ; }b = 6I-L=M\ @G$F # >
@T> 6 =?QD b &VI D 7I-?=B= C B6= B=? I D L*> >6;K= |=F I-D =9 Bd = F I BI--=V= @ R BTI-H7= I <R 6V= b @ ?4= HJ@ I D0I ,6?D > JI IKD M>D = HJBI = B> V] 2I F <\22I-= =K@ -@ D
S= I f D <D &%

<b Owb@ 2IK= L=


@G->F > I <D ; @ Z

PST ` ]h V OQ]P O TR V T I` `V T8TPI^ OVe VO gT8V ]!P


UT KV ]!OQ`cRegO T`c` O PgO _RU^V O ` ] PgO ^
gPgT`]!h gV OQ]P
O]!P
ghiV OQjghQOiTchQ^8j T O T
_^ V OQ]P
jS^ gP ^!R VT
RegTUhQhQT T
x
105
]P
] V OQTUP Vh ^jSj ] O 8^ V OQ]P 0
_T^ SRU] gjKjgh S`[`^ VOQ` ^O` ^P V T
x
h ^ Vj_] fVT
OiPgT
TV V Th ^!RURUTUP V` fhQT ^OV gT
T gPgT
^V OQRUT gOQTUPDRU]P gOVOi]!PgP UTT`V T
UV T
OiP_^P VfV `` gj OiT
j_T VYj ] !] ST T` gO R ShV `P
O gT``O4h ^h !] OVe T
UhQO OQPS^
V OQ]P
T`yV 8^hRU]P V h
T`V[hiTR^``
T`[jgO !]V`fV ]!j-j4TVOV`` ]P V[^RRTUjgV `^ KRU] ` T`RU^hR ShQ`
d TUPg]!PS` gP
T T jShiT` O jghQT

(S) :

0.0000x1
x1

+ x2
+ x2

= 1
= 2

Y <\ D b 7] d-; d2d7Kd-@-: = 2D D : -= 6D B6I-= ] <R BI &=?= LC6= u@ I 6= dK; d7d2 d-: BI-> XR ?= *=


F &D
o@ F 6=?= I-=E@GF 2=B= Q@
B= LHJI ;
6=?Dw I = 6= D CE@ @ ITf <\ o@  6I 7BD > D = 91F I
> <%D &F ?&= = B>\ uHJ@TI I +-=?'87*> K +%+-((')89LI 0 EHJ\2I = =Q6@ R LR ; 9

O ]P
^OiP VOiTP!V
` O !PgO #4RU^ VO ` ]Pm]
TV[h ^ jghQO #_R ^ VOi]!P
T T
T 9
j4T
VT [hQT` T

RU]
T j T OQT KjgO !]VKTV `OhiT`-R^hR gh`K`]!P!VKT TRV `K^ !TR
V ]!OQ`-RegO T`
V OQTUP ^
TUVh^D` S`V OiV VOi]!P ^ O T ]!PgPgT ^
`]!OV
x
x1 + 1 = 1
x1 = 0
Th T T 2 ^ ]P OT`VRU^ V^`V ]jgeSO gT
RTUVV T O 8R ghiV KT`
V R]!PgP
R T`Vlh^m`yV ^V OQT
gO T OiTP VcOQRUO
DhQO !PgT`YTUVR]
TS
P RT h UhQO OQPS^ VOi]!P
jS^ RThihQT gOGj ` TUP V T hQTjgh S` ^P jgO ]V

 

,


UJP

  


034=Mu>#Mu098

8J$2')$78n) | L@->6=
]PS` O

[A BC6D -> L=

]PS`hQT` `V

T hQOiP ^O T

XR

g^P_` 4 ^ TR
Ax = b
R

0 1
1
1
1
2
, b =
1
2 1
3 11

1
2
1
3
A=
1 2
2 1
^hR ghQT hQT ^P Th^ 8^V OQRUT
A
hQT` `yV
T[hQOiP ^O TT`V} OQhR]
d]
gTUhQhiT` ^hiT ` T

T``]!h VOi]!PS`
` `V
T

2: ;| I 6=
T; @ 2I-=HJ<II
 8J$2')$78n g

N= -\ @ /D
ER @TI I-BA = 4B@ CD
| L@->6=
]PS` O

B=

;
; BA ?C6D -> L=
[A BC6D -> L=

]PS`hQT` `V

2D L] | &= ?>6= 6= 7= 1F Dw]


jS^V O ghQT

^ ^R V OQ` T ^hi] `fh TUP_`T

T hQOiP ^O T

2x + 6y = 8

| -| = 2] <C@TD >= BZD !]

K@ [A KB> C D 2I-=zHJI E> 2IQ@T= [A BC6D x P-;L: y Z x PK; y ;

2x + 6.00001y = 8.00001
T j ] Sh T T`yV tOQh gOQTUP R]!P OiV OQ]PgP
d]
g]O Z ` ]
T hQT` `V
]!PS`O
] PS`
!
^ OiP VTUPS^P!VhQT` `V T


ThiT` `yV

2x + 6y = 8
2x + 5.99999y = 8.00002
]PSRUh S` OQ]P

x P-;L: y
x P-; y

V> 2IK@T= BA ?C6D ~x P-; P y Zzx P-; U y ;Q| <I ;


Z ` ]

ghQT

x P-; P y
x P-; U y

-\7I <C= V@GF 2=z@T= ;5. = I <\ 2= -D V@ V=?> LI ~@


8J$2')$78nL Y I VD ?=
HJI >6R
I 6f u@ ;  R <I 6= N\
2D/]-= N@
;
 8J$2')$78n $ | L@->6=
ED ?=


gO

]OiV

SPgT 8^ V ORT[PS]P` OiP

OVT hiTR^hR ghGT jShiOROiV T T


]PS` O

A2

ghQO

]PgPgT

A2 x = b
^h ST hQT !^OQPDTP
Pg]

T T S
]!jS`[` O

4 1
1 3
A=
1 0
1 0
Veg] T
hiO OiP_^ V OQ]P T
8^ V ORT`8` ]P V ] VTUP S`8^

1
1 0 0
0 2 0
0
, B =
0 0 3
0
1
1 1 1
^ _` `Y^ TR SPgT j RO`OQ]P T
!TR gPgT 4]PgPgT
j RUOQ` OQ]P>TUV
1
0
2
0

hQ^ 8^ V ORTR^

| 6I 6=
^hQR ghQT

detA  k A k1

` ]h V OQ]P T

T`V[jghQTUOQPgT

TV

k A k

` SO ^P VT

1 2 0
0 1 2
0 0 1

0
0
0

;; ;; ;; ; ; ; ;;
;Q| I 6= -I ;

A=

^hR ghQT

1
1

1
4

@ HJI ; >67= Dw# ]-= =E}H7@ I d @ b I-=

LHJI~@ = 6I-/f D D > BT= @ N@GF > LD 2] 9}I @ uXR v &I I XR ] I --=?=B> >
@
D 9I ;
 8J$2')$78nq Y
D ?= &=?=B> MG@ F 2=z@T= [I <R
]OiV

T T

]PS`hQT` 8^ V ORT`

XjgjghQO gT hQ^
T` T
LU
8^OiP V TP

gP^h !] OVe

0 0 0 1
j gO`
A1
(A)

N O ST
SThQT` ^!R V T `
103
gT
hiT g
P ]
T T
gT
T `yV
B

U2U

  

 

   

  



 
)


5,.+

 47? F0NM





!(

'

 

 

&

(L




# (

;=>@?-:58 ?)4; 5?  ?A:5<-U@098

BKI-= =N" I 2F I B2Z>6= = 7\ ; V&ITO@Gfn=BF I > D [I > MBDb BI-K=u@ I 2@ D 2I &[Z II-Sf @ @GF f R -= !&]  4@G@ F I 7= @ B> 2\ w@ @G2=F I LI ?>6R = \7> ->I-= =u2IT@ f~@ H7I
L> Z K=BC @->6D B= ; 
 E=

'> IOI;oaH_@@a"%>@KU 8  "I
C"N 8>@
!
XGA
B;=>@9
C"
#9Q@9jk8 =) !>@I"
c  9"b 


F.0;=>@9
X" 8 #;F;='GU ;C> O,a,".>@
A>?"3rX>,lF>@
* U    "bX88

bP ` OQP V T`` TORO^


RU^PSOQ` T` TR^hR gh gT8hQ^
j ] yTR VOi]!P ] Veg] !]PS^hiT
SP TRV T
T
Rn
gPI` ] _` wT` jS^RUT T` ` ShV^ V` ]!P g^ TP V^
T O`yVTUPSRUT
gPgOROiV TUV TRU^ ^!R V OQ`^ V Oi]!P T8h^
j ] yTR VOi]!P8] V eg] ]!PS^hQT
gPDj4]OQP VY`
gP-` ] S` wT` jS^RUT ^h^ ShiT` g^PS` T`T` jS^RUT`jgh S` UP ^
ST

`
!
]
!
P
V


^
g
j
4
j
U
T
h

`
U
R
O


^
j

`

^
_
P
`

]
S
P

`
V

V
i
O
!
]
P
Rn
`

"

0
Xea>?
\ I".>@
(p
CG,aLOpc '?9O@" K
X"%n;=>8D


y p L

uStuSt

Rn

pL

y Rn
k y p kk y x k, x L
y
L

>@yI"U;CL>c O,a,".>@
>?"3rX>,lF>@
* UD    O#"

{F
<X}F~ n 8{  F{ n~ }8 x |8|= }x |={ n{!~ n~p

2Y I r Z t@T= @ NR HJ-I = 6IK= -\ 7&= = K@TF2=?7>\ = L\


; SHJI V@ = <C= =
N
=
6
D
2
?
=
J
H
I
@ [IK= ; x  L\2IK= UK;L: y ; 6I

&=ENI @ o~R I BI-6= IK7= I Z@-= 9}I @ @ <I D O> = L= 7: ; Y


#@ SJH I
-=
@ L\ HJI 2=

XR ;
7= 2\

PgT ]OiV T gO[jS^!` ` T


jS^ h ] O OQPgT
T`V gP `] S` wT` jS^!RT T O TPS`OQ]P
]OiV
TV
hQT
y Rn
D
` ] _` wT` jS^RUT T !TRV T `YTP TP
`jS^ SP !TRV T
Pg]P
P gh %
v
D = {z Rn /z = xv, x R}
T`Vh^8j ]!yTR VOi]!PK] Veg] !]PS^hiT T
` hQ^
]!OVT ]!P j_T V R O T&%
O
^ TR
pD
y
y = p + u
p = xv

TUV T
u
v
=
0
bP T 8^ gT gTh^ T PSO T TUh^ VOi]!P ` O PgO$#ST gT
TV ]!PSR gT
T`Vh^j ]!yTR V OQ]P ] Veg] !]PS^hiT
u D
u
gT
`
O
T


T
U
R

^
Q
h
R
g
h

T

T
y
`
[
V

^
Q
h
]

`
y
D
p

` ]OiV

v T y = xv T v x =

1 T
.v y
vT v

vT y
p = T .v
v v
XOiPS` O RTV V TYT j T`` Oi]!P SOT j O ThiT ^OiV gT
^h^ 6, T O TR VOi]!P gT
j_T V` R O T
p
v

TP!V j4]
Tj ` TUP V T [hQ^V ^PS` ] 8^ VOi]!P SOV ^PS` ]
T
TP
%4]P
O #_T gT
y
p
(v Tj y).v
] mh ]!Pm] S` T T gT T T`V gP ` R^h^O T^hi] ` ST
T ^P
gO`
T`yV gPgT 8^ V ORT
 ^ ]!OVT
v y
vv
hQT`DR]hQ]PSPgT`` ]P V T`
ShVOijghQT` T
gO +
h T`jS^!RT
`

^Fj
v
Rn
D
] Veg] !]PS^hiTY`
gPgT ]OiV T gOSjS^``TYjS^ h ] O OQPgTYT`V ]P_R gPgTYV ^P_` ] 8^ VOi]!PchQOiP ^O T T

D F 22I-] =M6= =?R -u=?> HJf I -= = uBH7= MI I [fb 2-=?= D <D


7= 2\ BI-= I @ V@T= DwI VHJI @

4tb H7I HJ?I = b 7=BD D D @ L=


Ly~= HJI 7= %H7 I (8J6(8 F OI /D
2= F 7= L\ @ I B=
P =

1
vv T
k v k2

U9W

/R7>6HJ= I /HJI I 6F > 6= L= @ *>= D/Z


t
BB= I-= @ @T= = -\ : ;x - I BHJ-I = " 2I
b 7=BD
K> L=  @ VD B= 1%
O

=
(vv T )y
gTcV ] gV T`
] yTRV OQ]P
8^V OQRUT

U7^





 

 1

 

 1


    

UK;L: S= "
d

[I-=EI N@T=

] yTRV OQ]P
`

SPgT

 



  





]!OVT

98 jk+-XG"%89p %
:7;| 2D D @  -= ! D 2?= = 7N\ @ -= !BI-= 72I = [Z 2\ 2= [I-=7\ ;
-;VY 1F -\ ?= V@ L= E@ R I-= ; 2= 1%
i

h^cj ] yTR VOi]!P] V g


e ] ]!PS^hQT` YhiT `] S` tT`jS^!RT] V eg] ]P_^h T`yV
p = Py
D
u = yp =
]P_R
T`VhQ^ 8^ V OR T Tj ] yTR VOi]!PD] V eS] ]!PS^hQT `
(I P )y
I P
D
]OiV
h ^P !hiTTUP V T Qh T` O TR VOi]!PS` T ` TRV T `
TUV
bPK^ ^hQ] `

v
y

@T>(@TI 1F ->6\ ?>O@ Y 2=

TV[]PKTUP

v=

| 2D D
]

uSt6u3v

1
0
T

NI

^hQOV

gT

Re ^ %

vT y
k v kk y k

(a, b)|aT b| k a kk b k

8Jj %+ 018

gOiV[h OQP

cos() =

%


vT v

:

]P ^ gOQTUP

p = Py =

y1
0

{F
:0X}~Sn  { D  {!n~%} x |8:| }x |yxD|{ 6{!~ n~S

V= K=B>

M@GF I @T=

bP VOihQOQ` Tfh^ TUj `TP!V^ VOi]!P

gPgT

2D D I 2I Z

]OiV TfRU]

&= <C EI 7I [Z

T gPc` ] _` wT` jS^RUTq^ 8PgTfj_^ ^hQh hiT 9 SPc`] S` tT`jS^!RT%

D = {z Rn /z = z 0 + xv, x R}

Y
XtR D B= K=@ " K= " 7= 2[\ IK=  @GF 7[IKI =[Z T@ = K\ ; Q@T=B7> = &% = 2] 9Ik@
KU ;L:2;L:2;
]!OV

TV
`^lj ] yTR VOi]!P-] Veg] !]PS^hiT` hQ^ ]OiV T
Xhi] `
y Rn
p
D
^ !TR
U
T
V

]
y =p+u
p = z 0 + xv
uT v = 0
p = z 0 + P (y z 0 ) = (I P )z 0 + P y 
]
T`yVhQ^
^V OQRUT Tj ] yTR VOi]!PI` chQTD`] S` tT`jS^!R T TUP TUP
DjS^
] gV TUP
g^PS`hQTjS^ ^
P
v

uSt6u

{F
:0X}~Sn  { D n ,0:xD|C

@ Y [IK= I /2ID [Z B=
T

]!OV

LD 2\ N@@ /= Kx \ L\ )xKU @ ; y ;

SPgT 8^V OQRUT


T ^P
A
(n r)
`

i
h

T
`
]
S
`
w

T
`
S
j

^
U
R

T
O
^

T
T
Rn
A

g]PSR

rn

y ; | @T>6=
]P_`O

-=

]P_`[h^j ]!yTR V OQ]P

2= 2\2=

^jgeST

@GF I R I-=
gP TRV T

 

 

UT_

     

 

UK; S= "
d

[I-=EI 2I Z

] yTRV OQ]P
`

2] 7= 7= XR
2D D
LI XR o= B= 2I-R D B= N;@ -=

SP
` ] _` wT` jS^RUT

@ = -&\ = D B= ; x y
2= 7\ BI-= A 2I @

9R 6= <]
;

Xhi] `
^ !TR
TV T
R^
y =p+u
p = Ax, x Rr
A u=0
u Ker(AT )
b Pl] VOiTP V^hi] `% T

V
U
R
]
T

T

`
V

T


^
P jghiTOiP hQ^ 8^ V ORT
T`yVqOQP T ` O ghQT
T
A y = A Ax 
A
rr AT A

TUV %
^ TR
p = Py
= A(AT A)1 AT
TUV ] !Th^ 8^ V ORT Tj ]!yTR V OQ]P-] V eg] ]!PS^hQT` hQTPg] !^ T
%
. Tjgh S` ]P P
AT P 0 = I P


uStu

|}{!~SC<  x {F
<X}F~ n

ED ?= @ -= !

V@ ED ?= EH7I

T` 8^ V ORT` Tj ] yTRV OQ]PK`]!P!V T` 8^ V ORT`

BC@

@ 6ITf -= -= <> B> BI LR

SOGj_] ` ` TP VYhQT` T -j ]!j O UV `Y` gO ^P V T` %

P = PT
P2 = P
bP
$O #ST ^RT`Yj ]!j O UV `Y` hQT` 8^ V ORT`j R TUP V T`
T` 8^V OQRUT` T8j ]!yTR VOi]!PF` ]P VTUP UP ^h`OQP ShiO T` j gO`
TUhQhQT` ^ UPSTUP Vh T` jS^!RT&9 gP `] S`

T`j_^RT T O TUPS` OQ]P
jgh S`Yj_TUV OiV T . Tjgh _` ThihQT`RU]P V ^RV TP!VYhQT`Pg]
T`%

k P y kk y k

oNR2D >N= @B= N= @ LND @ --= = -= <L> I B> BI-= ; ED \7?> <=-I >= -=B> -\2>(I @ LBC6= = ; -I BHJI!F 7=BD N= &D C

5,KJ

u3vfuSt

1F ; }I 7I [Z

?A>.:5C54I098 uM <)4I47698 U@>@:B69<A>V47098




< }~ C|}F~ n  0yx |={F| \}{F<




; r R [AI BC6R D @ 6=4RI 2t] D 66IKT=?R2=@T>0C@ 9


I 7= MD BI-=?> VI



-&&= > = &7D L= =uCHJ@?I = wN@ D M@TB> I-=6BA=?OD ?@ C6D =/; HJI 2%= @T> @ K@ @ 7b I-= 72H7= 2I @D C B@ = ?=B> >6=
2= -> 2= LHJI
x  <\ UQ; P y

; BY=?>

PI` `V
T T`V] S` T
KjS^ V O T`
T` T` T` ^
` ] V OQT
TUP ]P_R V OQ]P T O TUP V T` TUP V UT`
y
bP T V ^hiO T gP
] UhQTVe U] O gT TRTc` `yV
T gO Uj4TUP
T
jS^ ^ V T`
]OiV
t
n
x xn
gTj_^ ^ V T` 9 VT
OiPgT bP ^ g
] PSRj_] ReS^ STfTUP V T 1
T hQT !TRV T
x = (x1 xn )
ti , 1 i m
SPgT`] VOiT
T` UT
TV gPgT` ] V OQTV e ] O gT
O
Yi
yi = f (ti ; x)

U7{





 

 1

    

QU ; P
D SK@TF 6= =?= 6I-= &=?=B> ?= D T@T9 C -> L=2= LHJHJI I D
HJI
ED LD
` = 7I-R =
Y 2=B=?O> b -> L= ; LD 0)'1#9+-')X8 2+%I 6+-/9 + ++ Q(
;
@Y oLR \ 6IK= @ @ ; -= 2] LC62D D
 

V Th
x Rn
i=1
T`yV
Oh^ ]PSRV OQ]P
f
UR ^ `chiOQP ^O T` O OiV !
] PS`lPg] S`

ei = yi Yi = aTi x Yi

` = 7I-R =
T

H7I jk')%')j ')p(8


SO

x Rn

16F I @
2
?
=
D
SBI-F I= HJI 2I Z <I @
BA BCD -> <= [I LR





  



UT j_]

t = t 1 t5

UT T `V
UT VhQ^ ` ]h VOi]!P
e = y Y
T gT`[R^ i ` Ti `T iT `

]PjS^ Qh T Tj ] gh
T ^

]OQP T`
x
RUT-R^`lTVlOQP V T j V]PS`lhQTDj ] gh
T g^ PS`ch T` S
j ^!RT gT` T` T`

]!OV
hQT !TRV T
gT
]!P V Qh T` UR ]
e
Rm
]!P!V[hQT`YhQO PgT``]!P!VhQT` T Tj ] gh
ai
]

T`

UhQT
V e ] O gT TUVDh^ ` ] VOiT
T`
Reg]!OQ` O
gO OQPgO QO ` TQh ^ RU]
x
m
gT X 2 ` ]OiV OQPgO 8^hQT
ei

T

 

D BI-=?> 7I-=
LD 7= }D 2D BI-D =?>O@ &=?=B> 4@ 6=?= 6I-= 1% LI 2ITf
;
+-" += -+T=?> +-yj JX89p-= 2 ] LC6D o2= @ @ 1-F = 2] LC6D @ 2/I D D [IKK= @T= %
D B= x y
2= 9 =B= 6IK=

f (t) = x1 + x2 t + x3 t2

T T 8TP!V T hQT
]
T`R^ `RU]PS` O`yVT

]OQP

 1


j_] ` ^P V T`` ]P VhQT` T T


TR]!PS` OQ`V T^hQ] `

k Ax Y k2

ei

TUV ` ]OiV

hQ^ 8^ V ORT

mn

@TI F6R F &\ 6I-@ = @ uO@Dx)HJI B[=IK2= I-R 6I= N@ @ @ #u@GF LD (F 8J&$2\ u&'1Q= @  Q<=X  % *LI Q%K+-= 018 @T&=I 2R I 6IK= @ y ;
;@ 2ITf LI 9G"%+T~'1Q@T%> p #> BQ> jk+-60)I 89Lp > &I &= &\7= KU ;L:2; P &F LI }@TI


hQTjgh S`[j ]RegT^ m`TPS` T


. ^PS`h T` jS^RUT m Oih` ^ !OV g]PSR gTV ] !T [hQTj4]OQP V Th O 8^ !T T
R 
A
h^ g
P ]
T8T SRUhiO OQTUPgPST
!TR VT
gOY^
j_T TDRe_^PSRUT`
^jSjS^ V TPgO 9
RU^
Y
Im(A) 
m >> n
gPgO gT8`]!h gV OQ]P g^PS`h T`j_^RT T` T` T`T`yV ]!PSRhQ^ +
!TRV T
 
Y
^ ` ]h V OQ]P
^
9 UV RU^hQR gh UT^ KjS^ ^ ^jgegT
R T`
V hQ^ ` ]h V OQ]P
` hiT` ] _` wT` jS^RUT
Im(A)

` `V
ThiOQP ^O T ` gO ^P V OV^
%

tY I LI x x 9I A H7I -C w= !F &] 2=tD @ B= L@ I -= &ITf T@ > D Qy KK@ @T= M2@ I-2R =B=?> B;=?> nD<> y B= [A p 89B"%CD#
b
;
') *8JXp(8 @ D ?= O= -\7I L= ;

AT Ax = AT Y
O
e j_]V e `T ^OQ` ]PgP_^ ghQTRU^
TVhQT`
Uj4TUP gTUP V T`TP V UT`
RUTc` `V T
rangA = n
m >> n
ai
ti 
^ SPgT-` ]h V OQ]P gPgO ST

i
O
V
T
`

]
h


V
i
O
!
]
>
P
^

]
Q
O
P

`
U
R
^

`

^
8
^
V
ORT
1 T
x qR
=UTD
(AP TTA)
A`ch^Y 8^V OQRUT T-j "
A+ =

X

V
V

T

P
V
Q
O

]
P

`
l
V
S
j
!
^
]
yT

R
V
Q
O

]
P

T

`

V
`
]
!
U
T

P
l
V

^
S
j
_
j

T
h

h
^ +
T
1 T
(A A) A
gThQ^ 8^ V ORT TR V^P gh^O T
ohQhQTc` ^V O` ^OV +
TUV
7
A
A A=I
AA+ = P

u3vNu3v

:}

 

0y~SDC x |}F~DS<


Y }I ; BA ?C6BD I -6> = <= &= 67f D 6D n<] x 2D D @


7=BD 7]; 9I [A BCD ODw!I F @ &M= @ % <I 

JH B= I=?> zyOHJI
w
@
N
D
K
@
=
2
/= D
&= BA ?C6D 2ITf>HJI

]!OV gPC` `yV


T hQOQP ^O T OQPSR] jS^ VO ghQT
]
T`VKV TUhQhQT gT
TV
Ax T =gb^P_`hiT-A(m
n) ]!OiP
rangA
< m TUV
bPI` gjgj4]!` T ^KjS^ T T jghQT RU]
RU^` T`
T`RU^ `
gT
b
/ Im(A)
m >n
T` `V TcP ^ ]P_RjS^` T`]!h VOi]!P TUV]!PmhiT T jghQ^!RTj_^ hQTl` `yV
Tc^
S^ VOi]!PS`
rangA = n
Pg] 8^hQT`Y] V TP -TPKhQT
ghiV OQjghQOQ^P V[jS^
AT

AT Ax = AT b

JU c
@@| BD A > BCD TS@ @G%F I ] [> D \2> B-[= IK>6== @ *D 2=BB=?= > Kb 7; @ =B D OD -> > T&2@ = = @ 7\ v K&@ I = HJ?I @ HJI V@GF , F X?R= &
\ 4@GKF @ , ?= }9I-@ D <I >6= L-HJ&=?I I >bD>6=26=B==?>
2] ;
 6D x 1F @ B>N@ @ F 2F-@ L2D = 2=?D y > x ]_~aZ ~ 2LI = 2\ @ >HJ4I @ 6I-f9/@ 26IT=?D f V@ 2=?<DD :yZ
D B=?I L= I O] ; t2F =] 72F =?D B=> ?@ >6\ 7I-==?> 2I-2=IQ@T= I 6-= = 2f ] LC6D 6@ D MD K-@T= = ! 2=B=?> ; OR @ =B= w2@ I
B=?I = 6R 9 ?= -\7I &= 6= D ?= &=O@ B= [b 2=?D
7=&= &2\2\ = UK; ; P HJI
 

 


 

1



   

T ` `V
TT`yVTUP P ^h 8^hGR]!P OiV OQ]PgP R^ hQ^R]!P OiV OQ]P gT
T `VYhQ^R]!P OiV OQ]P T
^ KRU^
AT A
A
S^PS`qhQTR^`
gPgT
^V OQRUTRU^ UT
^
UV eg] T gT
^ S`` OQ` gT
V [
T OQPgT 8R^RUTTVf]!P8h gO_j
T ^
A
gT`
Veg] T` S^!` T``
gT`V ^P_` ] 8^ VOi]!PS`] V eg] ]P_^hQT` gO]!P Vh ^ 
^ P!V^ !T
V TYP
O gT TUP V
`V^ ghQT`
OQPS^hQT

TP!V `OGhQT`YRU]hQ]PgPgT` T
` ]P VY] V eg]!Pg]
A

h
O

U
T

P
V
i
O
V
g

^
S
P

`
Q
h
^
4
j

V
T O TUPS` OQ]P
ATTP!AV = I

^
_
!
]
g
P
g
P
T


`
V

^
V
!OiTlj_]
`
x = A T b
j4]
RU]PS`V gO T gPgT S^!`T] V eg]!Pg]
UT gT
Im(A)
j_^ ^ ^jSegT
gTlRUTVVTRU]PS`V SRV OQ]P T OiTP V
] Veg] !]PS^hiT`

UT`
] V eS] ]!PS^hQT` T
gT DTUV T Pg]
T
fTVYhQ^` ]h V OQ]P gT`
S^V OQ]PS`fPg] 8^hQT`T`VY` O jghQT
n TlhiTj ] gh
]
T T`
]OQP T`RU^ `T`V ]!PSR gT
[R^hR ghQT T jghQOQRUOVT TUP Vh^cj ] yTR VOi]!P bP T ^c^
8V O^P gh^ OQ` T h^ 8^ V ORTcjS^ T`[V ^PS` ] 8^ VOi]!PS`

f x {!z 6{F<88~  p~S zo|~ {F

u3vfu

@-xZ > : UY =By D xd I W6=y D x : 2TI-c @T=y C ; D  LD 6@G= F I &I BA B4CD @ 49ND I Q@T= B=?> &=?=B>% F =B= 6I-=@  B= SD [I-=4@ M6x ITf y &=[&I D LR C B=
 [A  BC6D   
V T

]!OV gP
]
OQPgT j4]

T` `V

UhQT^ S
P T
gPD` `V
T
gPgTTUP V UT
] 
TV ` ]P V gT
t y = a + bt
a b
OiPgO QO ` T Y^ -`TPS` gT` ]!OiP
T`fR^ `h T T
T`fV ]O `
T ` T`

jS^ ^ UV T` 9
f` gO ^
P V T` %
t, Y

a b = 4
a
= 5
(S) :

a + b = 9
P ^ gOQTUP ` jS^` gT`]!h VOi]!P bP
R]P_`yV gOiV ]P_R hiT`
S^ VOi]!PS`YPg] 8^hQT`TP
ghVOijShiO^P V[jS^






TV ]!PSR
]P_R
1 1 1
3 0
1/3 0
T
T
T
1


A =
A A=
(A A) =
1 0 1
0 2
0 1/2
] -h^8`]!h gV OQ]P
^
]!OiP
T`R^ `
TV
a
=
6
=
b
=
5/2
T`yV gOQTUPK] V eg] ]!PS^h g^PS` 3 ^
bP T 8^ ST gT hiT TR VT
T`T T `
Y Ax = [1/2 1 1/2]T
R
RU]hQ]PgPST` T
eS^ gT8T T cj_T V ,V T !^hiT TUP V Tj ` TUP V T8jS^ h^ O`V^P_RT T VOQR^hQT8TUP V Th^
A
T` T
TUV[hQ^ ]OiV T
j4]
O
Yi
f (t) = 6 + 25 t
t = ti

F ]

-= E@ <I ;
?=BI V@ >HJI
7=BD
/D I
2=
@
@
@!F = D &=z<H7I I HJI &ITfMR D K6I-@-=E= @ &=?B==B=> 6IK=
;

]
2
=
7
\
*
@
&
T
I
f
u
@
2
J
H
I

B
=
=
6
I
=

I
?
=
6
>
\

D
u
=
?
=
>
B
>
&
=
t
@
~
R

=
B
=
;S@T| =
D [I-=
2I-= x  <\ UQ; U y

 

5,


u
fuSt

UK; U ~ =?>6\7=

K> L=

T` ` OQ]PhQOiP ^O T

O47<A:B8v?)4 JL<T;=>@?-:58 ?)4; 5?  ?A:5<-U@098




|}{!~SC<y6{} nn| 0
O#"f :3"%
1 0
XD& ".K3aea' pOG#
H

4%%'(')*
K X% Q*#+K0)8 p
Dr oB= D B= @ /= 7= 2\  @ [A9D ~> @?=  @ I oD =BD/I?= &=?=?> F @ @ ?> @ f 6D 2= M@ /D 7=BD B= > ; 2=BZ


H T H = HH T = I
PgT
^ V OQRUTD] Veg] !]PS^hiT8T`yV ]P_R gPgT 8^ V ORTKRU^ UT ]!P VlhQT` R]!hi]!PgPgT`l`]!P Vl] V eS]Pg]

UT` T`
8^V OQRUT` gT ]V^ V OQ]P T `
V QO T Tlj_T
V^V OQ]PmTUVh O TP!VOV ` ]P V gT`T T jghQT` T
^ V OQUR T`]

W&d





 

2
\

r D ?= ; 2= 7\

V eS] ]!PS^hQT`
PST 8^ V ORT] V eg] ]!PS^hQT

 1

?I-= 6D

T`yVPS^ V

 1


    
ThihQT

 

JR 6= L] 2=@T> #

TP!VYOQP !T `O ghQT[jS^

SPgOiV OQ]P

  





F 9R 6=

TVYh OQP T ` T[T`V



H 1 = H T

+4Qp('(')* =) 6O>O;CKG@"bG g3>?


\ ?&(
X"b?
O6"3'
!Sg3>?p& F".>@
e>@,".rX>@l>@
X?C'>?
C"C 8\k>@&(G@"3p c o
C>@K& O qU?ap9. :U
F
XSs c !;CO>F ! I"30Oa?U?9O
@"D?
lUO >@
C" a>?
!',_@G
>@,".rX>@l>@
X? (x R ) k Hx k=k x k
H



;
| EI -= K-= = L> ?> ?6= D  I 2I-=:% &] B> 9I-D >= HJI ~@ OD > T@ OI
2=
2=?D 6=I [A BC6D u@ O\7> ->= 76=BIKD =
=B> 7IK@T= I BA ?C6D 2ITf >HJI
B= -\2I &= =4I BA ?C6D OD

I = R I-= -= -= @GF I NKD@ ?= -> x B= W y




oP
T TV

k Hx k2 = (Hx)T (Hx) = xT H T Hx = xT x =k x k2

?= [b 2=?D

TV V T8j ]j O V lTP!V ^ PST SPgT8`yV^ gOQhiOiV 8P


O gT T`
Veg] T` gV OQhiO` ^P VcRT`V ^PS` ]
hQT` V OihQO`Tj OQPSROQjS^hQT TP!Vj4]
] V eg]!Pg] 8^hQOQ` T gP
` `V
T T UP ^V T `
`]
T gP ` `yV
T`^
S^ V OQ]PS`Pg] 8^hiT`
V OQ^P gh^ O`T gP ` `yV
T
^hR ]!P OiV OQ]PgP
RU^hR ShiT hiT` ^hiT `Yj ]!j T`
gg
P T 8^ V ORT ReS^jgOiV T

w{F}   6 n |S~S|}F~ n 

u
Nu3v

{F|

^V OQ]PS`

bP

 ~ }


I b @ &D &[= A L=BC@!D F I [bI-2=zD @T>  ]6O=?D@ MKR7> = ;  I-F = 2@T=?> D K>@T\7>> -@ >Q= @ u@ @; | F  @ 7I I @GF 7I I BM=?I D L=b /?K=I @ &D ]  2= 2I IK= 2t=?D =?>?> =BwI LL@TIT= I Z
R] 2&II [Z 79 = B= -2\2<D=?I D &2>\ = @G= F I w9ID B62= D/I ] VOb 2@=?D2D R> @ &I--= == ; 6S>R@TF IK= BV>=-I-@ , =MvM;9I-= D2D/>-=Z =?Y HJ> I -D 6@ E= HJ@I F B>B=-=?, I B=?I -I-@ = 6D>(H7I Z
2i @T>HJDI LHJI 6=?D ; S@G-F = HJKI @T= vM=&D0D ,Z D Y -7D ] L@ <bQ\7=
B= 9M@ 6B= = b 7=BID  2D = > 7\ 9@ u@ M#b> L>6D 2= <=
@|x QITf +Tb(@T')>6*= #pOLI %8 2I moKC6'8=@!7*F8J2%] HJp7I =?2@ I I B= D N> D b 7T?=B@=D u@ w&v =?%=B2> @ I ; Q"%p(8 %*0)%87 @ y 9I-D >6= LHJI D 2] -> 6I <= 66DD
K@T> Q@ ; B?> = EHJI O1F HJI 6I ?=BI L= B>= L?R = D -\7I I L= u[D I Q?>= = 6I-= 2= ; 2\
@
2= 7\  %
E@ /b 2=?D 0%
| 2D D
; =   > <>D E@


XCjS^ V O
gPST ^ OQhQhiT T TRV T `OQP Uj4TUP g^P V` T p ]
gPgT 8^ V ORT
]PDj_T V[R]P_`yV gO T
R
A
T`yV gP>] V OQh ]P S^ TUP V^hj4] lh^ ` ]h
gPgT ^ OQhihQT
S^` TD] Veg]PS]
T T
{q q }
Im(A)
V OQ]P T ` `V 1T` ` p UV T
OiP `
O UT UP ^hiTT`yV ]!PSR TRU]PS`V gO T gPgT S^` T] V eg]!Pg]
UT
` ] S` tT`j_^RTO 8^ !T
gP-TUPS` T ghiT T TRV T `
OiP V UVP
O gTT`yV gTRUTVVTRU]PS`V SRV OQ]P
SO
^ V cV OQ^P ShQ^ O`T fh^ 8^V OQRUT ]
UTjS^ YRT` TRV T ` bPDj ` TUP VT ^OQRUOGhQ^R]!PS`V SR VOi]!P T RTV V T
S^!`T[] Veg]PS]
T RU]PgP gT[` ] S`hiT[PS]
Tj ] R
T T
^
Re O V ]P Vh OQP V UVfT`Vfj T TP!V
^R^
O gT oP
j ^V O gT
^
Re O VRU]VTV ]j
RegT TUVY]!P gV OQhiO`Th^
V eS] gT T ^R V] OQ`^ VOi]!P
gOgj4T
TV
^ V V TUOQP ThQT
T] yTRV O
!RT gT`V ^P_` ] 8^ VOi]!PS`] V eg] ]P_^hQT` Uh
TUP V^O T`
] lV ^P_` ] 8^ VOi]!PS` T
P
O gT TP Vq`V^ ghQT`TVf` T ghQT TP!V
T
]!OQ`Yjgh S`[Re T` gThQ^
Veg] T T
^ S` `
]P_`O ]P_`fV] V
^ _]
gPgT 8^ V ORTR^ T
]!P V[hiT`R]hQ]PSPgT`
` ]P VYhiOQP ^O T TP!V
A M (R)
a
OQP Uj4TUP g^P V T` k ]P V ]!PS` gTh ]P
j4T VR]P_`yV gO TOiV n,n
^V O T TP V SPgT 8^ V ORT ] iV eS] ]!PS^hQT
]P V
Q
V TUhQhQT gT

T
y
`
Y
V
V

O

^
P
g

h

^
O
T
`
S
j
Q
O
T

T
hQT`[RU]hQ]PgPgT`Y`]!P!VPg]V T`
]


q
QT A = R
R
]
T
b
hQT` h
TUP V` T
T`V[] V eg] ]P_^hQTi ]PK^
`]!P!V Th^ ] T
Q
A = QR
R


r11 = q1t a1
r12 = q1t a2 ,

;;

r22 = q2t a2

r1n = q1t an ,

L@

rnn = qnt an

2= -= T@TI

bPKO TP V O$#ST^hQ] `hiTj ]

gOiV

a1 = (q1t a1 )q1

;;

a2 =

(q1t a2 )q1

(q2t a2 )q2 ,

}= D &=zH7I MHJI 7HJI

bP

T 8^

ST

gTReS^

QR

&=

jS^ [RU]hQ]PgPST6%

q1 =

q2 =

gTRU]hQ]PgPST

qi

a1 TV
r11 =k
ka1 k
a2 (q1T a2 )q1
ka2 (q1T a2 )q1 k

2] 9I

a1 k

2I ?= XA @

T`V[] gV TUP gT TP
` ] _`yV ^ ^P V T

qi

-=

7= 2\

`T`Yj ]!yTRV OQ]PS`] Veg] !]PS^hiT`

 

 


 

1



   

Bx I-= <\ UQ; W y -= 6D 6= R 6IK= M@ ] 2= 2=?D > w@T> 9 I L>  -I


`

hQT`

j T

i1

OQT ` !TRV T

` ThQ^ S^` T] V eg]!Pg]

UT

-R^hR gh `

UQ; W Mv = 2D Z Y KD @
=9 7] -\2I<= 6I Lu= w=?>x = yBy }; D0,6D VB=?I I OB=?D I B= 2=B=?> 72=DwB= ]K= -~\27@ I =B~D R <> =
 9I
7= OH7I 2=?D >
-X= R 6>@TIK= ~@ vM= &D Z -Y > -LD = LD@ XR

b
2
?
=
D
>
@
@ = 6= R 6I-= 2= 2=?D > ; 2= ] %
OHJI D B= OHJI 0%
 

2=?D

W-:

/=?> BI

j gO`TUP PS]

^P VhQT

` ghiV^V

Re O V

62I-D = D -=?> 6>-@ b>6D= D I-= @ Mx)D D BL= C6=


x y ; R 7I-D = <2C =B] ?= 7<= = /D ]
K@T> K@ ;!Y
D B=
;

bPFj4T V ^hiO`T hQ^


T8R]!PS`V SR VOi]!P` OhQTPS]
T T !TR VT `
T`VOiP OiT
9
^V OQRUT
ai
n
TRV^P gh^O T
bPDRU]PS`V gOiV
R]hQ]PSPgT`
] Veg]Pg]
T`RU]
Tj R T TP V T 8^PgO T
np
p
q
] V TPgO
]
T`V gPgT 8^ V ORTRU^ iUTV OQ^P ShQ^O T
bP
R] jgh UV T^hi] `h^ _^` T
A = Q 1 R1
R1
pp
] Veg]PS]
TlTP R]P VOiP S^P!Vh^
j ] R
T T
^
Re O Vc^ TR
TRV T `^ SOV ^O T`
np
 ^V ^OQRUOQT `
VTUh` SThQT`
RU]hQ]PgPST` ]
T` ^ TRhQT`
`]!OiTP!V hQOiP ^O T TUP VOQP j_TP g^P!VT`
]OiV
h^
n
ai P
^ ^hQ] ` gOiTP
Q2
gT`
T PgOQT ` TR VT `] V eg]!Pg]
` b
np


RUT gO ]!P V T gT
R1
T
T T
= Q 1 R1
A Q2 = R 1 Q1 Q2 = 0
A = QR = [Q1 Q2 ] =
0

Qjk8J89p $7Q"%01Q#%8}#89+-p p(#88tQ(#* K%Kjkjk899 8}"##8%8}%+Kp8QX%Q%Kjk98o#8


Q1

Ker(AT )

Im(A) 

8J 0189p/$7Q01Q%#89p #8

A{F| '6{ |}~Sn      <{

u
fu

D B=?BI = I w@ &Io= -DB= =?> D 6[= b 2=?wDB=D u> H7I TO@ O> L@>6D DO> vM= T2@ D/<u= Z @Y w7-v = D &I@ 2\ ;T2 D D NHJI I
LD ] > OB@I TN@ =BO> 2@ =?\ ?=
v@ LR L\ 7= &K=OD @ J6IKf DD >x = 2IHJI > 6LD >6LDD LI &=N> LB2>6>6] D = EHJy I ; @/D [A9> D > T?@ = Bu= @Nu@ [bvM2==?D&2D I Z Y -D @ L6@ &= = ;

Q2

-6\7= I &= 6I @
B= N-= \7I 2= N@
K@-I

bP-j_T VOQP V T j VT hQ^


UV eg] T T
^
Re O VRU]
T gPST
Veg] T T[V O^P gh^ OQ`^ VOi]!P gT
h^ 8^ V ORT
^ 6, T V OiV T SThQ^
Veg] T T
^ _` ` hT`V[j4]!``O ghQT gT ] !^PSOQ` T hiT`RU^hQR ghQ`YTP
A
RU]PS`V gO` ^P V T`V ^PS` ] 8^ V OQ]P_` Uh
TUP V^O T` ] Veg] !]PS^hiT` gOfT 4TR V STUP VlRTUVVTV O^P ghQ^ O`^ V OQ]P
RU]hQ]PgPSTj_^ cRU]hQ]PgPgT ] Uh
TP!Vj_^ Uh
TP!V
T`c`
V OQT` T-n[] _`Teg]h T TUVhiT` ]V^V OQ]PS` gT
O TPS``]!P!V T`T T jghiT`` O jShiT`TUVOQP V T``^P V` TcVTUhQhiT`V ^PS` ] 8^ V OQ]P_` R^ TUhQhiT`RU]P gOQ` TUP V:9

gT`^h ] OiV e T`P
O gT TP!Vjgh S`[`V^ ghQT` gTh^
UV eg] T T
^
Re O V

4%"%k'`(')&* "3p3 ag e 80f


X;\& > OF,".aK"3.UaO>?d
B   dN>8UB 'rX>?>?3."% d''
lF'"
\ 
XOG#N & ;oF ".mK. aO
da_@?,Ka,"bG?  


P

oR2>= $# ~x  L\ ;-UQ; ^ yH7I

bP

O ST

ST

H
v

 o87 G,apKI"

X>@
j
C  

= -=?> I BA9D > B= &=E= 2= &I 7I Z


TUj ` TUP VT gPST `

V OQTj_^

^jgj4] V[^
`] S` wT` jS^!RT

H = I 2P

c>

$#





 

 1

 1


    

 



UK; ^ ` = [b 2=?D @ 7I L@ =
2I-2= I-B= = -\2I=B2R =6= = S> <>D 9I @GF I VD B=?I B= &ITf  ?>6=  BI -= =?> >(@ ?= [b ;J2Y=?D
 <> &ITf
@ ; n@T> 6=?D
@
uHJI @ 6= LC6= 2 D % V@
 

^PS` ] 8^ VOi]!P Tn[] S` TUeg]!h T

d] fV OQ^P ShQ^ O`T qhQ^cR]hQ]PSPgT


gPgT 8^V OQRUT
]P8T TRV gT ^hQ^
k
A
PS^hiT j4] R]P_`T !T qhQT` h
TUP V`qP gh`fRU]PS`V gOiV`^ OV ^ V OQ]P_`qj R
^`` ] RUO l^
T PgO T`R] j4]!`^P V T` TlhQ^-R]hQ]PSPgT
T
nk+1
k
A
g^PS` nk+1 V ThihQT gT
]
R
Hk a k = z k

z1k =k ak k
zik = 0, 2 i n k + 1
oP
T TV
T`VY] Veg] !]PS^hiT RT gOO jShiO gT gT
k zk k=k ak k
 Hk


7= 2\

NHJI LD HJI uHJI

Hk = I 2

  





2I2I [ZuR @ &6\ KI &=Z


[A9D > ?=

V ^PS` ]
^V OQ]P8` ] S`qh^ O^ !]
hQT` ] S` !TRV T
TUP VT`
] OV
!
ak hQ^D`
bP VT
iO PgTl
V OQT
Hk

; 2]

2=

bPK] VOiTP V^hQ] `%

vk vkT
vkT vk
ThQ^ S^!`TR^Pg]!PgO gT T

XR -= LHJI
LHJI N@
;
<= @ 7=BD O-=D Df LD =ER ; I-=E@ ]
@ }I }2LI I R #\2> 6KI->6@ == 6= 6D K=B> D L = 19 -IM> }2@ =?R C6DB= 6BI-I =Vb L7R @ =BD 6-= D > ; B= 4HJI! F LI 2I!\72> I--=>= D L] V4I @ BR = 2I-R 66I-=!=MI H7I D Q?=H7I
@" @ _?,a"%@ '`
X>@
a>@99
XGO O 8 n_?,a
 % "d U>?K
%9K? 9jk8  g !>@'
C"
;=>?KSb^?H 8H".O>8F_?'
"%'
^ TR
T`yVhQTj T iO T
T V
v =a ka ke 
e1
oP j ^ kV O gT k ]P
Regk]O` O 1^

T Pg]
T 8^ O

vk

TRV T
^hiT

Rnk+1

dh S` UP ^hQT TUP V hiTfV e ]


T` gO ^ P V ]P V T
QO h!T`yVV ] y] `j4]!``O ghQT TfV ] !T
Tn[] _`Teg]h T j_T
TV V^P!V TV ^P_` ]
T
TP
UT Vjgh S` UP ^hiT TUP V gP TR VT
ak
zk
TUP gP !TR VT [RU]hQOiP ^O T
gP TR VT
!
] PgP





kuk2 = 1
H(u)f = e

f
u Rn

Rn


 g   Z[T6D8^&=zHJIg]PS`V]2IVS@GF ^&]4]2=z@/HJIgT` O

7=

TV

6=

2= ; !HJI

H(u)f = f 2u(uT f ) kH(u)f k2 = kf k2


d]!` ]PS`^hi] `
bP
RegT R egT ^hQ] `
V TUh
| |= kf k2
u

Y
TV

= uT f 

6f

T O`V T` O

2 f T e > 0

\ &I

I ED ?= E@ 7I L@ =  7=

H(u)f = e 

` ]OiV

&=

; = F ->\ B>N@ | &I JAJZ Y 2= 2I E@


b h OQP

kek2 = 1

T`V gPgT 8^ V ORT Tn[] S` TUeg]!h T

f 2u(uT f ) = e
1
u = T (f e)
2u f
ShVOijghQO^P V 9 !^ _RegTj_^
%
fT

}DwI

TUP

gT

H(u)

SPgT 8^ V O RT
STUhR]P ST

2 2 = 2 f T e
!^hQOiV T
^ _Re
Re ^ Pg] S` g]PgPgT

| f T e | kf k2 kek2 = kk

^hi] `

 

  

1F ->6\ ?> V@ <I ?=

TUV[h OQP

&= 9A -C ~x

^hQOV T`yV TjSh S``yV OR VTj_^ e

j_]V e `T

u=

TV

-> <= zy ;

PS]P
R]hQOQP ^O T`

h^

ST`V OQ]P

X[OQPS` O %

1
(f e)
2

=?> Q@9 ~H7I ;


i 89jk+TG"#8 =) 8 @" >@
C" a>?9
XGO O c
>8
6#K\2I-= UK; _ K=B> OI f 6D N@ ?=BI o@
Uj4]P

W2P

H = I 2eeT

H =I

j `TP!VT gP
T T

jghQT TR]!PS`yV _R V OQ]P g^P_`

UQ;e_ ` = b 7=BD
@@ ] 6=?R wN@ HJD I = ?<= C= ?= = b 7-=B=?D > >B>?>N2= = <Z D @ 2\ 7I > &]_~a= Z ~
;;;
 

R2

OG ;=>@
o 8'
C" k(O#"3U>?

@ 2I @ 6=
w; LD > B9 = B@ = -\7BI >O2@ =

^P_` ] 8^ VOi]!P Tn] S` TUeS]h T

@ ] @ &\

b S` T ]!PS` gTKh^mV ^PS` ] 8^V OQ]P ] V eS] ]!PS^hQTD^!` ` ]RO UT


hQ^ V O^P ghQ^ O`^ V OQ]P TKh^ RU]hQ]PgPgT
k
S^PS` n T`Vh^ 8^ V ORT
Tj ` TUP V TRO gT``] S`
hQ^
^V OQRUT[O TUP V OiV T n ]hQT ghQ]R O^ !]PS^h
R
Qk
R
gT`
T S
P O T`RU]hQ]PgPST`^ V
T jShQ^!R jS^
nk+1
Hk

5,



Q=

034=Mu>#Mu098

1
Hk

8J$2')$78 =) ` = 2I-R 6= /D I-= -= Xf <D


]

!T Yh^

TOihQhiT

T^jgj ] O 8^V OQ]P

 x 

2I E@ D K@T= &=?=B>  @TI BA ?C6D


^ K` TUP_` T`

> 6=?D = 2=B=?>E@ F 6=?= I-= 4D B= 6= HJI VR 6I-= 6=?= I-=


3x = 10,

. VT
9

OiPgT fhQTRU^

Th T

e2

TV ]!P V T

8JD $2[')I-$7=8 =% g ` = 2I-R 6= /@T=

T` T`

!T hQ^

]!OVT

f (t) = at + b

f (0) = 0,

T`R^

` `yV

gT[hQT !TR VT

fT

H7I -=

f (3) = 2,

T`yV] V eg] ]P_^h

MD ITftx 2I @ 4D K@T= &=?=B> ?y

SO^jgj ]RegThiT

f (1) = 1,

(10 3
x 5 4
x)T

2= 7\

4x = 5.

(3 4)T

hQT`

]OQP

OiT

^ D`TPS` T`

f (4) = 5.

]OQP

T`fR^

WU





 

 1

 1


    

 





  

87$7')$28 Y
D B= = -N=?> @ 6=-\2= "> 7D > B= H7[I I-6= D T@ = D N@ ?u= @ L=
; ; B= 6=MHJI
2J= I 2\ ; (y ;-Y
K@ 2=z@ K> N@ x ]_~aZ~
; . > =BD 6= 7I-=HJI

 87$7')$2
[IK= E@T= E@ N@ L= = LR
8   = " = OR 6I-=



]OiV

1
vv T ,
k v k2
h^
^V OQRUT T j ] yTRV OQ]P
` h^ ]OiV T T O TR VOi]!P
v
P V T j VT
U] V O ST TUP Vh^ 8^ V ORT
k 
] P V T
gT
T V
2
T
Q
=
I
2Pj_]
Q
=RU] I] ]Q
=Q
Q
T`V[] V eS] ]!PS^hQT
]OiV
g

^
`

T
U
R

]
P
g
T
PgP UT T
U
V
T
Q
O
g
P
T
y = (y1 , y2 ) R2
v
z = Qy
` ]OiV[P ShihQT
P =

] yTV T hiT !TR VT

` hiT`
]!OVT` T O TR VOi]!PS` T` j_TR V O T`
b = (0 3 0)T

1/3
2/3
a1 = 2/3 , a2 = 2/3 .
2/3
1/3

-\ K@T=?> &=
` = 7I-R = -= ! o@ BI-=
 87$7')$28 q Y
@ 6ITf 2I d 4R 7= @
]

T h^j ] yTRV OQ]P T


]OiV

TUV

BI *<I >6= B=6I-= = ; =?> BI XR

hQh S`V T RT
TV` gj OiT T`

` hQTjgh^PKTUP !TUP

gT

jS^

a1

TUV

-` ] _` T` jS^RUT` TRV ] OQTUh` T

LR D

a2

Rn

; ?= =EH7I
k ]!P!V T

Dw] @ D ?= B= -\2I L= Tb>= 6I-=

dim(V + W ) = dim V + dim W dim V W.

` ghV^ Vq^ TR

TUV

ST

T`j4TRV O T TP VTUP_`T

ghQT` T` 8^ V ORT`V OQ^P

gh^O T`OQP

OQT

T`


  

   

  



 !#"$&%&'(*)"+
,.- /102/436587:9;7=<>9@?BADCD/13E9;9@7FAG3H- IJADK2L89ML89@7(NO/4369K2CD7P<2C=QR<SC=9@7P9JATL89U7.N19U?JA=9UKSCD7(<SC=QR<SCD9U7(LV- KS0S9MWX/4A=CDY6?9M?/1C=CDI9RZ
,!9U7TNO/4369KSC[7G<SC=QR<SCD9U7TLV- K20S9\W/4A=CDY6?9]?U/4CDC=IU9 A(n n) 7=Q10^AT3E9@7 n 7:QR3EKSA=Y6Q1027TLS/40>7 C L89_3H- IU`^K2/4A=Y6Q10a?U/4C[/1?Bb
ADICDY67:A=Yc`^KS9
d\Ke<fQ1Y60^AGL89;NgKS9MLS9;3H- /436h1iUjSCD9k3EY60SIU/1YECD91l^?J9U36/mdet(I
7=YEhR0S$Y #29M`^A)KS9;=369;00SQO5^/4KL89 I A ?Q10^A=Y690^A.L89@7(N19@?BAD9KSC[7(0SQR0
0gKS3c7UlS/4<S<f936IU7nNR9U?BAD9KSC[7T<SCDQ1<SCD9U7n/17D7=Qg?YEI@7no Z2d\Q102?1lS7:Y x 6= 0 9U7:A;KS0pNR9U?JA=9K2Ck<SC=QR<SCD9]L89 A /R7=7=Q8?JY6I]oq3c/
NO/13E9UKSCk<SCDQ1<SCD9 lSQR0r/ Ax = x Z
,!9r?U/43c?JKS3kL89@7 7:QR3EKSA=Y6Q1027qL89r3H- IU`^K2/4A=Y6Q10s?/4C[/1?JA=IUC=Yc7FADY6`^KS9a9U7:AADC=i@7q?Q1t8AD9K8uvLSiU7X`^KS9
9JAX3E9
ADwSIQRC=iUWX9eLV- xMj>9U3.WXn Q10^ADC=9`^Ky- Q100S9e<f9K8A9U7=<>IUC=9UCm3E9CDIU7=Q1K2LSC=9X<2/1CzL89U7+CD/RL8Y6?U/4K8u{L8iU7+`^KS9 nn>>24 Z#|\0
CD9U?[w29C[?[wS9C[/}L8QR02?rL89U7eWqIA=wSQ8L89@7XY~ADIC[/OADYENR9U7`^KSY;<f9CDWX9JA:AD90^AaLV- /4<S<2C=Q8?[wS9UCX?9U7XC[/1?YE0S9@7q9JAe0SQR0LS93E9@7
?U/43c?JKS369Cz9Ju8<S36Y6?Y~AD9WX90^A?U/4C@l*or3c/L8YEfIUC=9U02?J9aLS9U7+WXIA=wSQ8L89@7zL89eCDIU7=Q136K8ADYEQR0LS9a7:587:A=iUWq9@7+36YE02IU/4Y6CD9U7mNgKS9@7
L2/4027369;?[w2/4<2Y~ADC=9k8lO3c/m?JQR0^NR9CDh19U02?J9T7:9UCD/\Y6?Y2/17=5gWX<8A=Q1A=Yc`RK291Z(0X/4YEAUl13E9@7WqIA=wSQ8L89@7(`^KSYS7=9CDQ10^A#<2C=I@7:9U0RADI9@7
<fQ1K2CG369\?U/43c?JKS3L89U7GNO/4369KSC[7(<2C=QR<SC=9@7(7=Q10^AGK8ADYE36Yc7:IU9U7G<>QRKSCG9ugA=C[/4Y6C=9k369U7GCD/R?JY60S9U7GLV- KS0a<fQ1365g0S1WX9;9U0a<2/R7=7D/40^A
<>/4Ck3c/W/4A=CDY6?9_?Q1WX<2/1h10S96%
n1
X

a i ti + t n = 0

9@7FA;369_<>QR3E5g0SRWX9_?U/4C[/1?JA=ICDYc7FADY6`^KS9_L89_36/XW/4A=CDY6?9_?Q1WX<2/1h10S9
i=0

D

ZZZ

1
A=

0
0

a0

ZZZ

a1
0
1 an1

 *n#T#$&RF+&+B!!k'.!#zJ
QR027:YcL8IUC=QR027T<2/4Ck9ug9UWX<S3E9mK20r7=587FADiWX9mLV- IU`^K2/OADYEQR027kL8YEfIUC=9U0^A=Y69363E9@7nQ1C[L8YE0>/4Y6C=9@7 %
*CDQ1KSNR9Cn3E9@7TQ102?JA=Y6Q1027 v(t) 9A w(t) l><>QRKSC t R l8A=9U3E369U7k`^KS&9 %
+

dv
dt
dw
dt

= 4v 5w
= 2v 3w



/N19@??JQRWXWq9{?JQR02L8YEA=Y6Q1027pYE02Y~ADY6/13E9@7
N19@?BADQ1CDYE9U3E369


   

Z 97=587FADiWX9}<f9KSAA=CD9}WXY67r7=Q1K27a36/ Q1CDWX9
du
Z#"%$
= Au
!

v(0) = 8, w(0) = 5

/N19@?6%

dt

u(t) =

v(t)
, u(0) =
w(t)

 

8
4
,A =
5
2
'"

5
3

& /R?[w2/40^AT`^KS9]3c/z7=Q136K8A=Y6Q10aLS9\3 - I@`^K2/OADYEQR0


9U0pL8Y6WX9027=Y6Q10 \9U7:A = x e l8`RK2YLSYENR9CDh19M7=Y a > 0
J9 A7=9p7:AD/4j2YE36Y67=9p/R7:5gWX<8ADQ4A=Yc`^KS9WX9U0RAXo)(UxICDQ}=7:Yaxa < 0 l#Q10 ?[wS9C[?[wS9C[/x(t)
L89@77=Q136K8A=Y6Q10>7z<2/1C:ADY6?KS36YEiUC=9@7zL89p36/
Q1CDWX9

0

(0CD9WX<S3c/+*U/40^AnL2/4027 ! Z#"%$Bl2Q10&N1Q1YEA;`^KS9
u(t) = et

LV- Q+,

at

v(t) = vet
w(t) = we
t

A=

 
 
du
v
v
= Au(t)

= et
w

dt
A

 
 
v
v
=
w

J9 A LSQ1YEA\L8Q10>?-JADC=9+K20S9+NO/4369KSC\<SCDQ1<SCD9+L89 A /R7=7=Q8?JY6I9+/4KNR9U?JA=9K2C;<SCDQ1<SCD9
Q10?U/43c?JKS369m/4Yc7:IUWq9U0^An369U7nIU3EIUWX90^AD7n<SCDQ1<2C=9@7kL89 A %

 
v
w

Zfd]/40>7;369z?/R7k<SCDIU7=90^AUl

  
 t 
v1
1
e
=
u1 (t) = t
1
e
w1
 2t 
   
5e
5
v2
u2 (t) =
=
1 = 2
2e2t
2
w2

1 = 1

,!/a3EY60SI@/4CDY~ADIzL8K}7=587FADiWX9+Y6Wq<23EYc`^KS9`^KS9zA=Q1KSA=9z?Q1Wzj2YE02/1Y67=Q1036Y60SIU/1YECD9+L89U7]7=Q136K8A=Y6Q1027M<2/4C=A=Yc?JK23EY6iCD9U7
9U7:AM7=Q136K8A=Y6Q10rL89m3 - I@`RK>/OA=Y6Q10rL8YEfIUC=9U0^A=Y69363E9RZS,!/X7:QR3EKSA=Y6Q10&h1I02IC[/4369]7U- I@?JCDY~A;L8QR02?0%
Q+,
X/.

=3

9JA

u 1 , u2

u(t) = u1 (t) + u2 (t)

=1

7=Q10^A;L8IJAD9CDWqY60SIU9U7n<2/1Ck3E9@7k?JQ10>L8Y~ADYEQR027nY60SY~ADY6/13E9@7Z

k !%&[*_*21zkpn+%
|\0vL8QR0S0S9UCD/rYc?JYn`^KS93c`^KS9U7z<SC=QR<SCDYEIA=IU7LV- YE0^A=IUC/Aq7=KSC=A=Q1KSAz<SC[/OA=Yc`^KS9a?Q102?9CD02/40^Az369U7zN/13E9UKSC[7+<SCDQ1<SCD9U7
9JA_369U7\N19U?JA=9UKSCD7\<SCDQ1<SCD9U7\L89?9C=AD/1YE0S9@7MW/4A=CDY6?9U7UZf,!9U7]L8IWXQ10>7FADCD/4A=Y6Q1027\7:QR0RA]Q1WXYc7:9@7l>9JA_Q10}7=9CDIJIUC=9UCD/o
3 - QRKSNgCD/1h19_L849 3qZ & ADCD/10S6h 5#"87:9 lS<fQ1K2Ck<S3EK>7;L89+L8IAD/4Y63c7Z
;;029TW/4A=CDY6?9T?U/4CDC=IU9
L89kL8Y6Wq9U027=YEQR0 o]?JQg 9 <?YE9U0^AD7?JQRWq<23E9ug9@7#Q1KqC=IU93c7*<fQR7D7=iUL89 NO/4369KSC[7#<SCDQ1<SCD9U7
0SQR0}0SI@?J9U7D7D/4Y6C=9UWq9U0^A]L8Yc7FAADYE0>?BA=9@7mLS/40>7 C Zyn,.- 9U027:9UWzjS369XL89q?9U7]NO/4369KSC[7\<SC=QR<SCD9U7\9U7:A]36>9 =8n?
@AB8C:@L89 A lV9JA
369+0SQ1WjSCD9+L89mQ1Yc7kDQ ,/4<S<2/1CD:/ E6AkKS029+NO/4369KSC;<2C=QR<SC=9 LS/40>7;?J9+7=<>9@?BADC=9+9@7FAM/1<S<f936Iz7=G/ FIHKJLB8MN?KJOMNADMLB8PfZ8,y9
C:Q+RTSVU2=8?
@AB8C:QWJFl#0SQ4ADI
l*9@7FAq3E9p<S36K27zhRCD/102LWXQ8L8KS369pL89@7zNO/4369K2CD7z<SC=QR<SCD9U7+L89 A Z,!/}7=Q1WXWX9aL89@7
NO/4369KSC[7n<SCDQ1<SCD9U7T9@7FA;IUhR/436(A)
9_o3cX/ B C:QWAD@aL89m3c/qW/OA=CDYc?J09 %
0

n
X
i=1

i =

n
X
i=1

aii


9A\QR090L8I@L8KSYEA]L8QR02?+`^KS97=Y!K20S9+W/OADC=Yc?J9+CDI9U3E369+<fQR7D7:i@L89+KS029+NO/4369KSC\<SC=QR<SCD9+?JQ1WX<S369Ju89Rl>7=Q10?JQR0 FKShRKSI
9@7FAM/1K27D7:YNO/4369KSCk<2C=QR<SC=9RZSdM9mWXUWq9Rl83E9m<2C=Q8L8KSYEAML89@7nN/13E9UKSC[7n<SC=QR<SCD9U7T9U7:AkIhR/13y/4K PB%@DC:F MOU Q U B_LS9 A %
 W    V 
  

n
Y

i = det(A)

' B8B8@U B8MOSVU 3k0y- 9U7:A<2/17q<fQR7D7:Y6jS369p9U0 hRI0SIUCD/13TLy- QRj8A=9U0SYECNO/13E9UKSCD7q9AXNR9U?JA=9K2CD7<SCDQ1<SCD9U7XL89&36/7=Q1WXWX9


QRK L8K<SC=Q8L8K2Y~AzL89eLS9K8u{WX/4A=CDY6?9U7mL8QR0^A_QR0 ?JQ10202/ EcAm3E9e7=<>9@?BADC=9RlyW/4Yc7m?J9C=AD/1YE0>7m?/17_<>/4C=A=Yc?JKS36YE9UCD7_QD,3E9@7
RN 9U?JA=9K2CD7T<SCDQ1<SCD9U7n7=Q10^Ak3E9@7kWXWX9U7n<f9CDWX9JA=A=90^AML89+?Q102?3EK2C=90%
 7:Y 9U7:A_NO/13E9UKSCm<SCDQ1<SCD9L89 A l 9@7FAmNO/4369KSC_<SCDQ1<2C=9XL89 A ! 9U0{<>/4C=A=Yc?JKS36YE9UCUlV7=Y A 9U7:A+YE0gN19UCD7=Y6jS3E9Rl
9U7:AkNO/4369KSCk<SCDQ1<2C=9mL89_3 - Y60gN19C[7=%9 $

:
7
Y
U
9
 7:A;NO/4369KSCk<SCDQ1<2C=9_L89 A l + 9@7FA;NO/13E9UKSCk<SCDQ1<SCD9]LS9 A + I Z
& Y 9@7FA(KS029;NO/4369KSCP<SCDQ1<2C=9kL89
l4369M7:587:A=iUWq9 (A I)x = 0 <>Q^7=7=iULS9nLS9U7(7=Q136K8A=Y6Q10>7P0SQ10X0gKS363E9@7(/4<2<>9U3EIU9U7

A

@

A
8
B

@
H
:
C
=
?
:
C
V
S
?
:
C

@
;
=
8
L
9
R
/
=
7
=
7
8
Q
J
?
6
Y
U
I
7Po Zg|\0/4<S<f9363E9 =%STH = @=8?KQWAD@X? C:SV? C:@/17D7:Q8?JY6Iko_KS0S9kNO/4369K2C(<SCDQ1<SCD9

3 E9m0SQO5^/4K&L89 A I Z A& /L8Y6Wq9U027=YEQR0p 9@7FAML8QR02?_/4K&WXQ1Y6027nIh^/4369_o "RZ
,!Q1C[7=`^KS9n369U7NO/4369KSC[7<SCDQ1<SCD9U77=Q10^A(L8Yc7FADYE02?JA=9@7lO369U7PNR9U?JA=9K2CD7#<SCDQ1<SCD9U77=Q10^AP3EY60SI@/4Y6C=9UWq9U0^AY602L8IU<>9U02LS/10RA[7Z
,.- Y6WX<S36Y6?U/OA=Y6Q10&CDIU?JY6<SCDQ8`RK29M9U7:An/4K27D7=91l8Q10&<f9027=9C[//1Kp?U/17kL89_3c/zW/OADC=Yc?J9_YcL890^ADY~ADI]<fQ1K2C;7- 90r?JQR0^NO/1YE02?C=9RZ
& Y]369U7
N19@?BAD9KSC[7<SCDQ1<SCD9U7
<>9UKSN19U0R6A JA=CD9?[wSQRY67=Y67e3EY60SIU/1YECD9WX9U0RAeY602L8IU<>9U02LS/10RA[7lGYE3c7
QRC=WX9U0RAkKS02n9mWX/4A=CDY6?9 X = [x ] x0SQ1,0r1 7:Y60ShRiKS3EY6iCD91nl89A;Q10r/ %
i=1

X 1 AX = = diag{1 n }

.0p9f9AUl AX 9U7:AT3c/zW/4A=CDY6?9\L8QR0RAn369U7n?JQR3EQR0S0S9U7T7=Q10^AG369U7TN19@?BAD9KSC[7 Ax = x `^KSY9U7:ATj2YE9U0pIUhR/4369\o X Z


|\0L8YEATL2/4027(?9M?/R7(`^KS9 @= BKMNQ  STU QWJOMN=%QJN@m9AG?J9A:A=9\<SCDQ1<SCDYEIA=In0S9;<f9KSAT7U- I@?JCDYECD9k`RK!- /NR9U?n3c/_WX/4A=CDY6?9
LS9U7GN19U?JA=9UKSCD7G<SCDQ1<SCD9U7UZ1.A3E369]?U/4C[/1?JA=ICDYc7:9k369M/1Y~Ak`^KS9 X /+<fQ1KSCn?JQR3EQR0S0S9U7TL89@7.NR9U?BAD9KSC[7(<2C=QR<SC=9@7(9An`^KS9_?J9@7
NR9U?JA=9K2CD7T<SCDQ1<SCD9U7n7=Q10^Ak3EY60SI@/4Y6C=9UWq9U0^AnY602L8IU<>9U02LS/10RA[7Z
|\j27=9CDNO/OADYEQR

0 %YE3k9ugYc7:A=9pLS9U7qW/OA=CDYc?J9U7q`^KSYk0S9r7:QR0^A<2/R7qLSY6/1h1Q10>/436Y67D/4jS369U7 ! Q10 3E9@7X/4<S<f9363E9&W/OADC=Yc?J9@7


KP @A+B8M  @=%$JZS(363E9@7;7D/OA=Yc7:Q10^A;/4K8upLS9K8up?Q102LSY~ADYEQR027k7:K2YENO/40^AD9U7 %
 YE3!9Ju8Y67:A=9+LS9U7nNO/4369KSC[7n<SCDQ1<SCD9U7TWKS3~ADYE<23E9@7
 36/&L8Y6WX9027=YEQR0L8K{7:QRK27:b 9@7:<2/R?J9+<2C=QR<SC=9/17D7:Q8?JY6Iz9@7FAm7:A=CDY6?JA=9WX9U0RA_Y608ICDYE9UKSCD9oe3c/pWzKS3EA=Y6<S36Y6?Y~ADIXLS93c/
NO/4369KSCk<SCDQ1<2C=9RZ
xTA=A=9U0RADYEQR0ylV369q7=9KS3#/1Y~A+L89q3H- 9Ju8Yc7FAD902?9qLS9qNO/13E9UKSCD7\<SCDQ1<SCD9U7\WzK23~ADYE<S369U7]0S97=K <XAm<2/17]oaY6WX<S36Y6`^KS9UC_`^KS9X3c/
W/4A=CDY6?9.7:QRY~AL8IJ9@?BADYENR9 ![q 3c/;W/4A=CDY6?9(Y6LS90^A=YEA=IT<2/4C*9Ju89WX<S36%9 $J%Z ;M0z9ug9UWX<S3E9.AF5g<SY6`^KS9TL89.W/4A=CDY6?9.L8IJ9@?BADYENR9
9@7FA A = 0 1 l`^KSYn<>Q^7=7=iUL89a36/}N/13E9UKSCq<SC=QR<SCD9aL8Q1K2jS3E9 7SZ,y9@7zNR9U?BAD9KSC[7+<2C=QR<SC=9@7z7=Q10^AqLS9a3c/Q1CDWX9
0 0
 
0 "1Z A 0y- 9@7FA;L8QR02?_<2/R7kL8Y6/1h1QR02/436Y67D/4j23E9RZ
l8Y6367;90ShR902L8CD90^A;L8QR02?]KS07:QRK27Fb 9U7=<2/R?J9\LS9+L8YEWX9U027:Y6Q1I
x=
0
d]/4027p?J9UC:A[/4Y6027e?/R7l.YE3\9U7:AeC=9U36/4A=Y6N19WX9U0RA/R?JY63E9Ly- Y608ICD9Cp7:KSCp36/NO/13E9UKSCeQ1K3c/ 02/4A=KSCD9L89U7eN/13E9UKSC[7
<2C=QR<SC=9@7nLV- K20S9mW/OA=CDYc?J9 A %
 7:Y A 9U7:AkLSY6/1h1Q10>/43691lg3E9@7kNO/4369KSC[7T<SCDQ1<SCD9U7n7=Q10^Ak3E9@7kI36IWX90^A[7kL8Y6/1h1QR02/4K8u
 7:Y A 9U7:ATADC=Yc/402h1KS3c/4Y6C=9Rlg3E9@7kNO/4369KSC[7T<SC=QR<SCD9U7n7:QR0^AnIUhR/13E9UWq9U0^An369U7nIU3EIUWX90^AD7;LSY6/1h1Q10>/4K8u
 7:Y A 9U7:An02Q107:Y60ShRKS3EY6iCD91lg369U7kNO/13E9UKSCD7n<2C=QR<SC=9@7n7:QR0RAnADQ1K8AD9U7kL8YEfIUC=9U0^A=9U7kLS9 7
9 "z9A]Y63*9@7FA]<>Q^7=7=Y6jS3E9qL89?[w2Q1Yc7:Y6CMKS029
 7:Y A 9U7:A\Q1C=A=w2Q1h1QR02/43691l23E9@7MNO/4369K2CD7M<SC=QR<SCD9U7;QR0^A\<fQ1KSC]WXQgLSKS3E6
j2/17=9mL89mN19@?BAD9KSC[7n<SCDQ1<SCD9U7TQ1C=A=w2Q10SQRC=WXIU7
 7:Y A 9U7:A#7=5^WXIA=CDY6`^KS9RlU7=9U7*N/13E9UKSC[7y<SCDQ1<SCD9U7!7:QR0RA#C=IU9363E9@7Z@,y9@7!NR9U?BAD9KSC[7y<2C=QR<SC=9@7y/17D7=Qg?YEI@7!o;LS9U7*N/13E9UKSC[7
<SCDQ1<SCD9U7kL8Yc7:A=Y602?BAD9U7k7=Q10^A;/436Q1C[7GQRC:ADwSQ1hRQ102/1K8uVZ
,!9]LS9CD0SYE9UCG<fQ1Y60^ATY6WX<S36Y6`^KS9]90p<2/4C=A=Yc?JKS36Y69Cn`RK29MADQ1K8AD9\W/OADC=Yc?J9]CDI936369\7=5^WXIA=CDY6`^KS9\9U7:AnL8Yc/4hRQ102/13EYc7D/4jS369;<2/1C
K20S9mW/OA=CDYc?J9mQ1C=A=w2Q1h1QR02/43669 % = Q AQ l DQ , Q 9@7FAkQRC=WXIU9m<2/4C n N19U?JA=9UKSCD7n<2C=QR<SC=9@7nQ1C=A=wSQR0SQ1CDWXIU7UZ2|\0r/
/13EQRCD7T3c /  Q AB8SVC:MN=%QB8MOSVU =8?
@AB8C:QWJN@eLy- KS029mWX/4A=CDY6?9m7:5gWXIJADC=Yc`^KS9_C=IU9363E09 %
i

A = QQT


   

(0rCDIU7=KSWXI_LS9+?J9m`^KSYy<SCDIU?iUL890%



X 

J#MNU  
@ C:=%M MNJNMNB8P@= BGJNMOP@Q H  W
Q JN@H :C = ?KC:S ?KC:@=
JNQ  MOQ  SVUKQWJNMO=8Q KMOJNMLB%P6@=8B>JOMNP@ W
Q H  
@ A+B8@H C = ? C:SV? C:@=

) )JJ)[#%p$&k
,(- Q1j F9U?BADY~n9U7:Am902?Q1CD9XKS0S9XQ1Yc7mL89XADCD/1027FQRC=WX9UC]K20S9W/OA=CDYc?J9X<2/4C+LS9U7]A=C[/40>7FQRC=W/OADYEQR027_7:Y6WX<S369U7m9U0
KS0S9kW/4A=CDY6?9nLSQ10^APQ10X?JQ10202/ EcAP3E9@7PNO/4369KSC[7#<SC=QR<SCD9U7Ul?1- 9@7FA=b o4b LSYECD91lKS0S9kW/4A=CDY6?9GADC=Yc/402h1KS3c/4Y6C=9GQ1KXL8Yc/4h1QR02/43691Z
,y9@7nA=C[/40>7FQRC=W/OADYEQR027T`RK2YyW/4Y60RADYE9U0S0S9U0RAk369+7:<f9U?JA=CD9mLV- K20S9mW/OA=CDYc?J9m7:QR0^AkLS9U7;7=YEWXY63EYEA=K>L89U7UZ
 

!#"%$&'$&()*+

,P.-UKMLB8MOSVU0/)13246587:9<;>=?3@BA3CD5FEGCF=:@B@FHI5FE
58?
EFJ8KL?NMOAP?Q5DESROT:UWVYX[ZVYXTRGE]\ A_^L5B9`AaEI?Q57OKY5G;b=`?[@cA[CF5
KYJ8K
A B
S
EcA_K`dY7^aAfeF@F5g?Q5F^_^5gh`7]5

B = S 1 AS
=8MOF MNJOLM B8H K@

,!/}A=C[/40>7FQRC=W/OADYEQR0 L89 NR9C[7 9U7:AqK20S9


>ZV.0 3 - I@?JCDYENO/10RAX7:QRK27q36/Q1CDWX9 = SB lQ10
CD9JA=CDQ1K2N19KS029hRI0SIUCD/13EYc7=A/4A=Y6Q10 L89B 36/ L8I/#202Y~ADYEQR0 L89@7aNO/4369K2CD7a<SC=QR<SCD9U7e9ArLS9U7pN19U?JA=9UKSCD7aAS
<SCDQ1<SCD9U7UZn|\0 /
LV- /4Y63E369K2CD7n369mC=I@7:K23~A[/OAnQ102L2/4WX90^AD/13 %
i C:S ? SV=%MLB%MNSTUj/)13246587:9k;>=?3@BA3CD5FElEF5m;kn:^o=(n:^5FEpJ8KL?q^f5DEl;srm;s5FEutD=^f5:7@BE'v@FJ vL@F5DE

wyxz{|} ~L]~{|g7=Q1YEA
KS0XN19@?BAD9KSC(<2C=QR<SC=9nL89 /R7=7=Q8?JY6Iko_36/_NO/4369K2CP<SC=QR<SCD9 Zg|\0/_L8Q10>?
l
`^KSY!7U- I@?JCDY~A SBS x = xxl2?9+`^KSYyN19UK8A;L8Y6C=9m`^KS9 A 9@7FAkNO/4369KSCk<2C=QR<SC=9_L89 B /R7=7=Q8?JY6I]/1KpNR9U?BAD9KSAxCk<2=C=QRx
<SC=9
Z
S x

,(- Y60RADIC JA;L89+?9U7TA=C[/40>7FQRC=W/OADYEQR027T9U7:A;L8Q1KSj23E9&%
 3E9@7nN/13E9UKSC[7n<SC=QR<SCD9U7n7:QR0^AnY602?[w2/10Sh1IU9U7
 907:K2<S<>Q^7=/10^An369U7nNR9U?JA=9K2CD7n<SCDQ1<2C=9@7G36Y60SIU/1YECD9WX90^AkY602L8I<f90>LS/40^AD7UlS3c/X7:Y6WXYE36Y~ADK2L89+/R7=7=Q8?JY6I9moq36/qW/Ob
A=CDY6?9 X L8Q10^Am369U7m?JQR3EQR0S0S9@7]7=Q10^Am369U7_N19@?BAD9KSC[7]<SC=QR<SCD9U7\A=C[/4027:Q1CDWX9 A 9U0KS029WX/4A=CDY6?9qLSY6/1h1Q10>/4369
L8Q10^Ak3E9@7kI36IWX9U0RA[7kL8Yc/4h1QR02/4KSua7:QR0RAk369U7nNO/4369K2CD7n<SCDQ1<2C=9@7TLS9 A % X AX = Z
QR0RADC=QR027pWX/1YE0^AD902/10RAr7:K2C&K20 9ug9UWX<S3E9`^KS9L89K8u W/4A=CDY6?9U7r7:9UWzjS3c/4j23E9@7aCD9<SCDIU7=90^AD90^Ap3c/vX
W UWq9
A=C[/40>7FQRC=W/OADYEQR0p36Y60SIU/1YECD9m7:KSC\L89K8urj2/R7:9@7kL8Y~ICD90^AD9U:7 %27=Q1YEA P 36/XW/4A=CDY6?9_LS9+<SCD!Q F9U?JA=Y6Q10rLS/40>7 R 7:K2C;36/
L8CDQ1YEA=9 L LV- /40ShR3E9 %





/
1
N
U
9
?
cos ()
cos() sin()
cos()
P =
= uu
u=
sin()
cos() sin()
sin ()
& YPQR0/4YEAmWX/1YE0^AD902/10RA\A=QRKSC=029C]36/pj2/17=9X?/402Q10SYc`^KS9zQRC:ADwSQ10SQRC=WXIU9zLV- KS0/10Sh1369 lf3c/p<SC="
Q F9U?JA=Y6Q10}L89UNgYE9U0RA

W/4Y60^A=90>/40^AkKS0S9m<SCD!Q F9@?BA=Y6Q10r7=KSCk3H- /Ou89_wSQRC=#Y (QR0RA[/439JA;7U- I@?JCDY~A


1

Q=

1 0
0 0

Q1KSCk<>/17D7:9UC;L89 P o Q l8Q10&K8ADYE36Y67=9m3c/XWX/4A=CDY6?9mL89_C=Q1AD/OADYEQR0&Ly- /10Sh1369

R=

cos()
sin()

sin()
cos()

,y9+?[w>/40ShR9WX90^AML89mj2/R7:9m7=9_A=C[/1L8K2Y~A;<2/1C %27=Y 9@7FA;369mN19@?BA=9UKSC;L89z?QgQ1C[L8Q10S02I9U7nLS/1027k3c/qj2/17=9+L89+L8IU<2/4C=AUl


9JA u 369mN19@?BAD9KSC;L89m?Q^QRCDLSQ10S0SIU9U7nLS/1027n36/Xj>/17=x9]LV- /4CDCDYENRI91lgQR0&/
x = Ru


& 1
Q YEA 3c/z<SCDQ!F9@?BADYEQR0eL89 x 7=KSC L LS/40>7.3c/+j2/R7:9]L89_L8I<2/1C:A@lR9A v 7=9U7n?JQgQRCDL8QR0S0SIU9U7(LS/1027T36/zj2/17=9\Ly- /1C=CDYENRI9RZ
xM3EQRCD7 y
 6 ) 

4  



y = Px
Rv = P Ru
v = R1 P Ru = Qu

9AML8Q10>?

Q = R1 P R

9 A;L8Q102? P 9JA Q QR0RAk369U7nWXWX9@7nN/13E9UKSC[7G<2C=QR<SC=9@7Z Q1WXWX9 Q 9@7FA;L8Yc/4hRQ102/13E9RlgQ10aCD9JADC=QRKSN19]Yc?JYV369]CDIU7=KS3EAD/4A


?Q10S0gK %SADQ1K8AD9mWX/4A=CDY6?9mL89+<SCDQ!F9@?BA=Y6Q10&7:K2C;KS0S9+L8CDQ1YEA=9+L2/4027 /q<fQ1KSCMN/13E9UKSC[7n<SC=QR<SCD9U7 "_9JA72l89JAM<fQ1K2C
NR9U?JA=9K2CD7k<2C=QR<SC=9@7;/17D7=Qg?YEI@7k369U7M?Q136Q10S029U7;L89z36/W/4A=CDY6?9zL89+CDQ4RA[/OA=Y6Q10 R l>?1- 9@7FA=b o4b LSYECD9m3E9@7ML8Y6CD9U?BADYEQR027;L89 L
9A L C=9@7:<f9U?JA=Y6N19UWq9U0^AUZ
2

lp


)'&

" p"")&(+

S'&( 

;M0S9{/13~AD9CD02/OADYENR9<SC[/OADY6`^KS9{/4K8u /436h1QRC=YEA=wSWX9@7aL89?/136?KS3\/1<S<SCDQg?[w2I}L89U7pNO/4369KSC[7p<SC=QR<SCD9U7a`^KS90SQ1K>7
LSIU?JCDY6C=QR027+<S36K27q36Q1Y60v9U7:AX3E9pA=wSIUQ1CDiWX9p7=KSY6NO/40^AX`^KSYn<f9CDWX9JAL89p36Q8?/13EYc7:9UCz369U7qNO/4369KSC[7<SC=QR<SCD9U7zL2/4027qL89U7
LSY67D`^KS9U7UlSL8YEAD7;L8Yc7D`RK29U7kL849 3]9UCD7=wSh1QRC=Y60yl8L8K&<S3c/40?JQRWq<23E9ug9RZ

 PSVCF @ /)132  AGJ:K @D5vL@DHFEF5mKL?Q5b7KY5g;b=`?[@cA[CF5

J`7 ?J*7?5g;>=?3@BA3CD5 EF5m;kn:^f=n:^5


EFJ*7.E^f=[J8@B;s5
A 
A
5DE ?'7OKY5;b=`?[@cA[CF5M*5MOAf=8dJ8K =^f5!KL7^a^f5 =^fJ:@BE ^5EQvN58CI?[@F5M`5
5DE ? CDJ8KL?Q5FKL7
A = diag{d1 dn } + F 
F
A

M*=:K(E^F\ 7OKAfJ:K M*5FEMOAoE h*7*5FE
M(76vL^f=:K CFJ:; vL^f5m9 5 ?Q5F^aE6h*7*5
Di , 1 i n



J

Di =

z C, |z di |

n
X
j=1

|fij |

\7=Q1YEA
KS029NO/4369K2C&<2C=QR<SC=9{7:K2<S<>Q^7:IU9{LSY~ICD90^A=9L89@7 d , 1 i n ZkxM3EQRCD7

9
U
:
7
;
A
:
7
6
Y
S
0
1
h
2
K
E
3
6
Y

i
D
C
\
9

9
;
A
V
L
- /1<SCDiU7n369\ADwSIQRC=iUWX9 2Z "Rl8Q10p/q3c/qWX/!FQ1C[/OADYEQR0 k(D I) + F k 1 Z
(D I) + F
,!9m?[wSQ1YEupL89m3c/q0SQ1CDWX9 k.k QRKSC=02Y~A;369_C=I@7:KS3EAD/4A;?[wS9C[?[wSI1Z

;M0S9/4<S<S36Yc?/OADYEQR0}Y60^A=ICD9U7D7D/40^A=9qL89?J9qC=I@7:KS3EAD/4A]9@7FAm3 - 9@7FADYEW/4A=Y6Q10LS9U7]NO/4369KSC[7]<SC=QR<SCD9U7]LV- K20S9XWX/4A=CDY6?9
QRj8A=9U0gKS9_90r<>9UC:ADKSCDj2/40^AkKS0S9mW/OADC=Yc?J9mL8QR0^AnQR0&?Q10S0>/ EcAn369+7=<>9@?BA=CD91Z
wyxz{|} ~L*~L{|



@F ?JN@ /1[2

1
0.1 0.1
2
0.4
A= 0
0.2 0
3

M`J8KL?q^f5DE6tD=:^587@mE vL@FJ vL@D5FEEmJ:KL?qEcAP? 7]HI5FEuM]=K(E^5FEMOAoEDh`7]5DElE 7OA[tD=:KL?PE

D1 = {z C, |z 1| 0.2}
D2 = {z C, |z 2| 0.4}

D3 = {z C, |z 3| 0.2}

"!

A dY7@D5 "#



   



X[

Z "  L8Yc7=`^KS9@7kL8943]9C[7=wSh1QRC=Y60

+J'T%&$pk ]+Jk%p# &#"+pk ${:%p& _!)J'G yb T!) X%&


T &"$p $p q+'T" &)
,(- Y60RADIC JA.<2C=Y602?JY6<2/132L89U7.W/OA=CDYc?J9U7.C=IU9363E9@7(7=5^WXIA=CDY6`^KS9@7P9U7:AG`^Ky- YE3>9Ju8Y67:A=9MKS0S9Mj>/17=9;L89;N19@?BAD9KSC[7P<SCDQ1<SCD9U7
Q1C=A=w2Q10SQRC=WXIU7UZ.|\0<>9UK8AaL8Q10>?r36/L8Yc/4hRQ102/13EYc7:9UC<>/4CKS0S9rADCD/1027:Q1CDWX/4A=Y6Q10 Q1C=A=wSQRh1Q10>/4369 %.7=Q1Y690^A A KS0S9
A=9U3E369W/OADC=Yc?J9q9JA Q 36/&W/OADC=Yc?J9XQ1C=A=wSQRh1QR02/4369zL8QR0RAm369U7m?Q136Q10S0S9@7_7:QR0RA_369U7_N19@?BAD9KSC[7]<SC=QR<SCD9U7_L89 A ly/13EQRCD7
Z
Q AQ = diag{ }
,!/XWXIA=wSQ8L89qL89 ^/1?JQRjSYy9@7FAMK20S9+WXIJADwSQ8L89zLV- I36YEWXY602/OADYEQR0}7=5^WXIA=CDY6`^KS9mYEA=IUCD/4A=Y6N19mK8ADYE36Y67D/40^A\LS9U7M7=Y6WqY636Y~b
A=K>L89U7kQRC:ADwSQ1hRQ102/13E9@ 7 %
 36/qW/OADC=Yc?J9]A=C[/40>7FQRC=WXI9\A=9U02L&N19UCD7nKS029]W/4A=CDY6?9_LSY6/1h1Q10>/4369
 3E9m<SCDQ8L8KSYEA;L89U7nADCD/1027:Q1CDWX/4A=Y6Q1027GQ1C=A=w2Q1h1QR02/4369U7.A=9U02L&N19UCD7T3c/XWX/4A=CDY6?9mL89U7nNR9U?BAD9KSC[7T<SCDQ1<SCD9U7UZ




&(c$6"



c

 N` S#+

`&( 
 "

9T<SC=Y602?YE<f91lj2/R7:IT7:KSCL89@7*CDQ4A[/OADYEQR027!7=K2??9U7D7:Y6N19@7l@7:9UCD/MYE3636K27FADC=I.A=QRK8ALy- /1j>QRCDL+7=KSC#KS0S9TW/OA=CDYc?J9 ! D$
7=Q1YEA A 63 /X7=Q1K27:b W/4A=CDY6?9 ! +$G7:5gWXIJADC=Yc`^KS9
A=
&

QRY~A R 3c/XW/OADC=Yc?J9mL89_CDQ4AD/4A=Y6Q10rLV- /40ShR3E9

R=

Q1KSCkIU3EY6WXYE029C;3 - IU3EIUWX90^A



[ l 

apq

app
apq

apq
aqq

%


apq 6= 0.


cos sin
.
sin cos

0SQR0&LSY6/1h1Q10>/43 l^QR0L8IJAD9CDWqY60S9 A=9U3!`^KS9


T

R AR =

,y9+?U/43c?JKS3yLSQ10S0S9
cotg(2) =


0
0

aqq app
2apq



   K
  4    K  


  4k\   )
    K' 


       

QR027=Y6L8IUC=QR027kW/4Y60^A=9U02/40^AMKS029zW/OADC=Yc?J9z7=5gWXIJA=CDYc`RK29
A=9U3E369`^KS93H- I36IWX90^A
ADCD/1027:Q1CDWX/4A=Y6Q10pQ1C=A=wSQRh1Q10>/4369 AD9363E9+`^KS9 A = An l2/nNR9UA? a = a = 0 9U7:A
0

ZZZ

0
pq

cos
sin

0
qp

apq

4  4  + 

7:QRY~AM02Q100gKS3 Zf,*/

sin
cos

ZZZ

|\0qN1IUC=Y29n`^KS9k7:9UKS3E9@7#3E9@73EY6h10S9@7#9JA.?JQR3EQR0S0S9@7 p 9JA q L89 A 7=Q10^APWXQ8L8Y>I9U7UZ(0X<>Q^7=/10^A


lS3c/XWXY67=9mo FQRKSC;7U- I@?JCDY~A 
t = tan

c = cos s = sin

a0pj = capj saqj , j 6= p, q


a0qj = caqj + sapj , j 6= p, q

a0pp = app tapq


a0qq = aqq + tapq

;M0e?[wSQ1YEu?J3c/17D7:Yc`^KS9k<>QRKSC 9A 9U7:AG?J9U3EK2Y>`^KSY2<f9CDWX9JAGLy- IU3EY6WXYE0S9UCG3 - I36IWX90^A.0SQR0eL8Yc/4h1QR02/43SLS9;<S36K27.hRCD/102L


WXQ8L8KS369 |a | = max |a p| q
pq

l[ 

i6=j

 SS")&

ij

'"L"

& QRY~A
3c/s7:KSYEA=9{L89{WX/4A=CDY6?9U7p90ShR902LSC=IU9}<2/1Cp3 - /13EhRQ1CDY~ADwSWX990 I36YEWXY602/40^Aov?[w2/R`^KS9}YEA=IUCD/4A=Y6Q10
2K 0 I36IWX9{A0^A&0S}Q10 L8Yc/4hRQ102/13M0SQR0 0gKS3 ! A = A$a9JAr7:QR0 7:5gWXIJADC=Yc`^KS91Z Q1WXWX9}3c/A=C[/4027:Q1CDW/OADYEQR0s9@7FA
QRC:ADwSQ1hRQ102/13E9RlR3c/q0SQ1CDWX9mL89SCDQ1jf90SY6K27kL89m3c/qW/OA=CDYc?J9_9U7:AM?JQR027:9UC=NRI9 ![q ?[w>/4<SYEA=CD9 $
k



X
i,j

a02
ij =

a2ij

i,j

}/4Yc7k?J9_WXWX9mC=I@7:K23~A[/OAk9U7:A;NgCD/1Yf<fQ1K2C;36/qW/OADC=Yc?J9 ! +$.ADCD/1027FQRC=WXIU9]?Y~b L89U7D7:K>7Z8d\Q102?

02
2
2
2
a02
pp + aqq = app + aqq + 2apq

QRWXWq9e7=9K23E9@7_3E9@7m3EY6h1029U7 9JA 7=Q10^AmWqQ8L8Y 2IU9U7Ul!?J9@7mC=I@7:K23~A[/OAD7_Y6WX<S36Y6`^KS9U0RAz`^KS93c/7=Q1WXWX9XLS9U7+?U/4CDC=I@7


SL 9U7_I36IWX9U0RA[7mL8Yc/4h1QR02/4KSu}/4pKShRWqq9U0^A=97FADC=Yc?BAD9WX90^A+L89X3c/pNO/13E9UKSC 2a ly9Az`RK29q3c/r7:QRWXWq9L89@7m?/1C=CDIU7]L89U7
IU3EIUWX90^AD7n0SQR0L8Y6/1h1QR02/4K8uaLSYEWXY60^K29_7:A=CDYc?BA=9UWX90^AML89m3c/WXUWq9+`^K2/10^A=YEA=I1Z
|\0rL8IUWqQR0^A=CD9_/13EQRCD7T369_A=wSIUQ1CDiWX9m7:K2YENO/40^A
2
pq






PSVC F @ /)1  =6EI7AP?Q5uM*5G;b=`?[@cA[CF5DE


5mKd`5mK)MO@FHI5 v)=@'^o=6;bH:? YJM*5uM*5 =*CDJ`n:ACc^f=EBE A[h`7]5CFJ:KYt:5m@cd`5
{A }
t:5m@mE7KY5;b=`?[@cA[CF5 MOAf=8dJ8K =^f56CFJ:KY?5mK =KL?G?J*7k ?5FE^5FEutD=:^587O@BE'vL@DJDv@F5DEM`5
E 7@l^f=sMOAf=8d`J:K =:^5
A
wyxz{|}D~L*~{|
-5 :9

2NRQ1Y6Cn<2/4Ck9ug9UWX<S3E9 Yc/4CD3E9A Z
\| 0 <>9UK8AIhR/13E9UWX90^AqL8IUWXQ10^A=CD9Cq`RK291lP7:Yn369U7NO/4369KSC[7z<2C=QR<SC=9@77=Q10^AA=Q1KSA=9U7XL8Yc7:A=Y602?BAD9U7Ul#3c/}7=KSYEA=9rL89U7
W/4A=CDY6?9U7 Q = ?Q10gN19UC=hR9MNR9C[7G3c/XW/OADC=Yc?J9_Q1C=A=w2Q1h1QR02/4369\?Q10^A=9U02/40^Ak369U7nN19@?BAD9KSC[7T<SC=QR<SCD9U7UZ
" B B%@U B8MNSTU #SK20&IU3EIUWX90^AM/40S0gKS36I_<>9UK8A;CD9UL89UN1902YECn0SQR0&0gKS3y/1K8uaYEA=IUCD/4A=Y6Q1027k7=KSY6N/10^A=9U7UZ
k

%$

l[ 

&('+]")&)

N` S+

,y9PADC=Y^L8K+<S36K27!h1C[/402L]I36IWX9U0RA*<2/4CDWXY n(n1)/2 ?Q1t8A[/40^A!CD93c/OA=Y6N19UWX90^A!?[wS9C@l Q10]3EKSY^<SCDIJiUC=9(LV- /4KSA=CD9U7


7FADCD/4A=IUh1Y69U7n<S36K27nIU?Q10SQRWXY6`^KS9@7 ! j2/136/5^/4h19]?J58?J36Yc`RK29]QRK&?[w2Q1YEup/N19@?\7=9KSY63 $

"


   

,!/]WXIJA=w2QgLS9;L89 R/R?JQRjSYg<SC=I@7:9U0^A=9kLV- 9JuS?J9U3E3690^A=9@7<>9UC:QRC=W/102?J9@7*<fQ1K2C(L89U7PW/4A=CDY6?9U7#<S369Y60S9U7(LS9n/4Y6jS3E9


L8YEWX9U027:Y6Q10 ! AF5g<SYc`^KS9WX90^AmY608ICDYE9UKSCD9Xo "87D7D$JZfd]/4027_369?/R7\hRI0SIUCD/13HlfQ103EK2YP<SC=IICD9C[/e3c/aWXIA=wSQ8L89
 !q  ?JYEb /4<SCDiU7 $BZ


X

+J'T%&z$& 'Gn**+)J& +k'(*k%pv&#"+pk MJk r%p)!!zp'Tkv)[#n#kk




l 



"!

"

 

 "

Q1KSCTKS0S9]W/OADC=Yc?J9]7:5gWXIJADC=Yc`^KS9 A lg369]`^KSQ1A=Y690^ATLS9  /5g369Y6h1w9@7FAn3E9\CD/1<S<fQ1C=ATL8I20SY<>QRKSCGA=Q1KSATNR9U?BAD9KSC


<>/4C
x 6= 0

xT Ax
xT x

A (x) =

\| 0 N1IUC=Y29Y6WXWqI@L8Yc/OA=9UWX90^Aq`^KS9a7=Y x 9U7:AzN19@?BAD9KSC+<2C=QR<SC=9Rly369a`^KSQ4ADYE9U0RAqL89  /5g369Y6h1wQ1KSCD0SYEA3c/rNO/4369KSC


<SCDQ1<SCD9m/17D7:Q8?YEIU9S9U0p9f9A Ax = x x Ax = x x Z
& Y
9JA 7:QR0RAGC=9@7:<f9U?JA=Y6N19WX9U0RAT36/+<S3EK>7.<f9JADY~AD9\9AG3c/+<S36K27Gh1C[/402L89MN/13E9UKSC.<2C=QR<SC=9\L89 A lR9A x l x 369U7
N19@?BAD9KSC[7n<SCDQ1<SCD9U7n/17D7=Qg?YEI@7lgQR0&/qIh^/4369WX90^Ak369U7nCDIU7=KS3~A[/OA[7k7:KSY6NO/40^AD7 
T

1 = A (x1 ) = minn {A (x)}


xR

n = A (xn ) = maxn {A (x)}

d\9m<S3EK>7l27=Yy369U7nNO/4369K2CD7n<SCDQ1<2C=9@7T7=Q10^AkC[/40ShRI9U7TLS/1027k3 - QRCDL8CD9_?JCDQ1Yc7=7D/40^AUlgQR0&/
xR

1 = min{max{A (x)}}
Si

Q+,

xSi

n = max{ min {A (x)}}

Si1 xSi1

@9 7FAkKS07=Q1K27:b 9U7=<2/1?9]`^KS9U36?Q102`^KS9mL89mL8Y6WX9027=YEQR0 i Z
,y9X7=Q1K27:b 9@7:<>/1?J9 <fQ1K2C\369U`^KS9U3#369X`RK2Q4A=Y690^AmL89  /5g3E9UYEhRw9U7:A]W/Ou8Y6WzKSW9@7FA]3E9X7=Q1K27:b 9@7:<>/1?J9z<SC=QR<SCD9
/17D7=Qg?YEIG/4K8u i <SC=9UWXYEiUSC=9@7VNO/4369KSC[7y<SCDQ1<2C=9@7Z,!9G7=Q1K27:b 9U7=<2/1?9P<>QRKSC!369U`^KS9U3RY63R9@7FA*WqY60SY6WzKSW 9@7FA#Q1C=A=wSQRh1QR02/434/1K
7=Q1K27:b 9@7:<>/1?J9M<SC=QR<SCD9\/17D7=Qg?YEI\/4K8u
<SCD9WXY6iCD9U7GN/13E9UKSC[7.<SCDQ1<2C=9@7Z - 9@7FAnL8Q10>?M369]7=Q1K>7Fb 9U7=<2/1?9;902h190>L8C=I
<2/1Ck3E9@7 n i + 1 NR9U?JA=9K2CD7n<SCDQ1<2C=i9@7T/R17=7=Q8?JY6IU7no { } Z
Si

l



 p p
"

"+

$ 
  +*+

L"+%`)&"+

,!/+WqIA=wSQ8L89]L89U7G<SKSYc7D7=/102?J9@7PY~ADICDI9@7(<f9CDWq9ATL89]?/136?KS3E9UC(369MN19@?BAD9KSCG<SC=QR<SCD9;/17D7:Q8?JY6IMom3c/m<S36K27Gh1C[/402LS9
NO/4369KSCk<2C=QR<SC=9RZ
& KS<2<>Q^7:QR027
7:5gWXIJADC=Yc`^KS9mL89mNO/4369KSC[7n<SCDQ1<SCD9U7TQRCDL8QR0S0SIU9U7n7:9U3EQR0
A
|1 | |n1 | < |n |

|\0p?Q1027=YcL8iCD9M3 - YEA=IUCD/4A=Y6Q10&7:KSY6NO/40^A=9]L8I >0SYE9moz<2/4C=A=Y6CkLV- K20aN19@?BAD9KSCnY60SY~ADY6/13 q L8Q10S02I1l^A=9U3y`RK29 kq k = 1 lg9JA


0!- 9@7FA;<2/R7nQ1C=A=wSQRh1QR02/43o v l23E9_N19@?BAD9KSCk<SCDQ1<2C=9_/17D7:Q8?YEImoq36/q<S36K27khRCD/102L89]NO/4369KSCk<SCDQ1<2C=9]Y67=Q136I9 
q
0

P/4CkCDIU?KSC=CD90>?J91lgQR0pWXQ10^ADC=9m`^KS9

xk+1 = Aqk
xk+1
qk+1 =
kxk+1 k
qk =

Ak q0
kAk q0 k

  

    

W K  


9AM?JQRWqWX9_369U7nN19@?BAD9KSC[7n<SCDQ1<SCD9U7




{v 1 v n }
q0 =

9A

 

4 

Q1CDWX90^AkKS0S9mj2/R7:9mL89
n
X

i v i ,

vn +

l8QR0&<f9KSA;IU?JCDY6C=9

n 6= 0

i=1

Ak q0 = n kn

Rn

n1
X
i=1

i
n

i
n

k

vi

!, Q1C[7=`^KS9 k l!369U7mC[/4<2<>QRC:A[7   A=90>L890^AzNR9C[7 7r<>QRKSC i 6= n l*?9a`^KSY.7=YEhR0SY29a`^KS93c/7:K2Y~AD9eL89U7


YEA=IUC=I@7 {q } ?JQ10gNR9CDh19mN19UCD7\369zN19@?BAD9KSC]<SCDQ1<SCD9 v ZV|\0}<>9UK8AmWqQR0^A=CD9C\LS9<S36K27]`^KS9 kAq k A=9U02LNR9C[7
9AM`^KS9_36/X?JQR0gN19CDh19U02?J9]9U7:Ak3EY60SI@/4Y6C=9mL89]AD/1K8u 7:Y 6= 0 Z
i
n

%$

l

n1
n



 p 
" "+ $ 
 c+]+

n1

L"+%c !")&(+]"+

Q1K2Ck3E9@7kWXWX9U7nC[/4Yc7:QR027Ul^3 - Y~ADIC[/OA=Y6Q10

Axk+1 = qk
xk+1
qk+1 =
kxk+1 k

/NR9U? kq k = 1 lg9JA q 0y- 9U7:AT<>/17GQ1C=A=wSQRh1Q10>/43>o v l8?JQ10gNR9CDh19;NR9C[7(3c/zL8Y6C=9@?BADYEQR0aL8KaNR9U?JA=9K2CG<SCDQ1<2C=9]/17D7:Q8?JY6I


oq3c/q<S3EK>7k<>9A=YEA=9mNO/4369K2Ck<SC=QR<SCD91Z
0

l

j"

N& 

"+

1Zkxk??I36IC[/OA=Y6Q10{<2/1C KPA+QWJOQ T@(V3c/pW/4A=CDY6?9 A + I /&3E9@7_WXWX9U7mNR9U?JA=9K2CD7]<SCDQ1<SCD9U7_`^KS9 A 9JAz7=9U7


NO/4369KSC[7+<SCDQ1<2C=9@7m7:QR0RAqL8IU?U/436I9U7zL89e3c/`RK>/40^A=YEA=I Z,!/rWXIJADwSQ8L89pL89@7+<SK2Y67D7=/102?J9@7mYEA=ICDI9@7mY60^NR9C[7:9@7
?JQR0^NR9CDh19XLV- /4K8A[/40^Am<S3EK>7mNgY~AD9e`RK293E9@7mCD/1<S<fQ1C=AD7   A=9U02L890^A+C[/4<SYcL89UWq9U0^A_NR9C[7-7SZ#|\0/L8QR02?
YE0^ADIC JA]o?9`^KS9
7=Q1YEAM3E9z<S3EK>7;<SCDQ8?[wS9+<fQR7D7:Y6jS369zL849 72l29JA]L89z<S36K27Ul23c/WXIJADwSQ8L897=9C[/LV- /4K8A[/40^A
<S36K27nCD/1<SYcL89]`^KS9_3 k- I@?/1kC:An90^A=CD9_3E9@7nL89K8up<S3EK>7n<>9A=YEA=9U7nNO/13E9UKSCD7T<SCDQ1<2C=9@7G7=9m?JCD9K27=91Z8,!/zA=9@?[wS0SYc`^KS9mL8K
L8IU?U/43c/4hR9;?JQ10>7:Yc7FAD9ML8QR02?;omCD9WX<S3c/1?9C <>/4C
l^/N19@?
Z .3EK27G3 - 9@7FADYEW/OADYEQR0eL89 7=9C[/
O
<SCDIU?JYc7=91lV<S36K27m3c/?JQR0^NR9CDh19U02?J9q7:9UCD/&C[/4A<SYcL891Zy*AQ1+KSA=I9JQRY67UlVY63P/4K8Az
`^KS9 6= <fQ1KSCzINgY~AD9C+`^KS93c/
W/OA=CDYc?J9_0S9+L89UN^Y69020S9+7:Y60ShRKS3EY6iCD9
8Zk!9@?[wS0SYc`^KS9;L89  P QB8MOSVU(O36/_WXIJADwSQ8L89;L89@7<SKSYc7=7D/402?9U7YEA=IUC=IU9U7<f9K8A A=CD9TIA=9U02L8KS9k<fQ1KSCP<f9CDWX9JA=A=CD9
3E9+?U/43c?JKS3yLS9_A=Q1KSA=9U7n369U7;N/13E9UKSC[7G<2C=QR<SC=9@7nLV- K20S9mW/OA=CDYc?J9m7:5gWXIJADC=Yc`^KS91Z & KS<S<fQR7=Q1027n9U0&9f9AM?/136?KS3EIU9
36/e<S3EK>7kh1C[/402LS9mN/13E9UKSCk<SCDQ1<SCD9 /1YE0>7:Y!`^Ky- KS0NR9U?BAD9KSCk<2C=QR<SC=9+/R7=7=Q8?JY6I v Z & Q1YEA P 3c/X3c/XWX/4A=CDY6?9
ZR,!/]W/OA=CDYc?J9
<>Q^7=7=iUL89n369U7PXW UWq9@7N19@?BA=9UKSC[7
L89k<SCDQ F9@?BA=Y6Q10qQ1C=A=w2Q1h1QR02/4369G7=KSC(3 - w^5g<f9CD<S3c/40
<SCDQ1<SCD9U7P`^KS9 A 9A.3E9@7PXW WX9U7(N/13E9UKSC[7<SC=QR<SCD9U(v7o_)3H- 9JuS?9<8ADYEQR0XLS9 P `^AKSYS9@7FA(CD9WX<S3c/1?I9n<2/4C 72Z1,(- /4<Sb
<S36Y6?U/OA=Y6Q10pL89;3c/mWXIJA=w2QgLS9\L89@7(<SKSYc7D7=/102?J9@7PY~ADICDI9@7.o P A <f9CDWX9JA:ADCD/zL8Q102?ML89\?U/43c?JKS369C(3c/+L89UK8u8YEiUWX9
<S36K27zhRCD/102L89eNO/13E9UKSCz<SCDQ1<2C=9eL89 A Z 9JA=A=9eAD9U?[wS02Y6`^KS9Rl#L8YEA=9&L89pLSI >/4A=Y6Q10yl*<>9UC=WX9JAA=wSIUQ1CDY6`^KS9UWX90^A
L89e?/136?KS369C_A=QRK8A=9@7_3E9@7_NO/4369KSC[7_<SCDQ1<SCD9U7_L89 Zy(363E99@7FA_A=QRK8A=9Q1Yc7m0gKSWXICDY6`^KS9UWX90^AmYE027:AD/1jS369X7D/40>7
<SCDIU?/1K8A=Y6Q10>7l>9JA_Q1036KSY<SC=IICD9C[/Xh1IU0SIC[/4369WXA90^AM3c/WXIJADwSQ8L89XL89U7\<SKSYc7=7D/40>?J9U7Mh1CDQ1KS<fI9@7k<SCDIU7=90^A=IU9
?JYEb /1<SCDiU7UZ
"



1
2







&% )J!*+&'Gk 1+#"+%pkk T T p"$& 0


|\0m<f9K8A#h1IU0SIC[/436Y67=9CV3c/nWXIJADwSQ8L89.L89@7y<SKSYc7D7=/102?J9@7VY~ADICDI9@7yo;L89@7yYEA=IC[/OADYEQR027VL8YEA=9@7!hRC=QRKS<>IU9U7UlB<>9UC=WX9A:AD/10^A
Ly- YcL890^ADY29UC+369U7mNR9U?BAD9KSC[7_<SCDQ1<SCD9U7_/R7=7=Q8?JY6IU7m/4KSu p <S36K27mh1C[/40>L89U7_NO/4369K2CD7_<SCDQ1<2C=9@7ZVx ?[w2/R`^KS9XY~ADIC[/OA=Y6Q10!l



   

Q10 /4<S<S36Yc`RK2936/ A=C[/4027:Q1CDW/OA=Y6Q10 A o ?[w2/1?KS0 8L 9U7pN19@?BAD9KSC[7Q1C=A=w2Q10SQRC=WXIU7Ul(9AaQ10 QRC:ADwSQ1hRQ102/13EYc7:9 ! <2/4C


]3 C[/4Wqb & ?[wSWXY6LgAkQRKMQ1K27=9w2Q13cL89C@l q  ?[w2/1<SY~ADC=9 $.369+7=5g7:A=iUWX9]CDIU7=KS3EAD/10RA@Z
G 

`)& N
 S

p"+

$ 
  +*+

L"+%`)&)"+

QRY~A {q q } KS07=587FADiWX9mL89 p NR9U?JA=9K2CD7nQRC:ADwSQ10SQRC=WXI@7.QRj8A=9U0^Koq3 - YEA=IUCD/4A=Y6Q10


 ?JQ10>7FADC=KSY6CD9\369+7:587:A=iUWq9 {Aq Aq }
 ?/43c?JK23E9UCk3E9@7k`RK2Q4A=Y690^A[7kL89  /5g3E9UYEhRw
 = q Aq , 1 i p
9  max kAq q k < T ol
 A=9U7:A=9UCk36/X?Q10gN19UC=hR902?
 Q1C=A=wSQRh1Q10>/436Y67=9C {Aq Aq } {q
q
}
&

(k)
1

(k)
p

(k)
1

G

(k)
1



 p p
"

(k)
p

1ip
(k)
p

(k)
i

(k) T
i
(k)
i i

(k+1)
1

(k)
i

(k+1)
p

 

!, /zWXIJA=w2QgLS9  ?Q1CDC=9@7:<fQ10>L/4Ka?U/17 p = n 87:QRY~A Q 3c/+W/OADC=Yc?J9 ! n n$(L8QR0^AG369U7n?JQR3EQR0S0S9U7G7:QR0^AG369U7


N19@?BAD9KSC[7kQ1C=A=w2Q1h1QR02/4KSu q 9JA]7:QRY~A A = Q AQ 3c/C=9U<SCDIU7=90^AD/4A=Y6Q10rL89 A 7=KSC;3c/Xj2/17=9zL89@7 {q } Z|\0
<f9K8AMI@?JCDYECD9_/436Q1C[7 ! 3]CD/1Wqb & ?[w2WqYcLgA $
k

(k)
i

Q+,

T
k

(k)
i

AQk = Qk+1 Rk+1

9@7FAkADC=Yc/40ShRKS3c/4Y6C=9_7:K2<>IUC=Y69KSCD91ZgPA]/4Y6027:Y

Rk+1

Ak = QTk Qk+1 Rk+1 = QRk+1


Ak+1 = QTk+1 AQk+1 = Rk+1 QTk Qk+1 = Rk+1 Q

(0 CDIU7=KSWXI1l 9U7:A36/W/OADC=Yc?J9&Q1C=A=wSQRh1QR02/4369&`^KSYk<f9CDWX9JAaL89rADC=Yc/402h1KS3c/4CDY67=9C 9AeQ10sIU?JCDYEA


9U0
Y60^NR9C[7=/10^AT369m<SQCDQgLSKSY~A QR ZS,!/qWXIJADwSQ8L89  <SCD902L&/436Q1C[7T36/Q1CDWX9_<2/4C=A=Yc?JKS36Y6iCDA9WX90^A;7:Y6WX<S369+7:KSQY6NO/40^A=9
 A =A
 A = QR ! <2/1C3]CD/1Wb & ?[wSWXYcLgAk<2/4Ck9u89WX<S369%$
 A = RQ
 A=9U7:AM7=KSCk3E9_<S36K27khRCD/102LpI36IWX90^Ak0SQ10L8Yc/4hRQ102/13
|\j27=9CDN1QR027n`RK29
l2?J9m`^KSYyY6WX<S36Y6`^KS9z`^KS9_369U7kW/OADC=Yc?J9@7k7:QR0^ATADQ1K8AD9U7;7=9WjS3c/4jS369U7n9AM`RK29m36/
7=KSY~AD9L89U7\W/OA=CDYc?JA9U7 Q =?Q1Q0gN19UAC=hR9+QN19UCD7\36/aW/OA=CDYc?J9XL89U7]N19@?BAD9KSC[7M<2C=QR<SC=9@7Zf,!/pW/OA=CDYc?J9 A ?Q10gN19UC=hR9+N19UCD7
KS0S9mW/4A=CDY6?9_LSY6/1h1Q10>/4369\DQ ,p369U7kNO/13E9UKSCD7T<SCDQ1<2C=9@7T7=Q10^AkC[/40ShRI9U7nLS/1027n3 - QRCDL8CD9mL8IU?C=QRY67D7D/40^A ! *Y6h1K2C=9 Z + $JZ
,y9@7n<>9UC:QRC=W/102?J9@7T7=Q10^A;?JQR027=Y6L8IUCD/1jS369WX90^Ak/4WXI36YEQRC=IU9U7n7=YyQ10&YE0^ADih1CD9mL89KSuaWXQgLSY >?U/OADYEQR027 
  PA+Q JNQ T@ L89a3c/WX/4A=CDY6?9a9U0 <SCD902/10RAX?JQRWqWX9&/4<S<SCDQu8YEW/4A=Y6Q10 L89&36/}<S36K27q<>9A=YEA=9&N/13E9UKSCq<SC=QR<SCD9
3H- I36IWX90^A ! n n$nL89 A
=
A
 C[/4027:Q1CDW/OA=Y6Q10a<SC=I@/43c/4jS369\LS9 A 9U0aKS0S9_W/OADC=Yc?J9 B C:M MOQ VSTUKQWJN@fZ8,y9@7GW/4A=CDY6?9U7 A C=9@7FAD90^AnA=CDY6L8Yc/Ob
h1Q10>/4369U7T9JA;3 - QRC:ADwSQ1hRQ102/13EYc7D/OA=Y6Q10e7U- 9J9U?BADKS9m90 O(n) 2Q1<27UZ
k

k+1

k+1

k+1





X

en'G)J'Tk
@DC:ADMNA+@ /1[2 "RZ & Q1YEA
9JA L89UK8u{CDI9U367z9JA KS0S9pWX/4A=CDY6?9a?/1C=CDI9RZQR0^A=CD9Cz`^KS9&7:Y 9@7FAN/13E9UKSC
<SCDQ1<SCD9mL89 D l2/13EQRCD7 a + ba9@7FA;KSb029mN/13E9UKSCn<SCDQ1<SCDD9mL89 aD + bI l8QD, I 9@7FAk3c/XW/OA=CDYc?J9]Y6L89U0^A=YEA=I1Z
8Z & QRY~A D 36/XW/4A=CDY6?9_?U/4CDC=IU9MADC=YcL8Yc/4hRQ102/13E9]L8I 202YE9m<2/1C


dii = 0, i = 1, . . . , n
di,i+1 = di+1,i = 1, i = 1, . . . , n 1

dij = 0,

/4Y63E369K2CD7 .

 W  


-K K 



QRKSC

j = 1, . . . , n

lS7:QRY~A

Z  L8Yc/4hRQ102/13EYc7D/OA=Y6Q10&LV- KS0S9mW/OADC=Yc?J9
x(j)

369mN19@?BAD9KSC;L89

Rn
(j)

Q10^A=CD9Ck`^KS9

xi

x(j)

9U7:AkKS0rN19@?BA=9UKSCk<SCDQ1<SCD9_L89

<2/1C  LV- /4<2C=i@7

5 9

L8Q10^Ak3c/ i iWX9_?JQ1WX<fQR7D/40^A=9_9@7FA
= sin 2i

j
.
n+1

/R7=7=Q8?JY6I9moq36/qNO/4369K2Ck<SC=QR<SCD9

j = 2 cos 2

j
.
n+1

2Z .0rLSIUL8KSY6CD9]369U7;N19U?JA=9UKSCD7T<SCDQ1<2C=9@7G9A;3E9@7nNO/4369KSC[7n<SCDQ1<SCD9U7nL89m3c/qWX/4A=CDY6?9


44

7:K2YENO/40^AD9

H

@C:A+MNAD@ /)1



MNB8@ K
 @ M

2 1
0
0
1
2 1
0

A=
0 1
2 1
0
0 1
2

{|\0?JQ10>7:YcL8iCD9]36/X7=KSY~AD9 1 l 1 l 2 l 3 l 5 l 8 l 13 lVZ6Z6Z2L8I >0SYE9m<>/4C

SVUKQWA+ADM

u0 = 1, u1 = 1,
uk = uk1 + uk2 ,

k 2.

/136?KS369CkKS0S9_NO/4369K2C;/4<S<SCDQ8?[wSI9_L89 u lS90rK8ADYE36Yc7=/10RAk369U7k<2KSY67D7D/402?9U7TY~ADICDI9@7Z
@C:A+MNAD@ /)1
& Q1YEA
9JA L89K8upN19U?JA=9UKSCD7T0SQR0&?Q136YE02IU/4Y6CD9U7nL89 R ZSd\IJA=9UC=WXY60S9Ck369U7nNR9U?JA=9K2CD7T<SCDQ1<SCD9U7T9A
369U7nNO/13E9UKSCD7n<2C=QR<SC=9@7nL8a9m36/qbW/OADC=Yc?J9 n n
k

A = aaT + bbT .


   

@DC:ADMNA+@ /1  SVU  @DC T@U AD@ K@ JNQIF PB  S  @ K@ QWA+S KM  & Q1YEA
l23c/7:QRWXWq9+LS9zL89KSu
W/OADC=Yc?J9@7k7:5gWXIJADC=Yc`^KS9U7UZS,y9@7nN/13E9UKSC[7n<SC=QR<SCD9U7nL89m?J9@7nA=CDQ1Yc7TWX/4A=CDY6?9U7k7=Q10^AAk0S=Q4ADAI9@7 + E






01 02 0n ,

1 2 n ,

1Z QR0RADC=9UCn3E9@7k<SCDQ1<SCDYEIA=I@7T7=KSY6NO/40^A=9@7n<>QRKSCnA=QRK8A
"

1 2 n .

i = 1, . . . , n
 M  + +
 MOM | | k E k lS`^KS936369+`RK29_7=Q1YEA;3c/02Q1CDWq9_W/OADC=Yc?JY6936369 k k Z
i

0
i

0
i

8 Z & QRY~A
lSQD,&369U7
7=Q10^A;369U7kW/OADC=Yc?J9@7n90ShR902LSC=IU9U7n<2/1Ck36/XWXIJADwSQ8L89zL89
^/1?JQRjSY ZV(0 K8A=EY636Y67D/40^=A+A3c/p02Q1CDWqdiag(a
9 k E k) = (ADCD/R?JA9 (E E)) lyWXQ10^A=CD9Cm`^KS9 E A=90>LNR9C[7_36/&W/OADC=Yc?J9
0gKS363E9RlS3EQRCD7D`^KS9 k 7 Z
SZ (0L8I@L8KSY6C=9m369]A=wSIUQ1CDiWX9mL89+?JQR0^NR9CDh19U02?J9]L89m36/qWXIJADwSQ8L89+L89 ^/1?JQRjSY l8YHZ 91Z
 M  a 0 l8<fQ1KSC i 6= j
 MOM}?[w2/1`^KS9 a lS+Q , 9U7:A;KS0S9mNO/4369KSCn<SCDQ1<2C=9mL89 A Z
i

(k)

(k)
ii

(k)

(k)

1/2

(k)



(k)
ij

(k)
ii

@DC:ADMNA+@ /1f/ & KS<S<fQR7=Q1027k?U/43c?JKS36I9m3c/q<S3EK>7;h1C[/40>L89\NO/13E9UKSC;<SCDQ1<SCD9


Ly- KS029mWX/4A=CDY6?9+7:5gWXIJADC=Yc`^KS9 A 9JA

369mN19U?JA=9UKSCk<SCDQ1<SCD9]/R7=7=Q8?JY6I v Z
"1Z
KS9U3E369_9U7:A;36/qW/OADC=Yc?J9 L89m<SCDQ F9U?JA=Y6Q10&Q1C=A=wSQRh1QR02/4369\7=KSC Z
8Z QR0RADC=9UC]`^KS9 P A /p3E9@P7_WXWX9U7_NR9U?BAD9KSC[7]<SCDQ1<SCD9U7]`^KS9 Avlyo&3H- 9JuS?J9U<8A=Y6Q10{L89 v Z KS9363E9@7_7:QR0RA
369U7]NO/4369KSC[7M<2C=QR<SC=9@7ML89 P A ZV.0L8I@L8KSY6C=9qKS0S9q<SCD9WXYEiUC=9WXIJA=w2QgLS9qL89X?/136?KS3L89U7]<S36K27\h1C[/402L89@7MNO/13E9UKSCD7
<SCDQ1<SCD9U7nL89 A Z
1

  o~

 
 

a
l 

  m

_ 

  _  

!#"$&%&'(*)"+
 

u S

TY690 `^KS9X3E9@7_0SQ4ADYEQR027mL8INR936Q1<S<fI9@7_LS/4027m?9e?[w2/4<2Y~ADC=9X7:QRYE9U0^A]ADC=i@7_h1IU0SIC[/4369U7Ul>QR00S9?JQ10>7:YcL8ICD9C[/eYc?JY
`^KS9_369+?/R7kL89U7F QWB C:MNAD@=X=8RF PB C:M HK@=1Z

,P]-KUKMLB%MNSTU)1[2  QB C:MOA+@ K


 P]-KUKMN@?
ST=%MLB8M  @
R
'

$
)
(

$
`
*
g
T
c
E
N
A
:
5
'
?
m
E
:
5

7
f
^
F
5
s
;
m
5
L
K
?

E
A
%&

KY5<;b=?3@BA3CD5 Cm=@c@DH 5

M*5kMOA_;s5FK(E AJ8K

5FEI?

"! # $T

(x Rn , x 6= 0) xT Ax > 0
=%@F M  KP]-KUKMN@X? SV=%MLB%M  @
 P]-U MO@=>UKP VQWB8M  @= =%@F M  KP]-KUKMN@= UKP V QB%M  ! @ <=

,!Q1C[7=`^KS9M3H- YE02IhR/13EYEA=I\9U7:AG3c/4CDh19Rl1Q10a<2/4CD3E9]L89MW/4A=CDY6?9
$G<f9CDWX9JAML89+L8I 20SY6Ck3E9@7k0SQ1A=Y6Q1027kL89_W/OADC=Yc?J9@7

l 

,+"



_9JA

fZ^,(- YE0SIUhR/13EYEA=I;Y60gN19UCD7=9

RZ

QRK

$  "+

1Z- m/.10325476@sci98".[i/:<;6.s=214> 7=Q1YEA f : R R R K20S9.QRC=WX9 KMOJNMOU PQWMNC @]L8I20SY69G<2/1C f (x, y) = x Ay l


Q+, A 9@7FAnKS0S9]W/OA=CDYc?J9 ! n n$JZ8,yQ1C[7D`RK29 A 9@7FAn7:5gWXIJADC=Yc`^KS91l^Q10p3EK2Y/R7=7=Q8?JY69;3c/+QR02?BADYEQR0 q lg/4<S<f936I9
 S C:F @? HKQ  C QWB8M HK@fl>L89 R LS/40>7 R l2L8I >0SYE9m<>/4C
"

&

90

(x Rn ) q(x) = xT Ax

Y A 9@7FA.LSI 20SY69k<fQR7=Y~ADYENR91l q 9U7:A.o_N/13E9UKSC[7<>Q^7:YEA=Y6N19@79JA(9Ju8wSY6jf9;L8Q102?nK20qK20SY6`^KS9k<fQ1Y60^AGL89kWXY60SYEWKSW


lS+Q ,&936369_7U- /40S0gKS3691Z`P/4Ck9u89WX<S3691l2?1- 9@7FAk369+?/17kLS9]3c/qQ10>?BA=Y6Q10r?/1C=CDI_L89m36/q0SQRC=WX9
x=0
q(x) = kxk2

L8Q10>?m36/qW/OADC=Yc?J9mYcL89U0RADY~ADI I 9@7FA\LSI 20SY69m<fQR7=Y~ADYENR91Zf|\0rN19UC=C[/XLS/40>7n36/7=KSYEA=9z`^KS9 q 9U7:A;KS0S9_QR02?BADYEQR0


 @]@fZ
Q1YEAMLS/1027 R 36/QR02?BADYEQR0
/NR9U? A = 1 1
q(x) = x + 2x + 2x x = x Ax,

A+STU
&

2
1

2
2

1 2

1 2

\| 0pQRj27=9CDN19M7=KSCk?J9AT9ug9UWX<S3E9_`^KS9]A=QRK8A=9\Q1CDWX9]`^K2/RL8CD/4A=Yc`^KS9 q(x) = X X q x x <f9K8A;7U- I@?JCDYECD9


L89]WX/10SY6iCD9MKS0SYc`^KS9_7:QRK27.3c/zQ1CDWq9 x Ax lS/N19U? A 7=5^WXIA=CDY6`^KS9RZ  3V7=K<XAnLS9\<2/1C:A[/4hR9C(IUhR/4369WX9U0RAT3E9
ij i j



  

A=9CDWX9m?JCDQ1Yc7:I q x x /N19@? a = a
|\0p<f9K8A\Wq9A:ADC=9 q 7:QRK27n36/QRC=WX9
ij i j

ij

ji

qij
2 ,

i 6= j

)   K

 4


!



     K

 

q(x) = (x1 + x2 )2 + x22 0

`RK2YR0S9T7- /4020^K23E9T`RK!- 9U0 ! 27 l 7$BZdMQR02?(3c/nQ1CDWX9 q 9@7FAL8I 202YE9G<>Q^7:YEA=Y6N19T/4Y6027:Yg`^KS9.3c/kW/OADC=Yc?J9 A /17D7=Qg?YEIU91Z

SZ

i/:<.1;_q 2 : .1;8";_i mgivo 2 892Ao  2


2 0Kego 238 254 . 214 4.m".1:<4 8vs   >

A = 1

ZZZ

n
n1

X
X

2x2i 2
xi xi+1 .
q(x) =
1
i=1
i=1
1 2

|\CUl q <>9UK8AJADC=9_WXYc7:9+7=Q1K27T3c/qQ1CDWX9_Ly- KS029+7:QRWqWX9mL89m?/1C=CDIU7

q(x) = x21 + (x1 x2 )2 + + (xn1 xn )2 + x2n

36/rW/OADC=Yc?J9XIAD/40^A+0SQR0 7:Y60Sh1K23EY6iCD91lV9U3E3699U7:AzL8I >0SYE9a<>Q^7:YEA=Y6N19RZ*|\0{CD9JADC=QRKSN19XYc?JY./1K ?JQg9 <e?JY690^Am<SCDiU7


3H- 9Ju8<SCD9U7D7:Y6Q10&L89m3 - IU0S9CDh1Y69\WXI@?/402Y6`^KS9mL8K7=5g7:A=iUWX9+L89U7nCD9U7D7:QRC:A[7Z
2Z m/; 8/.)214Kqri".1.[h54 @7=Q1YEA B KS0S9.W/4A=CDY6?9 ! pn$A=9U3E369G`^KS9 rang(B) = n Z@xM3EQRCD7!36/;WX/4A=CDY6?9 A = B B
9U7:A\L8I >0SYE9z<>Q^7:YEA=Y6N19RZf|\0rC=9A=CDQ1KSNR9]3c/W/OADC=Yc?J9+LSK7:587:A=iWX9+L89@7kIU`^K2/4A=Y6Q1027;0SQ1CDW/4369U7 !q  ?[w2/1<SYEA=CD9
$BZ & Y
0y- 9U7:A;<2/17kL89mC[/402h<S369Y60yl A 9@7FA;7=9KS369WX90^AM7=9WXYEb L8I 20SY69_<>Q^7:YEA=Y6N19RZ
B


e[

m+'.*n#)!_*)"+ $&k

l 

 +]"

Pu89WX<S369



+.+ m'&

" p"

_!)J'Tk $&&&)Jk {"+!)[#) +k


 q&&+

q(x) = 10x21 + 5x22 + 2x23 + 4x1 x2 2x2 x3 + 6x3 x1


= (x1 + 2x2 )2 + (x2 x3 )2 + (3x1 + x3 )2

10 2
3
5 1
= xT Ax
A=2
3 1 2

/NR9U?

\d Q102? A 9@7FA;7=9WXY~b L8I20SY69m<>Q^7:YEA=Y6N19RZ


" B B%@U B%MNSTU(Q1K2C(WXQ10^A=CD9C.`^KS9M36/_W/OADC=Yc?J9M9U7:A.L8I 202YE9\<>Q^7:YEA=Y6N19Rl4YE32/4K8AGWqQR0^A=CD9C.`^Ky- 9363E9M9U7:AGL89;<S36K27
0SQR0r7=Y60Sh1KS36Y6iCD9 ! ?J9+`^KSYy9@7FAk369+?/17k?Y~b L89@7=7=K27 $BZ

l



"&(+

PS C F @?)1[2



vqJ:EcA[?[A[t:5FE 

$&S$&"+$6S+* !"+





KY5 ;b=`?3@BA[CF5gE ;sH8?[@cA[h`7]5<M*H KA5vNJE AP?3APt85vNJEcEFe M`5<M*5DE tD=^f5:7@BEvL@DJDvL@D5FEEI?3@BA3C ?Q5m;s5FKY?

wyxz{|} ~L]~{|

RZ & SK <S<fQR7=Q1027 A 7=5^WXIA=CDY6`^KS9nL8I >0SYE9n<fQR7=Y~ADYENR91Z & QRY~A KS0S9nNO/4369KSC<SCDQ1<SCD9G/R7=7=Q8?JY6I9n/4KN19U?JA=9UKSC<SC=QR<SCD9


Zf|\0&/XL8QR02? Ax = x l89JA x Ax = x x = kx k > 0
x
"

i i

T
i

T
i i



    

   K

4   '
    K  4


     K
!

 


8Z  IU?YE<2C=Q8`^KS9WX9U0RA@l17=Y8A=QRK8A=9@7P3E9@7PNO/4369KSC[7<SCDQ1<SCD9U77=Q10^A(<fQR7=Y~ADYENR9U7UlOQ10/]<>QRKSCPA=QRK8A(N19@?BAD9KSCP<SCDQ1<2C=9 x
Z 9U7]L89CD0SY69C[7nQ1CDW/40^A\KS029zj2/R7:9+QRC:ADwSQ102Q1CDWqIU9 ![q ?[w2/1<SY~ADC=9 $BlfQ10I@?JCDY~A]<>QRKSC;ADQ1K8A
x Ax > 0
T
i

x 6= 0

n
X

x Ax =

i xi

!T

n
X

i xi

n
X

2i i > 0

P/4Ck9u89WX<S3691lS369U7nNO/4369K2CD7n<SCDQ1<2C=9@7TLS9m36/qW/OADC=Yc?J9mL8K7=5g7:A=iUWX9_LS9U7nCD9U7D7:QRC:A[7T7=Q10^A
i=1

l%$

i=1

(j {1 n}) i = 2 2cos
N&

"+y+]

+

`&( L"+

 q&&+>+

i=1

2j
>0
n+1

`&( p
 "+ $ q
 & & q
 $$6'&`

 

  'S  "

*Q1K8AD9U7z3E9@7+7:QRK27:b W/OADC=Yc?J9@7m?/1C=CDIU7m7=5gWqIA=CDY6`^KS9@7m<2/1C+CD/1<S<fQ1C=Azor36/LSY6/1h1Q10>/4369XLy- KS029eW/OA=CDYc?J9eL8I20SY69


f< QR7=YEA=Y6N19_7:QR0RAnL8I >0SYE9@7T<>Q^7:YEA=Y6N19@7Zg(0&9J9JA@lg7=Q1YEA A K20S9]A=936369]7=Q1K27:b WX/4A=CDY6?91l^?JQ10>7FADY~ADKSI9_L89U7 k <SC=9UWXYEiUC=9@7
36Y6h10S9@7*9A(?JQ136Q1020S9U7LV- KS0S9nW/OADC=Yc?J9 A L8I 202YE9n<fQR7=Y~ADYENR91Z wSQ1Yc7=Y67D7:QR027*KS0NR9U?JA=9K2C x L8QR0^A369U7 nk L89UC=0SY6iCD9U7
?Q1WX<fQR7D/40^A=9@7T7=Q10^Ak0gKS363E9@7 
k

x Ax =

 
xk

= xTk Ak xk
0


 Ak
0

xTk

? 9m`RK2Y!L8IWXQR0RADC=9_3c/q<SC=QR<SCDYEIA=I1Z
(0<2/4C=A=Yc?JK23EY69C@l2KS029?JQR02L8YEA=Y6Q10'UKPA+@=%=8QWMNC:@a<fQ1KSC_`^Ky- KS0S9zW/4A=CDY6?9z7:QRY~A_L8I >0SYE9<>Q^7:YEA=Y6N199U7:A]`^KS93E9@7
IU3EIUWX90^AD7kL8Yc/4hRQ102/1K8ua7=Q1Y690^Ak<>Q^7:YEA=YE7Z
l

N`&(L" 

 

 


 L
 "

  'S  "

,P]-KUKMLB%MNSTU)1  QB C:MOA+@ K


 MNQTSVUKQWJO@
(DTUj/T # ( & U $<#NZ # (FT EcA






PSVCF @?1

STF MNUKQWU B%@




n
X

(i {1 n}) aii >


 5DEl;b=`?3@BA[CF5FE

wyxz{|} ~L*~L{|

KY5!;b=?3@BA3CD5

j=1,j6=i

5DE ?qM.A[?5

|aij |

 P$ Z  & #qZ`XT R (
$ 

MOAf=8dJ8K =^f5pE ?[@cA[CI?5m;s5mKL?M*J:;yA_K =KL?Q5EmJ:KL?!M`H KA5FE!vNJE AP?3APt85DE

6|\0pKSA=Y63EYc7:9+Ly- /1j>QRCDLp36/X7=5gWqIA=CDYE9mL89 A 9A;3E9_/1Y~AM`^KS9

2|xi ||xj | x2i + x2j

<fQ1K2CkIU?JCDY6C=9

X
i6=j

aij xi xj

X
i<j

X
i<j

|aij ||xi ||xj |


|aij |x2i +

X
i<j

|aij |x2j

!, 9]LS9CD0SYE9UCT7=9U?Q102LeWq9UWzjSCD9M<f9KSAk7U- IU?JCDY6C=9 X X |a |x l^9AT3c/<SC=QR<SCDYEIA=I\LS9]L8QRWXYE02/102?J9]L8Yc/4h1QR02/4369


Y6WX<S36Y6`^KS9+`^KS9m?J9_AD9CDWX9]9@7FAM7:A=CDYc?BA=9UWX90^AkYE08IUC=Y69K2C;o X a x l2Ly- QD,
i

2
i

ij

j6=i

2
ii i

X
i6=j

aij xi xj <

aii x2i



  

l[

 ! + $6S+* F+




PS C F @?)1



vqJ:EcA[?[A E 

)   K

 4


!



     K

 

KY5l;>=?3@BA3CD5M*H (KAf5SvNJE AP?3APt85lEm5F@m=<?[@cAf=:K`dY7^f=:@BAaEFH 5!Em=:K(ENvN5F@c; 7?P=?3AJ8K(ES=]t:5 ClM*5DENvA[t:J*?[E

wyxz{|} ~L]~{| & Q1YEA


KS029eW/OA=CDYc?J9eL8I20SY69e<>Q^7:YEA=Y6N19RZ!*Q1K8AD9U7m369U7+7=Q1K>7Fb W/OA=CDYc?J9U7_<2C=Y602?JY6<2/13E9@7m7:QR0RA
8L QR02?rL8I 202YE9@7X<>Q^7:YEA=Y6N19@7 ! AL8Q10>?p02Q107:Y60Sh1K23EY6iCD9U7 $BZ 93c/YEWX<S36Y6`^KS9`^Ky- YE3k9u8Y67:A=9rKS0S9&/R?BA=QRC=Yc7D/OA=Y6Q10 A =
l/N19@? L8Yc/4hRQ102/13E9z9JA A=CDY6/10Sh1K236/1YECD9mYE0SICDYE9UKSC=9RZfd\Q10>?
9A]?[w2/R`RK29zI36IWX9U0RA
LDL
L89 D 7U- I@?JCDY~A xD Ax lSQ+, x 9U7:AnLK20S9m3EY6h1029_LS9 L ZS,y9@7k<SY6N1Q4A[7n7:QRD0RA;=L8QRL02?_<fA(L
QR7=Y~ADY~)7UZ
9+CDIU7=KS3EAD/OA@l>?9C=AD/4Y60S9UWq9U0^A\LV- KS0h1C[/40>LpY60^A=IUC/AM<SC[/OA=Yc`^KS91l>NgYE9U0RA]L8KCDIU7=KS3~A[/OAM<23EK27\h1IU0SIC[/43y7=KSY6NO/40^A
7=Y(Q10IU?C=YEA+KS0S9XQRC=WX9`^K2/1LSCD/4A=Yc`RK29q<>/4CmC[/4<S<fQ1C=A+orKS0S90SQRKSN19U3E369Xj2/17=91lyQR0C=I@/436Y67=9K20S9 A+STU VC:H @UKA+@fZ
l 0SQ107=YE0ShRKS36YEiUC=9RZg,*/qQ1CDWX9_`^K2/RL8C[/OA=Yc`^KS9 q(x) = x Ax
(CD90SQR027k369+?[w2/402h19WX9U0RAkL89mNO/4CDYc/4jS369
L89UN^Y690^A q(y) = y C ACy Zf|\0/q/13EQRxCD7U=l87=Cy
/1027kL8CIUWqQR027:A=C[/OA=Y6Q10 
1

T 1



PS C F @?)1 


STMS#MNUK@C%B%MN@K@
EcA[?[A[t:5FE KYBH d`=`?3APt85DEJ*7<KL7^_^5FEh`7]5

A


RJ  @=8B8@C

= ^f5;srm;s5KYJ:; n:@D56M*5 tD=:^587@mE'vL@DJDvL@D5FE vqJ

C T AC

K2/102L]Q10m<SY6N1Q1A=9(KS029(W/OA=CDYc?J9 7=5gWXIJA=CDYc`RK29(7=/1027V<f9CDWzK8A[/OA=Y6Q10!lQ10m3c/kWX9JA#7:QRK27V3c/nQ1CDWX9
l
/ N19@? D L8Y6/1h1QR02/4369M?JQR0^A=90>/40^A.ADQ1K27GA3E9@7T<SYENRQ4A[7ZgdMQR02?4lg369U7 =%M TU @= K@= ?M  SVB8=_?Q 02?JYcL890^An/N19UA?M?J=9KSLDL
uaL89U7
NO/4369KSC[7n<SCDQ1<SCD9U7 ! WX/1Y67;<2/17n369KSC[7nNO/4369KSC[7 $BZ


l
&

cp"

 q&&()"

 p"

`&( L"

Y A 9@7FAkKS029mWX/4A=CDY6?9mL8I 202YE9m<fQR7=Y~ADYENR91l8Y63y9Ju8Yc7FAD9_KS0S9mW/OADC=Yc?J9_0SQR0&7=YE02h1KS36YEiUC=9 R AD9363E9+`^KS9


A = RT R.

|\0/4<S<f936369]<>/4C=Q1Yc7 R 36/qC[/1?YE0S9m?U/4CDC=IU9]L89 A Z>,y9+?[wSQRY~upLS9 R 0y- 9U7:An<>/17nKS0SYc`^KS9


 /N19U? A = LDL lSQ10&Q1jSA=Y690^A R = D L
 7:QRY~A Q 36/XW/OADC=Yc?J9mL89@7nN19@?BA=9UKSCD7n<2C=QR<SC=9@7l Q AQ = L lSL8Q102? R = L Q
 R = Q L Q /N19U? Q QRC:ADwSQ1hRQ102/13E9
T

1/2

1/2

1/2

@F W
Q C  K
H @ 132  KY5[J8KC ?3AJ8K h*7]=*MO@F=`?[A3h`7]5M`H KA5!vNJE AP?3APt85SvN5:7? r:?3@D5CDJ8K(EcA3M`Hm@DH 5CDJ8;y;s5u7KY55B9?5mK
EcAfJ:K M*
5 ^f= Y
K J8@B;s5u587`CB^_A[MOA5mKKY5u=IvL@DeFEC =:Kd`5m;s5FKY?GM*5 tD=@cAf=n:^5 C`\ 5DE ?M*J:KC=`7OEBEcA 7KY5KYJ:@c;s5


e/.

Ry = x kxk2 = y T RT Ry.

T  &"$p$& &"+Jk q
,(- /1L2/4<8A[/OA=Y6Q10rL89m3c/XWXIJA=w2QgLS9zL8943_/4K>7=7k/1K8upW/OADC=Yc?J9@7k7:5gWXIJADC=Yc`^KS9U7ML8I 202YE9@7k<>Q^7:YEA=Y6N19@7k?JQR02L8KSYEAMoX36/
/1?JA=QRC=Yc7=/4A=Y6Q10&L89 wSQ1369U7 g51Z
Q1WXWX9XYE3(/&IA=IXQ1j27=9CDN1Iq/4K{<2/4C[/4hRCD/1<SwS9+<2C=I@?JIULS90^AUlV3c/e/R?BADQ1CDY67D/OADYEQR0
7U- I@?JCDY~A
/N19@? R A=CDYc/40ShRKS36/1YECD9_7:KS<fICDY69KSCD91ZS,.- /13EhRQ1CDY~ADwSWX9_?Y~b L89@7=7=Q1K27TCD9WX<S3c/1?9]369U7;I36IAWX=90^ADLDL
7 a <2/4=Ck36R9U7kRIU3EIUWX90^AD7

r
9JAM/13EhRQ1CDY~ADwSWX9]LS9W/402LS9 O   2QR<27ZS,!9U7nIU3EIUWq9U0^AD7;L89 R 7=/4A=Yc7FQR0RA;L89_<S36K27


ij

ij

n3
6

2
rij

i
X

2
rik
= aii ,

i, j = 1, . . . , n.

d\Q102?rADQ1K27a3E9@7eIU3EIUWq9U0^AD7aLS9 7=Q10^AajfQ1CD0SIU7e90 WXQ8L8KS369<2/4Cp3E9@7I36IWX9U0RA[7aL8Yc/4hRQ102/1K8u L89 lT?9}`^KSY


?JQR0^A=CDYEjSK29]o36/q7:AD/4j2YE36Y~ADI_0^K2WqIURC=Yc`^KS9_L89\3c/WqIA=wSQ8L89 ! 7=/1027T36/C=9U02L8CD9MADQ4A[/4369WX90^AnYE027=90>7:Y6jS369]/1KaAW/4KSNO/1Y67
?JQR02L8YEA=Y6Q10S029WX90^A $JZ
k=1

 

"



  K

J TS C:MNB
iSTH C

akk



 K

 

 


"

IJADwSQ8L89mL89 wSQ1369U7 g5

F @ /

QWMLC:@
k {1 n}
#1/2
"
k1
X
akk
a2kp

iSTHC

aik

p=1
QWMNC:@
i {k "+ 1 n}
#
k1
X
aip akp
a1kk aik

MNUjiSTHC

MNUjiSVH
a

    

4  K

p=1

p"+p'.*)J"zp X%&+$p#_#) X%pk G' "+ + ek


;M0S9  SVUKAB%MNSTU H Q  C:QB8M< H @&L89
LS/4027 R f< 9K8A\7U- IU?JCDY6C=9_7:QRK27n3c/zQRC=WX9_h1IU0SIC[/4369
R


f (x) = xT Ax + aT x + b

QD, A 9U7:AmKS0S9XW/OADC=Yc?J9X7:5gWXIJADC=Yc`^KS91l a R , b R ZyxMYE0>7:Y lVKS0S9qQ10>?BA=Y6Q10`^K2/1LSCD/4A=Yc`RK29z9U7:Am3H- 9JugAD9027=YEQR0


o R LV- KS0s<>QR3E5g0SRWX9pL8K7:9@?JQR02L L89Uh1CDI1l#9JAQ10 <f9KSAX3c/C=9U<SC=I@7:9U0^A=9Cq?JQRWqWX9&36/{7=Q1WXWX9pLV- KS0S9&Q1CDWX9
`^K2/RL8C[/OA=Yc`^KS9]9JAMLV- KS0S9_QR02?BADYEQR0r/<0S9 ! ?BFZ 2h1KSCD9 Z#"%$
n



lp 

lS Y
 ` S+

,P]-KUKMLB%MNSTU)1

 STU

S"+l"+

LS

A+B8MNSTU

A+STU

@]@

Z#"  QR02?BADYEQR0&`^K2/RL8CD/4A=Yc`^KS9mL89

 

K MOA[?h`7\ 7KY5 [ J:KCI?[AfJ:K




R2

tD=:@BAo=(n:^f5DEp5FEI?

& # *`TqTyEcA

x, x0 Rn , [0, 1]) f (x + (1 )x0 ) f (x) + (1 )f (x0 ).


#"%$
=8B C:MNA+B8@F @U B ADSVU  @]@
!
>0
f

& Y!3H- YE02IhR/13EYEA=I


Z T9U7:A;7FADC=Yc?BAD91lSQR0p<>/4CD3E9mL89]Q10>?BA=Y6Q10
d\9m<S36K27Ul27:YV<fQ1K2CkKS0
2l `^KSYV0S9+L8IU<>9U02Lr`RK29+L89 Q10/

>Z

1
f (x + (1 )x0 ) f (x) + (1 )f (x0 ) (1 )kx x0 k2
2
 SVC B8@F @U B ADSVU  @]@
A+STU ADQ  @
g = f

QR0&LSY~AM`^KS9 f 9U7:A
& Y
9@7FA;?JQR0gN19Ju89Rl^3c/Q102?JA=Y6Q10
f

>Z

9U7:A

>Z

Z" $



  

i C:S ? SV=%MLB%MNSTU

132

 J:Af5FKY?

f1 , f2

M`587:9 [ J:KCI?[AfJ:K(ECFJ:KLt85B9 5DE

)   K

 4


!



     K

 

5FEI?!CDJ8KLt85m9 5
f1 + f 2
5DE ?GCDJ8KLt85m9(5!vqJ*7@

f1
0
5FEI?GCFJ:KYt:5B9 5
W
sup{f1 , f2 }
#D

|\0NO/+CD9JADC=QRKSN19UCPh1IQRWXIJA=CDYc`RK29WX90^A.<2/1C(3 - IA=K2L89_L89@7.?JQRKSCDj>9@7.L89\0SYENR9U/1KXLS9\?J9@7PQR02?BADYEQR027.369;CDIU7=KS3EAD/OA
Q10>LS/4WX90^A[/43y7=KSYENO/10RA


PS C F @?)1f/  KY5 [J8KC ?3AJ8Kh`7.=`MO@F=`?3A[h`7]5b5DE ?gCFJ8KLt:5B9 5yEcAl5:?EF587^5m;s5FKY?E Ap5m^a^5s5FEI?6=EBEmJCcAH 5  7KY5

;b=`?[@cA[CF5 EF5m;yA M`H KA5bvqJ:EcAP?3APt85   A^o= ;b=?3@BA3CD5 5FEI?>M*H KA5bvqJ:EcA[?[A[t:5 =:^J8@mE>^o= [J8KC ?3AJ8K 5DE ? [J8@ ?Q5m;s5FKY?

CFJ:KLt85B9 5



wyxz{|} ~L]~{|  37:KW<qAmL89qWXQ10^A=CD9C_`^KS9z3c/QRC=WX9X`RK>/1L8C[/OADY6`^KS9


/N19@? L8I 202YE9
<fQR7=Y~ADYENR9e9U7:AKS029eQ10>?BA=Y6Q10 ?Q10gN19u891Z A IJAD/10^A7:5gWXIJADC=Yc`^KS91l*9363E9a9U7:AqL8Yc/4hRQ1f02(x)
/13EYc7==/1jSx369X7=AxKSC36/j>/1A7=9aL89a7=9U7
N19@?BAD9KSC[7q<SC=QR<SCD9U7+QRC:ADwSQ102Q1CDWqI@7l#7:QRY~A A = XDX ZPx;<2C=i@7q?[w>/40ShR9WX90^AqLS9&j>/17=9 x = Xy l f 7U- I@?JCDY~A
l!`^KSY(9@7FAz?Q10gN19u89q?U/4Cm7:QRWXWq9eLS9XQ102?JA=Y6Q1027m?/1C=CDI9@7_o&?Qg9 <e?JY690^AD7_<fQR7=YEA=YE7Z#dMQR02? f 9@7FA
g(y) = y Dy
?JQR0gN19Ju89RZ
d\9m<S3EK>7lS<fQ1K2CkKS0S9mW/OADC=Yc?J9mL8I 20SY69m<>Q^7:YEA=Y6N19Rl8Q10r/ 
T

1 kxk2 xT Ax n kxk2

Q , CD9U7=<yZ $k9U7:A_36/a<S3EK>7\<f9JADY~AD9 C=9@7:<!Z>hRCD/102L89%$;NO/4369KSC\<SC=QR<SCD9L89 Z |\0}90L8IUL8K2Y~A ! ?U/43c?JKS3c7MY60^A=9UC:b


+
WXIUL8Yc/4Y6CD! 9U7n3c/4Yc7=7=IU7T90r9ug9UCD?Y6?9%$T`^KS9 f ! 9@7FAnQRC:AD9WX90^A;?JQR0^NR9Ju89_/N19U? =A Z

1



'&

"+ "c$p


"+

PADK2L8Y6Q1027.3H- 9J9JAGLy- KS0p?[w2/40ShR9WX90^A(L89;NO/1C=Yc/4jS369U7P7=KSC(3c/m0SQRC=WX9k9UK2?J36Y6LSYE9U0S0S91Z & Q1YEA KS029;W/OA=CDYc?J9k0SQR0


7=YE0ShRKS36YEiUC=99JA x = By K20?[w2/10Sh19UWq9U0^A]L89N/1C=Yc/4j23E9RZf,!9q?U/4CDC=IzLS9z3c/a0SQRC=WX99K2?3EYcL8Y69B0S0S9q9U7:A\K20S9zQRC=WX9
`^K2/1LSCD/4A=Yc`RK29_LSI 20SY69m<fQR7=Y~ADYENR9_L2/4027 R 
n

kxk2 = xT x = y T B T By = kyk2B

Q+, k.k 9@7FAnKS0S9\0SQ1CDWX9M9U3E36YE<SA=Yc`RK29]/R7=7=Q8?JY6I9Mo


`^KS9m3 - Y60SIh^/436Y~ADImL8K&A=CDY6/10Sh1369\9@7FAM?Q1027=9CDN1IU9%$JZ
2
B

@F ?KJO@ 
 132

B=

B ! BT B

9U7:ATLSI 20SY69]<>Q^7:YEA=Y6N19;9ATQR0aL8IUWqQR0^A=CD9;/1?YE369WX9U0RA




2 0 MN\ J
4 0 5:?
A=
kyk2B = 4y12 + y22
0 1
0 1

v J8AaKL?[E ?Q5m^oE h`7]5


 5 C =:K`d5m;s5mKL?yM*5 tF=@cAf=n^f5 5DE ? A[CcA 7K C = K`d`5F;b5FKL?yMN\ H8C Y5m^a^5 
 \ 5FK(EF5m; n^f5 M`5FE q
f
^
=
*
n
`
J

7

^
5

7

K
P
A
Q
?
H
*
M
:
5
t

A
m
5
L
K
p
?
F
^
\
m
5
a
^
_
^
A

v
F
E
5
\

=

v
L
v
f
^
`
=
[
?
a
A
B
E
F
E
m
5
s
;
m
5
L
K
6
?
*
M
y
5
o
^
=
PE v Lem@D5<A_K(A[?[Ao=^f5
K


kxk2 = 1 
4y 2 + y 2 = 1
 
EI7A[tD=KY? ^F\ =89 5 YJ8@BA :J8KL?P=^5FEI?v@FJ vNJ:@I?[AfJ:KKY5m^  1 C  2 d 7@D5 
a11 


 
!



  K



 K

    

4  K



lp%$
&

QRY~A

lS Y
 ` S+

A=


5 4
4 5

"c$p


"+

 

 


Z  T Q1K23E9_KS0SYEA=Im9U3E36Y6<8A=Yc`^KS9


+

R2

9A;36/Q10>?BA=Y6Q10`^K2/RL8CD/4A=Yc`^KS9]LS9

/R7=7=Q8?JY6I9

R2

q(x) = xT Ax

QRKSC;L8Yc/4h1QR02/436Yc7:9UC A lSQ10r?/136?KS3E9m7=9U7nNO/4369K2CD7n<SCDQ1<2C=9@7G9AM7:9@7nN19@?BA=9UKSC[7n<SC=QR<SCD9U7

1 = 1

/N19@?

1 = 9

/N19@?


1/ 2
1/ 2
 
1/2
q2 =
1/ 2
q1 =

& Q1YEA
3c/ WX/4A=CDY6?9}QRC:ADwSQ1hRQ102/13E9}LSQ10^Ap369U7r?JQR3EQR0S0S9U7&7=Q10^Ap369U7pN19@?BA=9UKSC[7a<SCDQ1<2C=9@7ZTP9U?BADKSQ10>7&/13EQRCD7a3E9
?[w>/40ShRQ9WX90^AkL89mNO/4CDY6/1jS3E9@7 x = Qy ZS3c/Q1CDWq9m`^K2/RL8CD/4A=Yc`^KS9 q L89NgY690^A;/436Q1C[7

9A;Q10&C=9UW/4C[`RK29]L89m<23EK27k`^KS9

y T QT AQy = y T y = y12 + 9y22

y = QT x

y1 =
y2 =

x1

2
x
1
2

x2

2
x2

,*/Q1CDWq9`^K2/RL8C[/OA=Yc`^KS9rYE02Y~ADY6/13E9KS029rQ1Yc7eL8Yc/4h1QR02/436Yc7:IU9&7U- I@?JCDY~AaLSQ102?7=Q1K27X3c/{Q1CDWX9LV- K20S9}7=Q1WXWX9rLS9


?U/4CDC=I@7 
q(x) =

x
x
1 2
2
2

2

+9

x
x
1 + 2
2
2

2

,*(
/ #YEhRKSCD9 Z CD9<SCDIU7=90^AD936/vj>QRKS3E9KS0SYEA=I9363EY6<8A=Yc`^KS9
`^KSY_7- Q1jSA=Y690^Apo <>/4C=A=Y6CpL8936/ jfQ1K23E9
1
9UK2?J36YcL8YE9U0S0S9_<2/1CGADCD/1027:Q1CDWX/4A=Y6Q10eQRC:ADwSQ1hRQ102/13E9 Q ! CDQ4A[/OADYEq(x)
QR0pL89 =/4
$Bl8<SKSYc7k/4<2<S36/4A=Yc7=7=9WX9U0RAk7=KSYENO/10RAk369U7
/4u89U7n<SCDQ1<fQ1C=A=Y6Q10S0293Vo Z


1
1



  




)   K

Z  SQ10>?BA=Y6Q10r9U3E36YE<SA=Yc`RK29+L89


R2

 4


!



     K

 

  o~

  

  
 





 


  

 m



  
 

)
nkz#)J r)JJ)[*
|\0 ? Q1027=Y6LSiCD9XL2/4027+?9a?[w2/1<SY~ADC=9eLS9U7_QR02?BADYEQR027z?Q10^A=Y60gKS9U7mL8I20SY69U77:KSC+A=Q1KSAzQ1K<2/1C:ADYE9eL89a3H- 9U7=<2/1?9
NR9U?JA=Q1CDY693 R Z*|\002Q4A=9UCD/ x y 369<SC=Q8L8K2Y~A+7D?/43c/4Y6CD9zK27=KS93(LS9XLS9K8u}NR9U?JA=9K2CD7 x 9JA y 9A k x k 3c/p02Q1CDWq9
9UK2?J36YcL8YE9U0S0S9+L8KrNR9U?BAD9KSC x ! k x k= (x x) $BZ
,P]-KUKMLB%MNSTU 
1[2  ,6PC:M  P@  MNC @A+B8MNSTUKU @JNJO@   = M`Hm@BA[t:H 5gMOAa@F58CI?[AfJ:KKY5m^a^5gMN\ 7OKY5 [J8K)CI?3AJ8K f 5mK x R
X




1/2



M*=:K(E^f=sMOA_@D5 C ?3AJ8K

h`7.=KM

dR

  

?5mKM t85F@BE

5DE ?q^f=<^_Aa;yA[?5

KkKLJ*?Q5F@m=

h`7.=KMs5m^a^f565m9*AoEI?Q5

M`5^m\ 5B9OvL@D5FEBE AJ8K

1
(f (x + td) f (x))
t

f 0 (x; d) = lim

f (x + td) f (x)
.
t

|\0/_L8Q10>?n<>QRKSC 7=K<e7D/4WXWX90^A(<>9A=YEA.3 - /1<S<SCDQugY6W/OADYEQR07=KSYENO/10RAD9kL89k36/]QR02?BADYEQR0 f LS/40>736/mL8Y6CD9U?BADYEQR0


Ld 8Y~AD9 .
; 0  : ;t 8vs  .)2 0 ;2 .". 8".)2
#Z "%$
f (x + td) = f (x) + tf (x; d) + t(t)
!
Q , (t) AD902L&NR9C[7 7q/NR9U? t Z
D
,P]-KUKMLB%MNSTU 
1   B8@QWH  KM
 PC:@U B8MOQKMOJNMNB8P   KY5 [J:KCI?[AfJ:K f 5FEI?lMOAP?Q5! : 2  s
#"8/; $&% .)2  :<; ' o 2 J:K
M.A_@F=uE Aa; vL^5m;s5mKL? MOA))
( Hm@D5mKL?3Af=n:^5 v)=@'^f=uE 7AP?Q5 5mK x E AL5m^a^f5 vqJ:EBEFe M*57KL5M*Hm@BAPt8H 5M.A_@D5 C ?3AJ8KKY5F^_^5l5mK x M]=:K E
t+0



?J*7?5FE^5FEuM.A_@D5 C ?3AJ8K(E5:?qE*\ A_^N5m9`AaEI?Q5g7K t858CI?587@

,!9mN19U?JA=9UKSC

f (x)

M*5

Rn

?Q5m^'h*7*5

f 0 (x; d) = f (x)T d.

f (x)

9@7FAM/1<S<>9U3EI  .  8/;2  : L89_#9U0 x L8I 202Yy<2/4C

ZZ

f (x)
x1

f (x) =

f (x)
xn

  

=%@DC 

f (x)
xi

 4 

% > 

 & #Y Q10?[w2Q1Yc7:YEA\3c/aL8Y6CD9U?BADYEQR0

QB%MNSTU



 K

  \


d = ei



 K   K






4  
 

L8936/pj2/R7:9q?/402Q10SYc`^KS91l>Q10}NRQ1YEA]`^KS9


!

 

f 0 (x; ei ) =

,P.-UKMLB8MOSVU )1
 STHC 
@= K@)U M  @QWH
EFJ8KL?6M`5FEvqJ8AaKL?[E
 F5 E>CFJ*7O@ n`5FEbM*5<KAPt85 =`7 MN\ 7KY5 [ J:KCI?[AfJ:K
f
M*5 n ?Q5F^aEuh`7]5
J
5DE ?7KL5gCFJ8K E Q? =:KL?Q5 
R
f (x) = 

& Y
9U7:AL8YEfIUC=9U0RADY6/1jS369e90 l*369ehRCD/1LSYE9U0RAzLS9 90 9U7:AzQ1C=A=wSQRh1QR02/43(o3c/?Q1KSCDj>9eLS9a0SY6N19@/4K90
<fQ1Y6f0RAD9mN19UCD7T3c/XC=IUh1Y6Q10aQD,p3c/qxNO/4369KSC;L89 f 9U7:A;<S36fK27nh1C[/4x02LS9_`^Ky- 90 x Z
,(- 90>7:9UWzjS369

9U7:A;KS0S9

=%@AB%MNSTU

S = {x Rn | f (x) }

L89 f Z

6f (
x)

f (
x) =
f (x) =
f (x) <

G

f (x) >

Z#"  QRKSCDj>9@7kL89m0SY6N19U/1Kp9A;h1C[/1L8Y690^A
Z

epi(f)

G

Z   <SYEhRCD/1<SwS9_9JAM7=9U?JA=Y6Q10

9JA

 #D 4

! !


 K 



 ?M VC:Q?  @ 

,P]-KUKMLB%MNSTU 1
M 7 d]@m=Iv Y56M*5
f


 \ HvLA_d.@F= v L5MN\ 7KY5 [ J8KC ?3AJ8K

5DE ?^f=@FHmd.AJ8KsM*5



epi(f ) = (x, z) Rn+1 | f (x) z .
 = @FHmd.AJ8K EcAP? 7]HI5u=`7 M*5FEBEmJ`7OEM(7<d.@F= v Y55DE ?'=IvvN5F^fHI5 OvqJ d]@m=Iv Y5 

,!9U7&?JQ1K2C=jf9U7pL8902YENR9U/4K 7=Q10^ApL2/4027 R 9JAr3H- I<2YEhRCD/1<SwS99@7FArLS/4027 R


L8I 20SYEA;3E-9 ?JNQ U B8QWU V@U B+oq3 - IU<SYEhRCD/1<SwS9_/4Kr<fQ1Y60RA (x, f (x)) Z
(f (x), 1)
n

d]/4027

n+1

G   

0 &"!

' `"%'$p

,P]-KUKMLB%MNSTU 1f/  NM UKMNFIH F


?[AfJ:K
7KbvqJ8AaKY? ?QF5 ^ h`7]5
f
x

QWJ 

TJNS

 `

 

F MOU MOF HKF

JOSA+Q J

Rn+1

EcA[?c7]H 5=7<M*5FEBE 7.E

Rn+1

K = vvq5m^a^f5u;<AaKAa;s7;

lG369}NR9U?JA=9K2C

d]^fJnO=:^ M`5^o= [ J8KC




D$
f (x ) f (x), x Rn .
!
 ALJ8K>@D5FEI?3@D5mAaKL?^o=yCFJ8K)MOA[?[AfJ:K % y7K CF5F@I?Q=:AaK t8J8AoEcA_K =:d`5pM*5 J8Ks=<7OK>;<AaKAa;s7; ^JCm=:^ D A(^F\ AaKYHBd`=:^aA[?H
x 


v@FH8CFH M`5mKL?Q5'5DE ?LEI?3@BA3C ?Q5 J8Kv=:@B^f5F@m=M`5q;yA_K(A_; 7; E ?[@cA[CI?   J`7@S7K ;b=89`A_; 7; Aa^*E 7 ?qn:A5mKgE@!M*5GC =K`d`5F@


^5EF5mK(EM*5DEA_KLHBd*=^_AP?QHDEM]=:K E^f5DEM*H K(A[?[AfJ:K(EuCFJ:@c@D5FEQvqJ8KM]=KL?Q5FE 



PSVC F @ )132  STU KMLB%MNSTU K


U PA+@=%=8QWMNC:@ S#S ?KB8MOF QWJNMNB8P

; 7;#^JCm=^qM*5
M A HF@F5FKY?[Ao=(n:^5 8J K =
O
f

f (x ) = 0.
wyxz{|} ~L*~L{|

)(

?KC:@F MN@CGS C

C:@

 A

5DE ?<7K ;yAaKA 

Z $
yd\9z3c/aLSI 20SYEA=Y6Q10{LV- KS0}WXY60SYEWKSW36Qg?U/43 l2QR0A=Y6C=9 f (x ) d 0 l d R Z,*/
36Y60SIU/1C=YEA=ImL8Kr<SCDQ8L8KSYEAk7D?/136/1YECD9]YEWX<S36Y6`^KS9+`^KS9 f (x ) = 0 Z
,*/z?JQR02L8YEA=Y6Q10 ! Z D$P0!- 9@7FATh1I02IC[/4369WX90^A(<2/R7.7=K<e7=/10RAD9M?/1C.9U3E369M9@7FA.NRICDY>I9;IUhR/4369WX9U0RAG<2/4CGKS0eW/Ou8YEb
WKSW 36Q8?/43 ! 91Z h2Z f (x) = x /4Ka<fQ1Y60^A 0$GQ1KpKS0p<fQ1Y60^A;LV- Y60 29u8YEQR0 ! 91Z h2Z f (x, y) = xy /1Kp<fQ1Y60^A (0, 0)$JZ
,!9U7\<>QRYE0^AD7\90}3E9@7=`^KS9U367M3E9h1C[/1L8Y690^A\LV- KS0S9zQ102?JA=Y6Q10}7U- /40S0gKS369z7=Q10^A\/4<2<>9U3EI@7! "; :4 41:  : ;   ; . 214 LS9
3c/Q102?JA=Y6Q10yZ  3V<>9UK8A\7U- /1h1Y6CnLS9]WXY60SY6WX/2l2L89mW/Ou8Y6W/QRK&LS9m<>QRYE0^A:b 7=9363E9@7Z
T

LS9

fi

lS Y
 ` S+

G  

7+

p"

mS +



&"!

'

 "+

Z & KS<S<fQR7=Q1027.3E9@7
;M0S9MWKS3~ADY6/1<S<S36Y6?U/OADYEQR0q9@7FAGKS0N19@?BA=9UKSC.L89;Q102?JA=Y6Q100SQ1A=I
L8YEfIUC=9U0^A=Yc/4jS369U7 13c/mW/OA=CDYc?J9 p n LSQ10^AG369U7.3EY6h10S9@7.7=Q10^A.369U7Gfh1(x)
C[/1L8=Y690^(fA[7((x),
L89U7..Q1. 0>. ,?BfA=Y6Q1(x))
0>7 f 9U7:AG369 ^/1?Q1jSY690
1



f1 (x)T
f2 (x)T

f (x) =
.

ZZZ

M0S9zQR02?BADYEQR0 f 9U7:A]L8YEA=9XL89UK8urQ1Yc7\L8YEICD90^A=Yc/4jSf
369+9U0 (x)x 7=Y*9U3E369z9@7FA_L8YEfIUC=9U0RADY6/1jS369+90 x 9JA_7:Y?[w2/R`RK29
?Q1WX<fQR7D/40^A=9;L8KhRCD/RL8Y690^AP9U7:A.KS0S9kQR02?BADYEQR0eL8YEfIUC=9U0RADY6/1jS369k90 Z8|\0<>9UK8AT/13EQRCD7PLSI 20SY6C(369 ^/1?JQRjSY690L89;3c/
WKS3EA=Yc/4<S<S36Yc?/OADYEQR0 F (x) = f (x) Z,!/W/OADC=Yc?J9+Q1CDWqIU9m<2/4C\3E9@x7;NR9U?BAD9KSC[7khRCD/RL8YE9U0^AD7 F (x) 9U7:A\/4<S<f936I9
Q1KW/4A=CDY6?9 ;9U7D7=YE9U0S0S9zL89 l>0SQ4ADI9
Zf,!9 ;9U7D7=YE9U09U7:AMKS0S9+W/4A=CDY6?9+?/4CDCDI91lS7=5gWXIJA=CDYc`RK29
LSQ1210^4 Ak41;3H2- I36IWX90^A h 9U7:A;3c/qLSICDYENRI9_7:9@f?JQ10>L89 f (x)
Zf|\0/XL8Q102?
(x)
T



2f
xi xj

ij

f (x) =

2f
(x)
xi xj

|\0<f9K8AaL8I20SY6Ce?JQRWqWX9r<SCDIU?IUL89UWqWX9U0RA3 - /1<S<SCDQu8YEW/OADYEQR0 L8K7=9U?JQR02L Q1C[L8C=9rLS/1027X36/L8Y6CD9U?BADYEQR0


Ly- KS029_Q102?JA=Y6Q10 f 9U0 x QD, f 9U7:AkLS9K8upQ1Yc7kL8Y~ICD90^ADY6/1jS3E9
f (x + td) = f (x) + tf (x)T d +

i,j=1,...,n

t2 T 2
d f (x)d + t2 (t).
2
!

d
$

 4 

  



PS C 
 F @ 1
 A 5DE ?g7K ;yA_K(A_; 7;
x
F
5
I
E
'
?
m
E
F
5
y
;
A
M*H (KAf5GvqJ:EcA[?[A[t:5 
2 f (x )
wyxz{|} ~L]~{| 


  \



% > 

 K

^fJCm=^pM*5



f

 K   K



4  
 




)(

M*5:7:9 [ J8AoE>MOA HF@F5FKL?3Af=n:^5




J8K=


!

 

f (x ) = 0

58?

WXWXIUL8Yc/OAo;<2/1C:ADYEC#L89G3 - /4<S<SCDQu8YEW/4A=Y6Q10mL8KLS9K8u8Y6iWX9.QRCDL8CD9 ! Z $y?U/4C*3H- YE02IhR/13EYEA=I


l
S
l
6
Y
X
W
S
<
36Y6`^KS9+`^KS9 f (x ) 9@7FAM7=9WXYEb LSI 20SY69_<>Q^7:YEA=Y6N19RZ
d f (x)d 0 d
,!/\?JQR02L8YEA=Y6Q10z<2C=I@?JIULS90^A=9G0y- 9@7FA<2/R7*7=K<e7=/10^A=9G?Q1WXWX9.369GWXQR0RADC=9G3H- 9Ju89UWq<23E9nL89T36/;Q102?JA=Y6Q10 f (x) = x
/4K<fQ1Y60^A
ZP/4CT?JQ10^ADC=9Rl47:Y (x ) = 0 9JA f (x ) 9@7FATL8I 202YE9;<fQR7=YEA=Y6N191l^/436Q1C[7 x 9U7:A.KS0WXYE02YEWKSW
36Qg?U/43y7:A=CDY6?JxAM=L89 0f ! A+STU KMLB%MNSTU =8f
H =8Q U B8@$BZ
T

%$

! '

"

"+

& 

 "+

"



&"! N
 S

d]/4027M3E9@7;QRC=WKS3E9@7M?Y~b L89U7D7=Q1K27Ul a R l A W/4A=CDY6?9z?/1C=CDI9


Q10>?BA=Y6Q10L89 R LS/40>7 R Z

l W/4A=CDY6?9

(n n) B

(p n) f

9U7:A\KS029

f (x) = aT x + = f (x) = a

f (x) = xT Ax + aT x = f (x) = (A + AT )x + a
F (x) = Bx b = F (x) = B.

QRY~A g K20S9_Q102?JA=Y6Q10L89 R LS/4027 R 9JA h KS0S9_Q10>?BA=Y6Q10L89


/q<fQ1KSCMh1C[/1L8Y690^A
(g h)(x) = g(h(x))
&

LS/1027

Rn

f (x) = h(x)T g(h(x)).

Q1WXWX9+/4<2<S3EYc?/4A=Y6Q10rL89_36/QRC=WKS3E9m?Y~b L89U7D7=K27l8<fQ1K2C

t R d Rn

Rp

Z2,!/qQR02?BADYEQR0r?Q1WX<fQR7=I9

lSQR0&/

df (x + td)
= dT f (x + td).
dt

;029+/4K8ADC=9m/4<2<S3EYc?/4A=Y6Q10rL89m3c/qLSICDYENO/OADYEQR0&Ly- KS029_Q102?JA=Y6Q10r?JQ1WX<fQR7=I9RZ & Y


;

q[

"+ + e)[*
,P.-UKMLB8MOSVU )1   UK=8@F


^f5EF5Bd];s5mKL?

Q10r/

f (x) =k Bx b k2

f (x) = 2B T (Bx b).

x1 , x2 C 

f (x) =

KJO@6ADSVU 
[x1 , x2 ]

@.@
5DE ?GM]=K(E

K0EmJ`7OE Q5mK Em5F; n:^5


M`5
D5 E ?s7K 5mK(EF5m;kn:^5 CFJ8KLt:5B9 5 E A
C
Rn
A 5 

C
x1 + (1 )x2 C  (0, 1)

@F ?KJO@ )132  5DE!J`nD58?[E'^_AaKYHD=A_@D5FE EmJ`7OE Q5FEQv)=`CF5FEGt:5 CI?J8@BAf5F^aE



n`J*7^5FE67OKA[?HFE=OEcEFJCcAH 5DE  ?J*7?5pKLJ8@B;b5 M*5 n 
R

tD=:@BAfH:?QHDEq^_AaKYHD=A_@D5FE vqJ8^ e M.@F5DE




M*5

Rn 

^5FE

P/4Ck?JQR0gN190^ADYEQR0ylgQ10r7:KS<2<>Q^7:9UCD/q`^KS9_3H- 9027=9WjS369]NgYcL89m9U7:A;?JQR0^NR9Ju891Z & Y C 9A C 7=Q10^AkL89KSu&?JQR0gN19Ju89@7


l2/13EQRCD7TQR0&/
R
 C + C 9U7:AM?JQR0gN19Ju89
 C 9@7FA;?JQR0gN19Ju89Rl KS0rC=IU93
 C C 9@7FAM?Q10gN19ug9RZ
,P.-UKMLB8MOSVU )
1
  SVUKAB%MNSTU A+STU  @]@   KY5 [J:KCI?[AfJ:K f 5FEI?CFJ:KLt85B9 5EI7@67K 5mK(EF5m;kn:^5gCFJ8KLt:5B9 5 C M*5

L89



R
 A

E A

x1 , x2 C, f (x1 + (1 )x2 ) f (x1 ) + (1 )f (x2 ),


5FEI?CFJ:KYt:5B9 5
5FEI?FC J:KCm=]t:5 
 g = f
f

(0, 1).

  

 

f(x)

x
a




Z  SQR02?BADYEQR0&?Q10gN19ug9

x
a



Z  SQR02?BADYEQR0?JQ10>?/N19

 4 

  

 @F

?JN@= K
 @

@F ?KJO@ )1


% > 

[J8KC

 STU

  \



 K

A+B8MNSTUK=>ADSVU

?3AJ8K h`7.=*MO@F=`?[A3h`7]5



@]@=

 K   K




=]t:5 C


f (x) = x Hx 
H
5FEI?l7KY5 [J:KCI?[AfJ:K CDJ8KLt85m9 5
c(x) J 

f (x) = e
c
J
5DE ?7KL5KYJ8@B;s5 t:5 C ?QJ8@BA5m^a^f56h`7]5m^[CFJ:Kh`7]5

f (x) =k x k 
kk
J 

5DE ?GCFJ:KLt85B9 558?

f (x) = af1 (x) 
f1
a0
J 
58?
EFJ8KL?!M*587:9 [J8KC ?3AJ8K(ECDJ8KLt85m9 5FE

f (x) = f1 (x) + f2 (x) 
f1
f2
J 

5:?
EmJ:KY?GM*5:7:
9 [J:KCI?[AfJ:K(ECFJ:KLt85B9 5DE 

f (x) = max{f1 (x), f2 (x)} 
f1
f2

,P.-UKMLB8MOSVU )1 ,STF QWMNUK@S#H K


U @  SVUKAB%MNSTU A+STU  @]@
?QH
5FEI? m^ \ 5mK(EF5m;kn:^56M`5FE
?QF5 ^aE6h*7*5

dom(f ) 
x
f (x) < +

 J:A[?

CDJ8KLt85m9(5


x0 dom(f )
q(t) =

5FEI? ;sJ8KYJ`?QJ:KY5 Cc@DJ8AoEcEm=:KL?Q5pE 7O@


wyxz{|} ~L]~{|

&

QRY~A

(0, 1)

58?

[J:KCI?[AfJ:K =yKY5
f (x) = aT x + 
;>=?3@BA3CD5 Cm=:@B@DH 5Em5F;<A M*H K(Af5GvqJ:EcA[?[A[t:5
#D

W

i :C S ?KC:MNPB8P 1[2
 = [J:KCI?[AfJ:K



4  
 

 5GM`J8;b=:AaKY5!MN\ 7KY5 [ J8KC ?3AJ8K>CDJ8KLt85m9(5

7KY5gMOAa@D5 CI?[AfJ:K M*5

?Q5F^_^5gh`7]5

Rn

 
!


f

KYJ

1
[f (x0 + td) f (x0 )]
t

0hk1

S/1<S<S36Y6`^KSQR027T3E9+L8I20SYEA=Y6Q107=KSCk3E9+7=9hRWX90^A


[x0 , x0 + kd]

f (x0 + hd) f (x0 ) + (1 )f (x0 + kd)

/N19@?

Q+, y l y 7:QR0RA;`^KS9U36?Q102`^KS9@7TL2/4027nKS0rNRQ1Yc7:Y602/4hR9]LSK&<fQ1Y60^A x 9A L > 0 L8I<f902LrL89 x Z


& Y
9@7FAM?Q10gN19u89\9AkLSY~ICD90^A=Yc/4j23E9m9U0 x lSQR0&/q<fQ1KSC z dom(f )
f


f (z) f (x0 ) + f (x0 )T (z x0 ).

& Y
9U7:A]?Q10gN19u89]9A]L89UK8u&Q1Yc7ML8YEfIUC=9U0^A=Yc/4jS3691l>3E9 ;9U7D7=YE9U0 f (x ) 9U7:AMKS0S9+W/4A=CDY6?9z7:9UWXY~b L8I >0SYE9
<>Q^7:fYEA=Y6N19RZ
 PS C F @  1  SVU KMLB8MOSVU ! SV? B%MNF Q JNMLB%P ?
STH C H UK@  STU A+B8MNSTU A+STU  @]@ KM PDC:@U B8MOQJN@ 
 KbvqJ8AaKL? x R ;<AaKAa;yAaEF5 f CDJ8KLt85m9(56MOA)( HF@F5FKL?3Af=n:^5E A 58?'EF587O^f5F;b5FKL?qEcA f (x ) = 0.
|\j27=9CDN189 (T`^KS9kLS/10273E9;?U/17P?Q10gN19ug9Rl36/_?JQR02L8YEA=Y6Q10q0SIU?9U7D7=/1YECD9nL8KX<SC=9UWXYE9UCPQ1C[L8C=9nL89UN^Y690^A(0SI@?J9@7=7D/4Y6C=9T9JA
7=K <e7=/10RAD91Z>|\0&C=9A=CDQ1KSNR9MYc?JYV369_/4YEA;`RK29\ADQ1K8AkWXY60SYEWKSW36Q8?/13yLV- K20S9]Q102?JA=Y6Q10r?JQ10gNR9Ju89\9@7FAkKS0&WXYE02YEWKSW
h136Q1j>/43 ! <2C=QR<SC=Y6IJADIm`RK2YV0y- 9u8YEhR9]<>/17n3c/qLSY~ICD90^A=Yc/4j2YE36Y~AD%I $JZ

q/.

T  &"$pk $&$pk*'Gk*
,P.-UKMLB8MOSVU )1 ,MLC:@AB%MNSTU  @ K@=8AD@U B8@ 


Z|\0&90L8I@L8KSYEAM/4Yc7:IUWX90^A;`RK29 q(h) q(k) Z



h1Q WX=WX(19m?JQR02)k
7:I@`^KS902?9U7nQR0&/X`^KS9
 (0A=QRK8Ae<>QRYE0^ApLS93H- YE0^ADICDYE9UKSCC=9U36/4A=YE_LS9 dom(f ) l f 9@7FAa?Q10^A=Y60gKS99JAe3c/ L8IUC=Y6N1IU9rLSYECD9U?JA=Y6Q10S0S9U3E369
9Ju8Y67:A=9RZSdM9m<23EK27 f 9U7:A;36Qg?U/4369WX90^A;,yY6<27D?[wSYEA/(Y69020S91l8Y Z 9RZ
|f (y1 ) f (y2 )| L k y1 y2 k,

x0 + d dom(f )



^f=[J8KC ?3AJ8K

=`7 vqJ8AaKL?

EcA

Kkt85 C ?Q5:7@

M*5

Rn

f 0 (x; d) = f (x)T d < 0.

5FEI?q7KY5pMOAa@F58CI?[AfJ:KsM*5pM*5DEDCD5mKL?Q5vqJ*7@

 W








4   4 

4  K  K

"

f(x)

(D)
f(a)

x
a



Z  2Q102?JA=Y6Q10{?JQ10gNR9Ju89L8YEICD90^A=Yc/4jS3691ZV,*/a?JQRKSCDj>9XL89 f 9U7:A\ADQ1K FQRKSC[7\/1KL89@7=7=K27_L89q36/aAD/10Sh19U0RAD9

(D)
& QRY~A
9U7:AMKS029+L8YECD9U?JA=Y6Q10L89zLS9U7D?J90^AD9m9JA KS0CDI93!<>Q^7:YEA=YEFZ|\07=KS<S<fQR7=9 t 7=K<e7D/4WXWX90^A;<>9A=YEA\<fQ1KSC
`^KS9_3 - /1<S<SdCDQu8YEW/OADYEQR0pL8Kr<SCD9WXY69CkQRCDL8CD9_7:KSY6NO/4t 0^A=9m7=Q1YEAkN/136/1jS369

f (x + td) f (x) + tf (x)T d.

d\Q10>?_Q10r/ f (x + td) f (x) = tf (x) d < 0 l8Y Z 9RZ f (x + td) < f (x) Z
,!9U7pWqIA=wSQ8L89@7pLS9L89@7=?90^A=9}7=Q10^ArL89U7aWqIA=wSQ8L89@7aYEA=IUCD/4A=Y6N19@7e<fQ1KSC&36/ WqY60SY6WXY67D/OADYEQR0 L89U7aQ10>?BA=Y6Q10>7
LSY~ICD90^A=Yc/4j23E9@7q7=KSC R LS/10273E9@7=`^KS9U3E369U7qKS0S9rL8Y6C=9@?BADYEQR0 L89rL89U7D?J9U0^A=9&9U7:AX?[wSQRY67=Y69po{?[w2/1`^KS9pY~ADIC[/OA=Y6Q10so
<>/4C=A=Y6CzL89U7+YE08QRC=W/4A=Y6Q1027_hRI0SIUCD/13E9UWq9U0^A+3EQ8?/13E9@7Z*|\0WXY60SYEWXYc7:9p/436Q1C[7_36/&QR02?BADYEQR0 LS/4027z?J9JA=A=9aLSYECD9U?JA=Y6Q10
WXYE0SY6WXY67D/OADYEQR0 KS02Y6L8Y6CD9U?BADYEQR0S0S9U3E369Q1K CD9U?[w29C[?[wS936YE0SI@/4Y6C=9 $BZk,y97D?[wSIW/ hRI0SIUCD/13\9@7FAL8QR0S0SI?JYEb LS9U7D7:QRK27
!
3H- Y602L8Yc?J9mCD9<SCDIU7=90^A=9]Yc?JYy3 - YEA=IUCD/4A=Y6Q1V0 $ 
!
U MNB8MNQ JNMN=%QB%MNSTUS1 w2Q1Yc7:Y6C
Z
x
B8PC:QB8MOSVU
1 wSQRY67=YECnKS029+L8YECD9U?JA=Y6Q10rL89+L89@7=?90^A=9
Z & - YE3!0y- 9U0r9Ju8Y67:A=9_<2/R7lS/1C=C JAkL89m3 - /13EhRQ1CDY~ADwSWX91Z
k
d
& Y60SQ10
T

xk+1 = xk + tk dk ,

/ N19@? t > 0 AD93!`^KS9 f (x ) f (x + td ) l t (0, ) Z


Q1K2Ck36/7=KSYEA=91l8QR0r<>Q^7:9UCD/
Z
g = f (x )
C:SV?
ST=8MNB8MNSTU 
1[2W4u=:K(Ep^o= @D5 C Y5F@ C Y5l^_AaKYH =:Aa@F5 E A t ;yA_K(A_;yAoEm5u5B9(=`CI?Q5F;s5mKL?q^o=
k

k+1
k

^f5KLJ*7t:5D=`7gd.@F=*MOA5mKL?

tdk ) 
wyxz{|} ~L*~L{|
:E
0 !

3c/XL8ICDY6N1I9

gk+1

=76vqJ8AaKL?

xk+1 = xk + tk dk

& Y
WXY60SYEWXYc7:9z36/qQR02?BADYEQR0
?[w2/ c02/1h19 $.L8QRt0S0S9U0RA

.0&<>/4C=A=Yc?JKS36YE9UCkQ10r/

(t)

5FEI?SJ8@ ? YJ8d`J8KY=:^

l/436Q1C[7

0 (tk ) = 0

0 (t) = f (xk + tdk )T dk .


0 (0) = gkT dk
T
0 (tk ) = gk+1
dk .

[J8K)CI?3AJ8K


(t) = f (xk +
^o=sMOAa@F58CI?[AfJ:K

dk

Zf|\C@lS369U7kCDihR3E9@7kL89z?/136?KS3!L89

 4 

  

% > 

  \



 K



 K   K






4  
 

,!/ KMLC:@AB8MOSVU K@ JNQ ?KJOH = VC Q U K@ ?


@U B8@r9@7FA_369qNR9U?JA=9K2C d 02Q1CDWqIX`^KSYWqY60SY6WXY67=9
L8QR02?_36/XL8Y6CD9U?BADYEQR0pQR<S<fQR7=I9m/4K&h1C[/1L8Y690^A 


dk =

f 0 (x; d)

 

Z - 9@7FA

gk
.
k gk k

(0<SC[/OADY6`^KS9Rl8Q10&K8A=Y636Y67=9+/4K27D7=YV36/qN19UCD7=Y6Q10a02Q10&0SQ1CDWXI91l

;2 

dk = gk .

!, /F PB  S  @ KH C:Q KMN@U B Q1K+L89.<S3EK>7yh1C[/40>L89P<>9U0^A=9%$!?[wSQ1Yc7=Y~A!3c/kL8Y6C=9@?BADYEQR0+L89(<S36K27yhRCD/102L89(L89@7=?90^A=9


o?[w2/R`RK29\YEA=IUCD/4A=Y6Q10yZ>|\0&C=9UW/4C[`RK2! 9_`^KS9RlSLS/40>7k?J9+?/R7lg369U7;LSYECD9U?JA=Y6Q1027k7=K2??9U7D7:Y6N19@7n7:QR0RAnQ1C=A=w2Q1h1QR02/4369U7UZ
 39U7:A_?36/1YEC_`^KS9q36/&L8Y6C=9@?BA=Y6Q10L89<23EK27]hRCD/102L89z<f90^AD9<f9K8A A=CD9/4CDjSYEA=C[/4Y6C=9UWX90^A\W/4K2N/1Y67=9z9U0?9q`^KSY
?JQR02?J9UC=029.3c/\L8Y6CD9U?BADYEQR0L8KWXYE0SY6WzK2W&Z4,!9T?U/17L89@7yQR02?BADYEQR027`RK>/1L8C[/OADY6`^KS9@7!9@7FA<2/4C=A=Yc?JK23EY6iCD9WX90^A#YE027:A=CDK2?JA=YE
9JA]Q10NR9CDCD/XLS/1027;3c/e7=9U?BADYEQR07:K2YENO/40^AD9z?JQRWqWX9U0RA]/4WXI36YEQRC=9UCMoX<f9K}L89zCD/1Y67M?J9JA=A=9qL8YECD9U?JA=Y6Q10<fQ1KSC]7:K2YENgCD9
3c/XN/13E36I9_9A;0SQ10&36/q<f90^A=9mNR9C[7n36/X7=Q136K8A=Y6Q10!Z


)Bk'.*)J"+$p *"+T$&)Bk'(#)J"+&'T"+y%1+%&kk
d]/4027T369]?U/17nLV- KS0S9\Q102?JA=Y6Q10p`^K2/RL8C[/OA=Yc`^KS9;QRC:AD9WX90^Ak?JQR0^NR9Ju89 L8Q10>?\/R7=7=Q8?JY6I9\oKS0S9]W/OADC=Yc?J9_L8I >0SYE9
<fQR7=Y~ADYENR%9 $BlOQR0<f9KSA(WqQR0^A=CD9C ! ?JFZ1,yKS9U0gj>9UC=hR9C 5 9 $`^KS9n3c/MWXIJADwSQ8L89;L8! Kqh1C[/1L8Y690^AP/N19@?.CD9U?[wS9UCD?[w29U7*3EY60SIU/1YECD9U7
9JuS/R?BA=9@7n<SCDIU7=90^A=9_KS0S9+?Q10gN19UC=hR902?9M36YE02IU/4Y6CD9]/NR9U?]KS0pAD/4KSupIh^/43
q 


r1
r+1

2

Q , 9@7FAM369+C[/4<S<fQ1C=A;90^ADC=9+3c/X<S36K27\h1C[/402L89_9A\3c/X<S3EK>7;<f9JA=YEA=9NO/4369KSC\<SC=QR<SCD9+L89+3c/XWX/4A=CDY6?9z/17D7=Qg?YEIU9+oX36/
+
Q1CDWXr 9q`^K2/RL8C[/OA=Yc`^KS91Zf(363E9XL89UN^Y690^Am7:QRK27:b 36YE02IU/4Y6CD9z`^K2/402L}36/eQ102?JA=Y6Q109U7:A]W/43P?Q102L8YEA=Y6Q1020SI9Rlf?1- 9@7FA=b o4b L8Y6CD9
`^K2/40>L r L89NgY690^A;h1C[/40>LVZ

! 
&



 p p
"

QRY~A@l2LS/40>7

Rn



"

"

`S

q(x) =

1 T
x Ax,
2
x Rn

/N19@? 7:5gWXIJADC=Yc`^KS9XL8I 202YE9q<>Q^7:YEA=Y6N19RZ(0}KS0{<fQ1Y60RA


LSY~ICD90^AmL893 - Q1CDYEhRYE0S9 ! 3 - K20SY6`^KS9qWXYE02YEWKSW
h136Q1j>/4A3yL89 q $BZ>,y9mh1C[/1LSYE9U0RAkL89 q 9U7:A q(x) = Ax Z
|\0r7:9m<S3c/1?9_90&KS0r<>QRYE0^A x Z>|\0&/4YEA;KS0S9m/4<2<SC=Qu8Y6W/OA=Y6Q10&LV- Q1C[L8C=9mqL89 q 90 x Zf|\0pQRj8A=Y690^A
0

q(x) =

1 T
1
x0 Ax0 + (x x0 )T Ax0 + (x x0 )T A(x x0 ).
2
2

\| 0 ?[w29C[?[wS9}W/4Y60^A=9U02/40^AUlkov<2/4C=A=Y6CL89 x lk369<fQ1Y60^A x A=9U3_`^KS9 q(x ) = 0 lk?J9`^KSYmL8Q1020S9 x =


l8QD,
9@7FAn3c/zL8Y6C=9@?BADYEQR0pL89 ;9
nA=Q10!ZS|\0pQ1j27=9CDN19\`RK29]?9JA:AD9]LSYECD9U?JA=Y6Q10eQRKSCD0SY~A
x +d
Y6027FA[/40^AD/10SIWX9Ud0RA =! 7=/1A
027C=9@?[q(x
wS9C[?[wS9T) 3EY60SI@/4Y6C=9 $!369nWXYE0SY6WzK2W L89n3c/\Q102?JA=Y6Q10?/1C x +d = x = 0 ! ?JFZ 2hRKSC=9
Z $JZS,(- /436h1QRC=YEA=wSWX9m?JQR0gN19CDh19]L8Q10>?\9U0rKS0S9+7=9KS369_Y~ADIC[/OA=Y6Q10!Z
Q1KSCkK20S9_Q102?JA=Y6Q10
L89UK8uaQRY67kLSY~ICD90^A=Yc/4j23E9RlSQ10&IU?C=YEAk3H- /4<S<2C=Qu8Y6WX/4A=Y6Q10&LV- QRCDLSC=9m
f
0

= f (xk ) + f (xk )T (x xk ) + 1 (x xk )T 2 f (xk )(x xk ).


f(x)
2

|\0?[wS9C[?[wS9]9027=KSYEA=9

xk+1

AD93!`^KS9

f(xk+1 ) = 0

xk+1 = xk + dN ,

Z>|\0aADC=QRKSN19


1
dN = 2 f (xk )
f (xk ).



  4  K

4 







     


4  K

  




x
dN





f (x)

Z  d\Y6C=9@?BA=Y6Q10>7kL89 ; 9
nA=Q10&9JAMLSK&hRCD/RL8Y690^A

QRWXWq9\<>QRKSCn3E9@7(QR02?BADYEQR027n`^K2/1L8C[/OADY6`^KS9@7lR36/L8Y6C=9@?BA=Y6Q10p9JAn3E9]<2/R7GL89_L8IU<S36/R?J9UWq9U0^AT7=Q10^A Su8I@7Z & Y3 - QRCDL8CD9


SL 9?JQR0gN19CDh19U02?J9L89UNgYE9U0RAr`^K2/1L8C[/OADY6`^KS9Rl(3 - /1<S<S36Y6?U/OA=Y6Q10 L89?9JA:AD9}YcL8I9LS/4027p369?/R7ehRI0SIUCD/13;9U7:Ap36YEWXYEA=IU9
<>/4C_3E9e?Q1t8A+L8K?/136?KS3(L89X3 - Y60gN19C[7=9qL8K M9U7D7:Y690{9JAm<2/1Cm3E9@7m7:IUN1iCD9U7\wg5g<>Q1A=wSi@7:9@7m`RK2YPhR/4C[/40^ADY67D7:9U0^A]?J9A:AD9
?Q10gN19UC=hR902?91Z(0 <SC[/OADY6`^KS9RlV36/LSYECD9U?JA=Y6Q109U7:Az/4<S<2C=Q8?[wSIU9qYEA=IUCD/4A=Y6N19UWq9U0^A ?BFZ#?JQ1K2CD7+4iWX9e/40S02I9  $]9A
02Q1K27k/13E36Q1027nY6363EK27:A=CD9C;?9JA=A=9_<>Q^7=7=Y6jSYE36YEA=I+/N19@?M3c/qWXIJA=w2QgLS9+L8Krh1C[/1L8Y690^A;?JQR0 ! FKSh1K2I1Z

Gp



 p 
" "+



&" Y` S+

L!

)"+



,!9U7eWXIA=wSQ8L89@7aL89@7aL8Y6C=9@?BADYEQR027a?Q10 FKShRKSI9@7e7=Q10^ApL89@7eWXIJADwSQ8L89U7aY~ADIC[/OA=Y6N19@7e`^KSY lG/4<2<S3EYc`^KSI9@7eo KS029


QR02?BADYEQR0&`^K2/RL8C[/OA=Yc`^KS9m?JQR0^NR9Ju89_o n NO/4CDY6/1jS3E9@7lS?Q102LSKSY67=90^A;oq3H- Q1<SA=Y6WzKSW 90 n IAD/4<f9U7k/1Kr<S3EK>7Z
,P]-KUKMLB%MNSTU 
1[2 A H:?P=:KL?7KY5 ;>=?3@BA3CD5uE `;sH:?3@BA3h`7]5yM*H K(Af5vNJE AP?3APt85 M*5:7:9 t858CI?Q5:7@mEpKYJ:K KL7^aE x 5:? y
M`5

Rn

EFJ8KL?GMOA[?PE

& # 
 Rpv)=@l@m=IvvNJ:@I?

EcA

xT Ay = 0

i C:SV?
ST=8MNB8MNSTU 1  A
t:5 IC ?587@mE<KYJ8K%KL7^aEkM`5
EmJ:KY?;s7(? 7]5F^_^5m;s5mKL?<CFJ:K 7:dY7]HFE
p
Rn  p n 
^aAaKYHD=A_@D5m;s5mKL?qAaKM*Hvq5mK)M]=:KL?[E 
wyxz{|} ~L*~L{|

&

QRY~A

A_^oE>EmJ:KL?

A=9U367M`RK29

p
X

i di = 0.

i Adi = 0.

Z $

i=1

|\0&WzK23~ADYE<S36Y69 ! Z $noqh^/4K2?[wS9]<2/1C A lSQR0pQRj8A=Y690^A

p
X
i=1

.0 WzKS3EA=Y6<S36Y6/10RA ! Z $q<>/4C d l.Q10A=CDQ1K2N19 d Ad = 0 l(<2KSY67D`^KS9369U7NR9U?JA=9K2CD7e7=Q10^AeWK8A=KS9U3E369WX9U0RA


?Q10 FK2h1KSI@7Z>|\0rL8IULSKSY~AM`^KS9 = 0 ZS(0rC=IU<>IAD/10RAk369_<SC=Q8?9U7D7:K27n/NR9U? d , . . . , d lSQR0&/1C=CDY6N19\o = =
ZSdMQR02?]3E9@7kN19@?BA=9UKSC[7 d , . . . , d 7:QR0RAn36YE0SI@/4Y6C=9UWX90^AkYE02LSI<f902LS/10^AD7UZ
= = 0

& QRY~A;3c/Q102?JA=Y6Q10`^K2/1LSCD/4A=Yc`RK29]?Q10gN19ug9
T
1

T
1 1

q(x) =

1 T
x Ax + bT x + c.
2

  

 4 

% > 

  \



 K



 K   K



4  
 





!

 

i C:MNUKA+MN?
@  @ JOQ F PB  S K@ (|\0}<>/4C=A_LV- KS0{<>QRYE0^A
lVQ10WqY60SY6WXY67=9 7:K>??J9@7=7=Y6N19WX9U0RA_7:K2YENO/40^A
8L Y6C=9@?BADYEQR027 d , d , . . . , d ?Q10 FK2h1KSIU9U7\<2/4C\CD/1<S<>QRC:A]o36/ax W/OA=CDYc?J9 A lfY Z 91Z qd Ad = 0 l2<fQ1KSC i 6= j Z,!n/
7=IU`^KS90>?J9 {x } 9@7FATL8I 202YE9;<>/4C x = x + t d l^Q+, t WXYE02YEWXYc7:9 (t) = q(x + td ) Z^,!9;<>QRYE0^A.QRj8A=9U0gK
oX3c/ nb iWX9_YEA=IC[/OADYEQR0yl8Y Z 9RZ
0

T
i

n1

k+1

k k

xn = xn1 + tn1 dn1 = x0 +

9U7:A;3 - QR<8A=Y6WzKSW 8L Kr<SCDQ1jS36iWX9 ! q(x ) = Ax + b = 0$JZ


 PS C F @  1  5FEld.@F=*MOA5mKL?[ElEI7`CICF5FEBEcA EuCF=:^[CI7^HFE=`7:9bvNJ:A_KL?PE
n

n1
X

tj d j

i=0

T
gk+1
di = 0,

xk

dHmKYHF@FHDESv)=:@^o=<;sH8? YJM*5 M*5DE6MOAa@D5 C

i k.

P/4C]wg5g<>Q1A=wSi@7:9q7:KSC_369?[wSQRY~uQR<8A=Y6W/43PL89 t l>QR0/
`^K2/1LSCD/4A=Yc`RK291l8Q10r/q3E9@7kCD93c/OA=Y6Q10>7
wyxz{|} ~L]~{|

d- QD,&369mCDIU7=KS3~A[/OA@Z
S C:STJNJOQWMLC:@ )
132 x


gk+1

= gk + tk Adk ,

gk+1

= gi+1 +

k
X

tj Adj ,

T
gk+1
dk = 0

Z QRWXWq9 q 9@7FA

i < k.


M`5^o=>;bH:? YJM*5<M*5FE MOA_@D5 C ?3AJ8K(E CFJ8K  :7 d 7]HI5FE


k

Vk = {x0 } + lin{d0 , . . . , dk }

Cm=:^[CI7O^fH <
 ^F\ A[?Hm@F=`?3AJ8K

;yA_K(A_;yAoEm5

#x 3H- Y~ADIC[/OADYEQR0
lV3E9XhRCD/RL8YE9U0^A
9U7:A_QRC:ADwSQ1hRQ102/13#o
lyL8Q10>?QRC:b
Z - 9U7:Ak36/?Q102L8YEA=Y6Q10rLV- Q1<8kAD+YEW1/13EYEA=I+L8Kr<SCDQ1j23EiUgWq9_L89mWXY60SYEWXYc7=/4A=Y6Q10L89 d q, .7:KS. .C , Vd Z


wyxz{|} ~L]~{|

Vk

j=i+1

EI7@l^f5EFJ*7.E Q 5FEQv)=*CD5pk+1
=<KL5

A=w2Q1h1QR02/43yo

?3AJ8K EuCFJ:K 7:d 7*H 5FElEm=`?[AaE [ J8KL?



k+1

S C:STJNJOQWMLC:@ )1  =<;sH8? YJM*5 M*5DEuMOAa@F58CI?3AJ8K ECFJ8K  7:d 7]HI5FE = v(vL^_A[h`7]H 5k7KL5[J8KC ?3AJ8K h`7.=*M.@m=?3A[h*7*5[J:@ 

?Q5F;s5mKL?CFJ:KYt:5B9 56M*5 n CFJ:KLt85m@cd`55mK =`76vL^P7OE
A[?Hm@F=`?3AJ8K E 
R 
n
wyxz{|} ~L]~{| &
#" 
gk = 0
k<n
gn = 0
Vn = Rn
;

Q1YEA
<fQ1KSC
lS7=Q1YEA
?/1C
LV- /4<SCDiU7T369]?Q1CDQ13636/1YECD9 Z 1Z
;029mWX/10SY6iCD9_7=Y6Wq<23E9mL89+?Q1027:A=CDKSY6C=9]3E9@7;L8Y6C=9@?BADYEQR027n?JQ10 FKSh1KSIU9U7nYEA=IUCD/4A=Y6N19WX9U0RAk9@7FA
"RZ
SZ d& Y g= g6= 0 lS/13EQRCD7
0

k+1

k
dk+1

T
gk+1
Adk
,
T
dk Adk

= gk+1 + k dk .

y, 9\?JQg9 <e?JY690^A 9@7FA.?U/43c?JKS36I;L89M7=Q1C=A=9k`^KS9 d Ad = 0 Z1,!/_WXIA=wSQ8L89;7U- /1<S<f9363E9;/13EQRCD73c/-F PB  S K@ KH


Q  MO@U BIA+STU%H VHKPfZ!(36369e<>9UK8A A=CD9eK8ADYE36Y67=I9a<>QRKSC+WXYE02YEWXYc7:9UCzKS0S9eQ102?JA=Y6Q10 `^K2/1LSCD/4A=Yc`RK29XQ1C=A=9WX9U0RA
?JQR0gN19Ju89Rl?1- 9@7FA=b o4b LSYECD9a<fQ1KSCCDIU7=Q1K>L8C=9pKS07:587:A=iWX9LV- IU`^K2/4A=Y6Q1027q36YE0SI@/4Y6C=9@7XL8Q10^A36/W/OADC=Yc?J9r9U7:AeL8I >0SYE9
<fQR7=Y~ADYENR91Z
& QRY~AMoqCDIU7=Q1K2L8CD9]3E9m7=5g7:A=iUWX9
Z $
Ax = b
!
/N19@? L8I 20SY69}<fQR7=Y~ADYENR91ZT|\0 <f9K8A&C=I@7:QRK2L8CD9?J9}7=587FADiWX9oA=C[/N19UCD7X3c/WXYE02YEWXYc7=/4A=Y6Q10 L893c/QR02?BADYEQR0
`^K2/1LSCDA/4A=Yc`RK29\QRC:AD9WX90^A;?JQR0gN19Ju89
VC

T
k

q(x) =

k+1

1 T
x Ax bT x
2



  4  K

LSQ10^Ak3E9mhRCD/RL8YE9U0^AT9@7FA
"

JT
 S C:MNB

F @ K
 H



4 




q(x) = Ax b

VC



     


4  K

  

ZSd\9+7=Q1C=A=9m`^KS9m7:Y

MO@U BGADSVU %H T
 H P)?
SVH C JN@=  SVUKAB%MNSTU =3 HKQ

8L QR0S0SIRl g = q(x ) = Ax
B8PC:QB8MOSVU
l 9A d ?JQR0S0gK27
k 0. x g

1
/
6
3

?
S
K
3
J
9
8
u
S
<
6
3
6
Y
?Y~AD9%$nL8Kr<2/R7kL89+L8I<236/R?J9WX9U0RA

!

U MNB8MNQ JNMN=%QB%MNSTU

k = 0. x0
k

/436Q1C[7


9@7FAM7=Q136K8A=Y6Q10rL89 ! Z $BZ

C QWB8M HK@=

b d0 = g0

tk =

Y67=9+o FQ1KSC


q(x ) = 0

^


gkT dk
dTk Adk

MQ1KSNR9363E9mL8Y6CD9U?BADYEQR0&LSK&hRCD/RL8Y690^A;?JQ10 FKSh1KSI

xk+1 = xk + tk dk

k =

T
gk+1
Adk
T
dk Adk

dk+1 = gk+1 + k dk .
 <
k gk k

! q 

(0r<SC[/OADY6`^KS9_QR0&/1C=C JAD9\369U7nYEA=IUCD/4A=Y6Q1027nL8i@7k`RK29
9U7:A 7=K e7=/1WXWq9U0^A \<f9JADY~A@Z 9JA=A=9mWXIJADwSQ8L89_9U7:A
ADC=i@7;<fQ1<SK236/1YECD9m9JA]<>9UK8A]?Q102?KSC=CD90>?J9Ck3c/WXIJADwSQ8L89LS9 wSQ1369U7 g5 w>/4<yZ $k`^K2/102Lr36/aL8YEWX9U027:Y6Q10LS9
3 - 9U7=<2/1?9 n 9U7:AkA=CDiU7nIU3E9UN1I9RZ
,.- /13EhRQ1CDY~ADwSWX9r?Y~b L89@7=7=K27q<>9UK8AaIUhR/4369WX9U0RGA A=CD9r/RLS/4<SA=I/4K8u Q102?JA=Y6Q1027X02Q10`RK>/1L8C[/OADY6`^KS9@7L8Y~ICD90Sb
ADY6/1jS369U7UZy|\0INgYEA=9/436Q1C[7M369X?/43c?JK23LSK M9U7D7:Y6909JAm3E9@7]<>9UC:QRC=W/40>?J9U7]7=Q10^A\ADQ1K FQRKSC[7\7=KS<fICDYE9UKSC=9@7_op?9363E9@7
LS9m36/qWXIJADwSQ8L89+L8Krh1C[/1L8Y690^A@Z
"

JT
 S C:MNB

F @= K
 H



C:Q K
 MN@U BGA+STU%H V HKP K @ JN@B8A

 @C  

@@

8L QR0S0SIRl g = q(x ) = Ax b l d
B8PC:QB8MOSVU
l 9A d ?JQR0S0gK27
k 0. x g

1
/
6
3

?
S
K
!
3
8
L
r
K
2
<
R
/
7kL89mL8I<236/R?J9WX9U0RA;<>/4CnC=9@?[wS9C[?[wS9]3EY60SI@/4Y6C=9


U MNB8MNQ JNMN=%QB%MNSTU

k = 0. x0
k

@=X@ByiSVJOQ

 6M M C:@

= g0

tk = arg min f (xk + tdk )


t>0

Y67=9+o FQ1KSC




MQ1KSNR9363E9mL8Y6CD9U?BADYEQR0&LSK&hRCD/RL8Y690^A;?JQ10 FKSh1KSI

xk+1 = xk + tk dk

*369JA[?[wS9C=b  99UN19U7 $

k =

k gk+1 k2
,
k g k k2

k =

T
gk+1
(gk+1 gk )
,
k g k k2

dk+1 = gk+1 + k dk .

#QR36/ ^b  Y6jSY6iCD9%$

QC" H @ )132  v@FeDE AP?QHF@m=?3AJ8K(E J8K =pd`HFKYHm@DH n % 


^ 3=`7(?M`J8KCN@FHFA_KAP?3Af=:^aAoEm5F@^F\ =^ dJ8@BA[? ;s5S5FKvqJ:Em=:KL?

n
R
=7<^aA587kM*5FE [J:@c; 7^5FEM(7<d.@F=*M.Af5FKY?!CFJ:K 7:dY7]H Q? J`7?Q5DEl^5FE
A[?Hm@F=`?3AJ8K E 

dk = gk 
n
6@F

  

q[


 4 

% > 



 K

  \




 K   K



4  
 




a #) )J!m*)J"+ !"+%& 'T"+!#z)J*k


;;0r<SCDQ1j23EiUWq9mLV- Q1<SA=Y6WqYc7D/OA=Y6Q10rLS/1027
<2C=9U02La3c/qQ1CDWX9_h1I02IC[/4369]7=KSY6N/10^A=9
R
Y60SYEWXYc7:9UC
7:QRK27 fg (x)
(x) 0, i = 1, . . . , p


!

 

hj (x) = 0,
xS

j = 1, . . . , q

Q+, f l g l h 7:QR0^AkLS9U7nQR02?BADYEQR027kL89 R LS/4027 R 9JA S KS0r9027=9WjS3E9+LS9 R Z


|\0z/\C=9U<SCDIU7=90^A=I(Yc?JY^ADC=QRY67!AF5g<>9@7*L89n?JQR0^A=C[/4Y60RAD9U7 ?Q10^A=C[/4Y60^A=9@7!L8I@?JCDY~AD9U7*<2/4CL89U7#Y60SIh^/436Y~ADIU7UlU?Q10^A=C[/4Y60^A=9U7
L8I@?JCDY~AD9U7G<2/4CnL89U7GIh^/436Y~ADIU7.9JAk?JQ10^ADCD/1YE0^A=9@7(L8I@?JCDY~AD9U7G<2/4CTKS0e9U027:9UWzjS369 ! 0SQ10a0SIU?9U7D7=/1YECD9WX90^A.9u8<S3EYc?JYEA=9 $BZ8,y9
<SCDQ1jS36iWX9k?JQR027=Y67:A=9nL8Q10>?ToMA=CDQ1K2N19C<2/1C=WXY^A=QRK27369U7 x `^KSYS7=/4A=Yc7FQR0^A?Q10 FQRYE0^A=9UWX90^AA=Q1KSA=9U7369U7?Q10^A=C[/4Y60^A=9U7
KS0 `^KSYPC=9U02L WqY60SY6WzKSWrZ#|\0}9C[/p?Q1WXWX9q<2C=I@?JIULS9WXWX90^A]3c/rL8Yc7FADYE02?JA=Y6Q10{90^A=CD9qWqY60SY6WzKSW 3EQ8?/13P9JA
WXYE02xYEWKSW hR3EQRj2/4f3 Z
i

![ l 

S!`&

 !`"+ 

   `+

|\0r?JQ10>7:YcL8iCD9_3E9_<SCDQ1j23EiUWq9

YE0SY6WXY67=9C f (x)
7=Q1K>7
h (x) = 0, j = 1, . . . , q.
|\07:K2<S<>Q^7:9UCD/369U7TQ10>?BA=Y6Q10>7TFl h l6ZZZUl h ?JQR0RADYE0gKSWX9U0RA;L8YEICD90^A=Yc/4jS369U7UZ
 PS C F @  1f/  A x 5DE ?S;<AaKAa;s7; ^JCm=:^LvNJ`7@^5lvL@DJ`n^feF;b5 (P E) 5:?!EFJ*7OEp^m\ OvqJ*?%YeFEF5

(P E)

MOA5mKL?[E
EFJ8KL?l^aA_KLHD=:Aa@D5m;s5mKL?GA_KM`Hvq5mKM]=KL?[E
h (x )  j = 1, . . . , q 
?5m^oEuh`7]5
 =:d.@F=:K`d5 j
j  1 j q 

=:^J8@mEA_^G5m9`AaEI?Q5

h`7]5^5FEd.@F=
;s7^P?3A vL^aA3CF=`?Q5:7@mEyM*5

Z$
wyxz{|} ~L]~{| y,!/pL8IWXQR027FADCD/4A=Y6Q109@7FA]j2/17=I9z7=KSC]3E9zA=wSIUQ1CDiWX9LS9z3c/Q10>?BA=Y6Q10}YEWX<S36Y6?Y~AD99A\QR0
0S9L8QR0S0S9UCD/{Yc?JY;`^Ky- KS0S9L89@7=?C=Y6<8A=Y6Q107=Q1WXW/4Y6C=9RZ,.- 9U027=9Wzj23E9L89@7X<>QRYE0^A[7eL8YEAD7CDIU/13EYc7=/1jS369U7Ul#?1- 9@7FA=b o4b L8Y6CD9
`^KSYG7D/OADY67:Q10^Az7=YEWKS3EAD/402IWX90^AmA=QRK8A=9@7m369U7+?Q10^A=C[/4Y60^A=9U7UlV9U7:A+KS0S9p7:KSC=/1?9 S LS9 R Z!,(- wg5g<>Q1A=wSi@7:9e7=KSC+369U7
h1C[/1LSYE9U0RA h ! wg5g<fQ4A=w2iU7=9+L89_C=IUh1KS3c/4CDY~ADI%$GY6Wq<23EYc`^KS9+`^KS9
Y $&,!/X7:K2C:/R?J9 9@7FA;36Q8?/13E9UWq9U0^AnK20S9_N/1C=Y6IJADImL8Y~ICD90^ADY6/1jS3E9+LS9_LSYEWX90>7:Y6Q10
Z
!
Y! EY $&,y9]<S36/10AD/10SSh19U0^ATo S 90 x 9U7:AnKS0p7=Q1K27:b 9U7=<2/1?9;/:<0S9_L89]LSYEWX90>7:Y6Q10 n n q9qAn<f9KSA A=CD9]L8I 20SY90
Q102?JA=Y6Q10rL89U7khRCD/RL8Y690^AD7 h Z
Q1WXWX9]Q10&0S9m7- YE0^ADICD9U7D7:9]`RK!- /1K8upL8Y6C=9@?BADYEQR027noz<2/1C:ADYECkL89 x l8QR0&/1<S<>9U3E369C[/+<236/10aA[/40ShR90^Ano S 90 x
369+7:QRK27Fb 9U7=<2/R?J9
Q+, J 9@7FA.369 ^/1?Q1jSY690L89@7.?JQR0^A=C[/4Y60RAD9U79UM0 x= {y! h (xR ) : yJy= =0 l 0}j $JDZ ;M0S9\?Q102L8YEA=Y6Q1002IU?J9@7=7D/4Y6CD9T<fQ1K2CG`^KS9
7=Q1YEAMKS0WXY60SY6WzKSW 36Qg?U/43#L89 7=KSC 9@7FA_`RK!- Y63*0!- 9ugYc7:A=9+<2/R7ML89qL8Y6C=9@?BA=Y6Q10>7ML89qL89U7D?J9U0RAD9zLS/1027;369z<S3c/40
x
AD/10Sh19U0^A M (Z (3EK>7k<SCDIU?JYc7=IWX90^A f S
f (x ) 0, d M
?J9X`^KSY#YEWX<S36Y6`^KS9 ! ?U/4C d M $;`^KS9 dd f
QRK90>?JQ1CD9z`^KS9
9U7:A\QRC:ADwSQ1hRQ102/13!o M ! ?JFZ
2hRKSC=9 Z $BZ>|\CkKS0S9mCD9<2C=I@7:9U0RA[/OADYEQR0aL8K7:QRK27:(xb 9@7:<2) /R=?J9 0M 9@7FA ! ?BFZ2?[w>/4<yfZ " (x$ )
f (x ) +

q
X
j=1

j hj (x ) = 0.



LV- Q+,r369]CDIU7=KS3EAD/4AUZ



M = y Rn | y = J T

 



 K )  K

@F ?JN@ 1

 K  

 J8AP? ^f5GvL@DJ`n:^em;s5
A_KAa;yAaEF5m@


 J*7.E

>   > K 

K H CB@cAP? ^5FECFJ:KMOAP?3AJ8K(EMq\ J vq?3Aa;b=:^aA[?HFE




 

f (x) = x21 + x22


x1 + x2 = 1.
DC 5 h*7OA M*J8K(KY5

2x1 + = 0

2x2 + = 0
x1 + x2 = 1.
K Cm=:^[CI7O^qMOA_@D5 C ?M*J8K(KY5^o=<EFJ8^P7?3AJ8K

x1 = 1/2  x2 = 1/2  = 1

6
1

f (x )



Z 

.36/10aA[/40ShR90^A

9AnhRCD/RL8Y690^A
M

|\0XCD9W/4C[`^KS9TLSQ102?k`^KS9k369U7P?Q102L8YEA=Y6Q10>7PLV- QR<8A=Y6W/436Y~ADI Z $*Q1CDWq9U0^AP/NR9U?T369U7P?JQR0^A=C[/4Y60RAD9U7KS07=587FADiWX9


SL 9 n+q I@`RK>/OA=Y6Q10>7yo n+q Y602?JQR0S0gKS9U7UZUd]/40>7y369G?/R7Vh1IU0SIC[/43R! ?J9.7=587FADiWX9(9U7:A!0SQR0m3EY60SI@/4Y6C=9(9A*L8QRY~AKJA=CD9PCDIU7=Q136K
<>/4C_KS0S9XWXIJADwSQ8L89XY~ADIC[/OA=Y6N19RZ(0{/4YEAm?9U7]WXIJADwSQ8L89U7_YEA=IUCD/4A=Y6N19U7UlC=9Uh1CDQ1KS<fI9@7\7=Q1K>7\369X0SQ1W LS9<.C=QRh1C[/4Wqb
W/4A=Y6Q10 ;QR0{,!YE0SI@/4Y6C=9RlV<SCDQ1h1CD9U7D7=90^A]36936Q10ShL89eL8Y6CD9U?BADYEQR027mL89eL89@7=?90^A=9 FK>7=`^Ky- o?J9`^KS9369U7+?Q102L8YEA=Y6Q10>7
Ly- QR<8A=Y6W/436Y~ADI&7=Q1Y690^Aq/1<S<SCDQu8YEW/OADYENR9WX90^A7D/OADY67:/4YEA=9@7Z w2/R`^KS9aWKS3~ADYE<23EYc?/4A=9K2CXLS9&,*/4h1C[/402h19<f9K8A=b A=CD9
Y60^A=9UC=<SCDIJADIm?JQ1WXWX9_KS0r<SCDY~uaW/1C=hRYE02/13VL89m36/qCD9U7D7:QRKSC[?J9 Su8I9m/4Kr7:9@?JQR02LaWX9UWzjSCD9 ! = f /h $BZ
,P]-KUKMLB%MNSTU 
1[2 2  @
Q VC:QWU VMO@U   \ 5DE ? ^f= [J8KC ?3AJ8K L M*5 R R M]=K(E R M*H K(Af5v)=@
X
Z $
!
L(x, ) = f (x) +
h (x).
j



j j

,*/+?JQR02L8YEA=Y6Q10aLy- QR<8A=Y6W/436Y~ADI\L8Ke<2C=9UWqY69CTQ1C[L8CD9k9Ju8<SCDYEWX9]L8Q102?;3E9M/4YEAn`^KS9\3E9]?JQ1K2<S3E9 (x , ) 9@7FATKS0e<fQ1Y60^A


7:AD/4A=Y6Q10S0>/4Y6C=9_L89 L LS/1027 R R Z
K2/102Lq3E9@7#Q102?JA=Y6Q1027(90 F9K7=Q10^A(L89K8uQ1Yc7(L8YEfIUC=9U0^A=Yc/4jS369U7UlOQ10q<>9UK8A.I@?JCDYECD9nKS0S9;?JQR02L8YEA=Y6Q10q0SIU?9U7D7=/1YECD9
LSKLS9K8u8Y6iWX9Q1C[L8CD91ZV,!/r7=Q1K27:b W/4A=CDY6?9qL8K M9U7D7:Y690L8K ,!/1h1C[/40ShRYE9U0 L /17D7=Qg?YEIU9q/1K8uL8IUC=Y6N1IU9U7_7=9U?JQR02L89@7
<>/4CkC[/4<S<fQ1C=Ano x 9@7FA
j=1

L = 2 f (x ) +

q
X
j=1

j 2 hj (x ).

  
&

![ l



 K

9U7:A;WXYE02YEWKSW36Q8?/43 lS/436Q1C[7T36/qW/OADC=Yc?J9

- 9U7:A#3c/MCD9U7:A=CDYc?BA=Y6Q10+LS9
`^KS9 L 369+7=Q1YEAUZ

 4 

% > 

S!`&

|\0r?JQ10>7:YcL8iCD9_3E9_<SCDQ1j23EiUWq9



4  
 

 
!

9U7:AkA=936369+`RK29
d M.

YE0SY6WXY67=9C
7=Q1K>7

(P I)

 A




   *+

,P.-UKMLB8MOSVU )132
 SVU B8C:QWMNU B%@)QWAB%M  @
?3@F=:AaK)?5FEM*J:KY? ^5FEAaKMOA[CF5DEpEFJ8KL?GM]=:K(E

)1



 K   K

`^KSY8L8Q1YEAKA=CD9G7=9WXYEb L8I20SY69G<fQR7=YEA=Y6N191Z  3g0y- 9U7:A#<2/R7!02IU?J9@7=7D/4Y6CD9


M

i C:S ? SV=%MLB%MNSTU

dT L d 0,

/1K7=Q1K27:b 9U7=<2/1?9

 !`"+  



  \


f (x)
gi (x) 0, i = 1, . . . , p.
Kj= vvq5m^a^5 CDJ8KL?3@F=:AaKL?Q5b=`CI?[A[t:5 J`7 Em=`?c7@DH 5

 

5mK


^5FEkCDJ8K

I(x) = {i {1, . . . , p} | gi (x) = 0} .


F
5
I
E
'
?
F
E
8
J
P
^

7
?3AJ8K JDvq[? A_;b=^f5^J`CF=:^5 M*5
5FEI? EmJ:^[7(?3AJ8K JDvq?[A_;b=:^5^J`CF=:^5 M*5
x
(P I)  x
 A_K(A_;yAoEm5F@
f (x)
EmJ`7OE
gi (x) = 0, i I(x ).

d\Q102?_369U7k?Q10^A=C[/4Y60^A=9U7TY602/1?JA=Y6N19@7G0!- QR0RAM/1K2?JK20S9_YE0 >KS902?9+7:K2Ck3H- Q1<8ADYEW/13EYEA=I+L8Kr<SCDQ1j23EiUWq9 (P I) Z


 PS C F @  1   K@ H  U  H A V@C   J`7OEq^m\ .vNJ`?!YeDEm5lM*5pMOA)( HF@F5FKY?[Ao=(n:Aa^_AP?QH58?NM*5S@DHBdY7^o=@cAP?QHM*5FEGCDJ8K
?3@F=:AaK)?5FE>=*C ?3APt85FE ^5FE<d]@m=`MOA5mKL?[E
EmJ:KL?^aA_KYH =:Aa@F5F;s5mKL?AaKM*H vN5FKM]=KY?PE
E A
5FEI? 7K
g (x ) i=:^
I(x )
x
;yA_K(A_; 7; ^fJCm=^vNJ`7@g^5uvL@DJ`n:^em;s5
;s7^P?3A vL^aA3CF=`?Q5:7@mE>M*5y

7 (K 7`C`

5m@
J8@mEuA_^l5B9`AoE ?5
(P I)
p
0




i = 1, . . . , p 



?5m^oEuh`7]5

 

f (x ) +

i gi (x ) = 0,

Z#"87D$

Z "D"%$
Z "+ $
g (x ) = 0, i = 1, . . . , p.
!
|\j27=9CDN1QR027M`^KS9X369U7]IU`^K2/4A=Y6Q1027 Z "D"%$ b Z#"@+$ML8YEA=9U7_L89?Q1WX<S36IWX90^AD/1C=YEA=IX7=YEhR0SY>90^A_`^KS9X369WKS3EA=Y6<S3EYEb
?/4A=9UKSC /17D7=Qg?YEI]o+KS029]?Q10^A=C[/4Y60^A=9;! Y602/1?JA=Y6! N19\9U7:AG0gKS3 ZS|\0aC=9U0^NRQ1Y69MogYE0SQRK8u 5 9V<>QRKSCG3c/zLSIWXQ1027:A=C[/OADYEQR0
L8K&A=w2IQ1CDiWX9m`^KS9m3 - QR0pY63E36K27:A=CD9C[/z<>/4CkKS0r9Ju89UWq<23E9RZ
@F ?KJO@ )
1  J:A[? ^5vL@DJ`n:^em;s5
i 0,
i i

iI(x )

i = 1, . . . , p

AaKA_;yAoEm5F@

EmJ`7OE

f (x) = (x1 2)2 + (x2 1)2

x21 x2 0
x1 + x 2 2 0
x1 0.
M*5FEyEFJ8^P7?3AJ8K(E @DHD=:^aAoEB=(n:^f5DE<5DE ?@F5 vL@DHFEF5mKL?QHbE 7@<^f= `dY7@D5 % K = EFJ8^P7?3AJ8KWJ vq?3Aa;b=:^5 5DE ?
 \ 5mK Em5F; n:^5

^f= vL@FJ D5 C ?3AJ8K0M 7 vqJ8AaKL?


E 7O@ CF58? 5FK(EF5m; n^f5  \ 5DE ?<M*J:KCb^5yvNJ:A_KL?
  Cc@BA[t:J8K(Ey^5FE
(2, 1)T
x = (1, 1)T
CFJ:KMOAP?3AJ8K(EM`5 y7 K 7C *5m@5FK V 587^5FE^5FE6M*587:9yvL@F5F;yAfeF@F5DECFJ8KL?[@m=A_KL?Q5DEEmJ:KY?'=`CI?3APt85DE
x



K J`n`?[Af5FKL?!M`J8KC



1 = 2 = 2/3

2(x1 2) + 21 x1 + 2 = 0
2(x2 1) 1 + 2 = 0.

   


-K K


g2 = 0
g3 = 0

g2 (x )
-f (x )

j
g1 (x )

g1 = 0
-


Z & QR3EK8ADYEQR027]C=I@/436Y67D/4j23E9@7\9A+7:QR3EK8ADYEQR0}QR<8A=Y6W/4369 V369h1C[/1LSYE9U0RA
A[/40ShR90^A;oq 36/X?JQR0^A=C[/4Y60RAD9 g (x) = 0 90 x L89mWXWX9m<fQ1KSC g (x ) Z


X 


en'G)'G
132 & Q1YEA f 3c/qQ102?JA=Y6Q10rL89
)

g2 (x )

9JAmQ1C=A=wSQRh1QR02/43/4K<S36/10



@C:A+MNAD@

R2

LS/1027 R L8I20SY69m<2/4C

f (x, y) = 100(x2 x21 )2 + (1 x1 )2 .

Q10^A=CD9C]`RK29 x = (1, 1) 9U7:A\KS0<>QRYE0^A]7:AD/4A=Y6Q10S0>/4Y6C=9zLS9 f Z /43c?JKS369C f (x ) 9A_LSQ10S0S9UC\3c/02/4A=KSCD9LS9


Z
x
@C:A+MNAD@ )
1 & Q1YEA f 3c/X0SQ1CDWX9\9UK2?J36YcL8YE9U0S0S9+7=KSC R L8I 202YE9RlS<>QRKSC x R lS<2/1C

f (x) =k x k2 =

(x1 )2 + (xn )2 .

RZ Q10^A=CD9Ck`^KS9 f /RL8WX9JAkKS0S9+LSICDYENRI9mL8Y6C=9@?BA=Y6Q1020S9363E9_9U0aADQ1K8A;<fQ1Y60^AML89
"

SZ |\0r7=9]<236/R?J9mLS/40>7 R ZSx;36Q1C[7

f 0 (x; d) =

1
xT d.
k x k2

0y- 9U7:Ak<2/17kLSICDYENO/4j23E9_90 0 Z>|\0rLSI 20SYEA

f (x) = |x|

|x|
f (x) =
1 2
2 x

si |x| >
sinon

 A=K2L8Y69CM36/XL8IUC=Y6NO/4jSY63EYEA=I+LS9 f Z KS936369]9@7FA;3 - 9Ju8<SCD9U7D7:Y6Q10&L89 f <>QRKSC

f =k k2


|\0r?Q1027=YcL8iCD9\3c/Q102?JA=Y6Q10`^K2/1LSCD/4A=Yc`RK29]L8I20SY69+LS/40>7

@C:A+MNAD@ )1

Rn \ {0}

R2

f (x, y) = 5x2 + 5y 2 + 8xy 10x 8y.

<2/4C

7:KSC

Rn

9AM`^KS9

7


 4 

  

% > 



 K

  \



 K   K






4  
 


!

 

/ $GQR0^A=CD9C;`^KS9 9@7FA;KS029_Q102?JA=Y6Q10r?JQ10gNR9Ju89\9AML8IJAD9CDWXYE0S9UC;7:QR0pWXY60SY6WzKSW h136Q1j2/13yLS/4027 R Z


D
j $  9U<SCDIU7=90^A=9UCT36f9U7M?JQ1K2C=jf9U7nL89m0SY6N19@/4KrL89 f Z
V
?8$ex<2/4C=A=Y6CeL8K <fQ1Y60^AaYE02Y~ADY6/13 4) l./4<S<23EYc`^KS9CaYEA=IUCD/4A=Y6Q1027LS9U7eWXIA=wSQ8L89@7eL8K h1C[/1LSYE9U0RAe9AaL8K
h1C[/1LSYE9U0RA;?Q10 FKShRKSI1Z QRWX<2/4CD9Cn369U7n(4,
CDIU7=KS3~A[/OA[7nQ1j8AD90gK27UZ
@DC:ADMNA+@ 
1 & Q1YEA;36/Q10>?BA=Y6Q10 f L89 R LS/4027 R L8QR0S0SI9_<2/1C
2

f (x) = x21 + 2x22 + 4x1 + 4x2 .

QR0RADC=9UCk<2/4CkCDIU?KSCDC=9U02?J9_`^KS9m36/XWXIA=wSQ8L89+L89m3c/X<S36K27nQRC:AD9m<>9U0RAD91l2/NR9U?
90r<2/1C:A[/40^A;L89 (0, 0) hRI0SiUC=9]KS0S9+7=KSYEA=9mN19@?BADQ1CDYE9U3E369 {x } LS9\AD9CDWX9mh1I02IC[d/43

2
2
3k

1 k
3

xk =

= f (xk )

l>/4<S<S36Yc`RK2I9+o

(0L8I@L8KSY6C=9_369mWXYE0SY6WzK2W L89 f Z
@DC:ADMNA+@ 
1f/ & Q1YEA f : R R L89KSupQRY67\L8Y~ICD90^ADY6/1jS3E9z9JA A K20S9+W/OADC=Yc?J9
LSI 20SY69_<2/4C
q : R R
p

pn

L89CD/10Sh p Z & 1Q YEA

/D$ /136?KS3E9UCk3E9mhRCD/RL8Y690^AT9A;3E9 M9U7D7:Y690L89 90&Q102?JA=Y6Q10rL8Krh1C[/1L8Y690^An9JAML8K M 9U7D7:Y690L89 f Z


jV$nxM<S<S36Y6?U/OA=Y6Q10 `(CDQ1j23EiUWq9+LS9U7nWXQ1Y602L8CD9U7kq ?U/4CDC=I@7Z
q(x) = f (Ax).

q(x) =k Ax b k2 ,

Q+, b @9 7FAkKS0pN19@?BA=9UKSCkL89 R L8Q1020SI1Z /43c?JK23E9UC x `^KSYVWXYE0SY6WXY67=9 q 9JAkWX9JA=A=CD9 x 7=Q1K27T3c/+QRC=WX9 x = A b Z


KS9U3E369U7k7=Q10^Ak3E9@7k<SCDQ1<SCDY6IJA=I@7nL89 A Z
@DC:ADMNA+@ 
1  Q10^A=CD9CM`^KS9qLS/40>7;3c/WXIJA=w2QgLS9L8KhRCD/RL8Y690^AM?JQR0 FKSh1K2Iz/4<S<23EYc`^KSI9zoeKS0S9+QR02?BADYEQR0}`^K2/Ob
L8C[/OADY6`^KS9m?JQR0gN19Ju89Rlg/NR9U?\WXYE0SY6WXY67D/OADYEQR0r9JuS/1?JA=91l8369U7n02Q4AD/4A=Y6Q1027k7=KSY6NO/40^A=9@7k7:QR0RAkNRICDY 2IU9U7UZ
p

Q 

 
A 

Vk = lin{d0 , d1 , . . . , dk } = lin{g0 , g1 , . . . , gk }
dTk+1 Adi = 0 i = 0, 1, . . . , k

tk =

k g k k2
dTk Adk

d\Q1020S9Ck369U7k?Q1KSCDj>9@7kL89m0SY6N19@/4KrL89_36/qQR02?BADYEQR0

@DC:ADMNA+@ 1

f (x) = x21 + 4x22 4x1 8x2 .

(0L8I@L8KSY6C=9_369mWXYE0SY6WzK2W L89 f Z
/ $QR0RADC=9UC\`^KS9q36/pWXIJADwSQ8L89qLS93c/a<23EK27\QRC:AD9<f90^A=9X/4<2<S3EYc`^KSI9Xo f l9U0}<2/1C:A[/40^A]L89 (0, 0) 0S9q<>9UK8A
D
?JQR0gN19CDh19UCG9U0rKS0r0SQ1WjSC=9 20SY*LV- YEA=IUCD/4A=Y6Q1027UZ
j $a!CDQ1KSNR9CeK20 <>QRYE0^ApY60SYEA=Yc/43]<>QRKSCp`^KS9}36/ WXIA=wSQ8L89{L8K h1C[/1LSYE9U0RAa?Q10 FK2h1KSI}LS9 #3E9AD?[wS9UC   99UN19@7
V
/4<2<S3EYc`^KSI9+o f ?JQ10gNR9CDh19M9U0rKS0S9+7=9KS369_Y~ADIC[/OA=Y6Q10!Z
@DC:ADMNA+@ 
1 & Q1YEA;KS0S9]Q102?JA=Y6Q10`^K2/1LSCD/4A=Yc`RK29 f : R R L8I 20SY69]<>/4C
n

Q+,

f (x) =

1 T
x Qx bT x,
2

9U7:A;KS0S9_W/OADC=Yc?J9m?/1C=CDI9_7=5^WXIJADC=Yc`^KS9mLV- Q1C[L8C=9 n Z

   


-K K


"

"RZ d\Y67D?JK8AD9CmL89q3H- 9Ju8Yc7FAD902?99A+L893c/e0>/OA=K2C=9XL89U7]<fQ1Y60^AD7_7FA[/OADYEQR0S02/4Y6CD9U7MLS9


9U0QR02?BADYEQR0L8K{CD/10Sh
f
LS9m36/qW/OADC=Yc?J9 Q Z
SZ & Q1YEA x K20<>QRYE0^A\7:AD/4A=Y6Q10S0>/4Y6C=9Rl KS0S9zNO/13E9UKSCM<SCDQ1<2C=9+L89 Q 9JA u 3E9N19@?BA=9UKSC;<SCDQ1<2C=9z/R7=7=Q8?JY6I+o
Z
(
QR0^A=CD9Ck`^KS9

1
f (
x + tuj ) = f (
x) + t2 j ,
2

t R.

2Z d\Y67D?JKSA=9C(LS9T3c/\h1IQRWXIJA=CDY69TL89@7?JQ1K2C=jf9U7L89n0SY6N19@/4Kz9A(L89n3H- I<SY6h1C[/4<2wS9TLS9 f LS/4027#369U7P?U/177:K2YENO/40^A[7


 s2 },!/qW/OADC=Yc?J9 Q 9U7:A;L8I 202YE9m<fQR7=Y~ADYENR91Z
  },!/qW/OADC=Yc?J9 Q 9U7:A;7:IUWqY  LSI 20SY69_<>Q^7:YEA=Y6N19m9AnY63y9ugYc7:A=9mL89U7;<>QRYE0^AD7k7:AD/4A=Y6Q10S0>/4Y6C=9@7Z
 },!/qW/OADC=Yc?J9 Q 9U7:A;7:IUWqY  LSI 20SY69_<>Q^7:YEA=Y6N19m9AnY63y0y- 9Ju8Yc7FAD9m<2/17kLS9]<fQ1Y60^AD7;7:AD/4A=Y6Q10S0>/4Y6C=9@7Z
 },!/qW/OADC=Yc?J9 Q 9U7:AkYE02LSI 20SY69m9JA;0SQR0&7=Y60Sh1KS36Y6iCD91Z
QRWXWq9m/1<S<S36Y6?U/OA=Y6Q10!l8Q10&<>QRKSC=C[/qK8A=Y636Y67=9Ck369U7nW/OADC=Yc?J9@7 Q 9A;3E9@7kN19@?BA=9UKSC[7 b 7=KSYENO/10RA[7lSL2/4027 R








Q=

5 4
4 5

Q=

2 2
2 2

b=



2 2
,
2 2


2 2
Q=
,
2 6
Q=

9
18


1
b=
1


1
b=
0


6
b=
6


cas (C1)
cas (C2)
cas (C3)
cas (C4)

  

 4 

% > 



 K

  \




 K   K






4  
 


!

 

  o~





m

   

|\0 IJADK2L8Y69{LS/1027r?J9?[w2/4<2Y~ADC=9L89U7&WXIJADwSQ8L89U7rYEA=IUCD/4A=Y6N19@7a<fQ1KSCrCDIU7=Q1K2LSC=9K20 7=587FADiWX9{Ly- I@`RK>/OA=Y6Q10>7


36Y60SIU/1YECD9U7UZ  3S7- /4hRY~APL89nWXIJA=w2QgLS9U7PL89nAF5g<f9T<fQ1Y60^A Su89n`^KSY89U0Sh19U02L8CD90^AKS0S9k7:K2Y~AD9nLS9n7=Q136K8ADYEQR027P`^KSYS?JQR0^NR9CDh19
NR9C[736/m7=Q136K8ADYEQR0XLSKe7:587:A=iWX9RZ^|\0N19UC=C[/\`^KS9\?[w2/1`^KS9nYEA=IC[/OADYEQR0X<>9UK8AG7U- 9f9@?BA=K29C.9U0 O(n ) ! 9U0 O(n) <fQ1KSC
LS9U7(W/4A=CDY6?9U7Pj2/102L89@7 $9AG`^KS9M?9U7PWXIJADwSQ8L89U7.<>9UKSN19U0^A
JADC=9M?Q1WX<fIJA=YEA=Y6N19@7./NR9U?T3E9@7(WXIJADwSQ8L89U7GL89;<SY6N1Q1AD/1h19
7=Y n 9U7:ATADC=i@7kh1C[/40>LVZ
2

a



T &"$p $p q+'T" &)




RQ Y~A
K20a7:587:A=iUWq9\3EY60SI@/4Y6C=9MLS9;W/OA=CDYc?J9 A ! n n$(0SQ10eAx
7=YE02h1=KS36YEbiUC=9\L8Q10^AG3 - KS0SYc`RK29\7=Q136K8A=Y6Q109@7FA x ZS|\00SQ4AD9 x
3c/ ib iWX9_?JQRWq<fQR7D/40^AD9]L8K&N19@?BAD9KSC x ?/136?KS3EI_oq3H- YEA=IC[/OADYEQR0 k Z2|\0r7:KS<2<>Q^7:9UCD/z3E9@7nI36IWX90^AD7 a L8Yc/4h1QR02/4KSu
LS9 A=QRK27]0SQ100gKS367UZy,!/aWXIJA=w2QgLS9X?Q1027=Yc7FAD9qo&?/136?KS3E9UC]?[w>/1`^KS9zNO/1C=Yc/4jS369X7:IU<2/4CDIWX90^A@l>369U7_/4KSA=CD9U7\IJAD/10^A
2ugIUA9U7koq369KSCkNO/4369K2C;L89m3H- YEA=IC[/OADYEQR0p<2C=I@?JIULS90^A=9RZ
&

(k)
i

ii

"

JT
 S C:MNB

F @ K
 @QWADS  M

Q1KSC

LSQ10S0SI

k = 0 x(0) Rn

k1
i = 1, . . . , n

lS?U/43c?JKS369C
(k+1)

xi

n
i
X
1 h
(k)
bi
aij xj
aii

*, /]?Q10gN19UC=hR902?9.L89n3c/\WXIA=wSQ8L89n0SI@?J9U7D7=Y~AD9nLS9U7wg5g<>Q1A=wSi@7:9@7#7=KS<S<23EIUWq9U0^AD/4Y6CD9U77:K2C A ?Q1WXWX9T369nWXQ10^A=CD9
3 - 9Ju89WX<S369+7:K2YENO/40^A
j=1,j6=i

LSQ10^Ak36/7=Q136K8A=Y6Q10&9U7:A
x(1)

1 10
10 2

Z wSQ1Yc7=Y67D7:QR027



x1
x2

11
12

23E9@7nY~ADICDIU7kL89 ^/1?Q1jSYV7=Q10^A




x = (1 1)T
x(0) = (0 0)T








11
49
501
2499
(2)
(3)
(4)
=
, x =
, x =
, x =
6
49
251
2499

9A;36/qWXIJADwSQ8L89+L8Y6N19UC=hR91Z
9CDWzKSA=Q10>7k/436Q1C[7G369U7ML89K8u&?JQ136Q1020S9U7kL89
9A;Q10&Q1j8ADYE9U0RA
A
x(1) =

1.2
1.1

, x(2) =

.98
.98

, x(3) =
 

1.004
1.002

, x(4) =

.9992
.9996



  



 


4  

  K

 

9JA;3c/qWXIJA=w2QgLS9+?JQ10gNR9CDh191Z

 T  p"$&$p+%p*
k)J$pk
,y9@7kWXY67=9U7\o FQ12K CM7:QR0^AM9J9U?JA=KSIU9U7M7=IU`^KS9U0^A=Y69363E9UWq9U0^A;90<SCD902/10^AM<>QRKSC x l j < i l23c/L89CD0SY6iCD9mN/13E9UKSC
?/136?KS36I9m7:QRY~A x Z
" J VSVC:MLB  F @K@ 
 QWHK=8= @M K@J
8
L
QR0S0SI
k=0 x R
Q1KSC
l2?/136?KS369C
k1
i = 1, . . . , n
e[


(k+1)
j

(0)

(k+1)

xi

i1
X

n
X

1
(k+1)
(k)
bi
aij xj
+
aij xj
aii
j=1
j=i+1

! 

 @F QWC  HK@ 132 


=*h`7]5AP?QHF@m=?3AJ8K ;yAaEF5  DJ*7@uM`5FE
CFJ8; vqJ:Em=:KL?Q5DE E*\ 5 58CI?c7]565mK

n

O(n2 )
4 vqJ*7@
^5FE>M`587:9 ;bH:? YJM*5DE   \ A_; vL^Hm;s5FKY?Q=`?[AfJ:KjM*5<^F\ AP?QHF@m=?3AJ8KWM*5  =`7.EcE   5mA[M*5m^'KL5<KYH CD5FEBE AP?Q5sh`7]5y^f5<EI?QJC =8d5
MN\ 7K Em5:7^ ?P=(n:^5D=`7 M]=K(E^f58h`7]5m^)^5FE
EmJ:KL?N;yAoE DJ*7@pEFH h`7]5FKY?[Af5F^_^5m;s5FKY?'=^fJ:@BEh`7]5 M*5879 ?P=(n:^5D=`79sEmJ:KY?
x
KYH8CF5FEBEm=:Aa@F5DEvNJ`7@ =*CDJ`n:A  \ AaKL?QHm@Dr8?'M*i5CF5:? ?5M*5F@cKAem@D5!;sH8? YJM*5@DHFEcA3M`5qvL^[7(? *?SM]=:K E'^5 3=:AP?'h`7]5G^5FES;yAaEF5FE
 DJ*7O@uM*5FECDJ8; vNJEB=KL?Q5FEM*5
vq587(t85mKL?'E*\ 5 58CI?c7]5m@5FK>v=:@F=:^a^feF^f5E 7O@uM*5FE'vL@DJCF5DEcEF587@mEMOA HF@F5FKY?PE 
x



 



)(

@F QWC  HK@ 1


K vN5:7?qH8Cc@BA_@D5M*5DEpt:5m@mE AJ8K(ElM*5FE=:^_d`J:@cAP? ;s5DEM*5 =*CDJ`n:ALJ*7  =7OEcE   5mA[M*5m^]v)=:@n:^fJCmE
C =`h*7*5
5DE ?G7K n:^fJCM*5uCDJ8; vqJ:Em=:KL?Q5DE?5m^Nh`7]5l^f= EmJ`7OE 3;b=`?[@cA[CF5M.Ao=:d`J8KY=:^5
5FEI?NKYJ8KsEcAaK`d 7^aAem@D5   KY5
x
a
;yAaEF5  DJ*i7@uM`5 ? Ovq5 =*CFJn:AL@F5:t8Af5FKY?'=^fJ:@BE  @FHDEmJ`7`MO@D567OK E (E ?em;s5^_AaKYH =:Aa@F5 M*5 ii ovq58?[A[?5 ?P=A_^a^f5


(k+1)
[aii ]xi

e

"+ +n1+kp'T$pk

 /.


%$

 l 

W+

 N

= bi

n
X





(k)

[aij ]xj .

j=1,j6=i

T p"$&k )[*n_*) +k

')&  

|\0L8Q10S029ADQ1K8A+LV- /4jfQ1C[LKS0CDIU7=KS3EAD/4AmLS9X?Q10gN19UC=hR902?9z7=KSCm3E9@7_<SKSYc7=7D/40>?J9U7_L89XW/OADC=Yc?J9@7_`RK2Y(<SCDIU?JYc7=9
63 9mC=R3E9mL89@7nN/13E9UKSC[7n<SC=QR<SCD9U7UZ>|\0pC[/4<S<f936369_`^KS9 (A) 9U7:A;3E9mC[/51QR0p7=<>9@?BA=C[/43yLS9]3c/XW/OADC=Yc?J9 A lSY Z 91ZS369m<S36K27
h1C[/40>LaWXQ8L8KS369+L89U7nNO/13E9UKSCD7n<2C=QR<SC=9@7nL89 A lSNRQ1Y6C;?[w2/4<yZ Z


PS C 
 F @ )1[2




B

^5FECDJ8KM.A[?[AfJ:K(ElE 7OA[tD=:KL?5FElEFJ8KL?SH h`7APtF=^f5FKL?Q5FE

limk+ B k = 0

 

A_A

 J8AP?l7KY5;b=`?[@cA[CF5 Cm=@c@DH 5

A_AaA

limk+ B k v = 0  v Rn

(B) < 1

Q1KSCk3c/XL8IWXQR027FADCD/4A=Y6Q10yl8NRQ1Y6C#Z 3qZ Yc/4CD3E9A-5 SlS<yZ " 9 Z






PS C 
 F @ )1

 J8AP?l7KY5;b=`?[@cA[CF5

B  n n

KLJ8K E AaK`dY7^_Aem@D5

u(k+1) = Bu(k) + b

7OKyvL@DJCF5DEcEI7OEAP?QHm@F=`?[A SM]=:K E

M*H KA 6v=:@ ?3Aa@uMN\ 7OKsv)=:@ ?3Aa@6MN\ 7KsvqJ8AaKY? 0 58?!E 7Iv(vNJEmJ:K(Eh`7\ Aa^YvqJ:EBEFe *
M 5 7KbvqJ8AaKL? `9 5
u
Em=`?3AoE 3=:AP?
G
5
L
v
D
@

J
F
C
F
5
B
E
I
E
O
7

E
F
C
8
J
L
K
:
t
m
5
c
@
`
d
l
5
c
E
A
8
5
'
?
F
E
8
5

7

^
m
5
s
;
F
5
Y
K
?
c
E
A
W



u = Bu + b

 (B) < 1


C`\ 5DE ?

Rn

 M.A_@D5


h`7A

W W 


>K

wyxz{|} ~L*~L{|0



4   
 

4  

  K K 

e(k) = u(k) u = B k e0



A=9U02LaNR9C[7 0 7=Y (B) < 1 Ly- /1<SC=i@7.369]A=wSIUQ1CDiWX9 Z "RZ 

QC" H @ 1  J8;y;s5p^f5p@m= (J8KbEQvN58CI?[@m=^)5DE ?qEFJ*7t:5mKL?SM.A kCcAa^5 yH8tD=:^P7]5F@ ^f=>CDJ8KMOAP?3AJ8KsKYH CD5FEBEB=A_@D55:?



EI7>Em=:KL?Q5 (
M 7 ? LH J8@Dem;s5
vN5:7? Qr8[? @F5@D5m; vL^f=*CDH 5Gv)=:@l^f=sCFJ:KMOAP?3AJ8K E 7>Em=:KL?Q5
6@F

%$

kk

k B k< 1
5DE ?l7KL5pKLJ8@B;b5EI7(n`J8@IM*J8KKLH 5 h`7]5m^[CFJ:Kh`7]5 

l 

 SS")&

'"L"

"+



 p 
"+ "&("

N` S

,!9U7WXIJADwSQ8L89U7XYEA=IUCD/4A=Y6N19@7IA=K2LSYEIU9U7eLS/1027?J9?[w2/1<SYEA=CD9r?Q1CDC=9@7:<fQ10>L890^AoK20S9L8IU?Q1WX<>Q^7:YEA=Y6Q10L893c/
W /4A=CDY6?9 A L8K 7:587:A=iUWq936Y60SIU/1YECD97:QRK273c/{Q1CDWX9 A = M N /N19@? M 0SQR0 7:Y60Sh1K23EY6iCD91Z(,!9}7:587:A=iUWq9
36Y60SIU/1YECD9_<>9UK8AM/436Q1C[7n7- IU?C=Y6C=9_?JQRWXWq9_KS0r<fQ1Y60^A Su89
x = M 1 N x + M 1 b.

d- /4<SCDiU7q369aADwSIQRC=iUWq9r8l3c/}WXIJADwSQ8L89rY~ADIC[/OADYENR9p7=9C[/}?JQR0gN19CDh19U0^A=9a7=Yn3E9rC[/51Q10 7=<f9U?BADCD/13kL89p3c/WX/4A=CDY6?9


9U7:AM7FADC=Yc?BAD9WX90^AkY608ICDYE9UKSC;o "1Z
M N
Q1K2C9ug<23EYc?JYEA=9UCz3c/}L8I@?JQ1WX<fQR7=Y~ADYEQR0 ?JQRC=CD9U7=<>QR02LS/10RAz/1K8uWqIA=wSQ8L89@7XL89 ^/1?Q1jSY(9AG3_/1K27D7Fb & 9YcL89U3Hl*Q10
02Q4A=9
Q,
+
9JA 9JA F 7=Q10^AM369U7\<2/1C:ADYE9@7ML89 A A=CDYc/40ShRKS36/1YECD9U7
CD9U7=<f9UA?BADYE=NR9WXA90^A;E/4KrL8F9@7=7=Q1K2D7n9=A;/4diag{a
KL89U7D7=K27k, L8. .9_. 36,/a LSY6}/1h1Q10>E
/4369 ?JFZ 2hRKSCD9 Z " $BZ>|\0&Q1j8ADYE9U0^AM/436Q1C[7 
 % : ' 8 2 8 2  q  ' ; > M = D l N = E + F ! QR0r0SQ4AD9C[/ J ! = D (E + F )
 % : ' 8 2 8 2   s 4 4 " 2 ;8 2.o > M = D E l N = F Z
1

11

22





A=
E



Z#"  d\IU?JQRWX<>Q^7:YEA=Y6Q10L89_3c/XWX/4A=CDY6?9\<fQ1K2C;3E9@7nWXIJA=w2QgLS9U7;L89 ^/1?Q1jSYV9AML89 _3 /4K27D7Fb & 9UY6L89U3




|\0<f9KSA]/1?U?JIU3EIUC=9UC;?J9U7]L89UK8u&WXIA=wSQ8L89@7M9U0YE0^A=CDQ8L8KSYc7=/10^AMKS0
9@7FA;3 - Y~ADICDI_?U/43c?JKS36I_<2/4CkK20S9+L89U7kLS9K8u&WqIA=wSQ8L89@7l8QR0?/43c?JK23E9UCD/ q  2



q5;2=:892 .)2@o 
 : ;

x(k+1) =
x(k+1) + (1 )x(k) .
&
3

Z&Y

x
(k+1)

.0X/4YEAUl1QR0KSA=Y63EYc7:9UCD/m?9JA=A=9;YcL8I9;7=KSC=A=QRK8A./N19@? _/1K27D7Fb 9YcL89U3HZR|\0XQ1jSA=Y690^A(36/_WXIA=wSQ8L89MLSY~AD9ML89kCD93c/OuS/OADYEQR0yZ


,*/XL8IU?Q1WX<>Q^7:YEA=Y6Q10r?JQRC=CD9U7=<fQ102LS/10^A=9M9@7FA
M=

1
D E,

N=

1
D + F.

+

  



 


4  

  K

 

,(- Q1<fIC[/OAD9KSC#L89.<fQ1Y60^A S u89.9@7FA#0SQ4ADI


Z 9U7:A#LSQ102?P3 - Q1<fIC[/OA=9UKSC*LS9.<fQ1Y60RA
] L1
Su89+L89m3c/XWXIJA=w2QgLS9zL8943_/4K>7=7:b & 9YcL8L93 Z>|\=0r(DE)
<2/4CD3E9UCD/qL819 [(1)D+F


4 vs 4 " .)2.o
:<;  7=Y < 1 9JAMLS9 4Vs . " .)2@o 
 : ; 7=Y
Z

>1
PS C F @ )1  I7 vvqJ:EFJ8K(E
E ;bH:?3@BA3h`7]5u5:?N^f=sM*H CDJ8; vqJ:EcA[?[AfJ:K
?Q5F^_^5 h*7*5
EmJ:A[?

A
A =M N
MT + N
M*H KA5vNJE AP?3APt85  ^8J @mE

E
A
8
5
'
?
F
E
8
5
O
7
f
^
F
5
b
;
F
5
L
K
'
?

E
A
F
5
I
E

?
*
M
H

(
K
f
A

5
q
v
:
J
c
E
[
A
[
?
[
A
:
t
5

(M 1 N ) < 1 
 A
&
wyxz{|} ~L]~{| 

A
;





KS<S<fQR7=Q10>7k`RK29 9@7FAMLSI 20SY69m<fQR7=Y~ADYENR91Z>|\0&Q1j27=9CDN19_LV- /4jfQ1C[Lp`^KS9

M T + N = (AT + N T ) + N = (A + N ) + N T = M + N T .

(KSYc7D`RK293E9C[/51QR0v7:<f9U?JA=C[/43k9@7FAejfQ1CD0SI7:K2<>IUC=Y69KSCD9WX9U0RA<2/1CXA=QRK8A=90SQRC=WX9rW/OADC=Yc?JY69363E9RlPQ10sNO/INO/436KS9C
/NR9U?\36/q0SQRC=WX9m7=KSj>QRCDLSQ10S0SIU9]oX3c/q0SQ1CDWX9_N19U?JA=QRC=Y69363E9 k v k = (v Av) 
kM N k

QR7=Q1027

1/2

k M 1 N k=k I M 1 A k= sup k v M 1 Av kA .

w=M

Z>x;36Q1C[7
Av

kvkA =1

k v w k2A

= (v w)T A(v w)

= 1 wT Av v T Aw + wT Aw
= 1 wT M w wT M T w + wT Aw
= 1wT (M T + N )w.

|\0L8IULSKSY~AM/13EQRCD7n`^KS9 k v w k < 1 hRCR?J9_o3 - w^5g<fQ4ADwSiU7=9m7:KSC M + N ! <fQ1K2C w 6= 0$JZ


Z & Y A 0y- 9U7:Ap<2/R7pL8I20SY69}<fQR7=Y~ADYENR91lGYE3_9Ju8Yc7FAD9KS0 x =A 9U3]`^KS9
N) < 1
; ;  & KS<S<fQR7=Q102Z 7pAD`RK2K2L89 Y6Q1(M
2
0
;
7
6
3

/
=
7
S
K
E
Y
=
A
9
L8I20SY69m<2/4C 9JAk<2/1C
9JA
Z 9JA=A=9
= x Ax 0 
7=KSY~AD9_A=9U02L&N19C[7 7X?/1C (B) < 1 Z Q1WX{WX9 }x x = M Ax ==Nx AxAx lSQ1x0r/ = Bx
2
A
1

T
0

k1

k1 k

k1

T
k
1

k1

= (xk1 xk ) M A M (xk1 xk ) (xk1 xk ) N A1 N (xk1 xk )


= (xk1 xk )T (M T + N )(xk1 xk )

? /1C A M I = A N 9JA N A + I = M A Z>|\C x x 6= 0 7=Y60SQ10&Q10r/4KSC[/4YEA Bx = x


?J9q`^KSY*Y6WX<S36Y6`^KS9UCD/1Y~A_`RK29 /aKS0S9N/13E9UKSC]<SC=QR<SCD9mIhR/13E9o)"1l?J9q`^KSY*9@7FA]YEWX<fQR7D7:Y6jS369z<SK2Y67D`^KS9
Z
<1
d\Q102?z3H- wg5^<fQ4ADwSiU7=9z7=KSC MB + N Y6WX<S36Y6`^KS9q`RK29+36/a7:KSYEA=9 { } 9U7:A\L8I@?JCDQ1Yc7=7D/40^AD9]9A]?Q1WXWX9 (B)
>
l
E
Y
#
3
5
/?JQR0^A=C[/1L8Yc?BADYEQR0p/N19@?M369]/4YEAM`^KS9+?J9A:A=9+7=KSYEA=9m?JQR0gN19CDh19]N19UCD7 72ZSdMQR02? A 9U7:A;L8I 202YE9m<fQR7=Y~ADYENR91Z 0  Z
1

k1

k1

 S C:STJNJOQWMLC:@
132
H8?P=KL?LE ;sH8?3@BA[h*7*5lM`H KA5NvNJE AP?3APt85 ^o=;sH8? YJM*5pM*5S@F5F^o=:9(=`?3AJ8KsCFJ:KYt:5m@cd`5'E A 58?EF587^5
A


;s5mKL?'EcA

 0< <2
wyxz{|} ~L]~{|
MT + N

V|\0&INO/436KS9m7:Y6WX<S369WX90^A
MT + N =

1
1
2
D ET +
D+F =
D.

,y9@7yW/OADC=Yc?J9@7V0SQR0z7:5gWXIJADC=Yc`^KS9U7!L8I 202YE9@7!<fQR7=Y~ADYENR9U7yLSQ10S0S9U0^A*36YE9UKmIhR/13E9UWX90^A*o;L89@7yCDIU7=KS3EAD/OA[7yL89T?JQ10gNR9C=b
h19U02?J9m7=Yy369KSC;L8Yc/4hRQ102/13E9]9U7:AM7:A=CDY6?JA=9WX9U0RA;L8QRWXYE02/10^A=91Z



PS C F @ )1


CFJ:KLt85m@cd`5FKL?Q5 

 A

5DE ? 7OKY5G;b=`?[@cA[CF5 <


 M.Ao=:d`J8KY=:^5SEI?3@BA[CI?Q5F;s5mKL?qM*J8;yAaK =:KL?5 ^f=u;sH8? YJM*5M*5


M0S9qWX/4A=CDY6?9qo&L8Yc/4hRQ102/13E9z7:A=CDYc?BA=9UWX90^A_LSQ1WXYE0>/40^A=9X7=/4A=Yc7F/1Y~A]jSY690
7D/OA=Yc7:/4YEA
J = D (E + F )
a <fQ1KSC
J = 0, J =
i 6= j.
a
& Y
9@7FAMoXL8Yc/4hRQ102/13E9_7:A=CDY6?JA=9WX9U0RA;L8QRWXYE02/10^A=91l a > P |a | l>L8Q102? P |J | < 1 l2LV- +Q ,
A
wyxz{|} ~L]~{|

,!/qW/OADC=Yc?J9

;

ii

=*CDJ`n:AY5DE ?

l Z

aii > 0 i

ij

ij

ii

ii

j6=i

ij

ij

(J) < 1 

W W 

%$ %$



4   
 


>K

p! +

l 

4  

  K K 

   "! p
" &"

LG"




NS

- 9U7:AkKS0S9m`^KS9U7:A=Y6Q10rL8Y <?YE369moz3c/1`^KS9U3E369]Q10&<>9UK8AkC=IU<>QR02L8CD9]LS/1027n?J9UC:A[/4Y6027n?/17T<2/1C:ADY6?KS36YE9UCD7n?JQRWXWq9]369
?U/17kL89@7nW/OA=CDYc?J9U7TADC=YcL8Yc/4hRQ102/13E9@7.<2/1CkjS36Qg?U7Z



PSVCF @ 1o/  J8AP?


7KY5p;>=?3@BA3CD56?[@cA[MOAf=8dJ8K =^f5 v=:@6n:^J`CmEM*H K(Af5!vNJE AP?3APt85  ^J8@mE
A
(L1 ) = (J)2 <
7 CFJ*5 kCcA5mKL?M*5@D5m^f=89(=`?[AfJ:K
 = tD=:^587@J vq?3Aa;b=:^5 M(k

opt =

wyxz{|} ~L*~L{|
@F ?JN@ )1[2

#D 

1+
"87 9

PQRYEC Yc/4CD3E9A-5 SlS<yZ Z



1 (J)2

^a^P7OE ?[@FJ:K(ECF5DEM*5m@BKA5m@mEG@FHDE 7^P?P=?[E'v)=@67K 5B9 5m; vL^5

A=

=*CDJ`n:A 

H:? YJM*5gM*5

2 1
1
2






2 0
0 1
0 1/2
M=
, N=
, J=
.
0 2
1 0
1/2
0
EmJ:KL?
58?
^f= ;sH8? LJ`M`5gCFJ8KLt:5m@cd`5
 5FEutD=:^587O@BE'vL@DJDv@F5DEM`5
J
1/2 1/2 


(k+1)

= u2 + b 1

(k)

(k+1)

= u1 + b 2 .

2u1

(k)

2u2
\
F
5
c
@
D
@
8
5
O
7
p
@
D
5

E

?
.
M
[
A
8
t
o
A
m
E
I
H
!
5

v
:
=
@
s

C
*
=
`
h
]
7

5
P
A
Q
?
m
H
@F=`?[AfJ:K 

:
H
?
YJ

*
M
g
5
*
M
5

=
O
7
B
E
E

m
5
[
A
*
M
F
5
^
 









2 0
0 1
0 1/2
, N=
, L1 =
.
1 2
0 0
0 1/4
EmJ:KL?
5:?
^f=<;bH:? YJM*5gCDJ8KLt85F@ d5
 5FEutD=:^587O@BE'vL@DJDv@F5DEM`5

L1
0 1/4 
M=

(k+1)

(k)

2u1

= u2 + b 1

(k+1)

(k+1)

2u2

= u1
+ b2
1 (k)
=
(u + b1 ) + b2 .
2 2
sC =*h`7]5AP?QHm@F=`?[AfJ:K 
 \ 5F@c@D587O@p5DE ?M.A[t8AoEmHI5!v=:@
4
W  H:? YJM*5gM*5 5m^f=89(=`?[AfJ:K 

M=

0
2

 =^3C 7^J8K(E^5GvL@FJM(7OA[?M*5DE

, N=

2 +

0 2 +

, L =

tF=^f5:7@mE'vL@FJ vL@D5FEpHBd`=:^=`7 M*H:?Q5m@B;yA_KY=:KL?

"

(1)
2

1+

2
2
4

det(L ) = (1 )2 .
5DE ?SEI7IvqHm@BAf5:7@D5  # 58?G5F^_^5 CFJ:@c@D5FEQvqJ8KM>=`7>@F= J8KkEPvq5 C ?3@F=:^);yAaKAa;>=^  M*J8KC^f5DE
 =ktD=:^587@J vq?3Aa;b=:^5
t85mKL?!r:?3@D5 HBd`=:^5FE 
tF=^f5:7@mESvL@DJDvL@D5FEuM`J8APopt
 @^587@EmJ:;<;s5<tD=7?
 4k\ J
1
2 2 + 2 /4 = 2 2
 5g?P=`79 M*5 CFJ:KLt85m@cd`5FKCF55FEI?S=:^J8@mEpHBd*=^ 

opt 1.07
0.07  (1/4)2 



O

  




 

4  

  K

 

 


GQR0S02/1027 >Z TZ6l 3]Y63Ejf9C=A >Z Z6ln,y9W/1C=I@?[w2/43 Zn/40>L & /4h^/17:A=Y#(4j>/43 Z  :<; 0 ; 4  : ;)s 0 %5.1;6.s=2 l
N1Q136KSWX9 Q4  : % 0  :<;6.s=214 2 : # o ;_q  : ; 4 Z & <SC=Y60ShR9C@l "  Z
5 :9 Y6/1C=369Jq
A Z 3qZ  :<.'8vscq : ;   o! 4 2"As 0 % .1;6.s=2   : .1;_q5;2.oao 2 2 :#)o    : ; 0 ; 4  :<;  Z/R7=7=Q10yl" O SZ
5 9%$'}'& )(+*-, 29JA/.  x({10{32




l
N1Q136KSWX>9 "1'Z /R7=7=Q10yl*P/4CDYc7l "  Z  o! 4 2 cs 0 %5.1;6.s=2 0 : .1;_q5;2.oao 2 o ;6.s % 2%o  .1: 8 2)o  ;  %  ;2@s .
5 9%$'}'& )(+*-, 29J/
A .  x({10{32




l
N1Q136KSWX9m8'Z /R7=7=Q10y*l P/4CDYc7l "  Z  o! 4 2 cs 0 %5.1;6.s=2 0 : .1;_q5;2.oao 2 o ;6.s % 2%o  .1: 8 2)o  ;  %  ;2@s .
5 954y{768(+9:4 <; G/402>
L =!|?$!{|
  :<.1;
A@ " 0  s :  : ;=4 Z nwS9 RQ1w20 ;QR< gYE0>7G;;0SY6N19UCD7=Y~AF5
(C=9@7=7Ul n/43EA=Y6WXQ1CD91l " . Z
5 9%$'()|~CBD43| N{7(*E, 1/102%
L .6GFN} ~Lz w @ / 0  .)2 8". 2Ko  ;  ".10  : ;6@s=2 s 0 % .1;6@s=2 ZS,!/NRQ1Yc7:Y69C@l
" O Z
5 9%$H( |79   w "I
0 J{9U7=3E9U51l  9@/1L8Y60Sh2l }x+l " O Z
; 2  .   8%  co ; 2  . . /.  0 0 ;  Z(xkLSLSY67=Q1K
5 9g9KSC[/40^A 3qZ
;Q1C=A=w ;QR3E3c/40>@ LV" l 0 "  s : 2 Z . k ows : ;    I  . 92 C 41: 2 0 4 Z & ADK2L8Y69U7!YE0 /4A=wS9UW/OA=Yc?7!/402L_YEAD7*x;<S<S36Yc?/OADYEQR027UZ
5 9gYE02Q1K8u Z
. /.   0 0  : ;'      : % 0  :<; 6.s=2  / 032MZ L TZ(C=dMQgQ KS8027 Q102LVQ1(l3691l /1" C=OYc.7Ul Z" O SZ
5#"879MN ~L| 4 I
; 2 .Oo 92 .  8 ; :<4O o ;_q : ; =4
5 " 9











 



 

 



 

 
 

RF


STJN@=>@BXF

S B%=4A+JOP=

I<2YEhRCD/1<SwS9 ZJZZZZJZUZJZZJZUZJZZZZZZZJZUZJZZJZUZJZZZZJZUZJZZJZ

j2/R7:9m?/10SQ102Y6`^KS9mL89 R ZJZZJZUZJZZZZJZUZJZZJZUZJZZUZJZZZ

;9@7=7=YE9U0 ZUZJZZZZJZUZJZZJZUZJZZZZJZUZJZZUZJZZJZUZJZZZZJZUZJZZJZUZJZ


"

?JQR02L8YEA=Y6Q10LV- KS0S9mW/OADC=Yc?J9 ZZZZJZUZJZZJZUZJZZUZJZZZZJZUZ


?JQR0gN19CDh19U02?J9
36YE02IU/4Y6CD9
ZZJZUZZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZJZZJZUZZJZUZJZ
`^K2/RL8CD/4A=Yc`^KS9ZJZZJZUZJZZZZJZUZZJZUZJZZJZUZJZZZZJZUZJZZJZ
7=KS<f9CD3EY60SIU/1YECD9ZZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZZJZUZJZZJZ
?JQRKSCDj>9@7kL89m0SY6N19U/1KZJZZZZJZUZJZZJZUZJZZUZJZZZZJZUZJZZJZUZJZ

YE02IhR/13EYEA=I
L89 
R36LS9CZZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZZJZUZJZZJZUZJZZ


 

"
"

R/R?JQRjSYE9U0 ZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZZJZUZJZZJZUZJZZZZJZUZJZZ

,!/1h1C[/40ShRYE9U0 ZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZZJZUZJZZJZUZJZZZ
3EQRYyLV- YE0S9UC:ADYE9mL89 & 5^36N19@7FAD9C ZZZJZUZJZZUZJZZJZUZJZZZZJZUZJZ


7

"

L8IUC=Y6N1IU9_LSYECD9U?JA=Y6Q10S0S9U3E369 ZUZJZZZZJZUZJZZJZUZJZZZZZZZJZUZJZ 4 WXIJA=w2QgLS9


L8K&h1C[/1L8Y690^AsZJZZJZUZJZZUZJZZZZJZUZJZZJZUZJZZZZJZUZJZZJZ
L8Y6C=9@?BADYEQR0
L89+LS9U7D?J90^AD9 ZJZZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZJZZUZJZZJZ 7 W /OA=CDoXYc?J9L8Yc/4h1QR02/4369_L8Q1WXY602/40^A=9 ZZJZUZJZZZZJZUZJZZJZUZZJZ
L89m3c/q<S36K27kh1C[/40>L89\<f90^AD9 ZJZUZJZZJZUZJZZZZJZUZJZZ
L8I9U?BADYENR9 ZUZJZZZZJZUZJZZJZUZZJZUZJZZZZJZUZJZZJZUZJZZZZJZ
L8I 20SY69]02IhR/4A=Y6N19 ZZJZUZZJZUZJZZJZUZJZZZZJZUZJZZJZUZJZZ 
L8I 20SY69]<fQR7=YEA=Y6N19 ZZZZJZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZZ 
90>7:9UWzjS369+?JQR0^NR9Ju89{ZZJZUZZJZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZZJZ :
L8Yc/4hRQ102/13E9 ZZJZUZJZZJZUZJZZZZJZUZZJZUZJZZJZUZJZZZZJZUZJZGZ "
L8Yc/4hRQ102/13EYc7=/1jS369ZZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZJZZ

YcL890^A=YEA=I ZZJZUZJZZJZUZJZZZZZZZJZUZJZZJZUZJZZZZJZUZJZZJZU4Z "
/1?JA=QRC=Yc7=/4A=Y6Q10
Y60^NR9C[7:9 ZZZJZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZZJZUZJZZJZUZ "
ZJZZJZUZJZZZZZZZJZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZZ R
LDL
C[/1?JY60S9_?/1C=CDI9 ZZJZUZJZZJZUZJZZZZZZZJZUZJZZJZUZJZZZZJZ 7
7=<>9@?BADCD/13E9 ZZZJZUZJZZJZUZJZZZZZZZJZUZJZZJZUZJZZZZJZUZJZZ
7=IWXY~b L8I 20SY69]02IhR/4A=Y6N19ZJZUZJZZJZUZJZZZZJZUZJZZJZUZJZ 
2QR< ZJZUZJZZZZJZUZJZZJZUZJZZZZZZZJZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZ "
7=IWXY~b L8I 20SY69]<fQR7=YEA=Y6N19ZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZ 
Q10>?BA=Y6Q10
7=5^WXIA=CDY6`^KS9{ZZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZJZZUZJZZ "
?Q102?U/N19 ZJZZZZJZUZJZZJZUZJZZZZJZUZJZZJZUZZJZUZJZZZ "Rl :
A=C[/40>7:<fQR7=I9 ZZZJZUZJZZJZUZJZZZZJZUZJZZUZJZZJZUZJZZZZJZUZ "
?Q10gN19ug9 ZJZUZJZZJZUZJZZZZJZUZZJZUZJZZJZUZJZZZZJZUZJZ "Rl :
QRC:AD9WX90^AM?JQR0gN19Ju89 ZJZZZZJZUZJZZJZUZJZZZZJZUZJZZJZ " W/OA=CDYc?J9U7
7=9Wzj236/1jS3E9@7ZJZZZZJZUZJZZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZZ O
7:A=CDY6?JA=9UWq9U0^AM?JQ10gNR9Ju89vZJZUZJZZUZJZZZZJZUZJZZJZUZJZZZ "
WXYE0SY6WzK2W

h136Q1j>/43]ZJZZJZUZZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZJZZJZUZZJZUZJZZ
3 OAD9U/1K8upL8YEfIUC=9U0^A=Yc/4jSY63EYEA=IZJZUZZJZUZJZZZZJZUZJZZJZUZJZZZ 4
36Qg?U/43XZZZZZZZJZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZZZZZJZUZJZZ
h1C[/1LSYE9U0RA ZJZUZJZZZZJZUZJZZJZUZJZZZZZZZJZUZJZZJZUZJZZZZJZUZJZZJZ 4
7:A=CDY6?JA ZZJZUZZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZJZZJZUZJZZUZJZZZ


"87D7

 4 

"%7W"

WKS3EA=Yc/4<S<S36Yc?/OADYEQR0 ZJZUZJZZZZJZUZJZZJZUZZJZUZJZZZZJZUZJZZJZUZJZ
WKS3EA=Y6<S3EYc?/4A=9UKSCD7
L89 _KSwS08b *K2? 19UC ZZZJZUZJZZJZUZJZZZZJZUZZJZUZJZZJZUZ O
L89+,!/1h1C[/40ShR9 ZJZZJZUZJZZZZJZUZZJZUZJZZJZUZJZZZZJZUZJZZ +
WKS3EA=Y6<S3EYc?JYEA=I+Ly- KS029mN/13E9UKSCk<SCDQ1<SCD9{ZJZZJZUZJZZZZZZZ 

02Q1CDWq9
ZJZUZJZZZZZZZJZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZZZZZJZUZJZZ
lL89SCDQ1jf90SY6K27}ZZJZUZJZZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZZJZ
L8KrWX/4u ZZZJZUZJZZJZUZJZZZZJZUZJZZJZUZZJZUZJZZZZJZUZJZZJZ
9K2?3EYcL8Y690S0S9{ZJZUZJZZJZUZJZZUZJZZZZJZUZJZZJZUZJZZZZJZUZJZZ
7:KSjfQ1C[L8QR0S0SI9 ZZJZUZJZZJZUZJZZZZJZUZJZZUZJZZJZUZJZZZZJZ
N19U?JA=QRC=Y69363E9}ZZJZUZJZZJZUZJZZZZJZUZZJZUZJZZJZUZJZZZZJZUZJZZ
02Q1CDWq9@7
IU`^KSY6N/13E9U0^A=9U7&ZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZJZZUZJZZJZUZJZ
02QO5R/4K ZZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZJZZUZJZZJZUZJZZZZJZUZJZZJZUGZ "


 







QRCDLSC=9_L89+?JQR0gN19CDh19U02?J9 ZZZZJZUZZJZUZJZZJZUZJZZZZJZUZJZZJZ
"

<2YENRQ4AvZJZUZJZZZZJZUZZJZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZJZZUZJZZJZ "
<2/4C=A=Y693&ZJZZZZJZUZZJZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZZJZm
A=Q4A[/43XZJZUZZJZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZZJZUZJZZJZUZJZ;
<fQ1Y60^A
7FA[/OA=Y6Q10202/4Y6C=9 ZUZJZZZZJZUZJZZJZUZZJZUZJZZZZJZUZJZZJZUZJZZ



C[/402hqLV- KS0S9mW/4A=CDY6?9 ZZJZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZ "


C[/51QR0a7=<>9@?BA=C[/43pZZJZUZJZZZZJZUZZJZUZJZZJZUZJZZZZJZUZJZZJZUZJZZ 

7=9U?JA=Y6Q10 ZJZUZJZZJZUZZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZJZZJZUZJZZUZJZZZ :
7=Q1K>7Fb 9U7=<2/1?9\/<X029 ZZJZUZJZZZZJZUZJZZUZJZZJZUZJZZZZJZUZJZZJZn7
7=Q1K>7Fb 9U7=<2/1?9M<SCDQ1<2C=9{ZJZZZZJZUZJZZJZUZJZZZZJZUZJZZJZUZJZZUZJZ
7=<f9U?BADC=9mLV- KS0S9mW/4A=CDY6?9{ZUZJZZZZJZUZJZZJZUZJZZZZJZUZJZZJZUZ 
7=587FADiWX9
wSQ1WXQ1hRi0S9ZJZUZJZZZZJZUZJZZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZ "
7:Y60Sh1K23EY69CZZZZJZUZJZZJZUZJZZZZZZZJZUZJZZJZUZJZZZZJZUZJGZ "


ADCD/R?J9mLV- KS0S9mW/OADC=Yc?J9 ZUZJZZZZJZUZJZZJZUZJZZUZJZZZZJZUZJZZJZ 




NO/1C=Y6IJADI]36Y60SIU/1YECD9 ZJZZJZUZJZZZZJZUZJZZUZJZZJZUZJZZZZJZUZJZZJZUZa7
NR9U?JA=9K2CD7
?JQ10 FKSh1KSI@7{ZJZZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZZJZUZJZZJZUZJZ
3EY60SIU/1YECD9WX9U0RA;L8IU<>9U02LS/10RA[7 ZZZJZUZJZZJZUZJZZZZ6Z "
3EY60SIU/1YECD9WX9U0RAkY602L8IU<>9U02LS/40^A[7 ZJZZJZUZJZZZZZZZ "
Q1C=A=wSQRh1Q10>/4K8u ZJZZUZJZZJZUZJZZZZJZUZJZZJZUZJZZZZJZUZJZ>Z "
<SC=QR<SCD9U7sZJZZZZJZUZJZZJZUZJZZZZJZUZJZZUZJZZJZUZJZZZZJZUZJZ


You might also like