Two matrix eigenvalue inequalities - NIST · Title: Two matrix eigenvalue inequalities Author:...

2
JO URNAL OF RESEARCH of the National Bureau of Standards-B, Mathematics and Mat hemati cal Physics Vol. 66B, No, 2, April- June 1962 Two Matrix Eigenvalue Inequalities Seymour Haber (F cb ru a ry 15, 1 96 2) A lower bo und is given for the quanti ty AI /A., a nd an upp er bo und for t he qu anti ty Al - A., where a nd An are respectively the gr eat est and l east char acteri st ic r oots of a m at rix wi th posit ive roots, Th e bo und s involve the fi rst and seco nd coeffi cients of t he char acter- istic eq uat ion of the m at ri x, S uppo se .11 = (ai,) is a non singulal' n X n matri x wiLh cha ra cteri stic I'OO tS A J, A 2, ' , " An, so ord ered that , , Th e quantit y IAJ I/I Anl pro- vides a rou gh measw'e of th e prob able elTor in th e comput ation of the in ver se of A; it has been called by J, Todd [I , 2, 3]1 th e P- conclition numb er of A and be denot ed P (A), Von eum a nn and Goldstine [4 ] h ave s hown th at if A is symme tri c a nd positiv e d ef init e (in which case the Ai are all positiv e), then th e error in the in verse of A computed by a certain elimi- nation method, c an be bound ed by a quantit y pro- portion al to P (A ) ; if A is not s ymm etric positiv e definite, th e errol' can be bound ed by a qu a nti ty pro- pOltional to P (AA' ), We shall restrict our consideration to ma t ri ces whose root s ar e all positive, For these, p, J, D avis, E. V, H ayns worth , a nd M, Mar cus [ 5] obtain ed bounds on P invol ving d et A a nd on e other sy m- me tri c fun c tion of th e roo ts of A, If th e chara cter- istic polynomial of A i p(x )=x"- OJx,,- J+ ('2X,, - 2+ + (- l )"On a nd " e set th ey sho l\-ed tha t 1 - - fl=7), D ' D/'-' 1- ,1 - 1 (1) a nd th ey Jound similar in equalitie s inv olving On (= d et A) and an y other one of the Oi' In many cases, however, On is not know]] and it is in general difficult to cal culat e, 0 1 (= tra ce A) is easy to calcul ate, and O 2 can in general be calcul ated more easily than can On sin ce it is th e sum of [n (n - l )] /2 d etermin an ts of ord er two, In t hi s paper we pr esent (in Theor ems 1 a nd 1' ) a lower bound 1'01' Pin Lerms 01' 0 1 an d O2; an attempt to obt ain a cor- respon din g upp er bound fa ils, bu t leads to an inequ al- it y (Th eorem 2) on A[- An, the "spr ead" 01' the roots oJ A, Fin ally we th e m ethod of proof of Th e- or em 1 to obt ain an impro vement of the lower bound in (I), I Figures ill brackets indicate the literat ure referen ces at the end of this paper, 57 If \\ -e seL G'K = (K)Sd Al , A 2, ' , " An), then S')K i L it e K'lh ,YJ1lll1 cll'ic mean of Al, ' , " An ' Th e SK s ati s f, '- [6 ] the inequaliti es S tl ' _ AK I }? - > C II1 g iJ-K - An ' we l ave - /-LI and L et and and Si(!Jo I, !Jo2, ' , " !Jo n) S 2(!Jo I, !Jo 2, ' , " !Jo n) Si (AI, ' , " An) 8 2 (A 1, ' , " An) Si C £> , ,1' 2, ' , ".e n- I, 1) S2 (P , j' 2, X3 , ' , ', )' n- I, 1) (2) Theni [ a ndj 2 can be seen to be increas in g in P, a nd (3) Thus the right half of (3) should pro vide a lower bound for P , whil e the left half should provid e an upp er bound , We first calculate j 2( P ) : By di rect calculation we ean show tha t is nonn ega ti ve at all points for each i, Th erefore R at tains its ma ximu m a t a poin t wh er e each Xi is eiLh er 1 or p, Le ttin g RK( P) denot e the valu e of R wh en K - 1 of X2, X3, ' , "X n -1 are equ al to P a nd th e remaind er are equal to one, we find th at RK is equ al to: n- l (KP +n- I {') 2 n (KP +n- K )Z -(Kp 2+n- K ) (4)

Transcript of Two matrix eigenvalue inequalities - NIST · Title: Two matrix eigenvalue inequalities Author:...

Page 1: Two matrix eigenvalue inequalities - NIST · Title: Two matrix eigenvalue inequalities Author: Haber Subject: A lower bound is given for the quantity lamda-1/lamda-n, and an upper

JO URNAL OF RESEARCH of the National Bureau of Standards-B, Mathematics a nd Mathematica l Physics Vol. 66B, No, 2, April- June 1962

Two Matrix Eigenvalue Inequalities Seymour Haber

(F cbru a ry 15, 1962)

A lower bound is given for t h e qua ntity AI / A., a nd an upper bound for t he quant ity Al ­A., where ~" a nd An are respec tively t he greates t a nd least characteristic roots of a matrix wi t h posit ive roots, The bounds in volve t he fi rst a nd second coefficients of t he character­ist ic eq uation of t he m atrix,

Suppose .11= (ai,) is a nonsi ngulal' n X n matrix wiLh characteristic I'OO tS AJ, A2, ' , " An, so ordered tha t I A , I ~ I A 2 1 ~ , , ,~ I An l , The quantity IAJI/I Anl pro­vides a rough m easw'e of the probable elTor in the computa tion of th e inverse of A ; it h as been called by J, Todd [I , 2, 3]1 th e P-conclition number of A and ma~- be denoted P (A), Von eumann and Goldstin e [4 ] have shown that if A is symm etric and positive definite (in which case th e Ai ar e all positive), then the error in the inverse of A computed by a certain elimi­n a tion method , can b e bounded by a quantity pro­portional to P (A ) ; if A is not symmetric positive definite, the errol' can be bounded by a quanti ty pro­pOltional to P (AA' ),

W e shall r es tri ct our considera tion t o matrices whose roots are all posi tive, For th ese, p , J, D avis, E. V, H aynsworth, and M , Marcus [5] obtain ed bounds on P involvin g det A and one other sym­m etric function of the roo ts of A , If the character­istic polynomial of A i p(x)=x"- OJx,,- J+ ('2X,,- 2+

+ (- l )"On and " e set D,= (nnOn ) /O~, they sho l\-ed tha t

_1_<p< I + -l~lJl , 1 - - fl=7),D ' D/ '- ' 1- ,1 - 1

(1)

and they Jound similar inequalities involving On (= det A ) and an y other one of th e Oi'

In many cases, however , On is not know]] and it is in general difficult t o calculate, 01 (= trace A ) is easy to calcula te, and O2 can in gen eral b e calcula ted more easily th an can On since it is the sum of [n (n - l )]/2 determinan ts of order two , In this paper we presen t (in Theorems 1 and 1' ) a lower bound 1'01' Pin Lerms 01' 01 and O2 ; an a t tempt t o obtain a cor­r esponding upper bound fails , but leads to an inequal­ity (Th eorem 2) on A[- An, th e "spread " 01' the roo ts oJ A , Finally we appl~T the m ethod of proof of The­orem 1 to obtain an improvem en t of th e lower bound in (I ) ,

I Figures ill b rackets indicate the literature references at th e end of th is paper,

57

If \\-e seL G'K= (K)Sd Al , A2, ' , " An), then S')K i Lite K'lh ,YJ1lll1cll'ic m ean of Al, ' , " An' The SK satisf,' - [6] th e inequaliti es

S tl ' _ AK I }? - > C II1 g iJ-K - An' we l ave - /-LI ~ /-L 2 ~ !Jo3 _

~ fLn= I ,

and

Let

and

and

Si(!Jo I, !Jo2, ' , " !Jon) S 2(!Jo I, !Jo 2, ' , " !Jo n)

Si(AI, ' , " An) 8 2(A1, ' , " An)

SiC£>, ,1'2, .l'~, ' , ".en- I , 1) S2 (P , j'2 , X3 , ' , ' , )'n- I, 1)

(2)

Theni[ andj2 can b e seen to b e in creasin g in P , and

(3)

Thus th e ri ght h alf of (3) should provide a lower bound for P , while th e left half should provide an upper bound , W e first calcula te j 2(P ) :

B y direc t calcula tion we ean show tha t (o2R ) lox~ is nonnegative a t all points for each i , Ther efore R at t a ins its maximum a t a poin t wher e each Xi is eiLh er 1 or p , L etting RK(P ) denote t he value of R wh en K - 1 of X2, X3, ' , "Xn- 1 are equal to P and the r em ainder ar e equal to one, we find tha t RK is equal to:

n - l (KP+ n - I{') 2

n (KP+ n - K )Z-(Kp2+ n- K ) (4)

Page 2: Two matrix eigenvalue inequalities - NIST · Title: Two matrix eigenvalue inequalities Author: Haber Subject: A lower bound is given for the quantity lamda-1/lamda-n, and an upper

This r a tional function of K a ttain s its maxim um at

K=P~ I and so we ob tain

(5)

which is equivalent to: THEOREM 1:

I + ""I/I - A 1 / <5. P ,where A = --S=----

1- ""1 I -A n-S~ (n- l ) 1

The upper bound (5) can be sh arpened , since in fact we need only consider integer values of Kin (4 ). It can be shown th a t R1=m ax RK if p z

K ;:::[(n-1)(n- 2)] /2. Thus if r;::: [(n - I )(n-2)] /2, SUSz<5. R1(P ); and so, set ting p= Si /Sz, we have:

rep- I ) +~ p(p- I )] n + I <5.P. (6)

N ow if P2< [(n- I )(n - 2)] /2, th en p <5.max RK (P ) J(

= RK*(P ), say; and sin ce each RK(P ) is a strictly increas ing fun ction of P , p< RK* ([(n- I )(n-2)] /2)

!Cn- I )(n-2) <5. R1C[(n- I )(n-2)] /2) and so -y 2 > H;l( p).

Howev er i t can easily b e seen that if p;::: (-J2+ -~) /

(.J2+ I) , then Rll(p);::: ~(n- I )in- 2 ); and so we

conclude that: THEORE M I ' : Ij p ;:::(-J2+!) / (~2+ I ), then [ (p- I )

+ ""1/ p(p-1) In+ 1 <5. P . This lower bound is bet ter than the previous one,

wh en ever i t applies. The attempt to derive an upper bound for P

from th e leIt half of (3) fails, becausej 2(P ) approach es 1 uniformly in P as n incr eases, and so th e inequali ty j 2(P ) <5.Si/Sz will in most cases hold for all values of P . "Ve can , however , by considering the minimum of S~(Al' Y2, Y3, ... , Yn-l, An) - S2(Al' Y2, .. . , Yn- l, An) subj ect to th e condi tion AI ;::: Y2;::: Ya;::: . .. ;::: Yn- l ;::: An, obtain an upper bound for th e spread of th e roots of A. Calling th e above function of Y2, ... , Yn-l D , we evalua te its minimum directly by observ­in g that oD/oYi=- 2/ [n(n - I )](SI - Yi) and o2D / oYioY j= 2/n2 if 1· = j an d - 2/ [n 2(n - I )] if i~j; i, j = 2, 3, . . . , n - l. The (n- 2) X (n-2) m a trix (dij ), with dij= 02D /oy ,oYj is symmetric, and by Gersch gorin 's th eorem each of i ts eigenvalues lies in

th e circle JZ-2/n 2J <5.2 /n2 (~ ~) and so is posi tive.

Thus (d ij) is posi tive defini te, and, set tin g each OD/OY i equal to zero , we find that D is at a minimum when each Yi is equal to (AI + An)/2, and that th e minimal value is [(AI- AS ]/[2n(n- l )]. W e m ay th en conclude:

THEOREM 2: AI- An<5.~2n(n- 1 )(Si-S2).

By th e method of Theorem 1, i t is possible to sh fupen th e left side of inequality (1). Follo\\-ing the nota tion of [5] we write

and seek an upper bound for D l subj ect to the condition P =XI ;:::xz;:::. . . ;:::xn= 1. As in the proof of Theorem 1, we show that o2D J/ox7;::: O for i = 2, 3,

., n - I and finally ob tain th e r ela tion

[ P - I -1+Jogp J n DI <5. log p e P-l (7)

which leads to th e inequality: T HEOREM 3:

e P - l lo~ P - <-- e P - 1

.: - log P . D In

This inequality yields a lower bound for P which is always high er th an that given by (1) (as may be seen by comparing th e proof of Theorem 3 with the proof of (1) in [5]). However i t is cumbersome. It can b e simplified (and somewha t. weak en ed ) as follows: Sin ce xe1/X= a, a ;:::e, implies that x;:::a-e + l ,

I

and e/Dln;:::e by (2), we m ay conclude that (P - l )/ 1

log P ;:::e /D 1n-e+1. D eno ting this last quantity by A, we h ave (P - 1)jlog P ;::: A , which h as as an im­m ediate consequence:

1

THEOREM 3' : P ;:::A log A - l ; A = e/D 1n-e+1. This lower bound is most often , though no t always,

b etter th an that given in (1).

References

[11 J . Todd, The condi t ion of a certain matrix, P roc. Camb. P hil. Soc. 46, pp. 116- 118 (1949).

[2] J . Todd, The condi tion of certain matrices I , Quart. J. Mech . App!. Math. 2, pp. 469- 472 (1949) .

[3] J . T odd , The condit ion of ce rtain m atrices II, Arch. Math. 5, pp. 249- 257 (1954).

[4] J. von Neumann and H . H . Goldstine, N umerical invert ing of matri ces of high order, Bull. Am. Math . Soc. 53, pp. 1021- 1099 (1947).

[5] P . J . D avis, E. V. Hay nsworth, a nd M . Marcus, Bound for t he P-condition N umber of Matrices wit h P osit ive R oots, J . R esearch N BS 65B (Math . and Math. P hys.) No. 1, 13- 14 (J an.- Mar. 1961).

[6] G. H . H ardy, J . E. Litt lc\\·ood , an d G. Polya, Ineq ualities. (Theorc m 52) (Camb. Univ. Press, Camb ., Eng. 19.59) .

(P aper 66B2- 73)

58