Bounds on a distribution function that are functions of ......Shohat and Tamarkin [4]). I A...

5
--- -- ----- Journal of Research of the Nati ona l Bureau of Standar ds Vol. 53, No. 6, December 1 954 Research Paper 2556 Bounds on a Distribution Function That Are Functions of Moments to Order Four l Marvin Zelen Explicit ex pressions are presented [or bound s on a di st ribution function wh en mom ents to order rolll' are known. These inequalit ies are given in a fo rm s uitabl e [or applicat ions . 1. Introduction and Statement of Problem Tch ebychen' [ 7] 2 in J874 proposed a problem t 11at can be stated as follows: Let F (y ) be an unknO\\'n di st ribution fun ct i on oyer the clo se d in ter val 3 [a, b], and sat isfying the co nditions F(CL - O) =0 (j = o, J, ... , k). If the moments mj for j = O,I, ... , k arc known , th en for a giv en value of x, (a< x< b), wh at are the (sharp) llpper an cllowc l' hounds on F (x )? Tchebych cA' pr esented without proof a solution to the above problem, whi ch is som et imes called t he reduced-moment problem. Proofs were l ate!" given by ;'1arko ff [ I ], Posse [2], and Stieltj es [5,6]. '1 '1 1(' book by Sh ohat fLnd TfLluarkin [4 ] gives an. acco un t of some of the moclern- day treatments of the subje ct . This paper pr esents t he ex plicit ex pr essions for solu tions of the moment problem (often referred to as the TchebychcfT"-1[arkoA' inequaliti es ) for the cases k = 2,3,4. Inequalities th at arc functions of moments to order two were given by Tcheb ycheA' [ 7] for di stributions over the interval [O, b]. In equa li ti es th at are functions of moments to order t hr ee IVere given by Po sse [2]. Posse also so lved the case of four moments for di stribu tions over the in terval [a , ro). 2. Explicit Expressions for Bounds Thi s section pr es ents without proof the explicit expr essions for bounds on a di stribu tion function. Proofs may be found in [9]. Th ese are derived as special cases of the Tchebycheff- Markoff inequaliti es . In all that follows it will be ass umed t ha t (1) Th is willl" es ult in no loss of generality, as any di stribu tion fun ct ion can be mad e to conform to these conditions by the li se of a linear t ransform at ion. The assumption (1) implies th at a, b satisfy the inequaliti es (2) This fo llows from the necessary conditions for the so lution of the momen t probl em (d. Shoh at and Tamar kin [4]). I A condensation of certain res ul ts obtained by the author in a thesis submitted to the University of North Caroli na in June 1 951 in partial fulfillment of th e requ irements for t110 Master of Arts deg ree. 2 Figures in brac kets indicate the literature references at the end of t hi s paper. 3 Throughout this paper it will be understood that a di stribution function over the interval [ao, b] is one where the range of the random is [a, b l. and the end points will belong to that interval unless the end points are - co or + co. 377

Transcript of Bounds on a distribution function that are functions of ......Shohat and Tamarkin [4]). I A...

Page 1: Bounds on a distribution function that are functions of ......Shohat and Tamarkin [4]). I A condensation of certain results obtained by the author in a thesis submitted to the University

--- -- -----

Journal of Research of the National Bureau of Standards Vol. 53, No. 6, December 1954 Research Paper 2556

Bounds on a Distribution Function That Are Functions of Moments to Order Four l

Marvin Zelen

Explicit ex pressions are presented [or bounds on a distribution function wh e n mom ents to order rolll' are known. These inequalit ies are given in a form suitable [or applications.

1. Introduction and Statement of Problem

Tch ebych en' [7] 2 in J874 proposed a problem t11at can b e stated as follows: Let F (y) be an unknO\\'n distribution function oyer t he closed interval 3 [a, b], and satisfying the conditions

F (CL - O) = 0

(j = o, J , ... , k).

If th e moments m j for j = O,I , ... , k arc known, th en for a given value of x, (a< x< b), wh at are the (sharp) llpper ancllowcl' hounds on F (x)?

T chebych cA' presented without proo f a solution to the above problem, which is sometimes called the reduced-moment problem. Proofs were late!" given by ;'1arkoff [ I ], Posse [2], and Stielt jes [5,6]. '1'11(' book by Shohat fLnd TfLluarkin [4] gives an. account of some of th e moclern­day treatments of the subject .

T his paper presents t he explicit expressions for solutions of the moment problem (often referred to as the TchebychcfT"-1[arkoA' inequalit ies) for the cases k = 2,3,4. Inequalities that arc functions of moments to order two were given by TchebycheA' [7] for distributions over th e interval [O,b]. Inequali t ies that are functions of moments to order three IVere given by Posse [2]. Posse also solved the case of four moments for distribut ions over th e interval [a , ro).

2. Explicit Expressions for Bounds

This section presents without proof th e explicit expressions for bounds on a distribu tion function. Proofs may be found in [9]. These are derived as special cases of the Tchebych eff­Markoff inequalities .

In all that follows it will be assumed that

(1)

This willl"esult in no loss of generality, as any distribution function can be made to conform to these conditions by the lise of a linear t ransformation. The assumption (1) implies that a, b satisfy the inequalities

(2)

This follows from t he necessary condit ions for the solu t ion of the moment problem (d. Shohat and Tamarkin [4]).

I A condensation of certain resul ts obtained by the author in a thesis submitted to the University of North Caroli na in June 1951 in partial fulfillment of the requirements for t110 Mas ter of Arts degree.

2 Figures in brackets indicate the li terature references at the end of this paper. 3 Throughout this paper it will be understood that a distr ibut ion function over the interval [ao, b] is one where the range of the random variabl~

is [a, bl. and the end points will belong to that interval unless the end points are - co or + co.

377

Page 2: Bounds on a distribution function that are functions of ......Shohat and Tamarkin [4]). I A condensation of certain results obtained by the author in a thesis submitted to the University

l_ ~

2 .1. Bounds for Two Moments

Let F (y) be a distribution function on [a, b] wi th known moments

th en for a giy en x, (a< x< b),

l + bx < F (x) <1- l + ax (a- b) (a- x) - - (b- a)(b- x)

x2 --<F(x) < 1 1+ x2 - -

. 1 If a<x<-~ - b (3)

(4)

(5)

For any- distribution defined over (- 00, (0) inequalities (3) and (5) hold for x<O and x>O, respectively.

2 .2 . Bounds for Three Moments

Let F (y) be a distribution function on [a, b] with known moments

then for a given x, (a< x< b)

m3-(a + b) w= l + ab

l + ex{3 A (ex,{3,'Y) = (-y _ ex) ('Y - (3) '

° ~F(x) ::::;A(b, Z2, x)

A(x, b, Z2) ~F(x) ~A(x, b, Z2) + A(b, Z2 , x)

1- A (a, Zl , x) ~F(x) ::::; l

if x<O, g(x) ;::: ° if g(x) ~ O , x::::;w

if g(x) ~O , x;:::w

if g(x) ;::: 0, x> 0.

(6)

(7)

(8)

(9)

Inequalities (7) and (9) hold for any distribution F(y) on [a , (0) . Inequalities (6) and (8) hold for any distribution F (y) on (- 00, b]. Note that none of the inequalities (6) to (9) holds for distributions over (- 00, (0).

2 .3 . Bounds for Four Moments

L et F(y) be a d istribution function on [a, b] with moments

Let

c( )=12+ [ 'Y - m3+ 'Y ('Ym3-'"!'.4) ] 1 + ['Ym3- m4+(m3- 'Y)2]. 9 y ,'Y Y 1+ 'Y (m3- 'Y) . Y 1+ 'Y(m3- 'Y)

378

Page 3: Bounds on a distribution function that are functions of ......Shohat and Tamarkin [4]). I A condensation of certain results obtained by the author in a thesis submitted to the University

U (y )= g(y ,a), V(y)=g(y , b), Z (y )= g(y , x), and let Ul<U2, Vl<V2, ZI<Z2 be the di tinct zeros of U(y ), V (y ), Z(y) , respectively, tben a<vl< ul<,U2<U2< b.

D efine m3 (a+ b + x) - m 4 - ab - ax- bx

Z3 abx + a + b+ x - m 3

A m4- mN- l (1 + x2) (m4-m~- 1) + (x2 - m3x- 1)2

m3- (a + (3 +z3) - a(3z3 B (a,(3 ,'Y) ('Y- a) ('Y - (3 ) ('Y - Z3)

then for a given yalue of x, (a<x<b),

O ~F(x) ~A

B (b,x,a) ~ F(x) ~B (b ,x,a) + B (a ,b,x)

1+ x z2 < F (x) < l +xz2 +.11 (ZI-X) (ZI- Z2) - - (ZI-X)(ZI- Z2)

I - B (a,b ,x) - B (a,x,b) ~F(x) ~ I - B (a,x,b)

l -A ~F(x) ~ l

if a<x~vl'

if Vl~X~Ul

(10)

(11)

(12)

(13)

(14)

For any distribution defined over (- en, en) inequalities (10), (12), and (14) hold, respec­tively, for X<ZI' ZI<X<Z2, Z2<X.

However, the ordering of x in relation to ZI, Z2 is equivalent to the following. Let g(x) =x2- m3x- 1, then

x> o, g(x» O

x<O, g(x» ° g(x)<O

if, and only if, Z2<X.

if, and only if, ZI>X

(15)

(16)

(17)

Using (15) to (17) , the applications of tbe TchebychefI-MarkoiI inequalities for the case where F (y ) is defined over (- en, OJ) are made particularly easy.

3 . Application of the Tchebycheff-Markoff Inequalities

Let F (y ) be a distribution function whose fir t foUl' moments coincide with tho e of the standard normal distribution, i. e., mo= l , ml= O, m2= 1, m 3= 0 , m 4=3. The Tchebycheff­Markoff inequalities will be used to find bounds for F(x) when x= 2, 3.

Bounds using two moments: Since x> 0, inequality (5) is applicable, and we have

.8000 ~ F (2) ~ 1

.9000 ~F(3) ~ 1.

Bounds using jour moments: Since X> O, 9(2» 0, 9(3» 0, inequality (14) is applicable. ubstituting the appropriate values, we have

therefore, .8947 ~F(2) ~ 1

.9777 ~F(3) ~ 1.

Note that there are no inequalities applicable using only moments to order tluee.

379

Page 4: Bounds on a distribution function that are functions of ......Shohat and Tamarkin [4]). I A condensation of certain results obtained by the author in a thesis submitted to the University

----- -

4. Appendix

Statements and proofs of the Tchebycheff-Markoff inequalities can be fou nd in Shohat and Tamarkin [4], Uspensky [8], and Royden [3] . This section contains a statement of the Tchebycheff-Markoff inequalities as the above sources do not give the theorem in full generality, and it is not readily available in the literature.

Before stating the theorem it will be convenient to define the following: Let T n(Y), Un(y) , I1n(Y) , W n(y) be polynomials of degree n defined by

i b T n(Y) 8n - 1 (y)dF(y) = 0

i b Un(y)8n_l(y )(y - a)dF(y)= 0

f: I1n(y)8n- l(y ) (b- y )dF(y) = 0

i b Wn(y)8n_1 (y ) (y - a) (b- y)dF(y) = 0,

(18)

(19)

(20)

(21)

where en-ley) is any polynomial of degree ::::;n - l , and the coefficient for yn in T n(Y) , Un(y) Vn(Y) , W n(y ) is unity.

TchebychejJ-jt1arkojJ Inequalities: Let F(y) be any distribution function on [a,b] with moments mo, ml , .. . ,mk

mj= i b yidF(y)

and let x be a given number (a< x< b), then

where

(j = O,I , .. . , k ),

p(z) = ( b q( z) - q(y) dF(y ), Ja z- y

and YI < Y2< ... < x< .. . are the zeros of the polynomial q(y) of degTee l' defined by

q(y) = (y - x)w(y)

q(y) = (y - b) (y - a) (y -x)w(y)

q(y) = (y - a) (y -x)w(y)

q(y) = (y - b) (y -x)w(y)

if k = 2n, Un (x) I1n(x) > 0,

if k = 2n, Un (x) I1n(x) < 0,

if k = 2n - l , Tn (x) W n_l(x» 0,

if k = 2n- l , T n (x) W n_1 (x) < 0,

where r = n + 2 for eq (23), r = n + 1 for (22), (24), (25), and w(y) is determined by

i = O, 1, . . , n - l for (22)

i=O, 1,. ., n-2 for (23), (24), (25) .

(22)

(23)

(24)

(25}

COROLLARY : For eq (22) the inequali ties hold jar any distribution over (- 00 , CD) with moments­mo, ml,. . ., m 2n. The inequalities jar eq (24) hold JOT any distribution oveT [a, 0) with moments­mo, ml, .. . ,m2n- !. The inequalities JOT eq (25) hold JOT any distribution over (- ro, b] with. moments mo, ml, . .. , m2n- !.

380

Page 5: Bounds on a distribution function that are functions of ......Shohat and Tamarkin [4]). I A condensation of certain results obtained by the author in a thesis submitted to the University

I wish to cxpress my thanks to Professor Wassily Hoeffding, Univcrsity of S Ol'Lh Carolina, for his invaluable guidance during the preparation of this work.

5 . References

[1) A. Markoff, D emo nstration de cer taines in egali ti6s de ~. Tchebycheff, Math . Ann . XXIV, 172- J 80 (18 4). [2) C. Posse, Sur quelqu es applica t ions des fraction s continues a lgebriq ues (Acade mic Imperiale des Sciences,

St. P etersburg, 1886). [3) H . L. Royden, Bounds on a dist ri bution function \\"he ll its .first n moments arc g il'en, Ann . :V[ath . Stat. 24,

361- 376 (1953). [4) J . A. Shohat and J . D . Tamarkin. The problems of moments (Am. :V[ath . Soc. , NelV York, 1943). [5) T . J . Stieltjes, Sur l'el'aluation approchee des integrales, Compt. rend XCVII, 740- 742, 79 799 (1883) . [6) T . J . Stieltjes, Recherches sur les fraction s co ntinues, Ann . facu lte scicnces Toulouse VIII, 1- 22 (1894);

IX, 45- 47 (1895) . [7) P . T chebycheff, Sur les va leurs limites des integrales, J . de Math. [2) XIX, 157- 160 (1874). [8) J . V. Uspensky, In t rod uction to mathematical p robabilit.l' (YlcGra"'-Hill Book Co., New York, N. Y. , 1937). [9) M . Zelen, Bound s on a distribution function which are fun ctions of moments, unpublished mas ters th esis

(Unil'ersit.1' of ~orth Carolina Library, 1951).

WASHINGTON, Noyember 20, 1953.

381