kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying...

77
kAJ NE REPORT NO. QAR-Q-O11- COMPUTER SIMULATION -OF MAXIMUM' LIKELIHOOD OUTPUT FOR STANDARD- LANGLIE TEST DONALD C. RAPPAPORT DECEMBER 1977 ARTILLERY SYSTEMS DIVISION PRODUCT ASSURANCE DIRECTORATE US ARMY ARMAMENT RESEARCH AND DEVELOPMENT COMMAND DOVER, NEW JERSEY DISTRIBUTION SITXNT A Approved for public wa1ea~ Distriibution Unlimited

Transcript of kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying...

Page 1: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

kAJ NE

REPORT NO. QAR-Q-O11-

COMPUTER SIMULATION -OF MAXIMUM'

LIKELIHOOD OUTPUT FOR STANDARD-

LANGLIE TEST

DONALD C. RAPPAPORT

DECEMBER 1977

ARTILLERY SYSTEMS DIVISION

PRODUCT ASSURANCE DIRECTORATE

US ARMY ARMAMENT RESEARCH AND DEVELOPMENT COMMANDDOVER, NEW JERSEY

DISTRIBUTION SITXNT AApproved for public wa1ea~

Distriibution Unlimited

Page 2: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

0 _0 E ~NOREPORT NO. QAR-Q-011

Id

-C M UTER JU M LA ION OF -MA IMUzfIKELIHOODUTPUT FOR S NDARD l::

i= LA =LIE T EST '

DONALD C. RAPPAPORT D D Q

........ -'- F -

Artillery/Tank Systems DivisionProduct Assurance Directorate

US Army Armament Research and Development Command /Dover, New Jersey 07801

AppwoV0 4 - "

'd

Page 3: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

TABLE OF CONTENTS

PAGE

I. Discussion ........................................... 1

II. Sample Statistics: Maximum Likelihood Method ........ 2

III. Sample Statistics: Five Percent Random MalfunctionRate ............................. 3

IV. Sample Statistics: Ten Percent Random MalfunctionRate ............................. 4

V. Sample Statistics: Least Squares Fit of CumulativeNormal Probability Distribution.. 5

VI. Sample Statistics: Least Squares Linear Fit forAverage followed by Least SquaresFit of Cumulative Normal Pro-bability Deviation for StandardDeviation ........................ 6

VII. Comparison of Three Estimating Methods .............. 7

VIII. Applications of Derived Statistics ................. 8

Appendix A: Procedures for Determining TheAverage (V50) ........................... Al - A2

IX ~ 'te Sectionl,:j". section 0

'it13

te.. I'i

Page 4: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

Discussion

The purpose ef this report is to give an accounting of theefficiency and reliability of the sample statistics derivedfrom the Langlie Sensitivity Test using the maximum likelihoodmethod in obtaining an average penetration velocity (V50) anda standard deviation of the penetration velocity.

The assumption is made that the probability of obtaininga penetration is distributed as the cumulative normal proba-bility distribution. The maximum likelihood method in theorywill give the most likely estimates of the average and standarddeviation of this normal curve.,

The test procedure begins wich estimates of those levelsat which failure and success have highly likely probabilitiesof occurrence. These estimates have little credibility. Ifthey were good estimates, the test would not have to be conducted.This report shows the expected results with estimates, referredto as gates, of varying size around the true average.

The Langlie Test Procedure is defined in detail in Appendix A.A computer program was prepared simulating test results usingthis procedure. The true population was defined as being acumulative normal distribution with an average of zero and astandard deviation of one. Each of the sample distributionsshown were derived by using different starting estimates interms of the standard devi.ition.

Hopefully, these tables will provide insight in the useand application of this procedure.

Page 5: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

II. Sample Statistics: Maximum Likelihood Method

Most of this section is devoted to computer printouts ofdistributions of sample averages and sample standard deviations.An attempt was made in Figure 2-1 to summarize some of theaccumulated data. It is the author's opinion that the summaryhides much of the information contained in the printoutsbecause the distributions do not conform to standard proba-bility distribution curves, therefore although these printoutsare bulky, they are included.

The author has been advised by Ms. KodatA of AberdeenProving Ground, that the standard deviation (for the standardtest) should be divided by .745 in order to unbias the results.

From Figure 2-1, it is noted that as the initial gatesget closer the variation or standard deviation of the standarddeviation increases per unit average standard deviation (underStandard Deviation, see Standard Deviation/Average). Thestatistics were obtained from the grouped data on the printouts.It is assumed that part of the reason the Average of theestimated averages all tend to be negative is that the estimatesthat are exactly zero are in the group labeled -.10 to .A0 andthat some of the tables were computed using the same randomnumber set.

As stated previously, these tables were generated toprovide some insight in the analysis of sample estimates ofpenetration data to the user of the Langlie Test Procedure.Some applications are discussed in Section VIII of this report.

A. Author of the modified computer program used to calculatethe maximum likelihood average and standard deviation.

2

Page 6: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

0

Selected Summary of Computer Printouts

Initial Estimates (In standard deviations)-5 -2 -2 -1 0 -0.5

to to to to to to -,

+5 +3 +2 +2 +2 +0.5

Averages

Average -.01 -.01 -.03 -.03 -.05 -.04Standard Deviation .40 .39 .39 .38 .61 .42Number of valuesused from printout 8A9 827 816 849 467 757

Number of extremevalues not used 0 0 0 1 21 4

Standard Deviations

Average .77 .69 .71 .61 .77 .39Standard Deviation .42 .38 .51 .49 .85 .47

Number of valuesused from printout 8A9 825 884 844 463 753

Number of extremevalues not used 0 2 2 6 25 8

StandardDeviation/Average .55 .70 .72 .80 1.10 1.21

Total SimulationsAttempted 1000 1000 1000 1000 1000 1000

Number of simulationsnot used due to

No overlap 135 95 65 53 68 52

Iterative processfailed 36 78 49 97 444 187

Fig. 2-1

Page 7: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

~ M . cI m 1 M.' -"5'

0 so 0 o o eOoo p

OF 0 00 cO~ cb C~ c; c c00 c c

CW. I C;0U. w I o 0foe oO.0-.p i C 1 4

zr p .-, I-

a~ 9. o 0 0 o 0 00000 0000 0 ~ ~ ~ b ~ o

9j I t C' v r5f0 C ,0~ 0000 I O'tQ 0000 10 0 't.194C 9r *9 r^( (

9-Z V, >5 ' l a'0-p.Je' cc Li O - a cco jtfL 9 2 s- o o - 'cc' -

w! 9 3r1r'a C :Cc44c4 c C

m rrIn 4 r4 ' fc~ nj.e r- t- In r-' In 4's41 s I

5?- 0000

9 Z ~ L.-O I 0990~~ cc5~'s.

It,~0 0 0 O o o ~ o e o 9 I 0 0 0 0 0 0 0 0 C 0947c 9 .'C.J'91f 1:O0-(J'4pO' '('(~~' 0' .t4 p0(-

z9

L rWc a, 05 .? U, oI m-- - - -Z-- - L9

9C 9 Li I9 L

,~- . 9 I p

z 2 - - - -9 ,ri Q ~

10 1W0, " IA I0 I I 9U-L. 0 ZL5L i: m~ IL, Is ocLc [c A. - 3r-rt--.P Lf "

I9C I ~ . . . ... . ... 9.11-'510. 1 c9

MI 't as 5D ('r r- 01 IN'1 0 r-I-'D 0,0C, 010, lo- 100 ~ 0 00' 0 a'~ 49: ~ L . . ; ; r; 0 t'a 0'1'O*

m Ir cc9,(,0 Y ''G',f

z I-. I. I. I.II. 99 07c vI 4L~- c m~l--,~' O' 'jO v05~ 0r00 CcooooI

I0 : I I I I 1 1 1 1 0 U) -j I I I I ( .I\" 1 ' I' 0Lr pA Lf If 0 5 9 ~

9Csrr . I ' C C C c cC C( C C 9 t 5 Cf " C~ C '

4 I..'~I IC00 00 0 0 0 9C i- c 00 0 0 00 09

9 ' w I Uau-a Itji . I. I. I..1 0 .... ....

912 0 9 9 1 0 c . 1 mN 0 AU(

9 0 j

x ~ T 21 c usu9 -

1.. 0 00 00 OOC" ('0 009 1.. 100 00 C .'L921- . . . . . . . . .A Cc.. . . . . 9 xas~~~ a00~ 0

I=.. . . . . . . . . . . . 9 -4Z4110 O 0 CCC c0 4 wI COO 0 ecOr~I(I % IL9 0Ca('-cloC 05 0 'tof c'

c rI ( I-I .. . . . .'. C c

*<Lra >!C occo occ cccc o >

Page 8: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

-i u4 I 1 I

4T41

- *

i.1L *~fj Tr ii

Page 9: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

*3 23, 0Ia . o o1 DC D I' O

a~ c., a. ' ~ ~ a 3' 0 .a , C, a~0 0 20, 0, 000

06 01

00 *0 0l En *0 O

I c.

c OLC C C

L a CL 0

I~o a a, Ol 00,a ,r0 ) , C, o 10

0, I 7

c) c I 0: 0 0 0 OF3 ~

0

6N 1~4~ 4lofo l

a M

to 0N I ' 0 02'n V

r 0 0 ' s O N W C 4

0. 0 31

**-.o.. N C i20

rr x 0

0 010Lr

4 0

*N- .. O le \j N ells M000

0c- IC C c D c C C I C,, Il 0,C cL

I~a a I-I I- X- i a- r- r.. f- 1

-

0~~ I1 v I I- 0 a 0

Page 10: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

7H±

-M 7

IM

TILL

-1.1-L -HitEEL -T=

12ji 0 ..

-H±'L

+H4-rrT-

jIIIH±H-

TF

4t- Ta- - -JILL

+f -4-

-I 1A

T-- M-r-

.. ........

Page 11: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

IX AI 2

0 ,

5-F9 IC O : 01. - D-I I----I-

I .

> OCOD 0 00CDC0Co OCCOC C0 ~ ~ ~ ~ ~ ~ , -- -fJ- Cu C F-

e~IA1wOLu 0 0 0 C C4C p

U o o .'o3 O b 0000 co0't 01 0 0 0 00 I- 1' ~ 00 0 0 o o bo1x ~ 0 o, a 4 0 71 a 0\ Cu0 01 l'. 2r OO0..C 41 t '0 C u ' 4 ,

WC OD 0,0 M 00 .......... OD.... a0u

u u u u * uA ? I I

0 AJ

4 01 1 I 1-

~~L , r Ca,1- C # 5C4. .o .I

0>I 0oo 0 0 00<> 00 0 o~ 00000 0*

A ~ n 1 1- 1.

60,,.-I A'-L~j0j

014 1 N

. .. .. . . .: r. It trC m IoMoItoit0 (A I Z LCcp C I 0 C (t C~

Fi I I- :-kMla I- C.

..," ,

Al -cc.

-

0~~~ 3 0 'u *AI OA 0 Q

-1~ s 0 0n 0a0 0 0 0 I t0AIW-. . .a

oI NIIUMI I fIjo a c mO< 2C R 11 - P W IA A ;

Page 12: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

fill

T

Lill

tatt

-- T

T T - -------------- ----

-- ----------------------

T T-TT

T

--------- - - --- ------

I ------- ---

f :f-M

T

I d r[---- ---- ----- 4 -T -- -----

T- _1 T TIT t T-

-R-jfl-f I fl ttT

-TT

-- - ----- -- T ------

- I -- --- - --.. - ITT

A V

--------

TT [t

T-

Page 13: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

It I

z . L ;@u OW 0' 1; C; D, 1; 1*1 14tu ,1

IU I

~~z. . .i . . . . .I . .i.

0N c '0 0l 0 c 0 00 0C0jz cDQ 0 N o 0 0

0 0 0 1 0 CD 0 0 0

r' ~4 4 -z O . e .1 . 0 0

th I

DI

W~r w' IcL 'mfI 8l

co z' 0 ''o 0'3O 0' 0' 0' 0' C0' N.CD' .~t I-V- P) I U 'or

> 1 10 -*CM0 0 p o 0~a 00 LI' 06 D OO O

T D0' - I0 0 0000 C,0 00 . 0 . 000 0Ln 41 r'r N 8 p 4

- p

0 : 3 ^0 0 Nkc4' ir- 6 0 N 4 c r ' = CcO c 6~ CI' 4 48 - ai

> >

Z a

0N ' - - '- . . . . . . . . . .

1-I 00 ND evz P N a 'b' fw.m841 w I 0 r04

8 t n = 0 ccI1, Nr' lAor- 0'o 0' 0 0'I occo c0r'

80 U1 -I I

0. . . . . I c cI I 0c 0 0 C0 0 c L C . 11

Wi- 0Nw,- I wL.fL Ii I 'OP m8 L I 0 "0 00100 1~0 0 0 00 0 C 08 -

lLI W33 P8 4L.(

a I .0 . P8tI~1to I I 8 I>L..

C a Ct

8l 03oc oc o coo 0= * 0'

8W Li .I ... 7

8 I5 or10CI I I.I-8~~~k.I 0 0 0 00 0 0 0000000 0000 0000,

II 30 0 0 000

w 1- 71w 4 MN,20 0,r- 4 4 NO WI 4 4 4

'14 'ZIN~k J c§ l N Z N 1: N- (\I ml 7,77

Page 14: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

-MA'4

T -4T

P~r T

Page 15: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

101 01 11 01 1. A. 1. V T iA A A

> , ' ' ' ' c" 0 ' 0,9 '~a a'1; 0;01c;0* C;; 'P 01 cia'q' 0~ a,x ~ ~ ~ ~ a C,100 110 ,0,'0 ,4 ,0 1 0 0, a' ' a, ),,, l' 0 a0 ,

II

l. O n 0~ c O c r 4 o' C-0 C O 000 I. ~ z0i

I C C C Co CC Z 0 C C C 0 C CO D C 4 ~Z r'- O'0- ': th 6, D'~(~L Nmzi %11 00 ! ! 0.O mrt

I "Di D( -o o nc

c 1 .. .b . ' a . 0 . .. .. . ...1

U, "I m C a C, aIL N C r' mt I:

_j'I -- - - -- I IN N 4I(1

:10 D000 000 0 . 0

1 71 Si 45 F

0o z1 7~O N ~ b v5 N cooco rU o

-I-b-I I 0

I a.I .. ... ..F'4~ IS m0 4 (1 A 3o 0 N o o o0Oooo-o nW4 r0 04m

0 c- I I > IDIC

p C- I I n I

) o il I i I I I~ I I I

06 6' C o 1-1 0.0 00 0 0N3.t C0:1 a, OWCO 000 10.-M. zsI (.-. i N- _N 00

~~~~3U~~~~LA~ .-0 0. .Ur0 .5 .00~ 0000 <N(0

zA~ ~~I-'534

C. 00 cr 0 4 P

11.SA bc I_ L) \t-I-i (v 1--II I i 4co-D0 204

ob b 00 x .4

c3L -w a'i-ou Z 0D-D0 0t I -0a' oc oc Z'- 00C~N -.A3U N J tL- I. . . . . . . . L I

o ,u :1L: . 07'%- 0t. ( 0. _j 11 (zi-It~n- - _ 10 !_ I 'M ' czZA z(

o _j 4 7 0 . ...-1 0 0 0 00 0 0 D 0 00 0 0000<1p

*0.0. .Jn L,. NNN *- IT -A.- 1 .J N N . . . .- - - - --.r:.. .~~J . . . . . . . . . .1-4

0 1 U I N; N 0 - a N~ - 0 It-v rf \1r V03... . . . . .. . . . . . . . . . . .ZI1'7 7 41 N 0 0t 4 r

1 1 1 . 1 iit .

*1 (' , NNN4 .N N3-.- - -4--. N JN ~ '4N N - -,0

Page 16: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

IiI Itur L t I Ii I 1

~~ i1

-4744

_~~~~~ 1 fLVA~~pKY H t la t T I

et f .

414

It~ff

Page 17: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

H I I I i

Q>4 10 C~ 0t 0 0Q o o c 0 0 0 OC ,D o M 0 %1 1

4.L& o . c 0 t; 0 ; C0 0 ; 1;. 1 J~~ Oz t~0 ~q -0

u~ , ' a11 0 0

0 .~8 . .4 .= o . . .L~

w ~~ t5 0 0~ 0o 1 C op

cy 'o -60 D 0

0 o a 0 o 6Q 0 C

-i >c c)b )o 0 o: 0 0 0 0 0 3c 00C 0 CCCOo

t.-~~~~1 z I1 I -0 o o'F .. r E %-I .- . 1 . 110 r0: o

14r *~ r4 N *44 I

0 0 e : 0 U 01 -0 - 0o

04 -2 I. . *c ouo 1 , a c cDoc p f 0 - 4 'tLcCC ra

.3 x10 , 0 0 caD 0 Nfl X r-11'0-eWoooCD co000 co 0 M,0 a 0 * r

*48- '1I 0 -.-. 08 NO1 C;0Noa'' Opo 0' 00 0 flZ88 '

40 fI~ I

WI cu-.' \0 NI %jIJ\ A jN1 ( )

40 2 . .I, I [ -1 1 4

0 DO 0 00D0 00 23 O~OOM 0 00 000 0440Cr I- I.-O.- o cl4

C. . . . . . . . . . . . . . .C 0!4W4.33CCC It C5 4 I3CCC C C CO 334 I

4W-0 I '1

w IQU x.. I -N1'0' N -M 000 y 9, (A1, N In If)~ Int~N It~. r

lilIlI)I I .I1 . 1.... ....448/80 Ii Im- 0420 40 m I 42. 14' 1 .N-CDn

m m , It 4 4 )Ci1 TI 0I ( 4 .38/8

4U8JI 4'c -' " 11 CP-t 4 1 C. 8* o o *a. ,: I, i 4 I 04 . :i \

t ra I I I 0U

4~0 LLI IX o I OD .a~t( a.I I a........ .......

40 xl 404

<V, 0 3 0 T *.*...0

41* 1. 03 at (A a~

4 0. 11-C118a >0 0000 ow 00 0c 000 w r w00 0000 000 040 w

CUDE2 .3- 1l1p - 131 1 0--- 42 I: t3----- 1111-- 11111

0 8/ -0 000)p~0 a oo 1-30 p0 0000 C,0,04*

4 i w 3dJ cz C8 IIIN C;N~. C;8* N; C8..w

'5 [TlINI, rj 1, 0WMt r o lC1C O e o oDC

*8* 0 o 0 10

Page 18: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

I L

jj

IfI

A

ff -- aC

-F~~~iI 4 t>T -f[-f_ r

--N

11 Pitt

Page 19: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

z ' 1 #4 r A IA r A I. A :: $

30 *0 Do 00 0 cD 0 D 210 0, ,r. 0, 0~ C, ' (a), a'a 0 a

0 o0 0 D 0 OD

)% ~~~ ~4 0 40D o( D0 0n0

z -1 4 Z A 4 4 4 4 M-M 40

0i N > 1 0 0 0 C 0 'D 0 0>I 0 c C, c 0 I lc

Z44 I A- . , ) - l

4. NJ 4~~ C.n m~ 4, 4 4 4 0 ~ N 3~(u mm I Im In 41 ' 40-t: '

0. 1

1I. 01 , I, 0Q ]) I 1, 004 0 aJ,' 71 1 aO0pDO 0 p00 0 0 DO 0 0 CD4 P- c 41Y , a ,0 0 ,

C.i W Ll I I

00 D 3 0 0 0 0 0 0 * I g 02 0D 0 0D 0 000 00

0 ~ ss oo< 00,Nmk n 0 0 0, -jn 0f 01 Ni-t g- oD 0000 0 0 m 0r-01 ;.-3: "C'- 0 N .1 .g . 1 .4 IN~- 0 N11 -

x I-i -F N N N\1 N J N A -i114l NNN N

0:0Z >0 0 D D

I.-I 0o o 0 00 z i L, I z Z Oz 0zr i- -- N CN, \N

a' 0

0 1- J c I N b a 0 z 0~~~~~~~~C a-AJ pA L-P.C' P, C~~ C'0 sAO aO i 30 P0r 0f0n'W'L

Xo-4 PD < ; 4 ; ;1, t o

0*. a > r' )1aJ~IIII' *I. 00 A h I~ I h I 00

wU Ii Z 4 3 4 ' 0 * 4I -

* z0 O:Op ooCp CCC'C CC CCCCCo * c I'CC a CCCo CCC 6 o3- 10 3:313 3- 0- w--I 3---33 Lp N N *c0,

b L. 0:33 1 --- ~3 1--I 3- I--' v- - F-6 - -I-- - I --Z0i M.. II 31 1 I 01.

I- I 000L DO 0 0 0~0 00a 0 1,- 00 0 o o 0 0 0 0 D 00 -111 a'r-L I~N- - ItA - 1 3 p r- 40 in InIN- D M Ln I-0 I~

00 o>

4 1 I D p .>L

'0 L0 00 0000 0U!0 l OO10D : z1_j 0: 1 1S %

0:00. 00 0 0010 * "10 0000 0,0 00 0wr-LDe~ -0xr 1~~N- C. 1 ~a 0 D

0 0 .. o * O4I-L,w w.. ...LJ ..I .N N .. 0 0 ) . sI ... ... .. .~J . 0

Z34 W 0: I.- of3-3-3-3 3-FOP DODO3 3---0 0 1-33-3 3----- ---- 3 - Ow 1I 6. I I Lr 0 0 0

rL 00 M r vI I I I I I I I IIt I LL i>: 0 0 0 0 D I D 0 * I 0 P *

I (0 10 C

A SR A A xA A 1.

Page 20: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

. . . . . . . . . . . . . . . . . . . . . . . . . . . ..

H 4 HIL

H4 i-- TTH- 4 j tlt

RIM +1 -111, T 1 11f- 4- 1 1 1 1 .4--l- Ict -11H -1 - R FFFI-- -f -T 4 - -4 _4J14 h- t

44 w

IT

Ta - I--_- q - -

4 I R TI-14-1 -IT

IT . --- , f - I - -I * T,'T, t 1.

j fl l Tw- _0 - 4

i tl -V 114111J

L i i I I-T- j 4+

f I -,J-r r rl t r14,1

-11111 -T 1 11I It IT

7, TJ

i- t11 t - l tl-I t--rl 11

ft hit- F

Tt

i ti t

7T

t i

it I f

Page 21: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

C, l 0'0,a 0' Qa'

icJU)~ U

0 40J o 4, o o 0 aU 4 '0 D~ .O0 .. 8

Nj 0i (% r) me*( nmI **

7 c, 'r0a )l 1'- 0y 0D G l(7 -a'co a a,~s~O '

in u

0- -D0'o V - Cr O D0 Z (0.-00 -e4 r-9

NCNjU Nin, >0 0 0 000 0 0 0O 0 0000 0000 000 0* ±8-0 00000 00000 0000a I- C 0 090,Nr)4mo'

0 0c 0 o 0000 0',rq ,0 N r.1 48:01 - .-. r 2 m

44.' U. '-U' 'l :1 *mJ I1' O,\Ln c 0 0 c l0 [ 00 C C lO

w~~~~*LJ8~ m I L* v \ D oa , t X'0 )0 0 1a) y12 I I 09wp 0 0 8 ,60D

00l0.1 -- Jc' O O''O N l -- *0.8 '09or '0cc

000 uiI CO

000 ~ o.Ct- U,~ I 0 4 ~ N -c N ~ U.. '1 11111 I

11 11 *

84I.t=. C -8 8- *I 0. x '8-

0009 ~ ~ ~ ~ ~ ~ ~ 3 0 1.I00v00 0 0 9 I..., I 9D*. . . . . . . . . . . . .(nC 0 .4

188 IlaoI 0 coo 88 I~ aI 9 41..

0, 41 8 o 08 a 9"a

IW a. I ONN

IQ~CL0 c~ Ir ,z 9- 8- t Pt N C C -0L 1( J

98bI * .* N. c0.

0.Zn, WIs O pD00 000 0 000 00

C) 000 09 .. LOP .0 0 2 F000 DO9 280n 00 0 00 00 000D 0 00 00 0 0000 D a

90 c 31 cc -'0 4 -*-0 0- c 1 fmCU- 1 C'DaI n t N - 00 W)M CC- v UI9CA1. Z 4 tI 4 4 .. .. N. (

9 ~ ~ ~ ~ ~ ~ ~ ~ 1 v11 1 * aa * - - - *~~~

Page 22: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

I I f I I

-,-,I# TFf 'T17

H-H±T'Jtt- t

atT rT-

1H --- ff'-ft-tv"t

ill 1 -4-H Ufllj i - -

-1 _4 IFt f

41 I -i

I Tt J"m

-4 4 t'd i it-A

t

1- t i ll, T I t 1 1

1. 0

f t 1

1 4 P t' I

- I - - 1 ,, J/' ' k 1 T I

ilk

L 1t l I , t it

f , f i ! I t

t "I t t

f f 1, i f ; ,, l f ; t i t

-77

Page 23: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

.* . . .

000 0; 0; I.0 IAii 1'* U trfl LfLl noc 0 0 1!2 , c a r.a Ia l, a7a 0, 0 aX

LL I It o

I I0 0 N 4 ' 0 0 D. 4 0 Co

>, 0 00cm ' 0 0 0 0 0 0 0 0c:Coa: it Ir I. II i

w ~ ~ D 0 :1 0 0 C :m>C'~44 4tc~je r; 9 4 4 t 4 r, N i r) r 4 1*

u I I In i lco% 111Ii C. 1u I D

0 , t g0 0 0 0 = C P0U LI ) aC 01 t I

D0 0 D 0 )ozo0 6 0 0 -- 08 a 0:( r r) r- a -\Ir- l' I.-

0oo 0 00 0 0000Q 000 0 0*N -1 J) I CD 0 Nn n0z 0 a NI . c: . "...

N> .. j -(--.j N NN r'N m

0 2 z

10 r- 4- 'D c .0 0 0 N 0U' r -. . . . . . . . .V N m - Nr NNN10 0 l 2- - - NNLJ iN U

>i t,>I

N 0*- w 'N CI L)f~ 04

PW-.1 w WI I c;0 S; e1ce c c Li jLi

0 1II a,.

*0

C~ ~ ~ 03o; 21

Ot6 I )1 .

L. - 11 1 I .7-Ic c~~ 0Leb C 00c c c~ 0 s

ul cr Iw i - a -t -- ' I- I- 0 . I N~ N J-t 0 1 ,IJ0 0,D'

inJ 10~ II t~ 1%3 31,- 1% 1 Il 0 I * I 33 3 11 1 1 II I P.

:r II T 0III lU

0 II C o

W" wZ L. * l ,W t1 1 ;.

U- 2 1 I a I 2! I~-

V ot - L t,0 U) 0 O. 0

Page 24: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

t I

-0 TI t

'4t LIr:t 4

T ~ I i 4;f

Lt 1 44 fitF7 fR H tiI tr H

117 1 -i- '-I-If L 1I1

~~Ii IT,

ti

-1--1 1-4 44-; 4f

-7-11

Page 25: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

0I I l.cc r.M C :ccrcciccroa

3 C> o 0 0>C 0 04 0' :,0 '0tCDIccrc , a

.1~ .0 0 0 .j00 .I .I

LG wIcD 0=0 I 0OP 00 0 00 0- o DO >0

(EI I 4''xC' I

ILL. 60 i. . . .0

;0 0 C 4o 1 o oI It 0' ; - LIAUA NIri-- I N f 1m*

A.Af I I.0

to0~ it, cP Q 00 o6c OIo; 0 0C 000 0O D0 00

n I tn LMe I In

0 ' :t II I : I

-r a 0 -I!l-ECLC

6 :I I 0,, 0(\ 0\

0 0000o00 00 0 0 00 0 0 c 0 ,00

I-I 00 0 00'~ 0 0 00 u I ~C. - 1.

I) -

rII

Z I I u

Cj 010 10 CoC 6000

_j I Usr00 0cc NII IIIII iiNiI'lIP CC a, ok I I M'a: a p

0 m~ lt i. 0 C C 0 00 00 C 0 0 p -S

CO. 'C 0 0. oooooooo 0 0 0 0 CO O O O O ~ 0 D c 0

rr VIC- l c ~ 555, c ~ c 5 c c>111 c ccC ccC

A - 0.- A 1'. A I.- - * . L W A ?- $-A - -i- i ,-

(X w w I

Page 26: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

477 11H-4

-T1 Llr ~ __I-

I-i~ ~ 1-~I f

tjj

t T- J/ItIJ1*1

IfI

Page 27: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

L0oD oDoD oD 1 A 4 L W Ln I0 . . . . . . . . . ... . . ... 0.) jo0 0 0 0 0~l 01 00

x 0, 0 0 0 0 0 .4.

10 0 0 0 0 OW 0 Q~i 001(n4U' I,' I.

> " c 0 -0 0 0 c 0 C0c0 I- 0 0 O0 G~I-aZ If P- 0' -- 2 t-0 - ('-f 9. 0' -0 o DOmto: 01- 0 >0 o o oD 01 n z

0. .C C IU Ij

x0i~ 0. c CD 0, ,a , 0 11'Na

3 - It 1; a O * o'!~ 0*~O C*

0 0 - 0. 00 0 00000

of NI I *

I L:- U0 D o b o o D O 0 0 C. Ct I * -:U I 0 0 O CCO I.-U oG 0 0 D O

< iLf 0 o -L'l- 10 0, 0, 00 0 0' ' -Z

Ox i-. w~00O :C 0C , C, .:1Nint

0 . j a~J . o'( ' 0 0- .. , - Or- M N O3 I 000 0 000P r-0(U U C C c

0 0 0~C F.. o N r 41. I

0 IL.. 0 000 0 orP0 0 00 I 0900 0- 0C 0 C 0 a

I - ; Q ~~ -- a ~ 0 00e obc Dc i:o 6~ oC~

1. el v 9z- 07% 1

DO 0 o c~~~p 0 -- 3 !e0eZ0a

:0~ a ~ ~ . ...- .. . .C 6 0.0 .C C C . LI, D c D 0 F C.C'= C C c c c c ca t

9, 'II i 3z 7. U, N M CC C7c C CO b

or >11 0 0CC CO 0 c10 0CO rcoco D 00'a' a f 0. -P 0r 00 f- c C C 000 09 I .IC I0 I- 0 0 00 0

Nd .N I' \

Page 28: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

I I Lit

T+L-T I

It11T4- cr FLY=tl ti

1744

jif IT

T2 T

f J -11, _4 tlT L_ 41 T: 1-111-t UT I:

Tf: fli

1- T i: I t:

tI -lit

Fil -1:1

I TR

-Tt -1--tJLLJ

-7-7

-1 t I _T_- TTTI

J-I j -1

t

J1 __T IT

7-IT

4: t- t

It t 44

t V 141- 111 t

Page 29: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

>~ 0 OOl

0, C0,c0 C C c zC 0C

7t a'F I 0..

. . .. ..

~~I cr I 1Cl0 '~~7 0'0 0

4-,.- a pDr-cc C1J I . N V M (11 a1or I0'cJ~L -0 '4AAA.

0 o o u 0 0 0 p0 00j0 C 0 0 0 0 O

0000 L0C) 0. 00o: 0 o

10 00Ol0 0 0 0 n 0 0 0 0 - c c ,1 ) 'Y,0 e aa cl'e-

C; I

c1

CN A- \0. A.Ll N\W )0 1 - - - '4 -. -. r'V~~ N 00 ;0*~faL.o2 0E > aop azi ~ ooDol 0 a r~cc a eLL ~ u'

C, Q-i I P 1

e, e- 0 0E -

I in

CO( 1 00 10 0 C C ,O

Wc:coc~c 0 1 .

N' c.i C 4C 00.t c 0 0 rC\= a wC

C 0a 0) a ' '.LiO I~ . . .-a 1f .C I, - 1 -1- ;1 11 '1 1E 10

c 1 1P

ad~ I-pih. * 1a

c 000000 0 ooo a i-IvC cr 7n7 I 0ra 0 n D tL Dt~ ~ ' .. . . . a - . . . . . . . . .

a ~ jic

C, 11-

--

OF I*.~

Page 30: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

T Ti

J_ -Lr L

I't

~itT 'I1-I i j t~i

T- - --

-4- ..

4

t Ii ' 4 4J

f t I Lf!t1 5T __

Page 31: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

II I ....... ..

0 0 0 C 0 0 ~ 1- c 0 D 'r0 CT ri0L

C 47 0 0r, a 0 0W~~--0 > 090 0T0 0 r;0 ~-9

uwl 0 0 QC ~ 0 cc 0 0 0

CC-

> ccc 0 soc> 0 0 C0C c CC0C C*

OD. Q- IDO I00

x , 0 D P D LA 00 .- C C~ x Dr - 1-1 :( c '0 , '0 ' cQ*

0~~ 05D5 I~0 0 0 LA0J 4 rwo ''4 *.

a) 0 0o o -0 000 0,,LJ :10 co* c

(11 1m U, CCC C Cn CCC %P0 0 -U r.C cc a r, I

0 000

0 w 0' o C 0~C C '00t~'r o'''00 0'oo Q o o

I: z z .)c

0L 00 9 o 00C0 C CCC 4, 0 0.10 IC L) 0, 0 V. . - i (,co~~ m i....nA inN M Z oI ; nI ( ; ;r,~~ ~ 1 0')11I

\4 -4r ,I cc, 000

0 >IDI >

0I 4000 . . .-) W M 0~j~ U'4-'. CC i0'- Np- L CD.I 00 0 00000\ r 40 Ni-N co 0

0 a0 '0 0 L4, 1~9 00 '~- 4:

t z 0 c,4 0 0 0 000 0t

0 4r 40 cc".* r4 c\ c C C .- C Nr4L C-C~~000 0.F 0 0 0 0004... ...

> c# c c c ci1c c

D -a 1-0000000 D oC 0o 0 0o o 1- D 0 0060 0 1 o

6 ' t '0 ~ c ) N -c o r - 4 )t n +Z m 0 ' 1 - L A0 -n m N , 1. 4

I:

41~~~ 4

-! i P- L 0

~~0 I 4 0 ,

in n 1.) 4 4

41 1T oh* I 4 * L; 9o :. o00V.Lm 90 0x0 0~ 0 q2.

m CL CL I I.

4.0 0 10 0000 09: 00 0 000 D 0t=0 booo 0 aC o x

40 a L wN N N v~J) N{ ...- -j.-... Q N4 AJL NJAN41S >010030101 I I1 4, 4 0 1 11 1 0 100 D 1 0 0 0.

< 30. 0O~ 0: 00 0 10 4 4 > 0 0 0 O 0 0 0 0 0 0 0

4 L.j 0~ O * 0- 0 0:0~0' in 00o~ 0o' o' ,- o C) o c 000 :,c w.

o c r 1 10 1 A 0ol ioo to.~ Z 0 v in) 4 N 1 11 0 Ccuj~~~~~ .LL L %J LA A . . . .1.-. . 1 -- .:0

I x n Aj N N N 0 j (\ N N 11 N c4

Page 32: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

-7 ---------T, T T

T-T_------ ---- ---- -- _7IFF I 4tf

tat-7-T4 _t T-71t ------------tiI L Li. ITI:

-Ri It F T

t-14 -1-1 TVW_111I j;r

-1-4 TPT11 iIII

I fl -Il- :1

I I J1

t

t-, t Iti ti

4-1 -

....... 4 i !

4 11 It

Page 33: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

1 0; 0 C 00 a10 7 0' 0 ' 0x.. I Clf 0 K aK'0 ' 0 0

(DO~~ ~ 0 N 4 0c

a a=Lo :' Ic(C a O l0A '0 0 o o 7'c'-

,4~~~ 4( 4,

O ((+0 z 0p 40 0 p o Ct-14 C oC C - '

I-- it 0 :p 0

Ir ~ f~ r LL D~AI a Np=~ aDIn :I -ID0 m I -C0,D-\ n: ,-

n44 I il F0,'-04,e N4 ' \0 0N m ~ (Ct- 0 Nrl r, n

ii' N

c toXj fa co oaDo 0 xI r- r o Ca, O

.. . . . . .

41 a p a p- a

Po > 11 0-'~0 D~ 0 0 000100 o~ lo oo ~ o > 7I ~ cc 00Op0 1.-xN

Ii 7 .- .,:,.(' I. 1)NN I NN

~0I- oi i, -' 401 :~

0 0 0 0 410 0 ,' 0 0 I * ;0 0 0 0NJ l -~ '0'a o 47,0 - A

is 1 i-I -~ P:>I Dr(x1 I I D' o111

i-go ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ c F, 0 0 0 0 0 - .o o e 0 e V ~ O o o 0 1

6 1511 Ig I. .03K II '''Ic>s . I

P >1 C CCC C ci-SM1 I C I C

z s P --

x~ 0000000

Ct-Z U10s : D

0 0 0X P I100

000 0D0 P

iI t, F<t0: 2w, . . . 2.. . I

Page 34: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

ti ~ - I fl +4

.4 - 1A- - 1 -- - _ _ _ t

T I TI7 j~

tt4 t- -t-f_1 I t4 -lj

1->I 4- 1 'i-

- -- - ilH, 1 1 ---

it t~ ' it}'' t2 ~ I1 1

-I t

f4 '4

Page 35: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

o, 01 e, 00 01 ao 0' C, 0a a,0 0

24 a*. .. . . . . . . .

wu C;Op0 0 5 0 L0 00cr C; -'; ' 4 C;1

K ~ C C .1P0 T C5I- CCC 0 0 N1D0o '

z .- . . .-

> Oc b 0000 Op >-~ 0 0 c ~ 0 c c !f COr tII

u.. t- 0j0 ' 1- 0r u , P .a ,L IN N -1 (1) M0 0 N 0 000 r

o, o~ 00cy 0 0 0) xb - CO o N 1 CE ara 0

'0ILl0 10 N Ct~' 1 4*0 -

0

Ij Cj NNA,L L

I *

(A I

Cl L) -r D m 0 cec z -~.. ~ ~ '~ 1 0;~ .II aDis e) o ' \ 4 - 4 0- 0- U0o) ~ ur. 0;V1............... ; 1 004 (1e) 1I00 .... . .....-. L o 0 1 0 0 0 D0000 0t- *'

N c r 1 0 , 'Ll t:t il ii II'

I tiCc0cc t C e (V CCCC I~C cN Nr c

t- tf-e' t- Nt)Lf -II. '0r w 'II'

IDo 4 t-1 0 00 0 00 0 o0

-T * >l b 0 00 0 00 0

0~~ 0 .Ir 0 C ' *00-0 0. -.......................................* z

0 01;009 4 W I 0;~ 0109 0000 0 L W

C, o < >0 0x o' L 00 *o o bo o 0 0 0 00' w- L ~ I) ' ' o f ' (j ~ ' -~) U N - 0 ' t ' t I p* ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ W L.*...........................

00I a1b o D00000 00000 0ao F uc r-Is \1o 00 C,.) n 0 4* W11

- U)It

2 1 0 cc 'c0'4 nN 0......... cc "D 00 0 on !W.

Page 36: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

j-T'f F17 tj T-T-T T ITTT777 T-1 T r-T-1 T-7-T-1-T-171 V -1 t I Ff f I I

Rf V4 T f

It

Jjt +

_j T_

T J_

-1-14- 4- J'Al

tl J-1-11 I - -4MAZ I T '4 I IFr77 At

-14:'-R It# "-T--4 T -I

-1r T_ T -1

F r tj

-F I

TTI_t TiTl TFH , TI --till t7l 7-0

4 J 4I J-1- T

TT

tl

4

A-

4_1 1- 4-14 _L4 I-EM :T4 I-

A 4T1

f Wt 1 11 I- N I N

d li__ lttf 1 11- 1- It 1 1 1

"1 1 1 1 ! ,

I 1 4- f I

f i t t I ' l 1 t 1 ,

_j 1-1 A-

t J j

. T i- I ;T1 I I i I

fll f f i tl

i liji IM T II T l

ild i It f -1 fl 'i t

tl t I

ti T f T t t I I

7i r I I f fI '

i T

'T tj it I li

T

Y I I It

1_1 I i I ---

Page 37: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

a I . . *. C . a. *...22 10 0 CDo C DC C 0 D C =

O 0 0~ ~ 0 0I 0 C

tr ~aI

cx CDC 0 0 0 Ca C 0 C 0 D 0C C0 0D 0 0 D 0

Ci c Cc c 0 C, C C C C c0 C

Cl CDCC D QC C 0 0 0 o pza0 0 D- 0O C Co

s.- C I I

C Do

a 1,0 9 c L I

x 50 0 x 2 0 - om 7,0,

0 0 0 )a j, ,

k:, o c C C C ; 40 I A LA ' O I-i r, N- 0-

0D OOi 0 coi00 0o 0 =0 0 C I - O

pN 0n D-~U~ r-CO0' - o ( DI~t 1, 0D - r)

0 Ow 0O 0 C

P- A0Dgo- F- M I- A '' ' I I.

Op -a ;Wi u ~~

01 * O U I IIC-

Z t D I ~JICL4

0a 01 00 0 1 0 e C o o *o c o e o o c c p1

6 j w m4O 0, 4IAA aI AI Aj 1 1JA c;J'0 OD

Z~~o0'0~~PL ZC5.- C 0 4~ C 09 0

W, L nI- IA IAI SI A

wI I *AD I

D' Inm L -* z' A A2~* t, I

tA T.

V) uiI____ 7 '4

Page 38: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

ITI-CrA

ItI

Page 39: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

cc~ c o C-L 0 0 C) ; .1 .O.i.

-j 0 0 0 00 0 0 09 0 00000C

0 ~M44r,

C ,W 0 'c U,. . . .CDo~ CO 0, 0 0 0

0~~ ILL ox A.1Q ( .... .. .

> 0 01 00 : 99 00 co0 0 0 00 0

. . .. . . . . . Nc iN f-j f- ~ . 0.1 1 0tp C - .

Z I4 co0 00D o

cu 0, a. 0100 .z0 0 0 0 -N'

*n 4000 In. Pc~ p pLo e po o

U >

*o IN.-

Cr I I C0

I ... I r c Z "-'c *0'c t- a. I0 001 . . . . sP W' j I c1 0 C C ~ ~ 00 0I0

0 0 0 C

wP A0.- if I

0 L 0 0 0 L..0 0 0 0 0 P f .

D I

I-~~c c;' c;'CA

N'a.0' '0 C;~ ;I I '0 4LN-'

W 0

u . . ,P-CI 81 l 7 7 1 .11 W -' r mwr.

(T h [ U -i -l *I *I i * ,

-j 'u N"-~ h i N pr1, 0 0-

, I.

Page 40: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

T -II'5l3

3_j

Page 41: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

0, C 0. f...... II0 P) ".~4 0 A; ~ (n It ; It ~ 4

C, DF 0 , 0,a 0 I' a, a o,

Z(O 000 0; DP WIC 0.- o' ~ 4 4~N '-.

0 I ,C ; ;0~ p 0 U) 11 .- u1

0 0 D 0 9 0 0 0 c 00 0 0 09 0D0

GO' 0 qJ l 4 'D OD 0 0 '04- 0D P. J8~4

V DO00 0 aa00 (

4-. 4

I) I

0 ir IffAl0.Ua,

OpOPO OC'. 4DOPCO A -'0 0 *0 0 c 0C0 0 C 0 .&NS C~

> 0D 0 00 00000D oc > 00 00000 0 Do 0 0 0C- cCI LI

0 0 C 0 0 000 00000 004 0'~~ ~0~~nN"C4N4 A tz - - -- -0- - "4A

1.Z w-S 00000 000 L 0* 1 0 , 00 4 'I I b o 0 0 0 0 0 0

1' 2. 1 4nz -ma.aC - N Ttr> m

0NI1 z 1D- 0:0 0 C O 60 z o Coco 0000C 0 0 0 t4-0 CoN cLc$ ca

a I 4- 4:(Al I

D I.. ~ I . LEocLI.00 C O DO.CiQ coo*.- 4-l(IC p C OO CCO M IC 4'' 0

4. a~ U. ~ C' NL 0uf?0 441 1 0 0 0 0 0~ - 0 C J N< .17 'N'5l0 0 00 1 1 I-r"jt'

t'Z~~~~~c 0L1 I4 4iU

4 1. N ZN - ; 0 I 0000 0A 000 P4? rlWC Is 00 0 0 0 0 0 0 0

tC CC, 1r' D. I Ii4

.Z . . .III , a<' 41.

40 0CI 44 CL or CL4aP tU 4 N-c 4 4 , t,

I~~~. 4 5 rqfw I j 4l IN IN N A

rN - - - - - - C

4c I I fLO. APAfU DOD. 4-0-04 00 0 U O O pO C 0 0 00 0 -43111)p 0 ho a- 1I O

4x 2..( a0 777777.. .. 4 .....................

--------------- A ' A~ILU'p4 4 10 0 00 0 00 00 0 ~ C 0II

Page 42: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

III. Sample Statistics: Five Percent Random Malfunction Rate

In this section data is presented with the same assumptionsas in Section II except that it is assumed that there exists arandom five percent malfunction rate which can occur at anyvelocity level.

3

Page 43: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

r_' I t bi

I-IT

+ *111-TT11 _T

I' T I I

fT4

Page 44: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

I c; l )1 17 l I O cc c IDO cc 0a 1 10 0m I ,7 ,Y ,o ' 0 ,I,7,' ,7 a , 0 ,qo '0 '9 , 0

z oL . .

CW Q* D*0 1'DL0 C 0 ct DCD D~o o e 0 0 D 10 C, D 006 0 D C> obo 0 0 0 Z,

tr 0V4 .-j i tZ, 4 49 4,4 4 0 m \4 l0 IM cm, 4 M o

-jt 10:C c . o 0 0 0 >I 0 0 0 090 0 0 z L 0 C

IN 0' - D PN E~ 00 0 00 00o 0 1I... Ca co 2 N1M> UID12 D 0 c r i

IN %CM mIm4i 4Z 44, , 744

3L x 0'10 0'90'0'0' 0' ('a'0'' 7' , 0' 0' ZI r- co 0 0' co0 Y,''00 o, a a0'0, ,l , o

0' 0 . . .' .' . .~

mc. 0 I= zo coo 4 4 C 1 , T Usr- c i L )

, 0 Cl 0

00M 0un L..0 r-- a-. 0n-0

>- 10000000D 000 0 000 >J-1090 0 09 090D0 000 0O00r, 0- (r~~'L 1I II i0

c4 L- L'11 I0D O O O

0

0 z 100 2) I00

0Uz IOL I~ ~ ~

0,11 U o l.m4 8w V.rL-8)\ 0 r- r 0

r) 0 <11 1 ~ 00 0 n U) LI0Il-f-4 OD0~ ~ pn1. -FN '3 'Pc r 0'' 0% \ "-1 8 -N) L '00

0 C, I* > 1 W! 00> U8

048 a...... . .. . .... 0 0

0 0rL. 1II 1I 0 f

0 00000o o -

LILru WZL I c '

I: 0 010 1

I Zao 1 1811 11 1 08 001 I~

aa qaL U1 8 CC0 ;c fL

L 2 0 0 0 ft

w w 01

z ~ ~ 0.00 I,~ C lc ; Ia= p c '0c

>80 0l0 c00 0 000 0 o

WL L 0

01 r CI8>00 00C000 00

IT 0c P .c I r ' 4 N aw t, *~ I I1 N .1 *

rz M l il c

A A A-A

Page 45: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

f I I I I I I I I I I I I I I I I I I 1 11

+F4TT±LLU T- -ME ,

-AF111-1 --- I la F--LITE

4-4 -fl7 1111 f li, 17qt llt -H-111

DFr -T-r it1 14 kit A -H

C TT -1t, M IT -r 7T r T-t FT TTT,

_Ljj FF

# t H4+T-T- + -- - -l-,- -I

TT T It - :_:-1 4

T T--j t - ---

--

if -- - M

; , '111 # +4-: +

-4 ILL TT

+ T -IT F L41.17 -T- T- T

f fr HIt , ilr fl--- -1 1 h -44-

IT tt 4,91 --F i iiff4om

4It

ffT11jLi

, -- - - -

It

H4

Itt -t f-1- lit

1 4 0-- 4I I ilt I

T 1 , - - 1-1 -t -t-tit

It - -1-1 -iT

IT, -J

!RL Ittj f+ I

T

It t

4 f -1 IAI

J t t f f1 +71

t

44 4 t f11T1 11 1Hf f 4

if.44 i J 3T 7 T

Page 46: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

hi 0: 0a 0 0l Il & o o a

CO 0 4 0 0 0 >Coe 00C

1,0 00D c c

0 ~ 00 0 LLO~wo~ . . 0 0

i.'

~~cP0 1. ' q. 0 i. 4 f. - .O.C14 0

x 0,* C1 1C O ec o cco 0m o0 0' a0 0' Ca' 0N O Q O C O N

* .. '.

9C. e cr OD I L ) ~(D L~- c a~i-j4 04~ a, D ' , 0 .D0C0CC :

% ~ 01 N -t0 r- Cc 1 r)

>0 '06.010 -00000 00000 0 .6 OO D006*

1-Z 10. 0 10 000. 0N Z0 Ip 10 r 0000 00o o 0

InID z

9w. 9r nZr n 6 0w I *\ n' A' c 0 - . 4o f

IN Z < k L)I *011 I

< Q00

z I .O'0'- *01 0 3* > (

9 0 i~~~~~ - C~- N jJ M f - O ' - 0 0 0 0 0 - , - )-I

IN 9r I I

D~ C C-I e0b 0 o- o 9 I C 0 0 0 C O C Ccr~ Ct me 4 C?-0 ?- C - C I zi , 0 1--9

40.I I I I-.V

1-N IV 0 C

0~0IN 0 vTg * c~9L. 1- L)0 9 CCC DeboCC Do C It O1

9W.0 X oE ~ 90 >

*91-0a1- 0.. . . .. . . . .. . . .. . . . L0 VW Uw 0D 0 0~~ a ~~ C;o1 O.. I; ee; C C0.c c . Z o L -

a240 0 C. 0 D 0 0 L 0 ~ I Lococo oocceoo9Q~~~~~0. ~ t 0' ID c1i : 0@j l aI 6 NI.-90~C.I' ~ C - C ~a a o.11 1, Ic tI n \ 9 4 , r I.IW4 0. i1 .~0 00 0 0; 000 9 4a 0C 0 00 9a4~ wa j 9Z 9z wN, ,44P

0 .A '1i 0 0 0 000 00 0 0c

to 1i ~ 0 .Cu-06 D 0 00 9 . 0 00000 00 owInh~ '0 , 'o-0

0t'W. 1

a~C CuV N IN N N

I IIN

- * . .1,13

Page 47: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

I~ I

ct V T- tI-T

.71 -~- 7 L

:H-4 -LT 44 J.:jtvi;I , 4!3 4 iLjL7 f- -I1T .

-; H 4

~~2~~~I~ 14,P 4~ F

ITI

-7~

Page 48: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

IV. Sample Statistics: Ten Percent Random Malfunction Rate

In this section data is presented with same assumptions asin Section II except that it is assumed that there exists arandom ten percent malfunction rate which can occur at anyvelocity level.

Ig

4

Page 49: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

:1- c 0 Z) c L

I) ~I t 1a ( LcC(z 04 14~ 0 0 1u~ 1) 0* 0 u

1 c o cz0 0 oc0 Ol ra l a 'U,7a7aY

n~ bo O O oo o o 1-i at DnOcD 0

z m -j N Q t r 1) m~ m 4 4.

>ICCc 0 C c l C 00>ICC c c C =06-.--

F I 1.

0 0 :>f %9 -r I A

Ol 1 C .0 : 1

cI CC

7 1: o,71 a ca, a 0 0 0, 1 0D r-t-r- 0 cc r0. ccxc 7 7ao'7

LI .1, 41c 1 41 .

z ~ ~ b 000 000 N~~C

I W 1 11 I'

>o00o o 000 0 0 0 > 1-0 0 0 DCc0 ro

.. . . . 1

I L'c \' aI If - ~1 - I (1..c.rc c 0Z'r-ac o- LCcce CE x c VL

IJ I L) I:.4

CC

0 ~ ~ m c cc cca co o a 0 C i0 c~ 0 c CCO0 Z1 a- m- 1- 0 At(1M L - f- C1- - - ---

t1 'rCC C C C C!. C.z. Io. ~ C~4 CC

_ _ _ _ P

Page 50: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

4 J74

1 j _ -<H

a I If j

-I ,< dV {' l - -4~~ __ i- $ - I ___ 41--I~ b t_4 1j~~4 4U 1#1 If)t~ 1 wt~~

'K4 T Ptii 7 fJ UL ItiI Vtr t tii~

jnlid

IH"} ft vK jj-tfii i; I

I~~~~~ I W l -i-Ir

Page 51: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

a'. ~ . ....... .. 4

0' O, 0' Y 'l '1 0' 0 ! C 100 0' '00'a~ a' a, cp a' a a' O j aa 0') T'ja

WI 0i , C, 0 0; 0 1 0D 0 04 0 . .L r C . I Do" 0. -.0. C a'ror0 0 0 0 0 D0 D D 0 D (D 0 0 0 c O 0* ''

>I o

I-C 00> C. C~ 0 cc0 C4 :C C 00 0 CC

Or n 1 Z - . . . . . . .. .- t- "''v a'c %I *a ,

0r a 3j2L r' ,t0, 0 1 1'C 0' a, 0' a ''0 C -) C '-ic 3~tt ~C. c~-r-' I--

r, a, 'mar 0

> A -- I C. C, -Ci-. C CCCCC0 .- O 0; i CCCOCCOC C000CC

a ~ g c 0 00000 oCo 00 0 7o 000 o

acZ Ia

aN UL r- .7N C

tc 0, a)z0c0li f

~- N an CL L 1 4,1C\C ,

I''. -j N I a

C, lCCI f

p 0 D rrC. 3

a - 0 Zc I Ii

II - c .1111 1r1r r

Ir CI : - -

a'pZ i- C0 c ccCC -~L - CC C C C C C c - .Ckz

T I iCCCCC

4Cf

0 zV 1 ~ LLce

c C CCCa CCCC0

It :k L W I I I ICC I -C C Cc OC CC~0 C 9I CC CC at- a 211 ** 4IC' c cc c f

a c.~C~I I i IC

Page 52: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

IF T I T -II- IT T 71T-Tr I -F. -; TR-77TrT7-7-VFTT-1 I I I IT I I I I I I I I 'I I I I I I I

till'tl LL-11

-f- -t t --rH H

- -

FFTt-4Titti L t I

T ZI 11' ITF- 4

ILT- t li Ital.-1 -. T R -, M - -

j I Eff,

V 4tT --FrT 1-4I 'T LJ- L

uj 41 14 -1 t T- -T

4-J4 4-T-- -4 :

r-4- -t-T.-IL

I L

T IT t IT,

t M t t

ITT - I fl t V

E -1 -r - ---------

t I + lt ttI --R -1 -IR T

f- t

44------- '1 00 JJ

ML

F-4#m T

Page 53: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

0, aI I1 00 co A 0: A* AK A -- . -A;* A

cy. 0.0 ,a 7 0 a 7 a' 0, 0 01 a,

01f. 0 .AI 0 . . .. 0

OpO 0) 0 0 P0 cc 0 0: 0I ceo c

> A-A-A 10 C c C >8 c c c c rc- I:c c c i:c c~C 0 C_ a pa o 0 1D 0 D 0 0 7op c 0 C, c

t o

m~ c; 0,c *0 i,0! * a

6I- 0 C 0 0 0 o1 C, Coo o c Co, nA-m4Lr t'0p- 0'i CCA u'nt1o MID4v

A'

00

M%. N N

IA- CL-., 01 a, It-A -, Z

Or -r An t.h-aip1 r--4- 1,s- 0rc c o - 10 4 t-

,I :7 Ibc c3 C 0~.0 or J, 0CC 0CI N C mC XCIAcz

v Lr I1,1 I., gg c -I~~,ci~ crc'c~ ucc~l[ ~(r a-A - A A- A- A > C : Cjc

c~~~ c, I cll l~l Oc cZ

C~~. 12 .1

ZI C( oc c c c c cI c 7II- . . . . .-

\l. IN, f\l NIIIIII 77 T PA

>C~ CR C~ K1 C A-- -4

Page 54: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

l~~~~~t~ ITT~t!~ -i- ~

-47

if IH 4I.,1

(b ITI -

'"'

III IT

rrlft

41 5 I I

R , Pr~ W L V 1 4i -

i1j- II,.~ H't 1

44

l- fi~ ii 1 ,

ILI__7

Page 55: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

V. Sample Statistics: Least Squares Fit of Cumulative NormalProbability Distribution

An alternative method of etimating the average and standarddeviation was used with the hope that it would produce betterestimates. Although theoretically a least squares fit should notgive better results, it was felt that within the narrow constraintsof our sample space a better estimate could be made.

Two sample distributions were run. The printouts are shownin the figures following. The results were sufficiently poorin comparison to the maximum likelihood method that furtherstudy was abandoned.

5

Page 56: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

atI. ix!$

4mMM 4434 44, ,,,

>'0 L * 01.............

00 0 00 0 0' L 0 o '0 0 0 0 M4 00 f4 W 000 00-0 0 r'4nc- 010 0 00 j)

n3. 9,V*4F4e444isI n -4 '1 4

U0 C3 10 NN0000000 c 4 p u 444

4, w i a . * I4%3

tr4- 4w4' maI

)4 4: 'D 0000 :oooooPOOOebe 4-0000 00000 0e000~0

~.00

- 4ZC tA I :

CIO in1

* 4t. 4

z 0 31,4 3- -t- fC 00 00CL 11 - 1 ~ 0 ' 4 0 O 4

NZ a0c 47M m 'Dw0' ) 4 1O 00 C

1 'I 4

r -,4I U Ir (,c

01 4 031r- I

~~~ I . 1

C0 4, P, t4U A40 0 L ' I'N4ANQ0N4P t

9 0'4 ~~~~~~~c c< r:bo oo 00 0 c c0 0 *!! > i O O O0 00 0 ~ 09 p z 1,, (7 .2 - 10 1" 4 m3 w nN C C4 4 P'

~~3II - 4 b.19 0u0 0 0 00j 00~0 .0' - 100~0 0 0 0 0 0 0 0

~~~~~~~~~~~~~~~~~~ 23W9tnN4~'3 00NtAO 34OL14.t 0-N'~l

d1 39 2 1

4 143~-3403- z a

4 7 u 0.i4LnOO D~ aAC4 C 0 S 4 NL 4 w~-I c00 C 0 C C 4.t-W

[I- I IiL ts cI I 4I iDODO 0 D I Of 30,............. 0'

42 4 WI- ~~W- 0 0-0i..~ N-- 0 ar- 0 39 a 3W 300000 000 0 0, -0O0 C)' C400 4 I a914 -1c tnN C Dt

~~ pf I I~ I 43

Page 57: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

oo o Doo 01C ... . - .D C C, in

C4~ 000 CI0 o 0 0 0 0 COD-r C.,a 0: a

10 0 * 0

P4L ML0 (1

m 4 0, ~ c p 0 0 0000 0

,.I 0 , ,, *

,bt-~L I ~4L> Q~ CPCO 0 0 0 0 0 D0*

00

* z 0I D 0 .Ir 4C

C 0'

f 0 07I *

-a l.Nja uIrB - I . . .! .0. 0000 0*1

0 1 0 00D0 4 Lr.. tO 000 0 00 0000 0*9; ,:Z

~U t l C 0 N 'hC301~J ~ Z a q D. 0 0 0N j4 ,)

> I c

Ig '

I 'O* iu1 5! ~ 4 0 k -a 0 Z0'oo0 0 W.*

0*H a. O 0 N -0 OA _j

w 0t 0V 0 0 0 0 D Ir* ~ ~ ~ C 0 ;.; I 1 0 0 0O e 01 1 1 1Iuz *. ~1; *(; C L* ('A

3t 0 x. I >I~~~ ~ 0. B - B-4 1[

- W '

*'In* W Bj I N Ni * 3 9

* 4 * ? ' a I. 1 1 01 1 .l I DI I f lI~~ 1~oee 0S 0 0 0I~ ~: 4 : . 01 000O10I~

0000Z 1 11)N c ,D ' z_1 0 O O0MC*0,.~~ .. .I o P

*4 m -*

--------- L------

Page 58: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

VI. Sample Statistics: Least Squares Linear Fit for Averagefollowed by Least Squares Fit of Cumulative NormalProbability Ri for Standard Deviation

Hopefully, within the narrow constraints of the StandardLanglie Test Procedure another method may be of value inestimating the average and standard deviation rather than themaximum likelihood method. The method attempted here used aleast squares linear fit of the data to determine the average.This average was then used in the determination of a standarddeviation which would minimize the sum of squared deviationsfor a cumulative normal distribution curve. This method hassome merit in comparison with the maximum likelihood method.The sample distributions are shown on the following page.

6j

Page 59: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

*1 Co-. Coo r m r. N~ !Nm

2 11 II' 0I 01aa Ia0 ,a aa( *

I!a: I m I

Col o~ a~ C o oo000 > 0 C 0 oOo-* I - %- : . . . *

*1 ~ M fQ 1 0 00, -mr nII I 00 40 N0 I0'Ttc~~ 14CJ(N'344 4 1 't

1) 4 1f 10000 D 00' ec oc o co 01 z I \c: ccoa oaawc en aacn

. * *I - *

I f- 1.o c0c00 00: : co cc rc:: E E ~ cc cc,o It

c> IC C O

ZI102.1l LC4 IO 0 oo.j~3 * * ( C000 00 0 000W 00o

7 0

0 * I I

* L I. I

I' *****'ooV) *o o~o~ *1 *,1 i-

00>0* 01 1r ~ I

*iLIY. I- i, :I - (\, n 4, I ISI I' m m *nIr-

0' D L* '0 j. b' 0' I0p 00 -. . .10 N

*... ;f0 Q1 0 0 C 0 C 0

V,- I Is. II I1 ] . I I I

LZ.> - Ic c c0 r C , ..... *II C' I'.,. I i.( r * I I w o! O C O IO IO O 0 0 0 ** 1 1(A g1.J 0.1 C t 0 Q; O* a2 L 0

*,or II\4, .2 *1j L1. .*W01 or ,0 0 1

0I 0 . C * 0 2

4. C -a>r,-

!c z-., C41 I 01* C411 iccCCCC-0Il2 ~ ~ acr~tc r o *0 ICC C CcCCCe Co-'c'-1- o 0 -IC C C , CC C 3C C c o I

0w I0 1-000 CI0,CC cC0 0000 0 0I 1,00 0IO00,0000- WI . 0 L0~~I-IA0~- 14 10'C .0 01~C~ 0c r4UI0 I.-0' V 4fl(1 , ( -0cl 4i.r ro I -

I' I/t,. 1- 0117 77 7 * 0 1r.. 1.1.1.1..................0 11

Page 60: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

w~ 0 CC CC CC D CC

0. 8 a~ 0 0 0 0 0 0 0

e-'o~~ c c c ~ ~O~I' U, 'oC4 ,~~ 4kl F

Qt

'4' IIn CN) c '

>c

0 1 ~ ~ ~ 1 Ut -~ ~ f 0o0 ~ 0~

b ~ 0 0 ~;0 8-a 000~ 1o ~

0 0 0000: o o 0 0 900 8i-

00 0 6000c~ ~ '0

a w15 0

0. .0

tC- M 4 0.l >

0tt- 0 :) t-~o e o c : 1.- 0 0; C ;~~-~ c ec a~7 ,1 0, CC~o c~0

0 , - ~ c a o ' ~ ~

c ~ ~ 0 OP0 0 C

C.. L a

0c Ic IC "I\ la0a,- 0 I-I0000 0~ 0e I.-,I- I 8-

c;1- II;;c c 0 0c l

c 0080

co0

0 17 7707 7 7 *

Page 61: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

Ia 4:

0e0 0 cc C CC, 40r 0'0oQo ''

:!~ ~ ICD ~ D o 0 ~ ~

Doc CzL 0

a, ~ r's A. r- -,I- N nt

C% ICS f- Cc '4 'TC ~ C >1: ct>Lc ct -c c 0 041 t C C c.c~c 6*

C a- cc iio , ,c Cro

*~a CC

C1 Pc (z00 & I c~ 'T c

,C 4 C I ~> O~0 0 0'00 0 C'0 00'"0'' 0I-I I II F ' 0 0 0 ' ~

c. C C C c c C,CCI ** * . . . .

P 0C 0 C2 MN M'J~C g C- 0

C~~ ~ ~ ~ ~~~~ c0 ~ 0 0 0 0 0 0 0 C C0 ~ 0 0 0 C, C C

1 C 0

C (.5C1c QC C

C' r - c CC c c c

C' I- - - ~% ~ ~~5 . ( c

tl- C! . C C

cJ C C C1 C CcC'CCC ccc c C

I: I & (\F- c1> c cC: L : 0£ 4 : , ,. -

CC - I. .. . . . . . . .Co 0CIC a C C>I r.It =P, c c 0C C C C C C c C

C1 C1. .I , f771, 70 0 700 ' . ' T 'Q7

Page 62: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

I A

L Ij .

c 0 0 Dc c 0 C0 t3

* C; C; .; D. .; D C

S 40 0 C 0 0

0 0:

rm. fn m tfCII. n4nCiml1 4 4 .

c e z c c c C Ic c Ci C .C~ c

NI 0~ 0 00 0 0CODC I 0 00 00 0

CI 0 r- cc'~<a1 0 a:0IC

CI 0 , 0' 00, 7 0r 0 0%DI ~p* I,-

c ' c I= L; I: Co 10 C C C C 0 *C) I '~' N~~0 c i'C

ZN . ." " .; . . .

~: ~ C 000. C.0, 0 0C OC

0: c9 ;a cc C

a I t- ir V .1 w\ C I V- b-b-Ck-Q

i I -

if A- - i\rt &

to ~ ~ ~ ~ ~ F Ix' N0 I ) C

... .i

I

C CI C , C 0- CCC . . . . . .. . C I ,C , c,( , , c c c V l

I2 [

Page 63: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

VII. Comparison of Three Estimating Methods

On the following pages gross comparisons of the threeestimating methods attempted are made. In general, the standardmethod of maximum likelihood is best, although there are times,as shown in Figure 7-1, when the maximum likelihood computerprogram does not give answers while the method described inSection VI does.

Page 64: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

Comparison of Methods Used to Estimate theAverage and Standard Deviation

Initial Guesses (In Standard Deviations)

0 to +2Maximum Least SquaresLikelihood Linear Average

and Least SquaresNormal Std, Dev. a

Averages

Average -.05 .09Standard Deviation .61 .51Number of Valuesused from printout 467 865Number of extremevalues not used 21 33

Standard Deviations

Average .77 .57

Standard Deviation .85 .57

Number of Valuesused from printout 463 858

Number of extremevalues not used 25 40

Standard Deviation/Average 1.10 1.00

Total Simulations Attempted 1000 1000

Number of simulationsnot used due to

No overlap 68 81Iterative process failed 444 21

Fig. 7-1

Page 65: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

Comparison of Methods Used to Estimate theAverage and Standard Deviation

Initial Guesses (In Standard Deviations)

-1 to 1-2Maximum Least SquaresLikelihood Linear Average

and Least SquaresNormal Std. Dev.

Averages

Average -.03 .06Standard Deviation .38 .39Number of Valuesused from printout 849 933

Number of extremevalues not used 1 6

Standard Deviations

Average .61 .62Standard Deviation .49 .53Number of Valuesused from printout 844 930Number of extremevalues not used 6 9

Standard Deviation/Average .80 .85

Total Simulations Attempted 1000 1000Number of simulationsnot used due to

No overlap 53 60Iterative process failed 97 1

Fig. 7-2

Page 66: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

Comparison of Methods Used to Estimate theAverage and Standard Deviation

Initial Guesses (In Standard Deviations)

-2 to +2

Maximum Least SquaAes UnconstrainedLikelihood Linear AverAge Least Squares

and Least Square Normal Distri-Normal Std. Dev. bution

Averages

Average -.03 .01 .21Standard Deviation .39 .40 .65

Number of valuesused from printout 886 935 46

Number of extremevalues not used 0 0 0

Standard Deviations

Average .71 .72 .81Standard Deviation .51 .55 .98Number of valuesused from printout 884 933 45Number of extremevalues not used 2 2 1

Standard Deviation/Average .72 .76 1.21

Total Simulations Attempted 1000 1000 50

Number of simulationsnot used due to

No overlap 65 65 2

Iterative process failed 49 0 2

Fig. 7-3

Page 67: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

Comparison of Methods Used to Estimate theAverage and Standard Deviation H':

Initial Guesses (In Standard Deviations)

-5 to +5Maximum Least Squares UnconstrainedLikelihood Linear Average Least Squares

and Least Squares Normal Distri-Normal Std. Dev. bution

Averages

Average -.01 .02 .07Standard Deviation .40 .42 77Number of valuesused from printout 8& 088 41Number of extreme i Ivalues not used 00 0

Standard Deviations

Average .77 .84 .49 IStandard Deviation .42 .51 .64

Number of valuesused from printout 8M 888 41

Number of extreme Avalues not used 0 0 0

Standard Deviation/Average .55 .61 1.31

Total Simulations Attempted 1000 1000 50Number of simulationsnot used due toNo overlap 135 112 5Iterative process failed 36 0 4

Fig. 7-4

I

Page 68: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

VIII. Applications of Derived Statistics

Shown below are two examples using the derived statistics.

1. Given that an ammunition item has a true average pene-tration velocity of 800 and a standard deviation of 60, what isthe best estimate of the lowest sample average that can be obtainedwith 90% confidence. It is assumed the upper and lower gates are680 and 920.

Convert the upper and lower limit to standard deviations bytaking the differences from the mean and dividing by the standarddeviation. This gives values of -2.0 and 2.0. Look up the graph Ion Fig. 2-16. The 90% confidence level will be indicated by thatpoint on the graph which has 10 percent or less chance of occurrence.This value in standard deviations is roughly -.5. Multiplying this iinumber by the standard deivation and summing with the average gives

the solution as 770.

2. Given the same problem as above but assuming a 10% randommalfunction rate. Look up graph on Fig. 4-6. The value in standarddeviations is roughly .45, giving a solution of 773. A highervelocity which will yield a lower effective range.

A

8

Page 69: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

APPENDIX A

Page 70: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

PROCEDURES FOR DETERMINING THE AVERAGE (V5 0 )

1. Establish a lower and upper velocity such that:

a. The probability of obtaining a complete penetration atthe higher velocity is highly likely.

b. The probability of obtaining a complete penetration atth( lower velocity is highly unlikely.

2. Fire the first round at a velocity midway between thesetwo limits.

3. If the first round results in aNaT penetration, fire thesecond round halfway between the first round velocity and theupper limit velocity; otherwise, halfway between the first andlower limit velocity.

4. If the first two rounds result in a reversal (one partial,one complete), fire the third round midway between the velocityof the first two rounds. If the first two rounds result in twopartials, fire the third round at a velocity midway between thesecond round velocity and the Upper limit velocity. If thefirst two rounds result in two completes, fire the third roundmidway between the second round velocity and the A Mlimitvelocity.

5. Succeeding rounds are fired using the following rules:

a. If the preceding pair of rounds resulted in a reversal(one partial, one complete), fire at a velocity midway betweenthem.

b. If the last two rounds did not produce a reversal,look at the last four rounds. If the number of completes andpartials are equal, fire the next round midway between thevelocity of the first and last round of the group. If the lastfour did not produce equal numbers of partials and completes,look at the last six, eight, etc., until the number of partialsand completes is equal. Always fire at a velocity midwaybetween the first and last round of the group you examined.

c. In the event that conditions in b above cannot besatisfied, if the last round resulted in a complete, fire thenext round at a velocity midway between the last round and the40*r velocity limit; otherwise (last round is a partial) midwaTbetween the velocity of the last round and the Ipper limit.

Al

Page 71: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

d. Proceed as in a and b above.

e. Firing will terminate when 12 rounds have been fired.

f. In the event that the firing does not produce a zone ofmixed results, the average will be computed by averaging thehighest complete and lowest partial.

g. In the event that the firing produces a zone of mixedresults, computation of the average will be performed by usingthe cumulative normal and the principle of maximum likelihood.

A2

Page 72: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

SUPPLEMENTARY

INFORMATION

Page 73: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

I REPORT NO. QAR-O-OIi

COMPUTER SIMULATION OF MAXIMUM

'LIKELIHOOD OUTPUT FOR STANDARD

, LANGLiE TEST

K. . DONALD C. RAPPAPORT

DECEMBER 1977

ARTILLERY SYST.IS DIVISIONPRODU, T StJANCE DIRECTORATE \/

US AR,,,Y ARlM,1AMENT rz :'HAND DEVELOPMENT C 0'A'DOVE-S, N W JERSEY

Page 74: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

PROCEDURES FOR DETERMINING THE AVERAGE (V5 0 )

1. Establish a lower and upper velocity such that:

a. The probability of obtaining a complete penetration atthe higher velocity is highly likely.

b. The probability of obtaining a complete-penetration atthe lower velocity is highly unlikely.

2. Fire the first round at a velocity midway between thesetwo limits.

3. If the first round results in a# penetration, fire the

second round halfway between the first iound velocity and theupper limit velocity; otherwise, halfway between the first andlower limit velocity.

4. If the first two rounds result in a reversal (one partial,

one complete), fire the third round midway between the velocityof the first two rounds. If the first two rounds result in twopartials, fire the third round at a velocity midway between thesecond round velocity and the Upper limit velocity. If thefirst two rounds result in two completes, fire the third roundmidway between the second round velocity and the kVlimitvelocity.

5. Succeeding rounds are fired using the'following rules:

a. If the preceding pair of rounds resulted in a reversal(one partial, one complete), fire at a velocity midway betweenthem.

b. If the last two rounds did not produce a reversal,look at the last four rounds. If the number of completes andpartials are equal, fire the next round midway between thevelocity of the first and last round of the group. If the lastfour did not produce equal numbers of partials and completes,look at the last six, eight, etc.,*until the number of partials

and completes is equal. Always fire at a velocity midwaybetween the first and last round of the group you examined.

c. In the event that conditions in b above cannot besatisfied, if the last round resulted in a complete, fire thenext round at a velocity midway between the last round and the40or velocity limit; otherwise (last round is a partial) midwaybetween the velocity of the last round and the jPper limit.

AlAII

.4/

fir, - ,. "

Page 75: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

172 /7 f, _

Elp01%

( .TAT,, '; o

DEM4BER 1977

Page 76: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

Selected Surmary of Computer Printouts

Initial Estimates (In standard deviations)-5 -2 -2 -! 0 -0.5to to to to to to+5 +3 - 2 +2 +2 +0.5

Averages

Average -.01 -.01 -.03 -.03 -.05 -.04Standard Deviation .40 .39 .39 .38 .61 .42Number of values .

used from printout 827 849 467 757Number of extremevalues not used 0 0 0 1 21 4

Standard Deviations

es Average .77 .69 .71 .61 .77 .39Standard Deviation .42 .38 .51 .49 .85 .47

Number of values .

used from printout 825 884 844, 463 753

Number of extremevalues not used 0 2 2 6 25 8

StandardDeviation/Average .55 .70 .72 .80 1.10 1.21

Total SimulationsAttempted 1000 1000 1000 £000 1000 1000

Number of simulationsnot used due to

No overlap 135 95 65 53 68 52Iterative processfailed 36 78 49 97 444 187

Fig. ,2-1

K

Page 77: kAJ NE - DTICThis report shows the expected results with estimates, referred to as gates, of varying size around the true average. The Langlie Test Procedure is defined in detail in

Comparison of 'ethods Used co Estimate the

Average and Standard Deviation

Initial Guesses (in Standard Deviatiors)

-5 to +5-aximun Least SGuares Uncons trains-dLikelihood Linear Average Least Scr"--,s

and Least Squares Normal Distri-Normal Std, Dev. bucion

Averages

Average -. 0! .02 .07

Standard Deviation .40 .42 .11Number of values Ssused from printout 9 888 41

Number of extremevalues not used 0 0

Standard Deviations

Average .77 .84 .49

Standard Deviation .42 .51 .64Number of values 219_used from printout 888 41

Nuber of extremevalues not used 0 0 0

- Standard Deviation/Average .55 .61 1.31

Total Simulations Attempted 1000 1000 50

Number of simulationsnot used due to

No overlap 135 112 5Iterative process failed 36 0 4

Fig. 7-4

:1 -.