Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont...
-
Upload
madeline-foster -
Category
Documents
-
view
214 -
download
1
Transcript of Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont...
![Page 1: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/1.jpg)
Quantitative Testing Plans
May 8-10, 2006
Iowa State University, Ames – USAJean-Louis Laffont
Kirk Remund
![Page 2: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/2.jpg)
ISTA Statistics Committee 2
Overview
• Statistical framework
• Implementation in Seedcalc
![Page 3: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/3.jpg)
ISTA Statistics Committee 3
Testing plan design: statistical framework for quantitative methods
Seed lot:
true AP% = p
• Suppose n pools of m seeds were taken from the lot and that J flour sub-samples from each pool were measured K times.
n pools of m seeds … …
Grinding seeds into flour
… …
J flour sub-samples per pool
Measurement
K measures per floursub-sample
Measure 1 Measure 2 … Measure K
Flour sub-sample 1
Flour sub-sample 2
…Flour sub-sample J
Pool iyijk
![Page 4: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/4.jpg)
ISTA Statistics Committee 4
Testing plan design: statistical framework for quantitative methods
• Model:
ijk)i(jiijk ebapy Measurement k made on flour sub-sample j from pool i
True AP%= + + +
Random effect of pool i
2sampling,0N
Random effect of flour sub-sample j from pool i
2flour,0N
Random effect of measurmnt k for flour sub-sample j from pool i
2tmeasuremen,0N
The parameter p is estimated by the sample mean:
2p̂
k,j,iijk p,N~y
nJK
1p̂
nJKnJntmeasuremen
2flour
2sampling
22p̂
![Page 5: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/5.jpg)
ISTA Statistics Committee 5
0.0 0.5 1.0 1.5 2.0
AP%
Testing plan design: statistical framework for quantitative methods
Overall distribution of )N(p,~y y2yijk
nJKnJntmeasuremen
2flour
2sampling
22p̂
-1.0 -0.5 0.0 0.5 1.0
AP%
p +
Flour sub-sampling
Measurement
Sampling n pools of m seeds : derived from the variance of
2sampling
2 ker nel ker nelsampling
p (1 p )
m
2flour
2tmeasuremen
ker nelB(m,p )
and are obtained from historical experiments
flour2 tmeasuremen
2
![Page 6: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/6.jpg)
ISTA Statistics Committee 6
• Homozygous reference material and hemizygous test lots
Testing plan design: statistical framework for quantitative methods
• Remember that the true AP% p in the lot is expressed in %DNA when using quantitative methods
and that is expressed on a kernel basis.
2 ker nel ker nelsampling
p (1 p )
m
Introduction of the b-Factor (biological factor) to convert from %DNA to %Seed units: %Seed = b-Factor x %DNA or
ker nelp b p • Examples:
• Reference material and test lots have the same zygosity/ploidy/copy number b-Factor= 1
b-Factor= 2
![Page 7: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/7.jpg)
ISTA Statistics Committee 7
Testing plan design: statistical framework for quantitative methods
• Re-expression of in %DNA units:
2sampling
p(1 bp)
bm
2sampling
nJKnJntmeasuremen
2flour
2sampling
2
p̂2
2 22 flour measurement
p̂
(pCV )p(1 bp)
bnm nJ nJK
• Re-expression of :
Having observed in some experiments that ²measurement
seems to depend on p, the true AP probability, whileCVmeasurement is fairly constant, we can rewrite as: p̂
2
![Page 8: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/8.jpg)
ISTA Statistics Committee 8
Testing plan design: statistical framework for quantitative methods
• This formula serves as a basis for elaborating an OC curve that can be used to investigate properties of a testing plan
• We can then calculate the probability to “accept” the lot, given a true unknown AP% p:
where is the cumulative distributionfunction for the standard normal distribution
p̂p̂p̂
pALp|
pALpp̂Pr)p|ALp̂Pr(
• Lets now define an Acceptance Limit (AL) such that:
• if AL, “accept” the lot
• if > AL, “reject” the lot
p̂p̂
![Page 9: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/9.jpg)
ISTA Statistics Committee 9
Testing plan design: statistical framework for quantitative methods
• Example: testing plan components: 2 pools of 3000 seeds, 1 flour sub-sample/pool, 3 measurements/flour sub-sample, Std-Dev of flour sub-sampling error = 0.011%, measurement CV = 15%, Acceptance Limit (AL) = 0.1% (lot « accepted » if average of the 2 x 1 x 3 readings is AL)
True AP% in lot
Pro
ba
bili
ty o
f a
cce
pta
nce
(%
)
0.0 0.1 0.2 0.3 0.4 0.5
02
04
06
08
01
00
95%
5%
![Page 10: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/10.jpg)
ISTA Statistics Committee 10
Testing plan design: statistical framework for quantitative methods
• Consumer risk and producer risk are given respectively by:
where is the cumulative distributionfunction for the standard normal distribution
p̂
LQLAL)LQL|ALp̂Pr(riskConsumer
p̂
AQLAL1)QLA|ALp̂Pr(riskoducerPr
![Page 11: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/11.jpg)
ISTA Statistics Committee 11
Testing plan design: implementation for quantitative methods
• All of the methods discussed have been implemented in the newest version of the Microsoft Excel® spreadsheet Seedcalc
Estimating AP%
Designingtesting plans
Comparingtesting plans
![Page 12: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/12.jpg)
ISTA Statistics Committee 12
Testing plan design: implementation for quantitative methods
Testing plan design
Enter n, m, J, K and …
historical assay variation and…
LQL, AQL and AL
and get consumerand producer risks and OC curve
b-Factor and …
![Page 13: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/13.jpg)
ISTA Statistics Committee 13
Testing plan design: implementation for quantitative methods
The « Find Plan » tool can help the user to find testing plans satisfying certain conditions given some parameters
![Page 14: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/14.jpg)
ISTA Statistics Committee 14
Testing plan design: implementation for quantitative methods
Parameters for the search algorithms
![Page 15: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/15.jpg)
ISTA Statistics Committee 15
Testing plan design: implementation for quantitative methods
Find the highest AL that meets target consumer
risk for the LQL. No consideration of the
producer risk target.n, m, J and K are held
fixed
![Page 16: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/16.jpg)
ISTA Statistics Committee 16
Testing plan design: implementation for quantitative methods
Consumer and producerrisk targets satisfied
by changing AL, n, I and J
![Page 17: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/17.jpg)
ISTA Statistics Committee 17
Testing plan design: implementation for quantitative methods
Consumer and producerrisk targets satisfied
by changing AL, m, I and J
![Page 18: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/18.jpg)
ISTA Statistics Committee 18
Testing plan design: implementation for quantitative methods
Consumer and producerrisk targets satisfied
by changing AL, n, m, I and J
![Page 19: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/19.jpg)
ISTA Statistics Committee 19
Testing plan design: implementation for quantitative methods
Compare plans
Visual comparison of OC curves along with testing plan parameters
![Page 20: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/20.jpg)
ISTA Statistics Committee 20
Historical data gave 0.15% for the estimate of the flour standard-deviation. We expect that the measurement CV range is from 10% to 30% and weconsider the following testing plan: . LQL = 0.7% for a consumer confidence = 95%. AQL = 0.15% for a producer confidence = 95%. 1 pool of 3000 seeds, 2 flour sub-samples, 3 measurements. AL = 0.39% 1. Does this plan meet consumer and producer requirements when the measurement CV = 10%? 2. Compare the outcomes of this testing plan when the CV is varying from 10% to 30%.
Example
![Page 21: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/21.jpg)
ISTA Statistics Committee 21
Example
1. Does this plan meet consumer and producer requirements when the measurement CV = 10%?
YES
![Page 22: Quantitative Testing Plans May 8-10, 2006 Iowa State University, Ames – USA Jean-Louis Laffont Kirk Remund.](https://reader035.fdocuments.us/reader035/viewer/2022062718/56649ebd5503460f94bc6de1/html5/thumbnails/22.jpg)
ISTA Statistics Committee 22
Example2. Compare the outcomes of this testing plan when the CV is varying from 10% to 30%.