Making a curved line straight Data Transformation & Regression.

42
Making a curved line Making a curved line straight straight Data Data Transformation Transformation & Regression & Regression

Transcript of Making a curved line straight Data Transformation & Regression.

Page 1: Making a curved line straight Data Transformation & Regression.

Making a curved line straightMaking a curved line straight

Data Transformation Data Transformation & Regression& Regression

Page 2: Making a curved line straight Data Transformation & Regression.

Last ClassLast Class

Predicting the dependant variable Predicting the dependant variable and standard errors of predicted and standard errors of predicted values.values.

Outliers.Outliers.Need to visually inspect data in Need to visually inspect data in

graphic form.graphic form.Making a curved line straight.Making a curved line straight.

Transformation.Transformation.

Page 3: Making a curved line straight Data Transformation & Regression.

Early Growth Pattern of PlantsEarly Growth Pattern of Plants

0

5

10

15

20

25

30

0 10 20 30 40 50

Days after planting

Plan

t weig

ht (g

)

Page 4: Making a curved line straight Data Transformation & Regression.

Early Growth Pattern of PlantsEarly Growth Pattern of Plants

0

5

10

15

20

25

30

0 10 20 30 40 50

Days after planting

Plan

t weig

ht (g

)

00.511.522.533.5

y = Ln(y)

Page 5: Making a curved line straight Data Transformation & Regression.

Early Growth Pattern of PlantsEarly Growth Pattern of Plants

0

5

10

15

20

25

30

0 10 20 30 40 50

Days after planting

Plan

t weig

ht (g

)

0

1

2

3

4

5

6

y = y

Page 6: Making a curved line straight Data Transformation & Regression.

Homogeneity of Error VarianceHomogeneity of Error Variance

05

101520253035

0 10 20 30 40 50

Days after planting

Plan

t weig

ht (g

)

Page 7: Making a curved line straight Data Transformation & Regression.

Homogeneity of Error VarianceHomogeneity of Error Variance

0

1

2

3

4

0 10 20 30 40 50

Days after planting

Plan

t weig

ht (g

)

y =Ln(y)

Page 8: Making a curved line straight Data Transformation & Regression.

Growth CurveGrowth Curve

Y = eY = exx

Page 9: Making a curved line straight Data Transformation & Regression.

Growth CurveGrowth Curve

Y = Log(x)Y = Log(x)

Page 10: Making a curved line straight Data Transformation & Regression.

Sigmoid Growth CurveSigmoid Growth Curve

Page 11: Making a curved line straight Data Transformation & Regression.

Sigmoid Growth CurveSigmoid Growth Curve

0

50

100

150

200

250

300

350

0

50

100

150

200

250

300

350

Accululative Accululative Normal Normal

DistributionDistribution

Page 12: Making a curved line straight Data Transformation & Regression.

Sigmoid Growth CurveSigmoid Growth Curve

0

50

100

150

200

250

300

350

0

50

100

150

200

250

300

350

Accululative Accululative Normal Normal

DistributionDistribution

TT

-- ƒƒ((dddd

TT

Page 13: Making a curved line straight Data Transformation & Regression.

Sigmoid Growth CurveSigmoid Growth Curve

0

50

100

150

200

250

300

350

0

50

100

150

200

250

300

350

Accululative Accululative Normal Normal

DistributionDistribution

TT

-- ƒƒ((dddd

TT

Page 14: Making a curved line straight Data Transformation & Regression.

Probit AnalysisProbit Analysis

• Group of plants/insects exposed to Group of plants/insects exposed to different concentrations of a specific different concentrations of a specific stimulant (i.e. insecticide).stimulant (i.e. insecticide).

• Data are counts (or proportions), say Data are counts (or proportions), say number killed.number killed.

• Usually concerned or interested in Usually concerned or interested in concentration which causes specific concentration which causes specific event (i.e. LD 50%).event (i.e. LD 50%).

Page 15: Making a curved line straight Data Transformation & Regression.

Probit Analysis ~ ExampleProbit Analysis ~ Example

Insecticide concentration (%)

0.37 0.75 1.5 3 6 12 24

Number larvaekilled

0 1 8 11 16 18 20

Proportion killed 0 0.05 0.40 0.55 0.80 0.90 1.00

Level 0 1 2 3 4 5 6

Page 16: Making a curved line straight Data Transformation & Regression.

0

0.2

0.4

0.6

0.8

1

1.2

0 5 10 15 20 25 30

Insecticide concentration (%)

Pro

por

tion

larv

ae k

ille

dProbit Analysis ~ ExampleProbit Analysis ~ Example

Page 17: Making a curved line straight Data Transformation & Regression.

Estimating the MeanEstimating the Mean

0

0.2

0.4

0.6

0.8

1

1.2

0 1 2 3 4 5 6

Level

Pro

po

rtio

n l

arv

ae

kil

led yy= 50% Killed= 50% Killed

x x ~ 2.8~ 2.8

Page 18: Making a curved line straight Data Transformation & Regression.

Estimating the Standard DeviationEstimating the Standard Deviation

2.82.8

Page 19: Making a curved line straight Data Transformation & Regression.

2.82.8

22

Estimating the Standard DeviationEstimating the Standard Deviation

Page 20: Making a curved line straight Data Transformation & Regression.

2.82.8

22

95% 95% valuesvalues

Estimating the Standard DeviationEstimating the Standard Deviation

Page 21: Making a curved line straight Data Transformation & Regression.

2.82.8

22

95% 95% valuesvalues

= 1.2= 1.2

Estimating the Standard DeviationEstimating the Standard Deviation

Page 22: Making a curved line straight Data Transformation & Regression.

Probit AnalysisProbit Analysis

Conc. NumberKilled

Prop.Killed

(x) (z)(x-2.8)/1.2

Probit()

0.375 0 0.00 0 -2.33 0.00990.750 1 0.05 1 -1.50 0.06681.500 8 0.40 2 -0.67 0.25253.000 11 0.55 3 0.17 0.56626.000 16 0.80 4 1.00 0.841312.000 18 0.90 5 1.83 0.966624.000 20 1.00 6 2.67 0.9962

Page 23: Making a curved line straight Data Transformation & Regression.

Probit AnalysisProbit Analysis

-0.5 -0.3 0 0.25 0.5 0.75 1 1.25 1.5

Log10 (concentration)

Pro

bit

(p)

Page 24: Making a curved line straight Data Transformation & Regression.

Probit AnalysisProbit Analysis

Probit (Probit () = ) = + + . Log . Log1010(concentration)(concentration) = -1.022 = -1.022 ++ 0.202 0.202

= 2.415 = 2.415 ++ 0.331 0.331

LogLog1010 (conc) to kill 50% (LD-50) is probit 0.5 = 0 (conc) to kill 50% (LD-50) is probit 0.5 = 0

0 = -1.022 + 2.415 0 = -1.022 + 2.415 xx LD-50 LD-50

LD-50 = 0.423LD-50 = 0.423

10100.4230.423 = 2.65% = 2.65%

Page 25: Making a curved line straight Data Transformation & Regression.

ProblemsProblems

Obtaining “good estimates” of the Obtaining “good estimates” of the mean and standard deviation of the mean and standard deviation of the data.data.

Make a calculated guess, use Make a calculated guess, use iteration to get “better fit” to iteration to get “better fit” to observed data.observed data.

Page 26: Making a curved line straight Data Transformation & Regression.

Where Straight Lines MeetWhere Straight Lines Meet

Page 27: Making a curved line straight Data Transformation & Regression.

Optimal AssentOptimal Assent

0

20

40

60

80

100

120

0 2 4 6 8 10 12 14 16

Page 28: Making a curved line straight Data Transformation & Regression.

Optimal AssentOptimal Assent

0

20

40

60

80

100

120

0 2 4 6 8 10 12 14 16

Y1=a1+b1x

Page 29: Making a curved line straight Data Transformation & Regression.

Optimal AssentOptimal Assent

0

20

40

60

80

100

120

0 2 4 6 8 10 12 14 16

Y1=a1+b1x

Y2=a2+b2x

Page 30: Making a curved line straight Data Transformation & Regression.

Optimal AssentOptimal Assent

0

20

40

60

80

100

120

0 2 4 6 8 10 12 14 16

Y1=a1+b1x

Y2=a2+b2x

tt =[b =[b11-b-b22]/se(b)]/se(b)

= ns= ns

Page 31: Making a curved line straight Data Transformation & Regression.

Optimal AssentOptimal Assent

0

20

40

60

80

100

120

0 2 4 6 8 10 12 14 16

Y1=a1+b1x

Y3=a3+b3x

Page 32: Making a curved line straight Data Transformation & Regression.

Optimal AssentOptimal Assent

0

20

40

60

80

100

120

0 2 4 6 8 10 12 14 16

Y1=a1+b1x

Y3=a3+b3x

tt =[b =[b11-b-b33]/se(b)]/se(b)

= ***= ***

Page 33: Making a curved line straight Data Transformation & Regression.

Optimal AssentOptimal Assent

0

20

40

60

80

100

120

0 2 4 6 8 10 12 14 16

Y1=a1+b1x

Y3=a3+b3x

Page 34: Making a curved line straight Data Transformation & Regression.

Optimal AssentOptimal Assent

0

20

40

60

80

100

120

0 2 4 6 8 10 12 14 16

Y1=a1+b1x

Y3=a3+b3x

tt =[b =[b11-b-bnn]/se(b)]/se(b)

= ***= ***Yn=an+bnx

Page 35: Making a curved line straight Data Transformation & Regression.

Optimal AssentOptimal Assent

0

20

40

60

80

100

120

0 2 4 6 8 10 12 14 16

Y1=a1+b1x

Y3=a3+b3x

Y3=a3+b3x

Page 36: Making a curved line straight Data Transformation & Regression.

Yield and NitrogenYield and NitrogenN applied (lb/acre)

Seed Yield (lb/acre)

50 921 60 997 70 1086 80 1214 90 1299 100 1341 110 1370 120 1402 130 1409

Page 37: Making a curved line straight Data Transformation & Regression.

What application of What application of nitrogen will result in nitrogen will result in

the the optimumoptimum yield yield response?response?

Page 38: Making a curved line straight Data Transformation & Regression.

Intersecting LinesIntersecting Lines

900

1000

1100

1200

1300

1400

1500

40 50 60 70 80 90 100 110 120 130 140

N application

See

d Y

ield

(lb

/acr

e)

Page 39: Making a curved line straight Data Transformation & Regression.

Intersecting LinesIntersecting Lines

900

1000

1100

1200

1300

1400

1500

40 50 60 70 80 90 100 110 120 130 140

N application

See

d Y

ield

(lb

/acr

e) Y = 2.81x + 1055.10

Y = 9.01x + 466.60

Page 40: Making a curved line straight Data Transformation & Regression.

Intersecting LinesIntersecting Lines

tt = [b = [b1111 - b - b2121]/average se(b)]/average se(b)

6.2/0.593 = 10.45 6.2/0.593 = 10.45 ** , With 3 df , With 3 dfIntersect = same value of yIntersect = same value of y

bb1010 + b + b1111x = y = bx = y = b2020 + b + b2121xx

x = [bx = [b2020 - b - b1010]/[b]/[b1111 - b - b2121]]

= 94.92 lb N/acre= 94.92 lb N/acre

with 1321.83 lb/acre seed yieldwith 1321.83 lb/acre seed yield

Page 41: Making a curved line straight Data Transformation & Regression.

Intersecting LinesIntersecting Lines

900

1000

1100

1200

1300

1400

1500

40 50 60 70 80 90 100 110 120 130 140

N application

See

d Y

ield

(lb

/acr

e) Y = 2.81x + 1055.10

Y = 9.01x + 466.60

94.92 lb N/acre94.92 lb N/acre

1321.83 1321.83 lb/acrelb/acre

Page 42: Making a curved line straight Data Transformation & Regression.

LinearLinear

Y = bY = b00 + b + b11xxQuadraticQuadratic

Y = bY = b00 + b + b11x + bx + b2 2 xx22

CubicCubic

Y = bY = b00 + b + b11x + bx + b2 2 xx2 2 + b+ b3 3 xx33

Bi-variate DistributionBi-variate DistributionCorrelationCorrelation