L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... ·...

25
10/03/03 copyright Brian Williams, 2003 1 Courtesy NASA/JPL-Caltech. http://www.jpl.nas.gov. Model-based Diagnosis Brian C. Williams 16.410-13 November 3 rd & 5 th 2003 Brian C. Williams, copyright 2000

Transcript of L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... ·...

Page 1: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 1Courtesy NASA/JPL-Caltech. http://www.jpl.nas.gov.

Model-based Diagnosis

Brian C. Williams16.410-13November 3rd & 5th 2003

Brian C. Williams, copyright 2000

Page 2: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 2

Assignment

ReadingModel-based Diagnosis – Lecture notesPropositional Logic AIMA Chapter 6

Problem SetModel-based Diagnosis implementationPropositional Logic16.413: Hello World implementationDue Monday, November 17th

Page 3: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 3

senseP(s)

WORLD

observations actions

AGENTDiagnostic Agent:

• Monitors & Diagnoses

• Repairs & Avoids

• Probes and Tests

Plant

act

Symptom-directed

Page 4: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 4

Outline

Model-based diagnosisAccounting for failures

Explaining failuresHandling unknown failures

Page 5: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 5

Hidden Failures Require Reasoning from a Model: STS-93

Symptoms:• Engine temp sensor high• LOX level low• GN&C detects low thrust• H2 level possibly low

Problem: Liquid hydrogen leak

Effect: • LH2 used to cool engine• Engine runs hot• Consumes more LOX

Image taken from NASA’s web site: http://www.nasa.gov.

Page 6: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 6

Model-based DiagnosisGiven a system with symptomatic behavior and a model of the system, find diagnoses that accountfor symptoms.

12 Symptom6

6

O1

M2

M3

A1

A2

A

BCD

E

F

G

X

Y

Z

3

223

3

10

12

M1

6

12

Page 7: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 7

Model-based DiagnosisGiven a system with symptomatic behavior and a model of the system, find diagnoses that accountfor symptoms.

12 Symptom6

6

M1

M2

M3

A1

A2

A

BCD

E

F

G

X

Y

Z

3

223

3

10

126

12

Page 8: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 8

Diagnosis as Hypothesis Testing

1. Generate candidates, given symptoms.2. Test if candidates account for all symptoms.

• Set of diagnoses should be complete.• Set of diagnoses should consider all

available information.

Page 9: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 9

Outline

Model-based diagnosisAccounting for failures

Explaining failuresHandling unknown failures

Page 10: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 10

How Should Diagnoses Account for Symptoms?Abductive Diagnosis: Given symptoms, find

diagnoses that predict observations.6

6

12 SymptomM1

M2

M3

A1

A2

A

BCD

E

3

223

3

F

G

X

Y

Z

10

12

Assume Exhaustive Fault Models:

Page 11: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 11

How Should Diagnoses Account for Symptoms?Abductive Diagnosis: Given symptoms, find

diagnoses that predict observations.6

6

12 SymptomM1

M2

M3

A1

A2

A

BCD

E

3

223

3

F

G

X

Y

Z

10

12

Assume Exhaustive Fault Models:• O1 Drops low bit on A

A = 30011

A=20010

4 102

6

12

Page 12: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 12

ModelStructureModel of normal behavior for each componentModel for every component failure mode

ObservationsInputs and Response

3

223

3

M1

M2

M3

A1

A2

A

BCD

E

F

G

X

Y

Z

Multiplier(i):G(i):Out(i) = In1(i)*In2(i)

Stuck_in1(i):Out(i) = . . .

10

12

Abductive,Model-based Diagnosis

Page 13: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 13

X mode variables, one for each component cDc modes of component c = domain of xc XY model variablesM(X, Y) model constraintsO observable variables O Y

Partitioned into Inputs I and Response R

3

223

3

M1

M2

M3

A1

A2

A

BCD

E

F

G

X

Y

Z

Multiplier(i):G(i):Out(i) = In1(i)*In2(i)

Stuck_in1(i):Out(i) = . . .

10

12

Abductive,Model-based Diagnosis

Page 14: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 14

In, Resp: Assignment to I and R, respectivelyCandidate Ci: Assignment of modes to XDiagnosis Di: A candidate such that

Di In C(X,Y) predicts (entails) Resp

Diagnosis = {A1=G, A2=S, O1=G, M2=G, M3=G}

M1

M2

M3

A1

A2

A

BCD

E

F

G

X

Y

Z

Multiplier(i):G(i):Out(i) = In1(i)*In2(i)

Stuck_in1(i):Out(i) = . . .

Abductive,Model-based Diagnosis

3

223

3

10

12

Candidate = {A1=G, A1=G, M1=G, A2=G, M3=G}

Page 15: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 15

Abductive Diagnosis by Generate and Test

Given: Correct and exhaustive fault models for each component.

Generate: Consider each mode assignment as a candidate.

Test:1. Simulate candidate, given inputs.2. Compare to observations

• Disagree: Discard• Agree: Keep• No prediction: Discard

Problem:• Fault models are often incomplete• May incorrectly exonerate faulty components

Page 16: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 16

Outline

Model-based diagnosisAccounting for failures

Explaining failuresHandling unknown failures

Page 17: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 17

• Mars Observer• Mars Climate Orbiter• Mars Polar Lander• Deep Space 2

Courtesy NASA/JPL-Caltech. http://www.jpl.nasa.gov.

Issue: Failures are Often Novel

Page 18: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 18

Helium tank

Fuel tankOxidizer tank

MainEngines

Flow1 = zeroPressure1 = nominal

Pressure2= nominal

Acceleration = zero

Page 19: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 19

How Should Diagnoses Account for Novel Symptoms?Consistency-based Diagnosis: Given symptoms,

find diagnoses that are consistent with symptoms.Suspending Constraints: Make no presumptions

about faulty component behavior.1

1

1 SymptomOr1

Or2

Or3

And1

And2

A

BCD

E

1

111

0

F

G

X

Y

Z

0

1

Page 20: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 20

Consistency-based Diagnosis: Given symptoms, find diagnoses that are consistent with symptoms.

Suspending Constraints: Make no presumptions about faulty component behavior.

1

1

1 SymptomOr1

Or2

Or3

And1

And2

A

BCD

E

1

111

0

F

G

X

Y

Z

0

1

How Should Diagnoses Account for Novel Symptoms?

Page 21: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 21

Consistency-based Diagnosis: Given symptoms, find diagnoses that are consistent with symptoms.

Suspending Constraints: Make no presumptions about faulty component behavior.

1

1

Or1

Or2

Or3

And1

And2

A

BCD

E

1

111

0

F

G

X

Y

Z

0

1

How Should Diagnoses Account for Novel Symptoms?

Page 22: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 22

Consistency-based Diagnosis

And(i):G(i):Out(i) = In1(i) AND In2(i)

U(i):

Obs: Assignment to OCandidate Ci: Assignment of modes to XDiagnosis Di: A candidate such that

Di Obs C(X,Y) is satisfiable.

1

111

0

Or1

Or3

And1

A

BCD

E

F

G

X

Y

Z

0

1

Diagnosis = {A1=G, A2=U O1=G, O2=U, O3=G}

ALL components have “unknown Mode” U, Whose assignment isnever mentioned in C

Page 23: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 23

Testing Consistency Propositional Logic• DPLL• Unit propagation (incomplete)

•Finite Domain Constraints• Backtrack w forward checking, …• Waltz constraint propagation (incomplete)

• Algebraic Constraints• Sussman/Steele Constraint Propagation:Propagate newly assigned values through equations mentioning variables.

• To propagate, use assigned values of constraint to deduce unknown value(s) of constraint.

Page 24: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 24

X {1,0} X=1 X=0X=1 X=0

Encoding Models In Propositional Logic

(i=G) (In1(i)=1) Out(i)=1(i=G) (In2(i)=1) Out(i)=1(i=G) (In1(i)=0) (In2(i)=0) Out(i)=0

And(i):G(i):Out(i) = In1(i) AND In2(i)

U(i):

Or(i):G(i):Out(i) = In1(i) OR In2(i)

U(i):

(i=G) (In1(i)=0) Out(i)=0(i=G) (In2(i)=0) Out(i)=0(i=G) (In1(i)=1) (In2(i)=1) Out(i)=1

Page 25: L15a model-based diagnosis - MITdspace.mit.edu/bitstream/handle/1721.1/36896/2/16-410... · 2019-09-12 · 10/03/03 copyright Brian Williams, 2003 2 Assignment Reading Model-based

10/03/03 copyright Brian Williams, 2003 25

Summary:Model-based Diagnosis

• A failure is a discrepancy between the model and observations of an artifact.

• Diagnosis is symptom directed • Symptoms identify conflicting components as

initial candidates.• Test novel failures by suspending constraints

and testing consistency.• Newly discovered conflicts further prune

candidates.