Lockheed Martin Simulation, Training & Support ATML on LM-STAR ® Michelle Harris 407-306-6693...

Lockheed Martin Simulation, Training & SupportLockheed Martin Simulation, Training & Support

ATML on LM-STARATML on LM-STAR®®

Michelle Harris407-306-6693

[email protected]

Alicia Helton407-306-1592

[email protected]

Steven O’Donnell407-306-4325

Steven.J.O’[email protected]

22

Lockheed Martin Simulation, Training & Support

IntroductionIntroductionImplemented a set of ATML schemas on LM-Implemented a set of ATML schemas on LM-STARSTAR®®

Schemas used –Schemas used –TestDescription ML (draft 5.0)TestDescription ML (draft 5.0)

TestResults ML (version 0.15)TestResults ML (version 0.15)

Diagnostic MLDiagnostic ML

BayesBayes

Common Element Model (CEM) Common Element Model (CEM)

Dynamic Context Model (DCM – version 0.07)Dynamic Context Model (DCM – version 0.07)

33


Task DefinitionTask Definition

Convert a legacy CASS ATLAS TPS into ATML Convert a legacy CASS ATLAS TPS into ATML TestDescription.TestDescription.

Use TestDescription as input to the SELEX TPS Use TestDescription as input to the SELEX TPS Wizard™ and generate TestStandWizard™ and generate TestStand™™ sequences. sequences.

Execute the TestStandExecute the TestStand™™ sequences on the LM- sequences on the LM-STARSTAR®®..

Collect measured values using ATML TestResults.Collect measured values using ATML TestResults.

Interface with diagnostic reasoner to isolate to Interface with diagnostic reasoner to isolate to the fault more quickly and more accurately.the fault more quickly and more accurately.

44


Initial ApproachInitial Approach

Use an externally developed tool to convert ATLAS to Use an externally developed tool to convert ATLAS to Intermediate XML Intermediate XML

Use XML tools to transform the Intermediate XML to Use XML tools to transform the Intermediate XML to TestDescriptionTestDescription

TestDescription will provide the “what” to do information for the TestDescription will provide the “what” to do information for the TPSTPS

Use the TPS Wizard™ to generate TestStandUse the TPS Wizard™ to generate TestStand™™ sequence files capable of being run on LM-STARsequence files capable of being run on LM-STAR®®..

ATLASIntermediate

XMLATML Test Description

TestStand Sequence Files

55


IssuesIssues

Legacy ATLAS TPS was not designed to maximize Legacy ATLAS TPS was not designed to maximize portabilityportability

Intermediate XML generated from ATLAS was Intermediate XML generated from ATLAS was very flatvery flat

Difficult to understand test flow and translate into Difficult to understand test flow and translate into TestDescriptionTestDescription

Legacy ATLAS TPS didn’t adhere to style guide Legacy ATLAS TPS didn’t adhere to style guide which would have enforced specific design ruleswhich would have enforced specific design rules

Multiple fault callout permutations based on data Multiple fault callout permutations based on data evaluations made without test numbers created evaluations made without test numbers created problems in the diagnostic model developmentproblems in the diagnostic model development

66


Revised ApproachRevised Approach

An application was An application was developed to extract the developed to extract the “what” to do information “what” to do information from the ATLAS and save it from the ATLAS and save it to a spreadsheet.to a spreadsheet.

Human intervention Human intervention verified the information verified the information and added missing values.and added missing values.

An application was written An application was written to convert the spreadsheet to convert the spreadsheet to TestDescription.to TestDescription.

TestTest 20002000

Test GroupTest Group 11

Next on FailNext on Fail DIAGNOSTIC1DIAGNOSTIC1

Next on PassNext on Pass 20102010

Callout on Callout on FailFail

A4A4

High LimitHigh Limit 2525

Low LimitLow Limit NANA

ComparisonComparison EQEQ

UnitsUnits OhmOhm

Entry PointEntry Point NoNo

77


TestDescription Sample TestDescription Sample <Outcomes><Outcomes> <Outcome ID="0_1" value="Passed"/><Outcome ID="0_1" value="Passed"/> <Outcome ID="0_2" value="Failed"/><Outcome ID="0_2" value="Failed"/> <Outcome ID=" DIAGN1" value="Failed"><Outcome ID=" DIAGN1" value="Failed"> <ReplaceComponents><ReplaceComponents> <ReplaceComponent uutComponentId="UUT-0"/><ReplaceComponent uutComponentId="UUT-0"/> </ReplaceComponents></ReplaceComponents> </Outcome></Outcome> <Outcome ID="<Outcome ID=" DIAGN1" value="Failed">DIAGN1" value="Failed"> <ReplaceComponents><ReplaceComponents> <ReplaceComponent uutComponentId="UUT-1"/><ReplaceComponent uutComponentId="UUT-1"/> </ReplaceComponents></ReplaceComponents> </Outcome></Outcome>------snipped----------------snipped----------<Step xsi:type="Step_Test" ID="Step_2" testId="2000"><Step xsi:type="Step_Test" ID="Step_2" testId="2000"> <Results><Results> <Result xsi:type="Result_Test" testOutcomeId="2000A"><Result xsi:type="Result_Test" testOutcomeId="2000A"> <NextStep stepId="Step_3"/> <NextStep stepId="Step_3"/>  </Result></Result>

Using the information from TestDescription, the Selex TPS WizardUsing the information from TestDescription, the Selex TPS Wizard™™ builds the builds the frame of the new TPS with initiated variables, test criteria, simulation mode, pre frame of the new TPS with initiated variables, test criteria, simulation mode, pre and post conditions, and calls to “how-to” sequences. and post conditions, and calls to “how-to” sequences.

88

Lockheed Martin Simulation, Training & SupportTestDescription to LM-TestDescription to LM-STARSTAR®®

Needed to create the “how-to” TestStandNeeded to create the “how-to” TestStand™™ Sequences Sequences

Highly intensive manual taskHighly intensive manual taskSimplified through the use of Custom StepsSimplified through the use of Custom StepsGraphical interface to LM-STARGraphical interface to LM-STAR®® system software system software

99


Diagnostic ModelDiagnostic Model

DescriptionDescriptionModel is based off the Bayesian and Common Element Model is based off the Bayesian and Common Element Models from the AI-ESTATE standardModels from the AI-ESTATE standard

Stored in XML format derived from the AI-ESTATE Stored in XML format derived from the AI-ESTATE modelsmodels

Development of ModelDevelopment of ModelStart with the fault tree of the TPSStart with the fault tree of the TPS

Use historical test results and maintenance data to add Use historical test results and maintenance data to add more intelligence to the Modelmore intelligence to the Model

Learning algorithms are used to continuously feed back Learning algorithms are used to continuously feed back newly discovered test results (in TestResults ML format) newly discovered test results (in TestResults ML format) and maintenance dataand maintenance data

1010


Diagnostic ReasonerDiagnostic ReasonerProvides run-time environment for using the Provides run-time environment for using the diagnostic modelsdiagnostic models

Implements the AI-ESTATE interface to the diagnostic Implements the AI-ESTATE interface to the diagnostic modelsmodels

Uses the Dynamic Context Model to track session Uses the Dynamic Context Model to track session informationinformation

Allows for back-tracking through sessionAllows for back-tracking through session

Allows restart of Session from previous stopping pointAllows restart of Session from previous stopping point

Provides a set of “higher-order” interface functions to Provides a set of “higher-order” interface functions to minimize required calls for accessing model/reasoner dataminimize required calls for accessing model/reasoner data

Web-service based interface (using WSDL)Web-service based interface (using WSDL)

Utilizes a Bayesian Network Analyzer called SMILEUtilizes a Bayesian Network Analyzer called SMILE

By Decisions System Laboratory – Univ. of PittsburghBy Decisions System Laboratory – Univ. of Pittsburgh

1111


Lessons LearnedLessons LearnedOur current process is still heavily dependent on manual Our current process is still heavily dependent on manual intervention. intervention.

Very time-consumingVery time-consuming

Current legacy TPSs are implemented with tight coupling making it Current legacy TPSs are implemented with tight coupling making it difficult to separate the “what” and “how” informationdifficult to separate the “what” and “how” information

Other ATML schemas such as UUT Description and TestAdapter Other ATML schemas such as UUT Description and TestAdapter could aid in the porting processcould aid in the porting process

They were not mature enough at the time the task startedThey were not mature enough at the time the task started

Would be more cost effective to implement UUT test Would be more cost effective to implement UUT test requirements on new systems as opposed to re-hosting the requirements on new systems as opposed to re-hosting the applicationapplication

Not always a one-to-one test mapping from TPS to Diagnostic Not always a one-to-one test mapping from TPS to Diagnostic ModelModel

1212


ConclusionConclusionIndustry needs tools that can generate and Industry needs tools that can generate and consume ATML that could be exported to C, ATLAS consume ATML that could be exported to C, ATLAS etcetc

Using IEEE-1641 for Signal and Test Definition Using IEEE-1641 for Signal and Test Definition appears promising and further study by Lockheed appears promising and further study by Lockheed Martin is planned Martin is planned

Lockheed Martin is embracing ATMLLockheed Martin is embracing ATMLTestResults ML is deployed on LM-STARTestResults ML is deployed on LM-STAR®® systems systems supporting the JSF programsupporting the JSF program

As ATML matures, Lockheed Martin is prepared to As ATML matures, Lockheed Martin is prepared to implement this technology into our legacy and implement this technology into our legacy and future programsfuture programs

1313


DEMONTSTRATIONDEMONTSTRATION

1414


QuestionsQuestions

Alicia Helton407-306-1592

[email protected]

Michelle Harris407-306-6693

[email protected]

Steven O’Donnell407-306-4325

Steven.J.O’[email protected]

Lockheed Martin Simulation, Training & Support ATML on LM-STAR ® Michelle Harris 407-306-6693...

Documents

Transcript of Lockheed Martin Simulation, Training & Support ATML on LM-STAR ® Michelle Harris 407-306-6693...