An Approach to ATML using the SSAI RAI Standard SSAI Proprietary Information: Any distribution or...

Post on 29-Jan-2016

221 views 0 download

Tags:

Transcript of An Approach to ATML using the SSAI RAI Standard SSAI Proprietary Information: Any distribution or...

An Approach to ATMLusing the SSAI RAI Standard

SSAI Proprietary Information: Any distribution or disclosure of this information is subject to prior SSAI approval.

Dr. Ronald C. Salley (321) 724-5566 x274 rsalley@ssai.orgHugh Pritchett 321-724-5566 x260 hpritchett@ssai.org

RAI Visualization

Test PlatformRAI

Test Requirement Object

Test Program(test-platform independent)

The SSAI RAI Standard

The only model that completely supports

• complete platform independence and• parallel testing

RAI Visualization

RAI

Test Requirement Object

Test PlatformTest Program(test-platform independent)

The Test Requirement - the primary unit of currency for testing

The SSAI RAI Standard

Test Requirement vs. Test

Space = what Time = how data objects events

data-definition languages, eg., XML

programming languages, e.g., ATLAS

test platforms tests

test requirements test descriptions

test definitions

Test Requirement vs. Test

Space = what Time = how data objects events

data-definition languages, eg., XML

programming languages, e.g., ATLAS

test platforms tests

test requirements test descriptions

test definitions

Traditional Modeling

Test Requirement vs. Test

Space = what Time = how data objects events

data-definition languages, eg., XML

programming languages, e.g., ATLAS

test platforms tests

test requirements test descriptions

test definitions

RAI Modeling

Test Requirement vs. Test

Space = what Time = how data objects events

data-definition languages, eg., XML

programming languages, e.g., ATLAS

test platforms tests

test requirements test descriptions

test definitions

RAI Modeling

Test Requirement vs. Test

Space = what Time = how data objects events

data-definition languages, eg., XML

programming languages, e.g., ATLAS

test platforms tests

test requirements test descriptions

test definitions

RAI Modeling

Test Requirement vs. Test

TEST PLATFORM UUT

A, WFGB, WFG

C, DMM

E, DMM

D, DMM

F, DMM

G, DMM

ITA

H, WFG

1

2

3

4

5

6

7

8

9

10

16

15

14

13

12

11

Test Requirement vs. Test

TEST PLATFORM

SqW

A, WFG

2 µsec

RMSAvg

SnW

B, WFG

C, DMM

E, DMM

D, DMM

F, DMM

G, DMM

0 µsec5 µsec

3 µsec

ITA

H, WFG

1

2

3

4

5

6

7

8

9

10

16

15

14

13

12

11

UUT

Test Requirement vs. Test

TEST PLATFORM

SqW

A, WFG

2 µsec

RMSAvg

SnW

B, WFG

E, DMMF, DMM

0 µsec5 µsec

3 µsec

ITA

2

6

9

13

UUT

test requirement

Test Requirement vs. Test

TEST PLATFORM UUT

ITAA, WFG

B, WFG

SqW

5 µsec

E, DMM

2 µsec

RMS

F, DMM

Avg

3 µsec

SnW

0 µsec 2

6

9

13

UUT

test requirement

Test Requirement vs. Test

ITAA, WFG

B, WFG

SqW

5 µsec

E, DMM

2 µsec

RMS

F, DMM

Avg

3 µsec

SnW

0 µsec

TEST PLATFORM

2

6

9

13

UUT

test requirement

Test Requirement vs. Test

ITAA, WFG

B, WFG

SqW

5 µsec

E, DMM

2 µsec

RMS

F, DMM

Avg

3 µsec

SnW

0 µsec

TEST PLATFORM

2

6

9

13

UUT

test requirement

Test Requirement vs. Test

ITAA, WFG

B, WFG

SqW

5 µsec

E, DMM

2 µsec

RMS

F, DMM

Avg

3 µsec

SnW

0 µsec

TEST PLATFORM

2

6

9

13

UUT

test requirement

Test Requirement vs. Test

ITAA, WFG

B, WFG

SqW

5 µsec

E, DMM

2 µsec

RMS

F, DMM

Avg

3 µsec

SnW

0 µsec

TEST PLATFORM

2

6

9

13

UUT

test requirement

Test Requirement vs. Test

TEST PLATFORM UUT

ITAA, WFG

B, WFG

SqW

5 µsec

E, DMM

2 µsec

RMS

F, DMM

Avg

3 µsec

SnW

0 µsec 2

6

9

13

UUT

test result

Test Requirement vs. Test

During the test… the state of the test platform is the test requirement

Immediately after the test… the state of the test platform is the test result

Test Requirement vs. Test

A test requirement and its result are states of the same object, viz., the test platform.

Test Requirement vs. Test

A test requirement and its result are states of the same object, viz., the test platform.

A test requirement and its result are structurally identical trees whose nodes may have slightly different states.

Test Requirement vs. Test

ITA

TEST PLATFORM

A, WFG

B, WFG

E, DMM

F, DMM SqW

5 µsec

2 µsec

RMS

Avg

3 µsec

SnW

0 µsec

UUT

2

6

9

13

UUT

test platform state

Test Requirement vs. Test

B, WFG

E, DMM

F, DMM

TEST PLATFORMTEST PLATFORM

SqW

5 µsec

2 µsec

RMS

Avg

3 µsec

SnW

0 µsec

UUT

2

6

9

13

UUT

ITA

test platform state

Test Requirement vs. Test

TEST PLATFORM

E, DMM

F, DMM

SqW

5 µsec

2 µsec

RMS

Avg

3 µsec

SnW

0 µsec

UUT

2

6

9

13

ITA

test platform state

Test Requirement vs. Test

TEST PLATFORM

E, DMM

UUT

SqW

5 µsec

2 µsec

RMS

Avg

3 µsec

SnW

0 µsec 2

6

9

13

ITA

test platform state

Test Requirement vs. Test

SqW

5 µsec

2 µsec

RMS

Avg

3 µsec

SnW

0 µsec

TEST PLATFORM

UUT

2

6

9

13

ITA

test platform state

Test Requirement vs. Test

SqW

5 µsec

2 µsec

RMS

Avg

3 µsec

SnW

0 µsec

TEST PLATFORM

2

6

9

13

UUT

ITA

test platform state

Test Requirement vs. Test

SqW

5 µsec

2 µsec

RMS

Avg

3 µsec

SnW

0 µsec 2

6

9

13

UUT

ITA

test platform state

Test Requirement vs. Test

SqW

5 µsec

2 µsec

RMS

Avg

3 µsec

SnW

0 µsec 2

6

9

13

UUT

ITA

test platform state

Test Requirement vs. Test

SqW

5 µsec

2 µsec

RMS

Avg

3 µsec

SnW

0 µsec 2

6

9

13

UUT

test platform state

Test Requirement vs. Test

SqW

5 µsec

2 µsec

RMS

Avg

3 µsec

SnW

0 µsec 2

6

9

13UUT

test platform state

Test Requirement vs. Test

SqW

5 µsec

2 µsec

RMS

Avg

3 µsec

SnW

0 µsec 2

6

9

13

test platform state

Test Requirement vs. Test

SqW

5 µsec

2 µsec

RMS

Avg

3 µsec

SnW

0 µsec 2

6

9

13

test platform state

Test Requirement vs. Test

SqW

5 µsec

2 µsec

RMS

Avg

3 µsec

SnW

0 µsec 2

6

9

13

Test-platform Independent

test platform state

Test Requirement vs. Test

SqW

5 µsecpin 6

Avg

3 µsecpin 9

SnW

0 µsecpin 2

2 µsec

RMSpin 13

test platform state test requirementtest result{

Test-platform Independent

Test Requirement vs. Test

So what?

Resource Adapter Interface (RAI)

RAI Visualization

Test Requirement Object

RAITest PlatformTest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

Test Requirement Object

RAITest PlatformTest Program

(test-platform independent)

RAI Visualization

Resource Manager

Test Requirement Object

RAITest PlatformTest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

Test Requirement Object

RAITest PlatformTest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

Test Requirement Object

RAITest PlatformTest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

Test Requirement Object

RAITest PlatformTest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

RAI

Test Requirement

Test PlatformTest Program(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

RAI

Test Requirement

Test PlatformTest Program(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

RAI

Test Requirement

Test PlatformTest Program(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

RAI

Test Requirement

Test PlatformTest Program(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

RAI

Test Requirement

Test PlatformTest Program(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

RAI

Test Requirement

Test PlatformTest Program(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

RAI

Test Result

Test PlatformTest Program(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

RAI

Test Result

Test PlatformTest Program(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

`

Resource Manager

RAI

Test Result Object

Test PlatformTest Program(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

`

Resource Manager

RAI

Test Result Object

Test PlatformTest Program(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

RAI

Test Result Object

Test PlatformTest Program(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

RAI

Test Result Object

Test PlatformTest Program(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

Test Requirement Object

RAITest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

Test Requirement Object

RAITest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

RAI

Test Requirement Object

Test Program(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

Test Requirement Object

RAITest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

RAI

Test Requirement Object

Test Program(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

Test Requirement Object

RAITest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

Test Result Object

RAITest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

RAI

Test Result Object

Test Program(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

Test Result Object

RAITest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

Test Result Object

RAITest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

Test Result Object

RAITest Program

(test-platform independent)

Resource Adapter Interface (RAI)

Test requirements can be mapped to test results• dynamically using a test platform or

• statically using pre-collected data.

RAI Visualization

A map oftest requirements

totest results

Test Requirement Object

RAITest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

Test Requirement Object

RAITest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

RAI

Test Requirement Object

Test Program(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

Test Requirement Object

RAITest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

RAI

Test Requirement Object

Test Program(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

Test Requirement Object

RAITest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

Test Result Object

RAITest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

RAI

Test Result Object

Test Program(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

Test Result Object

RAITest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

Test Result Object

RAITest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

A map oftest requirements

totest results

Test Result Object

RAITest Program

(test-platform independent)

Resource Adapter Interface (RAI)

Test requirements can be mapped to test results• dynamically using a test platform or

• statically using pre-collected data.

Test requirements can be mapped to test results• dynamically using a test platform or

• statically using pre-collected data.

RAI test programs are independent of• the type of test platform mapping test

requirements to test results.

Test requirements can be mapped to test results• dynamically using a test platform or

• statically using pre-collected data.

RAI test programs are independent of• the type of test platform mapping test

requirements to test results.

RAI test programs are independent of• whether test platforms are mapping test

requirements to test results.

Test-platform State, Test Requirement, Test Result

struct TTiming{

Double m_Begin;Double m_End;

};

struct TCapability{

//signal with range, resolution, and accuracyT1641Signal m_T1641Signal;TTiming m_TTiming;string m_PinID;

};

struct TTestPlatformState: TCapability{

TTestPlatformState* m_pTTestPlatformState[ ];};

typedef TTestPlatformState TTestRequirement;typedef TTestPlatformState TTestResult;

SqW

5 µsecpin 6

Avg

3 µsecpin 9

SnW

0 µsecpin 2

2 µsec

RMSpin 13

Capability A

Capability B Capability C

Capability D

Test Requirement #1

SqW

5 µsecpin 6

Avg

3 µsecpin 9

SnW

0 µsecpin 2

2 µsec

RMSpin 13

SnW

7 µsecpin 12

Avg

10 µsecpin 7

SnW

0 µsecpin 6

Test Requirement #2 Test Requirement #3

RMS

1 µsecpin 4

SqW

0 µsecpin 2

Platform-independent Testing

#include "RAI.h"#include "TestRequirements.h"

void main(){

TTestPlatformState TestResult1, TestResult2, TestResult3;//Map test requirement #1 to test result #1TestResult1 = TestRequirement1;

if (TestResult1.Signal("UUTPin13") > 12.3)cout << "UUT passed" << endl;

else{

//Map test requirement #2 to test result #2TestResult2 = TestRequirement2;//Map test requirement #3 to test result #3TestResult3 = TestRequirement3;

if (TestResult2.Signal("UUTPin4") < TestResult3.Signal("UUTPin7"))cout << "Replace UUT's patudy" << endl;

elsecout << "Failure unknown" << endl;

}}

Platform-independent Testing

Test Requirement #1

SqW

5 µsecpin 6

Avg

3 µsecpin 9

SnW

0 µsecpin 2

2 µsec

RMSpin 13

Test Requirement #4

RMS

1 µsecpin 4

SqW

0 µsecpin 2

SnW

7 µsecpin 12

Avg

10 µsecpin 7

SnW

0 µsecpin 6

Test #2 and test #3 can be parallel

Test Requirement #1

SqW

5 µsecpin 6

Avg

3 µsecpin 9

SnW

0 µsecpin 2

2 µsec

RMSpin 13

SnW

7 µsecpin 12

Avg

10 µsecpin 7

SnW

0 µsecpin 6

Test Requirement #2 Test Requirement #3

RMS

1 µsecpin 4

SqW

0 µsecpin 2

Tests #1, #2, and #3 are necessarily sequential

Platform-independent Parallel Testing

#include "RAI.h"#include "TestRequirements.h"

void main(){

TTestPlatformState TestResult1, TestResult4;//Map test requirement #1 to test result #1TestResult1 = TestRequirement1;

if (TestResult1.Signal("UUTPin13") > 12.3)cout << "UUT passed" << endl;

else{

//Map test requirement #4 to test result #4TestResult4 = TestRequirement4;

if (TestResult4.Signal("UUTPin4") < TestResult4.Signal("UUTPin7"))cout << "Replace UUT's patudy" << endl;

elsecout << "Failure unknown" << endl;

}}

Platform-independent Parallel Testing

RAI Visualization

Test Result Object

RAI

Test Requirement Object

mapstest requirements

totest results

diagnoses,sequences, andcontrols

Test Program(test-platform independent)

The SSAI RAI Standard

ATML Capability and ATML Instrument

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

Test Requirement Object

RAITest PlatformTest Program

(test-platform independent)

RAI Visualization

Resource Manager

Test Requirement Object

RAITest PlatformTest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

Test Requirement Object

RAITest PlatformTest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

Test Requirement Object

RAITest PlatformTest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

Test Requirement Object

RAITest PlatformTest Program

(test-platform independent)

Resource Adapter Interface (RAI)

RAI Visualization

Resource Manager

RAI

Test Requirement

Test PlatformTest Program(test-platform independent)

Resource Adapter Interface (RAI)

Test requirements… trees of capabilities that must be satisfied

Instruments… lists of capabilities that can be satisfied

Test Requirement Instrument

Capabilitity A

Capabilitity B Capabilitity C

Capabilitity D

SqW

5 µsecpin 6

Avg

3 µsecpin 9

SnW

0 µsecpin 2

2 µsec

RMSpin 13

Capabilitity #1

Capabilitity #6

Capabilitity #2

Capabilitity #3 Capabilitity #4

Capabilitity #5

ATML Capability and ATML Instrument

struct TTiming{

Double m_Begin;Double m_End;

};

struct TCapability{

T1641Signal m_T1641Signal;TTiming m_TTiming;string m_PinID;

};

Test Requirement Instrument TCapability T16141Signal m_T1641Signal a 1641 signal a 1641 signal TTiming m_TTiming

m_Begin required delay in beginning signal

maximum possible delay in beginning signal

m_End required maximum life of signal

maximum possible life of signal

string m_PinID ID of UUT pin ID of instrument pin

ATML Capability and ATML Instrument

Legacy Testing Software

The test requirement is the key that unlocked the solution to the problem of porting legacy testing software across test platforms.

Legacy tests cannot be ported.Legacy test requirements can be ported.

The SSAI RAI Standard

• is extremely simple,• is founded in system theory, viz., the Theory of Real Systems,• is based on the (rigorously defined) test requirement,• addresses no testing events, services, or executables,• addresses only data objects, which are directly definable in XML,• completely supports complete test-platform independence,• completely supports parallelism,• allows test programs in most any programming language, and• resolves the problem of porting legacy testing software.

For the ATML to fully support the RAI element of the Framework IPT and thus fully support

• complete platform independence and• parallel testing,

the ATML must define an XML schema that supports the

• the test requirement object.

ATML support for the Framework IPT