Joint Exchange / Interop Work Group Test Workgroup

Eric Heflin/Judith Huntman/Ed O’ConnorAug 8, 2012

• Roll Call – Admin

• Announcements – Eric (5 mins)

• ‘Round-the-Room for Harmonized Specs – Eric (10 mins)

• Phased Approach to Harmonization for Remaining Specs – Judith/Ed (10 mins)

• ‘Round-the-Room for Phasing Approach – Eric (10 mins)

• Test Execution and Test Architecture – Ed (10-15 mins)

• Definition of Done – Ed (5 mins)

• Test Case Metrics – Ed (7 mins)

• Open Discussion – All

• Wrap Up - Eric

• RFP Schedule Review - Eric

Agenda

2

• Harmonized PRL (PD/QD/RD/MP/AF) Tests Are Drafted• No objections were received and are now candidates for “final” status

• Future changes are possible, but will be incorporated into the next phase of test cases design and implementation

• We will do a ‘round-the-room next on the status

• Vote next week to consider the harmonized Phase I test specs final

• RFP• Has 5 respondents

• Bidder interviews have been conducted top few vendors

• Analysis is nearing completion

Announcements

3

‘round-the-room

Can we vote next week to consider the harmonized test specifications (presented over the last few weeks) as final?

The scope of this question is the harmonized specifications for Patient Record Lookup (aka Patient Discovery, Query for Documents, and Retrieve Documents + Messaging Platform and Authorization Framework).

Harmonization Phases

Phase 1 – SOAP Send/Receive

Phase 2 – Direct Send/Receive

Phase 3 – Secondary Methods, Service

Discovery, & Provider Directories

•Parent Use Cases (Done)•Test Case harmonization (Done)•Tests: Mess & Auth Framework (Done)•Tests: Patient Discovery (XCPD, PIX, PDQ), Query for Documents, Retrieve Documents (Done)

•Test Execution Guides (Done)

•Parent Use Cases•Test Case harmonization•Tests: Direct Applicability Statement (Done)

•Tests: Direct XDM/XDR-Bridge (Done)•Tests: Direct Certificate Discovery (Done)

•Test Execution Guide

•Parent Use Cases•Test case harmonization•Tests: Web Services Registry (Done)•Tests: HPD+•Tests: Document Submission (Done)•Tests: Administrative Distribution (Done)•Test Execution Guides

Unified Test Process – Has Been Proposed

Phase II Work Plan: Direct Test Specs

Body Status *

Parent Use Cases Done

Test Case harmonization- Top-down (use case)- Bottom-up (spec based) tests

In Process

Tests: Direct Applicability Statement Done

Tests: Direct XDM/XDR-Bridge Done

Tests: Direct Certificate Discovery Done

Test Execution Guide- Combine Mod Spec Phase II (messaging)- Phase III (cert discovery) documentation

Not Started

* More detailed status will be posted on the Wiki

Phase III Work Plan: Secondary SpecsSecondary Methods, Service Discovery, & Provider Directories

Body Status

Parent Use Cases In Process

Test case harmonization Not Started

Tests: Web Services Registry- Bottom-up (spec based) test package is complete

Done

Tests: HPD+- Top-down (use case) test package is complete

Not Started

Tests: Document Submission- Bottom-up (spec based) test package is complete

Done

Tests: Administrative Distribution- Bottom-up (spec based) test package is complete

Done

Test Execution Guides- Doc Sub and Admin Dist draft guides exist

In Process

‘round-the-room

What are your thoughts about the phased approach for harmonization? Do you object to the proposed approach?

Test Case Execution

• Manual: Step-by-step instructions are included in written test packages

• Draft tracking worksheet for execution methods

• What tests are the best candidates for tooling?

• SOAP UI as a component, review different uses of it

• Other utilities/components to research?

• What about the conformance checklists?

• Refresh on Reference Toolkit concept

• Check-in on feedback to high-level Toolkit architecture

• Assumptions on prioritization at utility level• Message simulation for High test cases in PD/QD/RD

• Proof of concept of lightweight orchestration (BDD layer)

• Integration of NIST content tools (c32 then CCDA)

• Ideas/volunteers for utilities, modules, or approaches?

• Definition of “done”

• Metrics for SOAP UI scripts

Architecture Review

10

Open Discussion

Other topics?

•RFP released — July 2nd 

•Questions received by 6 organizations

•Answers distributed — July 13th

•Bids due — July 20th

•Expected award — August 15th

•Contract start — TBD

RFP Schedule Review

12

We are here