How to prepare for a IHE Connectathon Eric Poiseau Anne ... · How to prepare for a IHE...
49
How to prepare for a IHE Connectathon Eric Poiseau Anne-Gaëlle Bergé INRIA/Rennes
Transcript of How to prepare for a IHE Connectathon Eric Poiseau Anne ... · How to prepare for a IHE...
How to prepare for a IHE Connectathon
Eric Poiseau
Anne-Gaëlle Bergé
INRIA/Rennes
Connect-a-thon
• Interoperability test platform
• Forum for exchange
– Participants are technicians
– Tests interoperability
• Not a certification platform
– Participants are allowed to change code
during the event
3
Connectathon : how ?
• 4 month of preparation
– Inscription
– Workshop
– Home testing with log return
– Exchange of configuration parameters
• 1 week of Face to Face testing
– Independent monitors to check the tests
– Hundreds of transactions verified among the
thousands of possible transactions
4
During the connectathon
• Monday-Thursday:
– 8:30 – 18:00 (at 19:00 every one leaves)
• Thursday evening
– Social event
• Friday:
– 8:30 – 12:00 (presence required)
5
The IHE Test Process
6
Users
Sponsors:
Project
Management
Team Vendors
Sponsors:
Exhibits
Develop
Testing Tools
Testing Tools
Implement
Profile Actors
In-House
Testing
Connectathon
Demonstration
Deployed
Systems
Testing Results
Approves
Test Logs
IHE Technical Framework (Profiles Specification)
Product +
Integration
Statement
What will we test ?
• Potluck !
– We test what vendors have registered for !
• No imposed profiles
– Wishes from sponsors.
• Vendors have the last word.
7
What kind of tests ?
Specifications/Standards
Implementation A
Vendor A
Implementation B
Vendor B
Conformance testing
Interoperability
testing
8
Resources (estimation)
• Engineers : > 24 md
– CAT : 14 md
– Webinars: 3 md
– Test tools : 5 md
– Configuration : 2 md
• Travel costs :
– Round trips to Bern : >= 2
– Hotel nights : >= 12
9
Communication
• Mailing List
– Google group ihe-europe-2012 : registering to the mailing list does not register you to the CAT
– http://groups.google.com/group/ihe-europe-2012-connectathon
• Questions
– Tel: +33 2 99 84 74 58
– Mob: +33 6 85 97 01 26
10
Video of connectathon in Barcelona 2006
http://tinyurl.com/673gcl6
Connectathon in Europe
12
http://g.co/maps/ffmmg
Potential for networking
• More than 400 participants
• Standard specialist presents
• Opportunity for parallel meetings
– Dicom
– EU projects
• epSOS, HITCH, eHGI
– Regional projects
• Social event
14
Connectathon 2012 in Bern
The venue: BEA EXPO, Bern
12/10/2011
CAT 2012 in Bern - curent status
19
Connectathon 2012 in Bern
The venue:
BEA EXPO, Bern
Agenda
• 2011/11/01 : Registration opens
• 2012/01/15 : End of registration
• 2012/01/31 : Payment deadline
• 2012/02/03-08 : Webinar for participants
• 2012/05/01 : Limit for log return
• 2012/05/21-26 : Connectathon
21
Registration
• Gazelle to register – Not an easy task
– Do not wait for the last minute
• 1 system = 1 table + 2 engineers – Includes : network, power, lunch, breaks
• Need to ask yourself – How many systems ?
– Which actors ?
– Which profiles ?
22
How to register ?
1. Identify the list of actors and profiles that you wish to
test.
2. Create an account on Gazelle
– (only if you do not have one)
3. Update/Register organization information
4. Register system information
– You can copy and start with systems from previous
sessions.
5. Print and send the contract.
Registration is complete when contract is received by
Project Manager.
23
Registration Cost (2012)
• One system : 4200 € ex VAT
• Second system and up: 4200 € ex VAT
• Domain : 0 € ex VAT
• VAT: may not be collected if EU VAT number provided at registration time
• Additional participants : 600 Euros ex VAT/week
• Number of tables : 1 per system + 1 per extra pair of participants.
24
Pre-connectathon tests
• Pre-connectathon tests to do
– List is obtained from gazelle test
management
– View list of test to do from Gazelle
• Internet testing
– Simulators ( http://gazelle.ihe.net )
– External Validation Services
(http://gazelle.ihe.net/EVSClient )
25
Configuration Information
• Have your configuration ready and confirmed before the
deadline.
– I have assigned some default values
– If you change it… your peer will have to change it also….
• How important is it ?
– Most of the time spend in doing a connectathon test is spend
checking/changing the configuration parameters.
– More systems more choices of peers…. Try not to be the bad guy.
• Q : How to provide my configuration information ?
– Gazelle configuration pages
• Q : How to find my peer configurations parameters ?
– Gazelle configuration pages
26
Connectathon Tests (in Bern)
• No peer tests – Calibration, data sharing, scrutiny tests
• Peer to peer – You chose your partner among the available
ones.
– Gazelle helps you find out the possible partners
– Matching based on registration
• Group – Complete workflow tests
– Those are planned tests
28
Connectathon test plan
• For each test case
– Number of test instances to perform
– In general 3 instances for P2P tests and 1
for the others
• Look at CAT test plan for the system
you have created on Gazelle
29
How to start a test instance
• How to start a test instance
– Discuss with partner, skype…
• How to populate logs for the
evaluation of test instances
– Use of the chat window, upload of log files
• Submit test for grading
30
Sharing Samples
• Gazelle allows participant to share
samples
– Radiology images
– CDA documents, …
• Samples can be checked for
conformance using the EVS
31
Test Grading by monitor
• Worklist
• Do not stress monitors !
• Monitors are assigned tests based on competencies
• Monitors will show up to grade your test.
– Be ready to convince them that you have done a good job !
– Have logs ready, be ready to replay the tests
32
Test Grading by monitors
• Monitors may review more than one
test at a time to optimize their time.
33
Connectathon Grading
• Not automatic
• Manual task
• Updated every night !
• If no test on Wednesday At risk
• If no test on Thursday Fail
• Thursday afternoon : Critical test status
is enable
34
Pre-CAT Test tools
• NIST XDS tools:
– LogReader
– Xdstools2
• Mesa
• NIST CDA and PIX/PDQ tools
• Simulators
– Pharmacy, Laboratory, PAM
35
Other tools
• EVS Client
– HL7 V2+V3
– SAML
– CDA
– Certificates
– ATNA
• Gazelle
– Order Manager (RISMALL replacement)
– Demographic Data Server
36
Results of the connectathon
• No communication of failures
– We simply forget
• IHE communicates results at the
company level
– IHE will not tell you which system
participated at the connectathon.
38
IHE Integration Statement
• Results published at the company
level (no information about system
success published by IHE)
• Vendors publish « IHE integration
statements » to declare the
conformity of their products to IHE
profiles.
42
More on the IHE Integration Statement
• IHE Integration Statement template
– http://tinyurl.com/62ymvtc
• Where to publish it
– On your corporate web
– Use static URL
• http://www.acme.ch/ihe/myProduct_v2.3.pdf
– Use PDF
44
Purpose
• A tool to search IHE Integration
Statement published by Vendors.
• Vendors register IIS
• IIS remains on Vendors web site
• List of Actors/Profiles claimed in IIS
is stored in PR database.
46
Figures (November 2011)
• Over 435 IIS in the database
• Over 100 companies registered
• On the average 280 visits per month
in the last 12 month
50
Goodies
• Helps users find products that match
their needs
• Statistics for Vendors
• Feedback for committees
51
Links and URL
• IHE Integration Statement template
– http://tinyurl.com/62ymvtc
• Link to Product Registry :
– http://product-registry.ihe.net
• Documentation :
– http://gazelle.ihe.net/content/product-registry
• Support
– http://gazelle.ihe.net/jira/PR
52
