Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats...

17
Scaling Up 3D Medical Applications for People Everywhere Data Harmonization and Web3D Anita Havele, Nicholas F. Polys, Chris Lane, Ed Hammond, Vince Marchetti Wednesday, 2018, August 15 - 5:00pm to 6:30pm

Transcript of Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats...

Page 1: Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats and API: X3D holds: Volumes, meshes, appearances, metadata Lights, cameras Animation,

Scaling Up 3D Medical Applications for People Everywhere

Data Harmonization and Web3DAnita Havele, Nicholas F. Polys,

Chris Lane, Ed Hammond, Vince Marchetti

Wednesday, 2018, August 15 - 5:00pm to 6:30pm

Page 2: Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats and API: X3D holds: Volumes, meshes, appearances, metadata Lights, cameras Animation,

Topics / Discussions - Web3D & WG introduction

- Access: WWW and VR

- NIH 3D Printing / 3DMD scanning

- HL7 and the Informatics of 3D

- Bioinformatics & Analytics

Page 3: Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats and API: X3D holds: Volumes, meshes, appearances, metadata Lights, cameras Animation,

Web3D.org & WG introductions

Enterprise 3D (X3D): ISO-IEC formats and API:

● X3D holds:○ Volumes, meshes, appearances, metadata○ Lights, cameras○ Animation, interaction

● Web3D Medical Working Group● DICOM Liaison & reciprocal membership ● HL7 Liaison & reciprocal membership

Page 4: Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats and API: X3D holds: Volumes, meshes, appearances, metadata Lights, cameras Animation,

EHR Big Picture HL7:

FHIR, DAM

DICOM Web3D

X3D, H-ANIM

EHR

● Patient Imaging● Treatments ● ...

Visualize:● Microscopy● Bioinformatics● Scanning ● Physical

Therapy & ergonomics

● Analytics

● Volume vis● Meshes● Segmentations● 3D printing

Page 5: Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats and API: X3D holds: Volumes, meshes, appearances, metadata Lights, cameras Animation,

Access: WWW and VR

- X3D: desktop, mobile, immersive- Imaging

- X3D Volume Rendering- TIFF stacks, DICOM, NRRD, PNG- Scripted automated conversions- Online drag-and-drop service :

- HTML5/WebGL/X3DOM- Mirror4All by KShell

Page 6: Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats and API: X3D holds: Volumes, meshes, appearances, metadata Lights, cameras Animation,

Access: WWW and VR

- Portals- Zebrafish genetic and neuro atlas:

zbbrowser.com- Virtual Natural History Museum:

http://vnhm.de- CNS-PF neuron viewer - Cell image library

Page 7: Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats and API: X3D holds: Volumes, meshes, appearances, metadata Lights, cameras Animation,

VTVisionarium

Page 8: Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats and API: X3D holds: Volumes, meshes, appearances, metadata Lights, cameras Animation,

27 mil

stereo

pixels !

Page 9: Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats and API: X3D holds: Volumes, meshes, appearances, metadata Lights, cameras Animation,

WebVRWith X3DOM Javascript library

● Photospheres● Videospheres● Volumes● Heritage● 3D city models● ...

Page 10: Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats and API: X3D holds: Volumes, meshes, appearances, metadata Lights, cameras Animation,

NIH 3D Printing / 3DMD scanning

Page 11: Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats and API: X3D holds: Volumes, meshes, appearances, metadata Lights, cameras Animation,

Bioinformatics & Analytics

● Physics of DNA● Agent-based immune system● MPI_Blast results● Network visualization

Page 12: Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats and API: X3D holds: Volumes, meshes, appearances, metadata Lights, cameras Animation,

Compute the Cure (MPI-Blast)

Page 13: Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats and API: X3D holds: Volumes, meshes, appearances, metadata Lights, cameras Animation,

Network Visualization

Page 14: Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats and API: X3D holds: Volumes, meshes, appearances, metadata Lights, cameras Animation,

HL7, Informatics, and 3D

● Ed Hammond, Duke, HL7● Electronic Health Records on FHIR!● 3D data payloads of: DICOM, … X3D

Page 15: Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats and API: X3D holds: Volumes, meshes, appearances, metadata Lights, cameras Animation,

3DMD.com● Chris Lane● … see attached slideset….● High-resolution, high-throughput body scanning● Importance of data ownership… consumer scan should be treated as private

as a medical record@!

Page 16: Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats and API: X3D holds: Volumes, meshes, appearances, metadata Lights, cameras Animation,

3D Repositories & X3D

● Enterprise & large-scale collections● Metadata annotation in the scene● Semantics & Ontology integration

Page 17: Chris Lane, Ed Hammond, Vince Marchetti Scaling Up 3D ... · Enterprise 3D (X3D): ISO-IEC formats and API: X3D holds: Volumes, meshes, appearances, metadata Lights, cameras Animation,

Join Us!The Web3D Consortium is a not-for-profit organization dedicated to 3D data durability and interchange. Medical Working group reaches across SDOs to harmonize standards.

www.Web3D.org/join