Alexandros Sigaras | @AlexSigarasResearch Associate in Computational BiomedicineWeill Cornell Medicine

Microsoft Reactor Grand Central Tech

1.11.2017

How HoloLens Transforms HealthcareNYC HoloLens Developers Meetup

Source: EMC & IDC“The Digital Universe. Driving Data Growth in Healthcare”

https://www.emc.com/analyst-report/digital-universe-healthcare-vertical-report-ar.pdf

Healthcare & Big DataToday

Healthcare & Big Data2025 Predictions

Astronomy Twitter Youtube Genomics

Acquisition 25zetta-bytes/year

0.5–15billion

tweets/year

500–900 million

hours/year

1zetta-

bases/year

Storage 1EB/year

1–17PB/year

1–2EB/year

2–40EB/year

Source: NIH“Big Data: Astronomical or Genomical Zachary Stephens et al.”

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4494865/

Source: NIHhttps://www.genome.gov/sequencingcosts/

Cost per Genome

“My hope is that this becomes the foundation,the architecture,

whereby in 10 years fromnow we can look back

and say that we haverevolutionized

medicine.”

Precision Medicine InitiativeBudget

$130MF Y 1 6 E N A C T E D F Y 1 7 P R E S I D E N T ’ S

R E Q U E S T

$230M

Precision Medicine InitiativeRegional Medical Centers across USA

• Able to enroll diverse patient populations

• Strong electronic health record capacity

• Geographic spread

• Capacity to enroll 35,000 a year

NorthwesternUniversityInstituteforPublicHealthandMedicineEvanston,IL

UniversityofPittsburghClinicalandTranslationalScienceInstitutePittsburgh,PA

UniversityofArizonaCollegeofMedicine&PublicHealthTucson,AZ

Columbia/Cornell/NYP/HarlemHospitalInstituteforGenomicMedicineNewYork,NY

UniversityofCaliforniaSanDiegoDepartmentofBiomedicalInformaticsLaJolla,CA

MassachusettsGeneralHospitalGenetics&GenomicsUnitBoston,MA

HenryFordHealthSystemPublicHealthSciencesDetroit,MI

GeisingerHealthSystemGenomicMedicineInstituteDanville,PA

Precision Medicine InitiativeNYC

Cancer MoonshotState of the Union | January 2016

21st Century Cures Act SignedDecember 13th 2016

https://www.whitehouse.gov/CancerMoonshot

Mission

Weill Cornell MedicineMission

Care

TeachDiscover

The New style of tailored treatment

http://meyercancer.weill.cornell.edu/news/2015-01-22/new-style-tailored-treatment

Irene Price | 76y Female

• 2009 | Diagnosed with Bladder Cancer; initially followed traditional treatment showing signs of success

• Relapse | High-grade urothelial carcinoma in bladder and several lymph nodes

• Cystectomy (Bladder removal), sample sent for Genetic Analysis (WES)

• Underwent Radiation Therapy, Genetic Analysis Results showed HER2 Amplification (mutation common in breast cancer)

• Relapse | Signs of metastasis to the liver• Chemotherapy targeted treatment | 8 cycles with

Taxol and Herceptin• Disease free since Nov 2014

Medical History

EXaCT-1 Test Workflow

15

Orders Test Receives Report

Patient

Referring Physician

2000 Cores2PB Storage

Institute for Computational Biomedicine

Today

0 200 400 600 800 1000 1210 aa

0

38

# M

utat

ions

EGFR A289D/ I/ N/ T/ V

Rec.. Furin- like Rec.. GF_recep_IV Pkinase_Tyr

*source: ipm-cbio.med.cornell.edu

https://youtu.be/_Fly4U9eFRY

*credits: Lucas Films

Star WarsEpisode V – The Empire Strikes Back (1980)

*credits: Microsoft Researchhttps://www.microsoft.com/en-us/research/project/holoportation-3/

Video: https://youtu.be/7d59O6cfaM0

Microsoft HololensHoloportation

*credits: Case Western Reserve University

Microsoft HololensHealthcare

*credits: Case Western Reserve University

Microsoft HololensHealthcare

Reality-VirtualityContinuum

Milgram, Paul; H. Takemura; A. Utsumi; F. Kishino (1994). "Augmented Reality: A class of displays on the reality-virtuality continuum"

PhysicalReality (PR)

VirtualReality (VR)

AugmentedReality (AR)

AugmentedVirtuality (AV)

Mixed Reality (MR)

Gaze VoiceGesture

Ways to Interact

Visualizing Protein Structures

Visualizing Networks

Source: http://www.creativeapplications.net/linux/gephi-mac-windows-linux/

Visualizing Cancer Drug Networks

Data: Kaitlyn Gayvert

Bringing Networksinto Reality

https://youtu.be/Yu3Vxy6lQwg

Tumor BoardUsing Hololens across the world

https://youtu.be/O99CMi2ahD0

Demos

Minority Report

Release Date: June 21 2002

John Underkoffler

https://www.ted.com/talks/john_underkoffler_drive_3d_data_with_a_gesture

HealthcareLooking into the future

https://youtu.be/ZhAzqaV-lQk

Caryl and Israel Englander Institute for Precision Medicine

45

ipm.weill.cornell.edu