Big Data Visualization and Spatial Computing in Precision...

23
Alexandros Sigaras | @AlexSigaras Senior Research Associate in Computational Biomedicine Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019 Weill Cornell Medicine 06.19.2019 Big Data Visualization and Spatial Computing in Precision Medicine

Transcript of Big Data Visualization and Spatial Computing in Precision...

Page 1: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

Alexandros Sigaras | @AlexSigarasSenior Research Associate in Computational BiomedicineWeill Cornell Medicine

Biomedical Big Data Summer Bootcamp 2019

Weill Cornell Medicine06.19.2019

Big Data Visualization and Spatial Computing in Precision Medicine

Page 2: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

PrecisionMedicine

“The right treatment, for the right person,

at the right time”

Page 3: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

The New style of tailored treatment

http://meyercancer.weill.cornell.edu/news/2015-01-22/new-style-tailored-treatment

Irene Price | 76y Female

• 2009 | Diagnosed with Bladder Cancer; initially followed traditional treatment showing signs of success

• Relapse | High-grade urothelial carcinoma in bladder and several lymph nodes

• Cystectomy (Bladder removal), sample sent for Genetic Analysis (WES)

• Underwent Radiation Therapy, Genetic Analysis Results showed HER2 Amplification (mutation common in breast cancer)

• Relapse | Signs of metastasis to the liver• Chemotherapy targeted treatment | 8 cycles with

Taxol and Herceptin• Disease free since Nov 2014

Medical History

Page 4: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

Precision MedicineImpact

Dr. Kevin Holcomb and Ronda Kotelchuck

https://healthmatters.nyp.org/amazing-things-ronda-kotelchuck/

“I love Dr. Holcomb… He’s very reasonable, and he respects the patient. We really do make decisions jointly.”

Ronda Kotelchuck

Page 5: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

Artificial Intelligencein Healthcare

Page 6: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

PMKB

Huang et al “The cancer precision medicine knowledge base for structured clinical-grade mutations and interpretations” JAMIA 2017

Page 7: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

CNN Smoothie

P Khosravi et al. “Deep Convolutional Neural Networks Enable Discrimination of Heterogeneous Digital Pathology Images” EBioMedicine 2018

Page 8: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

CNN Smoothie

P Khosravi et al. “Deep Convolutional Neural Networks Enable Discrimination of Heterogeneous Digital Pathology Images” EBioMedicine 2018

Page 9: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

Spatial Computing in Medicine

Page 10: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

Reality-VirtualityContinuum

Milgram, Paul, et al. "Augmented reality: A class of displays on the reality-virtualitycontinuum." Telemanipulator and telepresence technologies. International Society for Optics and Photonics, 1995.

PhysicalReality (PR)

VirtualReality (VR)

AugmentedReality (AR)

AugmentedVirtuality (AV)

Mixed Reality (MR)

Page 11: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

AugmentedReality

Page 12: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

https://youtu.be/Fly4U9eFRY

VirtualReality

Page 13: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

MixedReality

Page 14: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

Visualizing Cancer Drug Networks

Gayvert, Kaitlyn M., et al. "A computational drug repositioning approach for targeting oncogenic transcription factors." Cell reports 15.11 (2016): 2348-2356.

Page 15: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

https://youtu.be/Yu3Vxy6lQwg

EIPM Mixed Reality Apps

Page 16: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

Tumor BoardUsing Mixed Reality across the world

Page 17: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019
Page 18: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

https://youtu.be/O99CMi2ahD0

EIPM Tumor Boardusing Mixed Reality

Page 19: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

https://twitter.com/AlexSigaras/status/897242543276138496

Realtime collaborationin Mixed Reality

Page 20: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

Realtime collaborationin Mixed Reality

Page 21: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

https://twitter.com/AlexSigaras/status/835210917746966529

Physicsin Mixed Reality

Page 22: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

https://youtu.be/ZhAzqaV-lQk

Page 23: Big Data Visualization and Spatial Computing in Precision ...bigdata.citytech.cuny.edu/bd_media/2019/07/Alex... · Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019

Caryl and Israel Englander Institute for Precision Medicine

23

eipm.weill.cornell.edu