The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo....

26
1 The Role of Image Search In Digital Pathology Workflows

Transcript of The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo....

Page 1: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

1

The Role of Image SearchIn Digital Pathology Workflows

Page 2: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

2

About Huron Digital Pathology• Located in Waterloo Region in Canada• Design and manufacture award-winning

whole slide scanning hardware• CE-IVD• Health Canada

• Bring to market the world’s first image search engine for pathology

• Partner with Dell Technologies

Page 3: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

A Crisis in Pathology

Severe shortage of pathologists and

laboratory services

Higher rates of cancer and other diagnostic-intensive diseases

3

Page 4: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

Analog workflow using microscopes

Digital workflow using digital slides

A Digital Transformation in Pathology

4

Page 5: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

5

Over the next 5 years, hospitals and labs will:Scan hundreds of millions of glass slides

Generate exabytes of unstructured

image data

…to improve quality and speed of diagnosis, accelerate discovery, and address a severe world-wide shortage of pathologists

Produce tens of millions of

pathology reports

Page 6: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

6

How do we search exabytes of unstructured, unlabeled image data?

Page 7: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

7

How do we tap into the vast knowledge contained in the pathology reports?

Page 8: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

8

How do we leverage the data to improve diagnosis and accelerate research?

Page 9: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

9

Page 10: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

10

Page 11: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

11

Indexing = compact representation

1 GB 10-15 KB

Page 12: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

12

Page 13: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

Live Image Search Demo

13

Page 14: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

Applications for Image Search

14

Page 15: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

15

Computational Consensus:Papillary Thyroid Carcinoma

“Virtual Peer Review”Query Whole Slide Image

Thyroid Medullary carcinoma>> read more

Noninvasivefollicular thyroid neoplasm with papillary-like nuclear features>> read more

Papillary thyroid carcinoma>> read more

Page 16: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

16

Image search connects pathologists to the vast knowledge of their colleagues 16

Page 17: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

17

DiscoveryResearchRelationships between cancer subtypes

Ultimately, connections to the genome

Page 18: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

18

Augmenting/Automating AIPathologist Annotates WSI

TUMOR

Image Search Engine Finds Similar Slides

Page 19: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

19

Augmenting/Automating AIPathologist Annotates WSI

TUMOR

Automatically Applies Annotations

TUMOR

TUMOR

TUMOR

TUMOR

TUMOR

Page 20: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

20

Auto-reporting

Page 21: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

Digital Slide Archiveon Isilon

Index

Huron WSI

Huron TissueScope iQ

Lab InformationSystem

3rd Party Scanners

3rd Party WSI

3rd Party Viewers/PACSthrough API

Reference Architecture with Dell EMC

21

on PowerEdge GPU Server

Page 22: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

22

NCI/NIH Dataset: TCGA Project

22

Page 23: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

23

NCI/NIH Dataset: TCGA Project

30,072 whole-slide images from the TCGA project We removed 952 WSIs due to low quality We processed 29,120 WSIs at 20X magnification From the 29,120 WSIs, 26,564 specimens were tumorous. A total of 17,425 files depict frozen sections A total of 11,579 files are diagnostic slides Approx. 20,000,000 patches

Page 24: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

24

Validation Summary

• Building diagnostic consensus with high confidence is possibleFrozen sections (e.g., BLCA 93%, KIRC 97%, and OV 99% )Diagnostic slides (e.g., PRAD 98%, SKCM 99%, and THYM 100%)

• The more the better[positive correlation of 80% between number of patients and the accuracy of majority consensus]

Page 25: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

25

The Future: wherever there are large images

Aerial Photography/Photogrammetry

Precision Agriculture Space Imaging

Page 26: The Role of Image Search In Digital Pathology Workflows · 10-15 KB. 12. Live Image Search Demo. 13. ... Medullary carcinoma >> read more. Noninvasive. follicular thyroid . neoplasm

Questions and Discussion

26

Patrick [email protected]