Abdominal CT Liver Parenchyma Segmentation Based on Particle Swarm Optimization
AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n...
Transcript of AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n...
![Page 1: AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n Reference annotations n Clinical routine segmentations n Results reported in the literature](https://reader033.fdocuments.us/reader033/viewer/2022050505/5f96fce78ada867b4535293d/html5/thumbnails/1.jpg)
© Fraunhofer
Medical Knowledge Through Research
Grzegorz Chlebus, Hans Meine, Nasreddin Abolmaali and Andrea Schenk
AUTOMATIC LIVER AND TUMOR SEGMENTATION IN LATE-PHASE MRI USING FULLY CONVOLUTIONAL NEURAL NETWORKS
![Page 2: AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n Reference annotations n Clinical routine segmentations n Results reported in the literature](https://reader033.fdocuments.us/reader033/viewer/2022050505/5f96fce78ada867b4535293d/html5/thumbnails/2.jpg)
© Fraunhofer
Medical Knowledge Through Research
Background
n Liver & tumor segmentation is required for many liver interventions
n Radioembolisation
n Basis for tumor load computation
n Required for dose computation
n Manual or semi-automatic segmentation
n Tedious and time consuming
n inter-observer variability
n Well studied problem for CT
n LiTS challenge 2017 (3rd place out of 28 teams) [1]
[1] http://lits-challenge.com/
![Page 3: AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n Reference annotations n Clinical routine segmentations n Results reported in the literature](https://reader033.fdocuments.us/reader033/viewer/2022050505/5f96fce78ada867b4535293d/html5/thumbnails/3.jpg)
© Fraunhofer
Medical Knowledge Through Research
Goal
n Develop automatic DL-based algorithm for:
n Liver segmentation
n Liver tumor segmentation
n Comparison with:
n Reference annotations
n Clinical routine segmentations
n Results reported in the literature
n Extends our previous work [1]
[1] Schenk A et al., “Deep learning for liver segmentation and volumetry in late phase MRI”, ECR 2018.
![Page 4: AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n Reference annotations n Clinical routine segmentations n Results reported in the literature](https://reader033.fdocuments.us/reader033/viewer/2022050505/5f96fce78ada867b4535293d/html5/thumbnails/4.jpg)
© Fraunhofer
Medical Knowledge Through Research
Datan 90 patients with primary liver cancer and/or liver metastases
n 76 scheduled for radioembolisation
n DCE-MRI
n Acquired at Städtisches Klinikum Dresden, Germany
n 3T Discovery MRI, GE Healthcare Systems, USA
n Contrast agent Gd-EOB-EDPA (Primovist®, Bayer Healthcare)
n LAVA sequence
Native 20s 60s 120s 15 min
![Page 5: AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n Reference annotations n Clinical routine segmentations n Results reported in the literature](https://reader033.fdocuments.us/reader033/viewer/2022050505/5f96fce78ada867b4535293d/html5/thumbnails/5.jpg)
© Fraunhofer
Medical Knowledge Through Research
Manual segmentations
n Reference
n Very precise and time consuming
n Done by radiological assistants and reviewed by a radiologist
n Used for training of deep learning models
n Routine
n According to clinical routine standards
n Defined by one radiologist and two residents
n Contouring and interpolation software [1]
[1] Weiler F et al., “Building blocks for clinical research in adaptive radiotherapy”, CURAC 2015.
![Page 6: AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n Reference annotations n Clinical routine segmentations n Results reported in the literature](https://reader033.fdocuments.us/reader033/viewer/2022050505/5f96fce78ada867b4535293d/html5/thumbnails/6.jpg)
© Fraunhofer
Medical Knowledge Through Research
Segmentation Pipelines
n Axial
![Page 7: AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n Reference annotations n Clinical routine segmentations n Results reported in the literature](https://reader033.fdocuments.us/reader033/viewer/2022050505/5f96fce78ada867b4535293d/html5/thumbnails/7.jpg)
© Fraunhofer
Medical Knowledge Through Research
Segmentation Pipelines
n OrthoMean [1]
[1] Prasoon A et al., “Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network”, MICCAI 2013.
![Page 8: AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n Reference annotations n Clinical routine segmentations n Results reported in the literature](https://reader033.fdocuments.us/reader033/viewer/2022050505/5f96fce78ada867b4535293d/html5/thumbnails/8.jpg)
© Fraunhofer
Medical Knowledge Through Research
Neural network architecture
n U-net like [1]
n 4 resolution levels
n 9M trainable parameters
n Receptive field 94x94 voxels
n 3x3 convolution kernels
n Short skip connections [2]
n Batch normalization
n Spatial dropout[1] Ronneberger O et al., “Convolutional networks for biomedical image segmentation”, MICCAI 2015.
[2] Drozdzal M et al., “The importance of skip connections in biomedical image segmentation”, 2016.
![Page 9: AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n Reference annotations n Clinical routine segmentations n Results reported in the literature](https://reader033.fdocuments.us/reader033/viewer/2022050505/5f96fce78ada867b4535293d/html5/thumbnails/9.jpg)
© Fraunhofer
Medical Knowledge Through Research
Data preprocessing
n Normalization
n 2nd and 98th percentiles mapped to [0, 1] range
n Resampling to a 2mm isotropic voxel size
n Training data augmentation
n Random rotations
n Random intensity shifts
n Training/validation/evaluation split
n 57/5/28 liver
n 60/5/20 liver tumor
![Page 10: AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n Reference annotations n Clinical routine segmentations n Results reported in the literature](https://reader033.fdocuments.us/reader033/viewer/2022050505/5f96fce78ada867b4535293d/html5/thumbnails/10.jpg)
© Fraunhofer
Medical Knowledge Through Research
Results: Training Data Size
n Liver segmentation quality
Axial OrthoMean
![Page 11: AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n Reference annotations n Clinical routine segmentations n Results reported in the literature](https://reader033.fdocuments.us/reader033/viewer/2022050505/5f96fce78ada867b4535293d/html5/thumbnails/11.jpg)
© Fraunhofer
Medical Knowledge Through Research
Examples: Liver
White – Reference
Solid black – Axial
Dashed black – OrthoMean
![Page 12: AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n Reference annotations n Clinical routine segmentations n Results reported in the literature](https://reader033.fdocuments.us/reader033/viewer/2022050505/5f96fce78ada867b4535293d/html5/thumbnails/12.jpg)
© Fraunhofer
Medical Knowledge Through Research
Examples: Liver tumors
White – Reference
Solid black – Axial
Dashed black – OrthoMean
![Page 13: AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n Reference annotations n Clinical routine segmentations n Results reported in the literature](https://reader033.fdocuments.us/reader033/viewer/2022050505/5f96fce78ada867b4535293d/html5/thumbnails/13.jpg)
© Fraunhofer
Medical Knowledge Through Research
Results
n Axial vs OrthoMean
![Page 14: AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n Reference annotations n Clinical routine segmentations n Results reported in the literature](https://reader033.fdocuments.us/reader033/viewer/2022050505/5f96fce78ada867b4535293d/html5/thumbnails/14.jpg)
© Fraunhofer
Medical Knowledge Through Research
Results: Comparison with routine segmentations of the liver
n Manual routine segmentations: 10 ± 4 min
n OrthoMean: 7.3 ± 0.4s
![Page 15: AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n Reference annotations n Clinical routine segmentations n Results reported in the literature](https://reader033.fdocuments.us/reader033/viewer/2022050505/5f96fce78ada867b4535293d/html5/thumbnails/15.jpg)
© Fraunhofer
Medical Knowledge Through Research
Comparison with literature
n Direct comparison not possible due to differences in datasets
![Page 16: AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n Reference annotations n Clinical routine segmentations n Results reported in the literature](https://reader033.fdocuments.us/reader033/viewer/2022050505/5f96fce78ada867b4535293d/html5/thumbnails/16.jpg)
© Fraunhofer
Medical Knowledge Through Research
Summary
n Liver segmentation quality of our segmentation approaches was comparable to that of manual routine segmentations
n Tumor segmentation is a more difficult task than liver segmentation
n Acquiring more training data has a positive impact on the model performance
n Direct comparisons with other methods remain difficult due to lack of publicly available data
n Future work
n More extensive validation
n Evaluation of 3D architectures
![Page 17: AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n Reference annotations n Clinical routine segmentations n Results reported in the literature](https://reader033.fdocuments.us/reader033/viewer/2022050505/5f96fce78ada867b4535293d/html5/thumbnails/17.jpg)
© Fraunhofer
Medical Knowledge Through Research
Thank you for your attention J
Questions?
![Page 18: AUTOMATIC LIVER AND TUMOR SEGMENTATION IN ......n Liver tumor segmentation n Comparison with: n Reference annotations n Clinical routine segmentations n Results reported in the literature](https://reader033.fdocuments.us/reader033/viewer/2022050505/5f96fce78ada867b4535293d/html5/thumbnails/18.jpg)
© Fraunhofer
Medical Knowledge Through Research
What does the neural network see?