Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based...

38
1 / 38 Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin Cancer Diagnostic System DOC Riga 2019

Transcript of Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based...

Page 1: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

1 / 38

Results and challenges running cloud based

diagnostics

Dr.sc.ing. Dmitrijs Bļizņuks

Riga Technical University

Non-contact Skin Cancer

Diagnostic System

DOC Riga 2019

Page 2: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

2 / 38

Outlines

• Skin cancer non-contact diagnostics

• Achievements

• Modular architecture: Pros & Cons

• Diagnostic algorithms

Page 3: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

3 / 38

Why skin cancer?

Page 4: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

4 / 38

Age-adjusted death rates for the 10 leading causes of death in United States

SOURCE: NCHS, National Vital Statistics System, Mortality.

Page 5: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

5 / 38

Page 6: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

6 / 38

Page 7: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

7 / 38https://www.cancerresearchuk.org/health-professional/cancer-statistics/statistics-by-cancer-type/melanoma-skin-cancer/survival

95%

5%Survival rates

Page 8: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

8 / 38

Wavelengths’ skin penetration depth

Page 9: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

9 / 38

Place your screenshot here

Cloud service

Handheld device

Page 10: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

10 / 38

• More than 1500 lesions tested

totally

• More than 1.5 years of testing

in Latvian Oncology Clinics

• Tested by General Practice

doctor

• Found 2 melanomas during two

months

• Ongoing tests in Hungary and

Bulgary

Page 11: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

11 / 38

10+ years of research in biophotonics

5 Dr.phys.

University of Latvia

Experienced doctors of the Oncology Center of Latvia

Dermato-oncologists

Hardware and software design3 Dr.Sc.ing.

Riga Technical University

Page 12: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

12 / 38

✓ Non-invasive✓ Portable✓ Quantitative✓ Reliable (Sp=98%)✓ Uses various spectra✓ Image analysis within seconds✓ Wireless✓ Image evaluation in time (Archive)✓ Affordable

Main users

General Practice doctors

Page 13: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

13 / 3813

Page 14: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

14 / 3814

First page from

doctor’s view

Page 15: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

15 / 3815

Acquired images

viewing and assigning

to the patient

Page 16: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

16 / 3816

Patient control

Page 17: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

17 / 3817

Patient’s skin

measurements

Page 18: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

18 / 3818

Servers monitoring

and control

Page 19: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

19 / 3819

Server’s load

monitoring

Page 20: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

20 / 38

Page 21: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

21 / 38

Cloud based diagnostics (SaaS)

Could be used as a standalone service for various image analysis

Calculation node 1

Checkyourskin.eu

Device 1Doctor 1Doctor 1

Patient 1Patient 1

Internet

Calculation

process 1-1

Calculation

process 1-m

Calculation node n

Calculation

process n-1

Calculation

process n-m

...

Patient nPatient n

Device nDoctor nDoctor n

Patient 1Patient 1

Patient nPatient n

Page 22: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

22 / 38

Page 23: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

23 / 38

Page 24: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

24 / 38

Optical Density spectra of skin lesions

D.Jakovels et al. Application of principal component analysis to multispectral imaging data for evaluation of pigmented skin

lesions, Proc. SPIE 9032, Biophotonics—Riga 2013, 903204 (November 18, 2013)

Page 25: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

25 / 38

Specific stair-like inner structure to keep light polarization

Page 26: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

26 / 38

4 layer PCBs

5 separately controlled LED groups

4 LEDs in each group

up to 500mA to each diode

Page 27: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

27 / 38

Raspberry Pi

Compute 3

module

USB WiFi

module

USB “IDS”

camera

USB 3G/4G

module

Central control module

Illumination

control (STM32)

LED current

drivers

Five groups of

4x LEDs each

USB

USB USB

SPI

LED supply voltage +0.3V

Current and voltage

control for each LED

Photodiode

Trigger

Mea

sure

d in

ten

sity

LED control board

LED ring

LED supply

voltage step-down

Analog

voltage

setpoint

Li-ion

battery

Power and

charging

Temperature

sensor

User buttonsDigital inputs

Analog

voltage

setpoint

Digital-to-

analog

convertor

SPI

Resistance

Modular architecture

• LED illumination,

• LED control,

• Camera,

• Central module,

• Wireless connectivity.

3G → 4G

WiFi 2.4GHz → 5GHz

Camera 1 Mpix / 5MPix

Page 28: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

28 / 38

l=535nm

l=660nm

l=950nm

Nevus

p’ karte

Melanoma

p’ karte

Page 29: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

29 / 38

Searching for marker

Page 30: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

30 / 38

Stabilizing by marker

Page 31: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

31 / 38

Removing hair

Page 32: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

32 / 38

Searching for healthy skin

Page 33: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

33 / 38

Page 34: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

34 / 38

Page 35: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

35 / 38

MELANOMA VS SEB.KERATOSIS

Melanoma

Seborejas keratoze

Page 36: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

36 / 38

0.0

50.0

100.0

150.0

200.0

250.0

-2.0 0.0 2.0 4.0Me

an

AF

in

ten

sity fro

m s

ele

cte

d le

sio

n a

rea

, a

.u.

Mean p'max from selected lesion area (estimated from 100 maximal values of selected area), a.u.

Seborrheic Keratosis(n=13)

Hyperkeratosis (n=9)

Melanocytic Nevus(n=23)

Melanoma (n=3)

I. Lihacova, K. Bolochko, E. V. Plorina, M. Lange, A. Lihachev, D. Bliznuks, and A. Derjabo, "A method for skin malformation classification by combining

multispectral and skin autofluorescence imaging," SPIE Proc 10685, 1068535 (2018).

Page 37: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

37 / 38

Page 38: Non-contact Skin Cancer Diagnostic System€¦ · Results and challenges running cloud based diagnostics Dr.sc.ing. Dmitrijs Bļizņuks Riga Technical University Non-contact Skin

38 / 38

Acknowledgements

This work has been supported by European Regional Development Fund

project ‘Portable Device for Non-contact Early Diagnostics of Skin Cancer’

under grant agreement # 1.1.1.1/16/A/197

Dmitrijs Bļizņuks

[email protected]