CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs....
Transcript of CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs....
![Page 1: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/1.jpg)
Smartphone based Blood Oxygen Level Measurementusing Near-IR and RED Wave-guided Light
Nam Bui, Anh Nguyen, Phuc Nguyen, Hoang Truong, Ashwin Ashok, Thang Dinh, Robin Deterding, Tam Vu
1/30
PhO2
![Page 2: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/2.jpg)
Chronic Obstructive Pulmonary Disease (COPD)
24 Million Americans
have COPD
2/30
Leading cause of death in the US, 2016
OFTENFOUND IN LATE STAGE
$34,000 treatment in ICU
Early detection of COPD is key to successful treatment
![Page 3: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/3.jpg)
Heart rate
Blood pressure
Breathing rate
Wheezing sound
Oxygen saturation (SpO2)
Vital signs screening in COPD
3/30
Oxygen Saturation needs to be measured frequently
![Page 4: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/4.jpg)
Oxygen Saturation (SpO2)
𝑺𝒑𝟎𝟐 =𝑵𝒐. 𝒐𝒙𝒚𝒈𝒆𝒏𝒂𝒕𝒆𝒅 𝒉𝒆𝒎𝒐𝒈𝒍𝒐𝒃𝒊𝒏
𝑻𝒐𝒕𝒂𝒍 𝑵𝒐. 𝒉𝒆𝒎𝒐𝒈𝒍𝒐𝒃𝒊𝒏𝟏𝟎𝟎%
O2
O2
O2
O2
Oxygenated hemoglobin Deoxygenated hemoglobin
4/30
![Page 5: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/5.jpg)
Photon Detector
IR emitter Red emitter
AC
R IR
Non-invasive Measurement of Oxygen Saturation
Intensity
t
Intensity
t
ACIR
ACR
𝑺𝒑𝟎𝟐 = 𝒇𝑨𝑪𝑹𝑨𝑪𝑰𝑹
5/30
![Page 6: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/6.jpg)
Red and IR Wavelength Selection
At Red= 660 nm and IR = 960 nm, the difference of light absorption
by oxygenated hemoglobin and deoxygenated hemoglobin is largest.
6/30
Absorbed by red
pigmentation
Harmful
Low penetration
![Page 7: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/7.jpg)
Pros Cons
High accuracy Inconvenient
Costly
Smartphone-based blood oxygen measurement
Dedicated Hardware Solutions
![Page 8: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/8.jpg)
A solution to capture the oxygen level and is
High accuracy.
Low-cost.
Easy to make by patients
8/30
![Page 9: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/9.jpg)
9/30
PhO2
Smartphone based Blood Oxygen Level Measurement
![Page 10: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/10.jpg)
10/30
IR emitter Red emitter
PULSE OXIMETER
Hardware Challenges
PHONE BASED PULSE OXIMETER
Light
Source
![Page 11: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/11.jpg)
11/30
Challenge. Phone’s camera IR filter
Sensor
IR filter
![Page 12: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/12.jpg)
Existing Software-based Solutions
DigiDoc iHealthCare
RGB
Color
Image
Red Light
IR Light
DISADVANTAGES
Inaccurate: Green channel is mostly absorbed by red pigmentation.
Coarse-grained: one record per 10 seconds.
![Page 13: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/13.jpg)
Solution.
Red and NIR for Oxygen Saturation Measurement
NIR
14/30
NIR
is available in most of phone’s flashlight and is not filtered by the phone’s camera.has similar characteristics of hemoglobin absorption with the IR lights.
NIR
![Page 14: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/14.jpg)
15/30
PhO2 NIR Extraction Technique
Absorbed by redpigmentation
Green filter
Absorbed
NIR
Red and Green filter cuttoff
![Page 15: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/15.jpg)
And 5 More Challenges…
16/30
Smartphone’s camera picks up most of the lights
Finger movement and Contact pressure
Pressure
Micro movements
RGB Intensity
Conversion between RGB and light intensity
Flashlight heat can cause skin burn
![Page 16: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/16.jpg)
17/30
3D printed Optical Hardware Add-on
![Page 17: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/17.jpg)
18/30
Smartphone’s camera picks up most of the lights
RGB Intensity
Conversion between RGB and light intensity
Finger movement and contact pressure
Pressure
Micro movements
Flashlight can cause skin burn
3D printed Optical Hardware Add-on
![Page 18: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/18.jpg)
Wavelength selection
𝝀𝑹= 678 nm
𝝀𝑵𝑰𝑹= 724 nm
𝑺𝒑𝟎𝟐 =𝜺𝑯𝒃 𝒓 − 𝜺𝑯𝒃 𝒓 𝑹
𝜺𝑯𝒃 𝒊𝒓 − 𝜺𝑯𝒃𝑶𝟐 𝒓 + 𝜺𝑯𝒃𝑶𝟐 𝒊𝒓 − 𝜺𝑯𝒃 𝒊𝒓 𝑹
20/30
X:678
Y: 724
Z:1.002
𝜶
𝜶 = 𝒂𝒓𝒄𝒕𝒂𝒏(𝒂/𝒃)
a
b
![Page 19: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/19.jpg)
Pressure Detection and Recommendation
No
rma
lized
In
ten
sit
y
PPG signal in a 7 seconds window
Sample
No
rma
lized
In
ten
sit
y
Sample
PPG signal in a 7 seconds window
21/30
No
rma
lized
In
ten
sit
y
PPG signal in a 7 seconds window
Sample
![Page 20: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/20.jpg)
22/30
Heat Reduction with Distributed Lighting Source
𝐸𝑝 = ℎ𝑓
𝑬 =
2.55 mm 0.6 mmModifyBandpass filter
To maintain
the high light
intensity
𝑯
![Page 21: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/21.jpg)
Detecting pressure
ROI detection and create thePPG signals
PPG
Identify the peaksand troughs
Calculate peak-to-peak ratio
95
%
Collecting raw data
23/30
AlgorithmsPhO2
![Page 22: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/22.jpg)
App overview
PPG display
Image frame
24/30
![Page 23: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/23.jpg)
25/30
![Page 24: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/24.jpg)
In-lab experiments
• 3 males, 3 females
• 5 times performs the hyperventilation (a breath
holding technique to reduce oxygen).
• Totally 560 samples.
26/30
![Page 25: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/25.jpg)
27/30
PhO2 vs. Existing apps
Sp
O2 (
%)
Measurement Indices
DigiDoc
Sp
O2 (
%)
Measurement Indices
iHealthCareS
pO
2 (
%)
PhO2
Time (s)
![Page 26: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/26.jpg)
Experimental results
28/30
3.5%
![Page 27: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/27.jpg)
In clinic experiment
In hospital experiment with patient.
29/30
![Page 28: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/28.jpg)
30/30
Fine-grained evaluation of the patient
Low Oxygen Level
Coughing
![Page 29: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/29.jpg)
31/30
Heat Reduction Evaluation
Hand multimeter
Thermalcouple Probe
![Page 30: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/30.jpg)
32/30
Output temperature of different add-on designs
0
10
20
30
40
50
60
Without Banpass Filter With Bandpass Filter
58.9
4538.5
36.840.3
37.6
Tem
peratu
re (
Cels
ius)
Large Tunnel Small Tunnel Multiple Small Tunnels
![Page 31: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/31.jpg)
Conclusion
❑Accurately measuring oxygen level using low-cost opticalfilm filters.
❑Detect the appropriate contact pressure between fingerand phone’ camera.
❑3D-printed add-on to handle the problem of lightscattering and finger movement.
34/30
![Page 32: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/32.jpg)
Application for optical light based sensing
35/30
Cholest-erol
Optical light
based sensing
Urea Lactate
Water
Alcohol Glucose
![Page 33: CamK Weekly Meeting - mnslab.orgmnslab.org › nambui › ppts › Sensys2017_Ph02.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2](https://reader033.fdocuments.us/reader033/viewer/2022042406/5f1ff9dd5ad94336bd4dbb6c/html5/thumbnails/33.jpg)
Smartphone based Blood Oxygen Level Measurementusing Near-IR and RED Wave-guided Light
Nam Bui, Anh Nguyen, Phuc Nguyen, Hoang Truong, Ashwin Ashok, Thang Dinh, Robin Deterding, Tam Vu
37/30
PhO2