Heart Sound Segmentation: A Stationary Wavelet Transform...

65
Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach Author: Nuno Marques Advisors: Rute Almeida Miguel Coimbra

Transcript of Heart Sound Segmentation: A Stationary Wavelet Transform...

Page 1: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Heart Sound Segmentation: A

Stationary Wavelet Transform

Based Approach

Author:

Nuno Marques

Advisors:

Rute Almeida

Miguel Coimbra

Page 2: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Classifying Heart Sounds PASCAL

Challenge

The challenge had 2 tasks:

Segmentation and Classification

and Anomaly Detection

This work describes

what i did in the first

task: Segmentation

and Classification

Page 3: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Datasets

iStethoscope Digiscope

Non-controlled

environment

No expert!

Who was

auscultated ?

Controlled

environement

Done by expert!

Auscultation were

performed on

infants exclusively!

44100 Hz

20 auscultations

4000 Hz

80 auscultations

Page 4: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Heart Sounds We want to detect and

distinguish these two

peaks ! (which are the

heart sounds!)

Page 5: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

How do you detect and distinguish

heart sounds ?

Page 6: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Heart Sound Segmentation

Cardiac Segmentation algorithms

can be successfully divided

in 4 phases:

Pre-

processing

Representation Classification

Segmentation

Page 7: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Pre-

processing

P

Page 8: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Pre-

processing

P

Page 9: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Pré-

processamento Representation

R

Page 10: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Pré-

processamento Segmentação Representation

R

Page 11: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Pré-

processamento Segmentação Segmentation

S

Page 12: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Pré-

processamento Segmentação Segmentation

S

Page 13: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Pré-

processamento Segmentation

S

Page 14: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Pré-

processamento Segmentation

S

Page 15: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Pré-

processamento Segmentação Classification

S1/S2/sistole/diastole?!

C

Page 16: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Pré-

processamento Segmentação Classification

S1 diastole S2 sistole S1

C

Page 17: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Manual Annotation

P

Page 18: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Manual Annotation

P

Page 19: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Fourier Transform

Mediana1 Mediana2 ... P

Page 20: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Spectral Analysis

P

Page 21: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Pre-Processing

P

Just downsampled iStethoscope!

Page 22: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Representation

R

A good cardiac signal representation

should have 2 characteristics g1 e g2

Page 23: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

g1. Accentuate the difference between

S1/S2 and sistole/diastole

R

S2 S1

sistole diastole

Page 24: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

g2. Accentuate the difference between

S1 and S2

R

S2 S1

Page 25: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Representation

R

• Shannon Energy Envelope

• Shannon Entropy Envelope

Domínio do

tempo

Page 26: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Shannon Energy Envelope

R

Page 27: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Shannon Energy/Entropy

R

Page 28: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Representations

R

• Continuous Wavelet Transform

• Discrete Wavelet Transform

• Stationary Wavelet Transform

• S-Transform

• Empirical Mode Decomposition

• Hilbert-Huang Transform

Time-Frequency

Domain

Page 29: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Digiscope Results

R

Page 30: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

iStethoscope Results

R

Page 31: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Segmentation

S

We can divide the Segmentation phase

into 2 sub-phases:

• Peak Detection

• Boundary Detection

Page 32: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Peak Detection

S

Page 33: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Boundary Detection

S

Page 34: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Convolution

S

Page 35: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Idea!

S

Use a filter in the SWT that looks

like the S1/S2 in order to

determine their boundaries!

Page 36: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Stationary Wavelet Transform

x[n] h1 [n]

g1[n] h2 [n]

g2 [n]

g3 [n]

h3 [n]

Scale 1 Coeffs

Scale 2 Coeffs

Scale 3 Coeffs

gj[n] gj+1[n] 2

hj[n] hj+1[n] 2

Daubechies 38

S

Page 37: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Problem

S

x[n] h1 [n]

g1[n] h2 [n]

g2 [n]

g3 [n]

h3 [n]

Scale 1 Coeffs

Scale 2 Coeffs

Scale 3 Coeffs

Stationary

Wavelet

Transform gj[n] gj+1[n] 2

hj[n] hj+1[n] 2

Page 38: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Problema

S

h10 [n] x[n] g1[n] g9[n] ... ( ) Signal becomes completely deformed!

Page 39: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Solution

S

x[n] g1[n] g9[n] h10 [n] ...

Lets use the Convolution‘s Associative property!

( )

x[n] g1[n] g9[n] h10 [n] ... ( ) =

Page 40: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Solution

S

g1[n] g9[n] h10 [n] ... ( ) x[n]

Page 41: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Signal Transformation: Digiscope

S

x[n] Shannonenergy(x[n])

Page 42: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Signal Transformation: iStethoscope

S

x[n] Shannonentropy(x[n])

Page 43: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Shannon Energy

S

Page 44: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Wavelet Coefficients

S

Page 45: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Inflection Points

S

Page 46: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Segment Descriptors

S

- Maximum

Page 47: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Segment Descriptors

S

- S1/S2 - Sistole/Diastole

Page 48: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

S

Page 49: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

PASCAL Challenge Results

S

Page 50: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Determining Boundaries

S

Page 51: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Determining Boundaries

• Variation between Segments

• Longest Increasing/Decreasing

Sub-sequence

S

Page 52: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Variation Between Segments(a1)

Maximum length of segment

Minimum length

Of segment

S

Page 53: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Longest Increasing/Decreasing

Sub-sequence(a2)

S

Longest

Increasing

Sub-Sequence

Longest

Decreasing

Sub-Sequence

Page 54: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Baseline Method(a3)

S

Maior

sub-sequência

crescente

Maior

sub-sequência

decrescente

Page 55: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Results

Média +- desvio padrão (ms)

S

Page 56: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Classification

Page 57: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Pré-

processamento Segmentação Classification

S1/S2/sistole/diastole?!

Page 58: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Individual descriptor

C

This segment’s descriptor - Máximo

Page 59: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Expanded Descriptor

C

This segment’s descriptor - Máximo

Page 60: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Combination of descriptors:

Individual

C

This segment’s descriptor - Máximo

Page 61: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Combination of descriptors:

Expanded

C

This segment’s descriptor - Máximo

Page 62: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Results: Combination of

Descriptors

C

Page 63: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Conclusion

Page 64: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Conclusion

• Spectral Analysis

• Evaluation of different types of

Representations

• New peak detection algorithm

• 2 new boundary detection algorithms

• Article publication in Computing in

Cardiology 2013

Page 65: Heart Sound Segmentation: A Stationary Wavelet Transform ...mcoimbra/lectures/PSI_1314/PSI_1314_NMarques.pdf · Heart Sound Segmentation: A Stationary Wavelet Transform Based Approach

Thank you!