Spectral Clustering of Synchronous Spike Trains

23
Spectral Clustering of Synchronous Spike Trains 1 Spectral Clustering of Synchronous Spike Trains António R. C. Paiva, Sudhir Rao, Il Park and José C. Príncipe Computational NeuroEngineering Laboratory (CNEL), Department of Electrical and Computer Engineering, University of Florida, USA IJCNN 2007, August 2007 A.R.C. Paiva supported by FCT grant SFRH/BD/18217/2004. Supported in part by NSF grants ECS-0601271, ECS-0422718 and CISE-0541241. António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Transcript of Spectral Clustering of Synchronous Spike Trains

Page 1: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 1

Spectral Clustering of SynchronousSpike Trains

António R. C. Paiva, Sudhir Rao, Il Park and José C.Príncipe

Computational NeuroEngineering Laboratory (CNEL),Department of Electrical and Computer Engineering,

University of Florida, USA

IJCNN 2007, August 2007

A.R.C. Paiva supported by FCT grant SFRH/BD/18217/2004.Supported in part by NSF grants ECS-0601271, ECS-0422718 and CISE-0541241.

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 2: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 2

Outline

Introduction

Distance between two spike trains

Clustering algorithm

Results

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 3: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 3

Introduction

Outline

Introduction

Distance between two spike trains

Clustering algorithm

Results

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 4: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 4

Introduction

What are spike trains?

0 T

DefinitionSpike trains are discrete representations of single-neuronactivity as sets of spike times {tm; m = 1, . . . , N}. That is, theaction potential shape and amplitude in the recordings isdisregarded and only the instant it occurs is considered.

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 5: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 5

Introduction

Clustering of synchronous spike trains?

0 T

S1

S2

S3

S4

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 6: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 6

Introduction

MotivationClustering as an analysis tool

In neuroscience:I Clustering “is” unsupervised classification.

• Estimation of information.

I Clustering groups neurons with “similar” spike trainsallows to study:

• Functional connectivity in the brain.• Organization in neural assemblies.

In engineering:I Brain-Machine Interfaces (BMI)I Liquid-State Machine (LSM) computationI Spiking neural networks (SNN)I ...

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 7: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 7

Introduction

Previous approaches

Eggermont (2006) used the cross-correlation coefficientas a measure, and applied hierarchical clustering.

I Computation of the cross-correlation coefficient assumesbinning, which imposes time quantization.

Fellous et al. (2004) utilized a “correlation-based measure”followed by fuzzy k-means.

I Evaluation of the measure is computation intensive.I Dimensionality of clustering increases with the number of

spike trains.I Determines one cluster at a time.

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 8: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 8

Distance between two spike trains

Outline

Introduction

Distance between two spike trains

Clustering algorithm

Results

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 9: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 9

Distance between two spike trains

Binless distances between two spike trains

Victor-Purpura’s distance – Dspike[q] (1995, 1997, 2005)

dij = minall spike pair

combinations, k

∑k

cost(tici[k] → tj

cj[k])

I Non-euclidean distance

van Rossum’s distance (2001)I Euclidean distanceI Conceptually and computationally simple

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 10: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 10

Distance between two spike trains

van Rossum’s distance (in more detail...)

(a) ti1

ti2

ti3

ti4

tiN

i

0 Ttime

(b)

With filter impulse response h(t) = exp(−t/τ)u(t),denote the i th filtered spike train as

fi(t) =Ni∑

m=1

h(t − tim).

van Rossum’s distance is defined as

dij =1τ

∫ ∞0

[fi(t)− fj(t)]2 dt

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 11: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 11

Distance between two spike trains

Fast computation of van Rossum’s distance

Substituting the filter impulse response and the expressionfor the filtered spike trains into the definition of the distanceyields

dij =12

Ni∑m=1

Ni∑n=1

Lτ (tim − ti

n) +Nj∑

m=1

Nj∑n=1

Lτ (tjm − tj

n)

+

Ni∑m=1

Nj∑n=1

Lτ (tim − tj

n),

with Lτ (·) = exp(−| · |/τ) is the Laplacian function.

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 12: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 12

Clustering algorithm

Outline

Introduction

Distance between two spike trains

Clustering algorithm

Results

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 13: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 13

Clustering algorithm

Which clustering algorithm?

Propose to use spectral clustering.I Clear distinction between measure similarity of data points

and actual clustering procedure.I Good behavior with nonlinearly separable clusters.I It has a close relationship with information theoretic

methods.

The algorithm proposed by Ng et al. (2001) was used.

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 14: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 14

Clustering algorithm

Affinity matrix

Consider n spike trains s1, s2, . . . , sn.

The affinity matrix A is an n × n matrixquantifying the similarity between any two spike trains.

The ij th entry of the affinity matrix is

aij =

exp

(−

d2ij

2σ2

), if i 6= j

0, otherwise

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 15: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 15

Clustering algorithm

Overview of the clustering algorithm

1. Compute the distance matrix of all spike train pairs.

2. Evaluate the affinity matrix.

3. Apply spectral clustering.

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 16: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 16

Results

Outline

Introduction

Distance between two spike trains

Clustering algorithm

Results

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 17: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 17

Results

Simulation paradigm

Spike trains were modeled as homogeneous Poissonprocesses, with firing rate 20 spk/s, and where generatedaccording to a Multiple Interaction Process (see Kuhn etal., 2001) with synchrony parameter ε.

For set of parameters, we generated 100 spike trainsdistributed through 3 clusters.

Results were averaged over 100 and 500 Monte Carlo runs(without and with jitter, respectively).

Gaussian kernel size was fixed at σ = 10.

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 18: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 18

Results

Clustering perfectly synchronized spike trains

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 19: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 19

Results

Clustering spike trains in the presence of jitter

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 20: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 20

Summary

Proposed simple method for clustering of synchronizedspike trains.

Presented computationally efficient method for evaluationof van Rossum’s distance.

Use of spectral clustering is a good choice.I Clear distinction between measure similarity of data points

and actual clustering procedure.

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 21: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 21

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 22: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 22

van Rossum vs. VP distanceClustering perfectly synchronized spike trains

van Rossum’s distance VP distance

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida

Page 23: Spectral Clustering of Synchronous Spike Trains

Spectral Clustering of Synchronous Spike Trains 23

van Rossum vs. VP distanceClustering spike trains in the presence of jitter

van Rossum’s distance VP distance

António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida