Spectral Clustering of Synchronous Spike Trains
Transcript of Spectral Clustering of Synchronous Spike Trains
Spectral Clustering of Synchronous Spike Trains 1
Spectral Clustering of SynchronousSpike Trains
António R. C. Paiva, Sudhir Rao, Il Park and José C.Príncipe
Computational NeuroEngineering Laboratory (CNEL),Department of Electrical and Computer Engineering,
University of Florida, USA
IJCNN 2007, August 2007
A.R.C. Paiva supported by FCT grant SFRH/BD/18217/2004.Supported in part by NSF grants ECS-0601271, ECS-0422718 and CISE-0541241.
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 2
Outline
Introduction
Distance between two spike trains
Clustering algorithm
Results
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 3
Introduction
Outline
Introduction
Distance between two spike trains
Clustering algorithm
Results
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 4
Introduction
What are spike trains?
0 T
DefinitionSpike trains are discrete representations of single-neuronactivity as sets of spike times {tm; m = 1, . . . , N}. That is, theaction potential shape and amplitude in the recordings isdisregarded and only the instant it occurs is considered.
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 5
Introduction
Clustering of synchronous spike trains?
0 T
S1
S2
S3
S4
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 6
Introduction
MotivationClustering as an analysis tool
In neuroscience:I Clustering “is” unsupervised classification.
• Estimation of information.
I Clustering groups neurons with “similar” spike trainsallows to study:
• Functional connectivity in the brain.• Organization in neural assemblies.
In engineering:I Brain-Machine Interfaces (BMI)I Liquid-State Machine (LSM) computationI Spiking neural networks (SNN)I ...
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 7
Introduction
Previous approaches
Eggermont (2006) used the cross-correlation coefficientas a measure, and applied hierarchical clustering.
I Computation of the cross-correlation coefficient assumesbinning, which imposes time quantization.
Fellous et al. (2004) utilized a “correlation-based measure”followed by fuzzy k-means.
I Evaluation of the measure is computation intensive.I Dimensionality of clustering increases with the number of
spike trains.I Determines one cluster at a time.
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 8
Distance between two spike trains
Outline
Introduction
Distance between two spike trains
Clustering algorithm
Results
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 9
Distance between two spike trains
Binless distances between two spike trains
Victor-Purpura’s distance – Dspike[q] (1995, 1997, 2005)
dij = minall spike pair
combinations, k
∑k
cost(tici[k] → tj
cj[k])
I Non-euclidean distance
van Rossum’s distance (2001)I Euclidean distanceI Conceptually and computationally simple
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 10
Distance between two spike trains
van Rossum’s distance (in more detail...)
(a) ti1
ti2
ti3
ti4
tiN
i
0 Ttime
(b)
With filter impulse response h(t) = exp(−t/τ)u(t),denote the i th filtered spike train as
fi(t) =Ni∑
m=1
h(t − tim).
van Rossum’s distance is defined as
dij =1τ
∫ ∞0
[fi(t)− fj(t)]2 dt
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 11
Distance between two spike trains
Fast computation of van Rossum’s distance
Substituting the filter impulse response and the expressionfor the filtered spike trains into the definition of the distanceyields
dij =12
Ni∑m=1
Ni∑n=1
Lτ (tim − ti
n) +Nj∑
m=1
Nj∑n=1
Lτ (tjm − tj
n)
+
Ni∑m=1
Nj∑n=1
Lτ (tim − tj
n),
with Lτ (·) = exp(−| · |/τ) is the Laplacian function.
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 12
Clustering algorithm
Outline
Introduction
Distance between two spike trains
Clustering algorithm
Results
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 13
Clustering algorithm
Which clustering algorithm?
Propose to use spectral clustering.I Clear distinction between measure similarity of data points
and actual clustering procedure.I Good behavior with nonlinearly separable clusters.I It has a close relationship with information theoretic
methods.
The algorithm proposed by Ng et al. (2001) was used.
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 14
Clustering algorithm
Affinity matrix
Consider n spike trains s1, s2, . . . , sn.
The affinity matrix A is an n × n matrixquantifying the similarity between any two spike trains.
The ij th entry of the affinity matrix is
aij =
exp
(−
d2ij
2σ2
), if i 6= j
0, otherwise
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 15
Clustering algorithm
Overview of the clustering algorithm
1. Compute the distance matrix of all spike train pairs.
2. Evaluate the affinity matrix.
3. Apply spectral clustering.
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 16
Results
Outline
Introduction
Distance between two spike trains
Clustering algorithm
Results
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 17
Results
Simulation paradigm
Spike trains were modeled as homogeneous Poissonprocesses, with firing rate 20 spk/s, and where generatedaccording to a Multiple Interaction Process (see Kuhn etal., 2001) with synchrony parameter ε.
For set of parameters, we generated 100 spike trainsdistributed through 3 clusters.
Results were averaged over 100 and 500 Monte Carlo runs(without and with jitter, respectively).
Gaussian kernel size was fixed at σ = 10.
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 18
Results
Clustering perfectly synchronized spike trains
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 19
Results
Clustering spike trains in the presence of jitter
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 20
Summary
Proposed simple method for clustering of synchronizedspike trains.
Presented computationally efficient method for evaluationof van Rossum’s distance.
Use of spectral clustering is a good choice.I Clear distinction between measure similarity of data points
and actual clustering procedure.
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 21
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 22
van Rossum vs. VP distanceClustering perfectly synchronized spike trains
van Rossum’s distance VP distance
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida
Spectral Clustering of Synchronous Spike Trains 23
van Rossum vs. VP distanceClustering spike trains in the presence of jitter
van Rossum’s distance VP distance
António Paiva, Sudhir Rao, Il Park and José Príncipe CNEL, University of Florida