Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar...
Transcript of Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar...
![Page 1: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/1.jpg)
MULTIVARIATE ANALYSES WITH fMRI DATA
Sudhir Shankar Raman Translational Neuromodeling Unit (TNU)
Institute for Biomedical Engineering University of Zurich & ETH Zurich
![Page 2: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/2.jpg)
Motivation
Modelling Concepts
Learning From Data
Multivariate Bayes in SPM
Generative Embedding
![Page 3: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/3.jpg)
Motivation • Local activations – Univariate approach
2
1
significant not significant
![Page 4: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/4.jpg)
Univariate to Multivariate
2
1
1
2
not significant not significant
![Page 5: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/5.jpg)
Motivation
Learning from data
Multivariate Bayes in SPM
Generative Embedding
Modelling Terminology
![Page 6: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/6.jpg)
Steps for analysis Feature
Extraction
Modelling
Classification
Clustering
Regression
Prediction
Model Selection
Cross validation
Performance
Inference
![Page 7: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/7.jpg)
Feature Spaces Raw data
Model parameters
GLM – regression coefficients DCM – connection parameters
Voxel activity
F1 F2 . . . FP
S1
S2 Data Point or Feature Vector
.
.
SN
• High dimensionality • Class/Cluster distributions • Interpretation
![Page 8: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/8.jpg)
Model Selection - Generalizability
Model Fit
Model Complexity
Bishop (2006), Pitt & Miyung (2002), TICS
![Page 9: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/9.jpg)
Modelling goals • Prediction
• Model Selection
h X Y
Sparse Coding Distributed Coding
Predictive Density
Model Evidence
![Page 10: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/10.jpg)
Motivation
Learning From Data
Multivariate Bayes in SPM
Generative Embedding
Modelling Concepts
![Page 11: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/11.jpg)
Learning from Data
Supervised Learning
Unsupervised Learning
Reinforcement Learning
Semi-supervised Learning
![Page 12: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/12.jpg)
Supervised Learning
Function - f
Independent variables X
dependent variable Y Categorical Continuous
![Page 13: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/13.jpg)
SVM
Classification
• Kernel Function – K 𝒙𝒊,𝒙𝒋 = 𝝓 𝒙𝒊 .𝝓 𝒙𝒋
𝝓
Function - f X Y
• Generative classifier • Discriminative classifier
Kernel Methods
Kernel methods for pattern analysis, Taylor , Cristianini, 2004
![Page 14: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/14.jpg)
K-fold Cross Validation
• Model Selection • Performance evaluation
Accuracy
1
2
3
87%
75%
89%
Training data
Test data
![Page 15: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/15.jpg)
Performance – Single Subject
𝑝 = 𝑃 𝑋 ≥ 𝑘 𝐻0 = 1 − 𝐵 𝑘|𝑛,𝜋0
Brodersen et al. 2013, NeuroImage
Binomial Test
k=30
![Page 16: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/16.jpg)
Performance – Multiple Subjects
Brodersen et al. 2013, NeuroImage
Fixed effects
Random effects
http://www.translationalneuromodeling.org/tapas/
![Page 17: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/17.jpg)
Using classification for fMRI data
Pattern localization
Searchlight classifier
Nandy & Cordes (2003) MRM , Kriegeskorte et al. (2006) PNAS Mourao-Miranda et al. (2005) NeuroImage
Whole brain
Pereira et al. (2009) NeuroImage, Mitchell et al. (2004) Machine Learning
Word Category
Food Building People
![Page 18: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/18.jpg)
Confounds – GLM vs MVPA
Todd et al. 2013, NeuroImage
![Page 19: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/19.jpg)
Unsupervised Learning Building a representation of
data
Dimensionality Reduction Time series Clustering
K-means Mixture models
![Page 20: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/20.jpg)
K-means
Mixture of Gaussians
Bishop (2006)
![Page 21: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/21.jpg)
Interpretation • Cluster parameters
• Purity Inferred Labels
External Labels
Subjects
Cluster 1 Cluster 2
![Page 22: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/22.jpg)
Motivation
Learning from Data
Multivariate Bayes in SPM
Generative Embedding Modelling
![Page 23: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/23.jpg)
Encoding Vs Decoding Models
![Page 24: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/24.jpg)
Encoding Vs Decoding
Friston et al. 2008 NeuroImage
![Page 25: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/25.jpg)
Coding hypotheses
Spatial vectors Smooth vectors
Sparse vectors
Singular vectors of data Support vectors
Distributed vectors
𝑈 = 𝑅𝑌𝑇 𝑈𝑈𝑉𝑇 = 𝑅𝑌𝑇
![Page 26: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/26.jpg)
Bayesian decoding of motion
Experimental factors: 1. Photic 2. Motion 3. Attention
Attention to motion dataset - Büchel & Friston 1999 Cerebral Cortex
Friston et al. 2008 NeuroImage
![Page 27: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/27.jpg)
Multivariate Bayes in SPM
![Page 28: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/28.jpg)
Results
Friston et al. 2008 NeuroImage
![Page 29: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/29.jpg)
Results
![Page 30: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/30.jpg)
Laminar activity related to novelty and episodic encoding
Maas et al. 2014 Nature Communications
![Page 31: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/31.jpg)
Motivation
Learning from Data
Multivariate Bayes in SPM
Generative Embedding
Modelling Principles
![Page 32: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/32.jpg)
Subject 1
Subject 2
Subject N
Voxel activity
Subject 1
Subject 2
Subject N
Connectivity
Dynamic causal model (DCM)
Classification Clustering
Group 1 Group 2
. . . . . .
![Page 33: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/33.jpg)
Generative Embedding - Classification
Brodersen et al. pLOS computation biology 2011.
![Page 34: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/34.jpg)
DCM - Speech processing
Brodersen et al. pLOS computation biology 2011.
![Page 35: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/35.jpg)
Working memory - fMRI • 41 Schizophrenia patients (DCM IV,ICD 10), 42 controls
• Visual numeric n-back working memory task
Deserno, Lorenz et al 2012. The Journal of Neuroscience 32 (1). Society for Neuroscience: 12–20.
1 5 4 2 9 8 9
3 5 900ms
500ms
![Page 36: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/36.jpg)
Model based clustering
Brodersen et al 2014 Neuroimage
![Page 37: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/37.jpg)
Results – Healthy vs Schizophrenic
Brodersen et al 2014 Neuroimage
![Page 38: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/38.jpg)
Brodersen et al 2014 Neuroimage
Results – Schizophrenia patients
![Page 39: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/39.jpg)
Unified model for identifying subgroups
![Page 40: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/40.jpg)
Summary
Learning from Data
Multivariate Bayes in SPM
Generative Embedding
Modelling Principles
![Page 41: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/41.jpg)
Practicals • Multivariate Bayes in SPM • Classification
• Clustering
![Page 42: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding](https://reader030.fdocuments.us/reader030/viewer/2022040300/5e6d5b2033c1d14c254dcb6c/html5/thumbnails/42.jpg)
Thank you