Image and Data Analysis for Spatially Resolved...

60
ACTA UNIVERSITATIS UPSALIENSIS UPPSALA 2020 Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology 1964 Image and Data Analysis for Spatially Resolved Transcriptomics Decrypting fine-scale spatial heterogeneity of tissue's molecular architecture GABRIELE PARTEL ISSN 1651-6214 ISBN 978-91-513-1003-9 urn:nbn:se:uu:diva-419173

Transcript of Image and Data Analysis for Spatially Resolved...

Page 1: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

ACTAUNIVERSITATIS

UPSALIENSISUPPSALA

2020

Digital Comprehensive Summaries of Uppsala Dissertationsfrom the Faculty of Science and Technology 1964

Image and Data Analysis forSpatially Resolved Transcriptomics

Decrypting fine-scale spatial heterogeneity of tissue'smolecular architecture

GABRIELE PARTEL

ISSN 1651-6214ISBN 978-91-513-1003-9urn:nbn:se:uu:diva-419173

Page 2: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

Dissertation presented at Uppsala University to be publicly examined in Room 4307,Ångströmlaboratoriet, Lägerhyddsvägen 2, Uppsala, Thursday, 29 October 2020 at 14:00 forthe degree of Doctor of Philosophy. The examination will be conducted in English. Facultyexaminer: Professor Roland Eils (Charité-Universitätsmedizin Berlin and Berlin Institute ofHealth).

AbstractPartel, G. 2020. Image and Data Analysis for Spatially Resolved Transcriptomics. Decryptingfine-scale spatial heterogeneity of tissue's molecular architecture. Digital ComprehensiveSummaries of Uppsala Dissertations from the Faculty of Science and Technology 1964. 59 pp.Uppsala: Acta Universitatis Upsaliensis. ISBN 978-91-513-1003-9.

Our understanding of the biological complexity in multicellular organisms has progressed attremendous pace in the last century and even more in the last decades with the advent ofsequencing technologies that make it possible to interrogate the genome and transcriptome ofindividual cells. It is now possible to even spatially profile the transcriptomic landscape oftissue architectures to study the molecular organization of tissue heterogeneity at subcellularresolution. Newly developed spatially resolved transcriptomic techniques are producing largeamounts of high-dimensional image data with increasing throughput, that need to be processedand analysed for extracting biological relevant information that has the potential to lead to newknowledge and discoveries. The work included in this thesis aims to provide image and dataanalysis tools for serving this new developing field of spatially resolved transcriptomics tofulfill its purpose. First, an image analysis workflow is presented for processing and analysingimages acquired with in situ sequencing protocols, aiming to extract and decode molecularfeatures that map the spatial transcriptomic landscape in tissue sections. This thesis alsopresents computational methods to explore and analyse the decoded spatial gene expressionfor studying the spatial molecular heterogeneity of tissue architectures at different scales.In one case, it is demonstrated how dimensionality reduction and clustering of the decodedgene expression spatial profiles can be exploited and used to identify reproducible spatialcompartments corresponding to know anatomical regions across mouse brain sections fromdifferent individuals. And lastly, this thesis presents an unsupervised computational method thatleverages advanced deep learning techniques on graphs to model the spatial gene expressionat cellular and subcellular resolution. It provides a low dimensional representation of spatialorganization and interaction, finding functional units that in many cases correspond to differentcell types in the local tissue environment, without the need for cell segmentation.

Keywords: iss, image, processing, clustering, deep learning, GCN, graph

Gabriele Partel, Department of Information Technology, Division of Visual Information andInteraction, Box 337, Uppsala University, SE-751 05 Uppsala, Sweden.

© Gabriele Partel 2020

ISSN 1651-6214ISBN 978-91-513-1003-9urn:nbn:se:uu:diva-419173 (http://urn.kb.se/resolve?urn=urn:nbn:se:uu:diva-419173)

Defence on Zoom: https://uu-se.zoom.us/j/62337809210

Page 3: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 4: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 5: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 6: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 7: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 8: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 9: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 10: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 11: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 12: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 13: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

detector

emission lter

exitation lterobjective

specimen

Dichromaticmirror

Page 14: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

d

d =λ

2 ·NA,

λ NA

Page 15: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 16: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 17: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 18: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

Hyb round 1 Hyb round 2 Hyb round 3 Coding scheme

osmFISH

mRNA 1

mRNA 2

mRNA 3

round

1

round

2

round

3

gene 1gene 2gene 3

round

1

round

2

round

3

gene 1gene 2gene 3gene n

MERFISH

mRNA mRNA mRNA

gene 1gene 2gene 3gene n

bitround 1 round 2 round 3

SeqFISH

mRNA mRNAmRNA

mRNA mRNA mRNA

SeqFISH (smHCR)

Page 19: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

ln

n = 4l

Page 20: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

Anchorprimer

BarcodeLinker(5th base)

Linker5' arm 3' arm

Padlock probe

mRNA

cDNA

cDNA

Cycle 4

Cycle 1

Cycle 2

Ligation& RCA

Padlock probeHybridization

Sample preparationmRNA

Reversetranscription& RNase H

RT primer

GACT

Sequencing

CTGAGNNN

CTGANANN

CTGANNNT

Cycle 3

CTGANNCN

41

42

43

44

Detectabletargets

DAPI +color channels

DAPI +decoded signals

Nucleichannel

Anchorchannel

Tchannel

Gchannel

Cchannel

Acahnnel

Cycle 1 Cycle 2 Cycle 3 Cycle 4 5th base

Mouse braina

b

c

d

IM IRT θ

L IM IR

θL(T (IM , θ), IR)

Page 21: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

IR T (IM )

Page 22: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 23: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

Nuclei image Gaussian blurring( = 5)

Watershedlabels

Inverted smoothed image

Thresholded image Histogram

Otzu threshold

Inverteddistance transform

Watershedlabels

ISE

Tw(I) = I − I ◦ SE

Page 24: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

Originalimage

Top-hattransformed

Page 25: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

G = (V,E)V E eu,v ∈ E u v

wu,v

eu,v wu,v

st (G,w, s, t)

s− t C = (S, T ) Vs ∈ S t ∈ T

∑eu,v∈XC

wu,v

Page 26: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

XC ST

XC = {eu,v ∈ E : u ∈ S, v ∈ T}.

s − t

π s tπ π

G = (V,E,w, s, t) f Gπ G

π s tfu,v < wu,v eu,v π

S T

cu,v ∈ R

f

c(f) =∑

eu,v∈Efu,v · cu,v.

π st

cu,v ππ π

Page 27: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

Image Segmented image

source

sink

s

t

source

sink

u

v

s

t

wu,v

optimal s-tcut

K hf̂ X1, X2, . . . , Xn

f̂h(x) =1

nh

n∑i=1

K

(x−Xi

h

),

Page 28: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

∫K(t)dt = 1 f̂h(x)

pq

DKL(p||q) =N∑i=1

p(xi) ·p(xi)

q(xi).

p qp q

y

Page 29: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

y = b+∑i

xiwi,

xi wi b

f(y) = (y, 0)

Page 30: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

n

softmax(y) =eyn∑i e

yi

Input layer (L0)

Hidden layer (L1)

Hidden layer (L2)

Output layer (L3)

j

z

Forward pass

i

k

l l

k

j

i

Backward passz

a

x1

x2

x3

w1w2

w3

Neuron Activationfunction

b

y f(y)

bKernel

Receptive eldActivation map

Convolutional layerc

3 ×3

Page 31: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

−M∑c=1

yc (pc),

M ycc pc

c

lwij

∂l

∂wij=

∂l

∂z

∂z

∂yj

∂yj∂wij

,

lz z

jth yj yji j wij

Page 32: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 33: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

M

MT cov(X)M

M cov(X)X

cov(X)M = λM,

λ d XX

YY = XM.

X

W HX ≈ WH.

X ∈ Rp×n

W ∈ Rp×r H ∈ R

r×n

p r p < r W

HW

XW W H

W,H‖X −WH‖2F , s.t.W,H ≥ 0.

Page 34: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

XD d d < D d � D

X

k

Page 35: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

G = (V,X,A) V ∈ Rn

A ∈ Rn×n

X ∈ Rm×n

Page 36: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

GCNCNN

uK

uK

u

h0u = Xu ;

hku = σ

⎛⎜⎝Wk

∑v∈N (u)

hk−1v

|N (u)| +Bkhk−1u

⎞⎟⎠ , ∀k ∈ 1, . . . ,K ;

zu = hKu ;

Xu u h

N (u) u σ Wk Bk

zuu u

Page 37: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

D

B

C

FE

A

D

B

C BEF

C

A

A

A

A

h0h1

z

a b

F

C E

C FB E FA

D

A

BC DB E FA

CA

BC D

B C

C E

F E

C F

E

C EB E FA

FC

c

zA

Page 38: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

ec c ξ

ξ =K2

c

2m,

Kc

c mη

η =1

2m

∑c

(ec − γξ),

γ

Page 39: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 40: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 41: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 42: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 43: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 44: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 45: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

a

sa ta

sb tb

b

Page 46: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 47: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 48: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 49: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 50: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 51: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 52: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 53: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 54: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 55: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 56: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 57: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 58: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 59: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved
Page 60: Image and Data Analysis for Spatially Resolved Transcriptomicsuu.diva-portal.org/smash/get/diva2:1465757/FULLTEXT01.pdfPartel, G. 2020. Image and Data Analysis for Spatially Resolved

Acta Universitatis UpsaliensisDigital Comprehensive Summaries of Uppsala Dissertationsfrom the Faculty of Science and Technology 1964

Editor: The Dean of the Faculty of Science and Technology

A doctoral dissertation from the Faculty of Science andTechnology, Uppsala University, is usually a summary of anumber of papers. A few copies of the complete dissertationare kept at major Swedish research libraries, while thesummary alone is distributed internationally throughthe series Digital Comprehensive Summaries of UppsalaDissertations from the Faculty of Science and Technology.(Prior to January, 2005, the series was published under thetitle “Comprehensive Summaries of Uppsala Dissertationsfrom the Faculty of Science and Technology”.)

Distribution: publications.uu.seurn:nbn:se:uu:diva-419173

ACTAUNIVERSITATIS

UPSALIENSISUPPSALA

2020