Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

33
FACULTÉ DES SCIENCES ÉCONOMIQUES ET SOCIALES Institut de recherche en ingénierie des connaissances et logiques de l’espace SEMANTIC ALIGNMENT OF DOCUMENTS WITH 3D CITY MODELS Camille Tardy 1 , Laurent Moccozet 2 and Gilles Falquet 1 University of Geneva 1 Institute ICLE 2 Institute of Services Science In 3U3D 2012 conference Nantes, France

description

Presentation of the published paper for the 3u3d2012 conference. Paper available : http://dx.doi.org/10.1051/3u3d/201202011

Transcript of Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Page 1: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

FACULTÉ DES SCIENCES ÉCONOMIQUES ET SOCIALES Institut de recherche en ingénierie des connaissances et logiques de l’espace

SEMANTIC)ALIGNMENT)OF)DOCUMENTS)WITH)3D)CITY)MODELS)Camille'Tardy1,'Laurent'Moccozet2'and'Gilles'Falquet1'University*of*Geneva*'1*Institute*ICLE*2*Institute*of*Services*Science*

In'3U3D'2012'conference'Nantes,'France'

Page 2: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

A)Digital)Library)of)Urban)resources)

2'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

http://www.lviz.org/wpAcontent/uploads/2009/03/vancouver1980.png*

Documents'

3D'city'Models'

Page 3: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Context)

3'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

http://www.lviz.org/wpAcontent/uploads/2009/03/vancouver1980.png*

Task'Requires'access'to'

Page 4: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Problem)Statement)

4'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

http://www.lviz.org/wpAcontent/uploads/2009/03/vancouver1980.png*

Navigates/'Looks'at'

Establish'semantic'links'between'3DCM'objects'and'documents'

Page 5: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

ContextualisaFon)

• Represent'the'documents'in*context*

•  Visually'link'documents'to'the'3D'object'

• Requires':'1.'Compute'the'semantic'alignment'relationships'2.'Compute'the'user'interface'layout'

'

5'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

Page 6: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Related)Work)

•  3D'visualisation':'NIRVE'[1],'Periscope[2]'

•  Contextualisation'in'space':'Geocoding'process'in'GIS'[3]'

•  Visualisation':'World'Explorer'[4]''

Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.'' 6'

Page 7: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

A)Model)to)Compute)the)Links)

7'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

http://www.lviz.org/wpAcontent/uploads/2009/03/vancouver1980.png*

Geonames'

CityGML'

Urbamet'

Domain'Ontologies'

Link'document[object'

Coverage'

Annotation'

Page 8: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

IndexaFon)and)AnnotaFon)

• Documents'are'indexed''• Annotation'•  RDF']ile'

•  Coverage'•  Space'•  Time'

'•  3d'object'annotation'•  CityGML'representation'and'Geonames'identi]ication'

8'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

Page 9: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Ontology)Alignment)

•  Indexation'vocabularies''

'

9'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

CityGML' Geonames' Urbamet' Domain''Ontologies'

Page 10: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

IdenFficaFon)

10'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

http://www.lviz.org/wpAcontent/uploads/2009/03/vancouver1980.png*

Geonames'

CityGML'

Urbamet'

Domain'Ontologies'

Link'document[object'

Page 11: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

IdenFfying)city)objects)

•  From'CityGML'to'Geonames'

•  Position'

•  Function'

• Rules'to'solve'ambiguities'

11'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

Page 12: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

IdenFficaFon)of)City)Objects)

12'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

Page 13: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Storey)IdenFficaFon)

•  Contained'in'the'footprint'

•  Contained'in'the'building''(CityObjectGroup*–*part_of/contains)*

•  Function'(lodXStorey)*

•  Name':']loor'number''•  Elevation'(geoname)*

•  Creation'of'a'class'“Storey”'in'CityGML'

13'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

Page 14: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Storey)IdenFficaFon)Formula)

14'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

Page 15: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Storey)IdenFficaFon)Example)

15'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

http://lesleyannwhite.co.uk/wp[content/uploads/2011/11/house_tran.png'

Page 16: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

A)Model)to)Compute)the)Links)

16'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

http://www.lviz.org/wpAcontent/uploads/2009/03/vancouver1980.png*

Geonames'

CityGML'

Urbamet'

Domain'Ontologies'

Link'document[object'

Coverage'

Annotation'

Page 17: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Find)the)connecFons)

•  Type'of'links'

•  Explicit'(Boolean'value)'•  Direct'or'indirect'connection'

•  Suggestion'(Weight'value)'•  Through'non[geographic'entities'•  Object'is'not'contained'in'the'3DCM'

17'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

Page 18: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Alignment)Algorithm)

•  Input''•  Document'corpora'(indexed)'•  3D'city'model'(indexed)'

• Output'•  Matrix'of'links''•  M(doc,obj)'''

•  Focus'on'the'spatial'coverage''

18'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

Page 19: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Algorithm)

• One'document','one'object'

•  Cov(obj)'≤'Cov(doc)'or'vice'versa'•  CityGML/Geonames'

•  Search_link'function'4'cases':''1.'Direct'link'2.'Direct'link'by'class'3.'Link'through'non[geographic'entities'4.'Link'by'spatial'proximity'

19'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

Page 20: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Direct)Link)

• M(doc,obj)='true''

20'

G:“Geneva''airport”'

G':“Geneva''airport”'

Cov(doc)'

Cov(obj)'

Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

Page 21: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Direct)Link)by)Class)

• M(doc,obj)=true'

21'

G':“Geneva'airport”'

Cov(doc)'

Cov(obj)'

Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

“airport_'building”'

Page 22: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Link)through)NonNgeographic)EnFFes)

• M(doc,obj)=1/semantic_distance(“surgery”,'“HUG”)'

22'

G:'“HUG”'

Cov(obj)'

Idx(doc)'

Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

“surgery”'

Page 23: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

g2'g3'

g4'

The)object)is)a)group)

•  The'main'object'is'identify'with'a'geoname'

•  Get'the'object'that'correspond'to'the'current'geoname'''

•  Fall'back'to'cases'1,'2'or'3'with'the'new'object'''

23'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

g1'

Page 24: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

•  e'not'in'cov(model)'•  e'and'f'are'spatially'close'

Link)by)SpaFal)Proximity)

26'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

G:'e'

Cov(doc)' Cov(model)'='f'(geoname)'

G:'e'

• M(doc,obj)='1/euclidean_distance(e,f)''http://i149.photobucket.com/albums/s62/WorkingFilms/AucklandCity2.jpg'

Page 25: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

ParFcular)SituaFons)

•  The'object'is'a'group'

•  Storeys'

Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.'' 27'

Page 26: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Example):)Geneva)Airport)

28'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

Cov(doc)'='“Switzerland”'(geoname)''

Idx(doc)'='“Swiss”,'“airline”,'“tablets”,'“crew”'

http://www.journal[aviation.com/'

Page 27: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Example):)Geneva)Airport)

29'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

Cov(obj)'='BuildingFunctionType':'“Airport_Building”'(cityGML)'Cov(model)''='“Geneva'Canton”'(geoname)'

e'(geoname')'='label':'“Aéroport'Genève[Cointrin”,'feature'code':'“S.AIRP”(Airport)'

Page 28: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Example):)Geneva)Airport)

•  “Switzerland”'contains'“Geneva'Canton”'

•  Idx(doc)'contains'“airline”'

•  Link'between'doc'and'all'airports'objects'in'the'model*

• M(doc,obj)=true '[>'explicit_link'

Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.'' 30'

Page 29: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Example):)University)of)Geneva)

31'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

Cov(doc)'='“Uni'Dufour”'(geoname),'Storey':'name'='1'(CityGML)''

www.unige.ch'

Page 30: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Example):)University)of)Geneva)

32'Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.''

Cov(obj)'='“Uni'Dufour”'(geoname)'

Obj'is'a'group'of'4'storeys':''

!  o4''Storey':'name'='3'!  o3''Storey':'name'='2'!  o2''Storey':'name'='1'!  o1''Storey':'name'='0'

http://sketchup.google.com/3dwarehouse/details?mid=da6dc]b704f4294c9202d3aef1555f0c'

Page 31: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Example):)University)of)Geneva)

•  Cov(doc)'and'Cov(obj)'contains'“Uni'Dufour”'

•  Cov(doc)'[>'Storey'

•  Search'link'with'obj'sub[objects'

•  Cov(o2)='“Uni'Dufour”,'Storey':'name'='1''

• M(doc,o2)=true'

Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.'' 33'

Page 32: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

Conclusion)

•  Semantic'indexing'

•  Identify'links'through'numerous'connections''•  Future'Work':'•  Evaluation'via'a'use'case'

•  Deal'with'fuzzy'area'

•  Develop'the'different'visualisation'technics'

•  Develop'the'query'system'

Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.'' 34'

Page 33: Semantic alignment of documents with 3D city models C. Tardy et al 3u3d2012

References)

Semantic'alignment'of'documents'with'3D'city'models,'C.'Tardy'et'al.'' 35'

1.  W.'Wiza,'K.'Walczak,'W.'Cellary,'Proc.*of*the*9th*Int.*Conf.*on*3D*Web*Technology.* Periscope' [' A' System' for' Adaptive' 3D' Visualization' of'Search'Results.'29–40.'(2004)'

2.  ' J.'Cugini,'S.'Laskowski,'M.'Sebrechts,'Proc.*of*IST/SPIE's*12th*Annual*Int.* Symposium:* Electronic* Imaging.' Design' of' 3D' visualization' of'search'results:'Evolution'and'evaluation.'23–28.'(2000)''

3.  C.B.'Jones,'A.I.'Abdelmoty,'D.'Finch,'G.'Fu,'S.'Vaid,'Proc.*of*the*3rd*Int.*Conf.* on* Geographic* Information* Science.' The' SPIRIT' Spatial' Search'Engine:' Architecture,' Ontologies' and' Spatial' Indexing.' 125–139.'(2004)''

4.  S.'Ahern,'M.'Naaman,'R.'Nair,'J.H.I.'Yang,'Proc.*of*the*7th*JCDL.'World'explorer:' visualizing' aggregate' data' from' unstructured' text' in' geo[referenced'collections.'1–10.'(2007)''