Post-disaster 3D Modeling of a Collapsed City: Citadel of...

28
PostDisaster 3D Modeling of a Collapsed City: Citadel of Bam, Iran http://dsr.nii.ac.jp/bam/ Asanobu Kitamoto National Institute of Informatics Elham Andaroodi University of Tehran Mohammad Reza Matini University of Yazd Kinji Ono National Institute of Informatics

Transcript of Post-disaster 3D Modeling of a Collapsed City: Citadel of...

Page 1: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Post‐Disaster 3D Modeling of a  Collapsed City: Citadel of Bam, Iran

http://dsr.nii.ac.jp/bam/

Asanobu Kitamoto National Institute of Informatics

Elham

Andaroodi University of Tehran

Mohammad Reza Matini University of Yazd

Kinji

Ono  National Institute of Informatics

Page 2: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

December 26, 20032011/11/15 Digitization of Cultural Heritage  2

Cultural Heritage News

Page 3: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

One of the biggest mud  brick complex in the world.

Most of the citadel was  collapsed by the quake.

One year later, “Bam and  its Cultural Landscape”

was inscribed on the list of  World Heritage in Danger.

Citadel of Bam2011/11/15 Digitization of Cultural Heritage  3

Page 4: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Project HistoryDecember 31, 2003 January 2004

April – June, 2006 December 26, 2008

2011/11/15 Digitization of Cultural Heritage  4

Page 5: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Project Framework2011/11/15 Digitization of Cultural Heritage  5

OntologyModeling

Rendering

Wireframe

Multimedia Website

Heterogeneous

data archives

Voluntary data collection

Institutional data collection

Physical  reconstruction

Museum exhibition

Cyber world Physical world

ArchitecturalProcess

ConceptualProcess

After the disaster

In the future

Page 6: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Integration of Heterogeneous Data2011/11/15 Digitization of Cultural Heritage  6

Estimating missing information is a critical problem!

Page 7: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Comparison of Workflow

Computer Experts

Domain Experts

Modeling Rendering

Computer Experts

Domain Experts

Modeling Rendering

Create

InstructCheck

Create

Create

1st

Phase (bad) 2nd

Phase (good)

CreateTransfer

2011/11/15 Digitization of Cultural Heritage  7

Page 8: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Architectural Modeling and Rendering

Modeling Rendering•

Experts should model 

the structure.•

Model is created by a 

CAD tool (AutoCAD).•

The output is 

wireframe models.•

Accuracy is important.

Experts should render  the appearance.

Model is rendered by a  3D CG tool (3ds max).

The output is  multimedia content.

Appearance is  important.

2011/11/15 Digitization of Cultural Heritage  8

Page 9: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Collaboration of Experts

Domain experts

(e.g. architects) focus on the  accuracy of models. 

Computer experts

(e.g. CG engineers) focus on  the usefulness of systems and outputs. 

Separation of modeling and rendering

is more  efficient because of the division of roles.   

Similar to the separation of model / view in  software engineering (modular design).

2011/11/15 Digitization of Cultural Heritage  9

Page 10: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Architectural Process

A 3D model accurate  enough for physical 

reconstruction.

Accuracy includes   appropriateness as  Persian architecture.

New data cannot be  measured in a post‐

disaster reconstruction.

2011/11/15 Digitization of Cultural Heritage  10

Page 11: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Requirement of Accuracy

High

Moderate

Low

Original image: Digital Globe

Accurate

Inaccurate

Manual

Automatic

Good balance between  accuracy and cost

2011/11/15 Digitization of Cultural Heritage  11

Page 12: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Photogrammetric Map2011/11/15 Digitization of Cultural Heritage  12

IFCA Project

(By Prof. Adle), NCC, ICHHTO 

Rough reference of the shape and location.

Page 13: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

1.

Geometrical modification 2. Structural modification

2011/11/15 Digitization of Cultural Heritage  13

3. Proportional modification 4. Details

Page 14: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Rendering of Exterior Space

one part of Bazaar

CAD-based 3D drawing:Dr. M.R. Matini

(NII)

3D modelers:Global Information and Telecommunication Institute (GITI), Waseda

University, Tokyo

2011/11/15 Digitization of Cultural Heritage  14

Page 15: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Rendering of Interior Space

one room of Sistani

house

CAD-based 3D drawing:Dr. M.R. Matini

(NII)

3D modelers:Raazahang, University of Tehran, Iran

2011/11/15 Digitization of Cultural Heritage  15

Page 16: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Semi‐Automatic ModelingPhotogrammetric MapIFCA Project

(By Prof. Adle), NCC, ICHHTO 

PhotographsFrom experts and tourists

Simple 3D ModelTextureStructure

Overlay

2011/11/15 Digitization of Cultural Heritage  16

Work by Mr. Natchapon

Futragoon

Page 17: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Workflow2011/11/15 Digitization of Cultural Heritage  17

Page 18: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Automatic Modeling

Laser scanning Structure from MotionImage: Building Rome in a DayImage: Wikipedia

New data cannot be  captured from now!

2011/11/15 Digitization of Cultural Heritage  18

Page 19: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Multiple Images or Videos

Work by Mr. Tiago da

Silva

Using point correspondences and 

projective geometry fails due to the lack 

of photographs, variety of cameras, and 

temporal change due to renovation. 

7‐minute video taken from a helicopter 

by NHK in 1981 has potential for the 

automatic reconstruction of a 3D model, 

but not yet completed.  

2011/11/15 Digitization of Cultural Heritage  19

Page 20: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Conceptual Process

3D models represent the  structure ⇔ conceptual 

models represent the  knowledge.

Two models are made  separately, but could be 

linked in the future to  realize the 3D semantic 

database of Bam.

2011/11/15 Digitization of Cultural Heritage  20

Page 21: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Conceptual Modeling

Conceptual modeling is  about representing 

relationship of concepts  using ontology. 

Multilingual ontology  represents typology of  buildings.

Input  and output data is  annotated with concepts. 

2011/11/15 Digitization of Cultural Heritage  21

Page 22: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Conceptual Rendering

Conceptual rendering is  about storing and 

visualizing conceptual  models.

Concepts are stored in  RDF (Resource 

Description Framework)

Website is automatically  generated from RDF. 

2011/11/15 Digitization of Cultural Heritage  22

Page 23: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Summary

Architectural modeling

produced a number of 3D  models with enough accuracy for virtual and physical 

reconstruction of the Citadel of Bam.

Workflow for modeling and rendering

is crucial for  the efficient generation of multimedia content.

Conceptual modeling

developed Bam3DCG ontology  for representing many kids of project‐related data.

Conceptual rendering

developed automatic website  generation system based on RDF. 

2011/11/15 Digitization of Cultural Heritage  23

Page 24: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Future Work

Semi‐automatic modeling of remaining parts to make the 3D model of the whole city.

Interactive rendering of 3D models

through  the Internet (Web) while protecting original  3D models from users. 

Linkage between architectural and conceptual  models

for the 3D semantic database of Bam. 

2011/11/15 Digitization of Cultural Heritage  24

Page 25: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Last Words for March 11

Cultural heritage was lost again on March 11.

Post‐disaster reconstruction start suddenly  without preparation. How is it possible to be 

well‐prepared for future disasters?  

Short‐term response

focuses on raising  awareness and starting data collection activity.

Long‐term response

focuses on reviving  memories as the symbol of the community. 

2011/11/15 Digitization of Cultural Heritage  25

Page 26: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Software

Architectural Modeling–

Computer‐aided design (AutoCAD)

Architectural Rendering–

Computer graphics / virtual reality (3ds Max)

Conceptual Modeling–

Ontology editor (Protégé)

Conceptual Rendering–

Semantic Web framework (Jena)

2011/11/15 Digitization of Cultural Heritage  26

Page 27: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

References•

Asanobu KITAMOTO, Elham ANDAROODI, Mohammad Reza MATINI, Kinji

ONO, "Post‐Disaster 

Reconstruction of Cultural Heritage: Citadel of Bam, Iran", Jinmonkon

2011, pp. (in press), 2011‐12

Elham ANDAROODI, Asanobu KITAMOTO, "Architectural Heritage Online: Ontology‐Driven Website 

Generation for World Heritage Sites in Danger", Digital Heritage: Proceedings of Euromed

2010 

(3rd International Euro‐Mediterranean Conference), Lecture Notes in Computer Science (LNCS) 

6436, M. Ioannides

(Eds.), pp. 277‐290, Springer‐Verlag, doi:10.1007/978‐3‐642‐16873‐4, 2010‐11 

(Best Paper Award)

Natchapon

Futragoon, Asanobu KITAMOTO, Elham

ANDAROODI, Mohammad Reza MATINI, Kinji

ONO, "3D Reconstruction of a Collapsed Historical Site from Sparse Set of Photographs and 

Photogrammetric Map", ACCV Workshop on e‐Heritage 2010, 2010‐11

Mohammad Reza MATINI, Alireza

EINIFAR, Asanobu KITAMOTO, Kinji

ONO, "Digital 3D 

Reconstruction Based on Analytic Interpretation of Relics; Case Study: Bam Citadel", Proceedings of 

the 22nd International Symposium on Digital Documentation, Interpretation & Presentation of 

Cultural Heritage (CIPA 2009), 2009‐10

Kinji

ONO, Elham ANDAROODI, Alireza

EINIFAR, Nobuaki ABE, Mohammad Reza MATINI, Olivier 

BOUET, Frank CHOPIN, Takashi KAWAI, Asanobu KITAMOTO, Asaka

ITO, Eskandar

MOKHTARI, 

Saeed

EINIFAR, Seyyed

Mohammad BEHESHTI, Chahryar

ADLE , "3DCG Reconstitution and Virtual 

Reality of UNESCO World Heritage in Danger: the Citadel of Bam",

Progress in Informatics, No. 5, pp. 

99‐136, 2008‐03

2011/11/15 Digitization of Cultural Heritage  27

Page 28: Post-disaster 3D Modeling of a Collapsed City: Citadel of ...agora.ex.nii.ac.jp/~kitamoto/research/publications/k:kh11-ppt.pdf · ONO, "Post‐Disaster Reconstruction of Cultural

Acknowledgment3D 

CG 

reconstruction 

of 

the 

Citadel 

of 

Bam 

is 

collaborative 

research 

project 

between 

the 

Digital 

Silk 

Road 

project of NII and Iranian Cultural Heritage, Handicraft and Tourism Organization (ICHHTO);

Waseda

University, 

GITI and Prof. Dr. Kawai's Lab;

University of Tehran, Prof. Dr. Einifar's

Lab, and Razahang

Architectural Office. 

The 3D photogrammetric material is provided to NII by Professor Chahryar

ADLE from CNRS and ICHHTO. We 

thank 

Mr. 

Tomohiro 

Ikezaki

for 

implementing 

the 

Bam3DCG 

website 

generation 

system. 

We 

also

thank 

students who worked for Bam Project at Dr. Kitamoto’s

Lab during the NII internship program, namely Tiago da

Silva, Natchapon

Futragoon, and Xinling

Chen.

2011/11/15 Digitization of Cultural Heritage  28