ARTISTE Project Presentation

Gert PresuttiProject Manager, NCR SE-Copenhagen

Roberto Vaccaro

R&D Project Manager, Interactive Labs (Giunti Publishing Group)

2

Vision

A more effective system for classifying, storing, linking, matching and retrieving art images

3

ARTISTE - An EU RTD Project

• NCR (Coordinator)

• IT Innovation Center

• Giunti Interactive Labs

• The National Gallery

• Centre de Recherche et de Restauration des Musées de France

• Uffizi

• Multimedia Research Group

• Victoria and Albert Museum

• Budget on € 2.77M (EC € 1.8M)

• 22.5 man years over 30 months

http://www.artisteweb.org

4

ARTISTE Objectives

• Business Objectives Identify how the technical systems developed in the project can be

deployed and exploited in a number of sectors Establish business models that give the content owners direct

control over the distributed representation, access and exploitation of digital multimedia content and metadata

Ensure that the vision and results of the project become as widely known and understood as possible

5

ARTISTE Objectives

• Technical Objectives Meet specified end-user requirements for achieving a system directly

useful to professional users in the fine arts. Develop automatic metadata representations for image categorisation Develop seamless distributed access to multiple collections Develop distributed content-based navigation methods for art collections Develop image analysis algorithms to assist the work of Art Professionals Build and prove the value of a robust and scalable integrated environment

that incorporates the above components using the TeraData Object-Relational database

6

Core Technologies

• Distributed links server software, user interfaces, and content-based navigation software

• Content based analysis for the automatic extraction of color, shape and texture features

• Art collection integration through a web based architecture

• Teradata Object Relational database for the effective management and analysis of huge repository of large high resolution images

• Dynamic metadata system for image categorization primarily based on XML

7

ARTISTE System Architecture

CommonMetadataSchema

Object-relationalUDM

Presentation Layer

Art DB

UDM

AuthoredLinks

(Replicated)

AuthoredLinks

(Replicated)

Gallery 1 Gallery 2

Metadata

Presentation Layer

Distributed Queryand Metadata Layer

Commonreference

information

Web Server Web Server

Browser

Object-relationalUDM

Art DB

UDMMetadata

Distributed Queryand Metadata Layer

Third-partybackground server

8

ARTISTE Business Model

Images

Researchers,historians andconservators

Publishers

Educationalcourse

creators

Gallerybranded

sites

Galleries andother content

owners

ImagesImagesSupport

Services

Accesscontrol

Images

Images

Images

Payment

Payment

New research,results andtechniques

Educationalmaterial

Images forpublication

Paymenthandling

9

2. Prototype: Design complete, Distributed

linking and initial pigment identification

algorithms based on final user requirements

1. Prototype: Initial Query-layer and sample algorithms

based on initial user requirements

3. Prototype: Metadata incorporated, content-based navigation, and

initial recognition algorithms

ARTISTE System Milestones

PM0 PM6 PM12 PM18 PM24 PM30

4. Final System

PM = Project Month

10

ARTISTE Documentation Milestones

Prototype evaluation: PM10, PM16, PM22, PM30

Report on Data Capture, PM9 Image content analysis algorithms

report, PM24 ARTISTE Metadata Standards

Positioning, PM30 Description of Linking and content

based navigation technology, PM24 User Interface description, PM24 User Defined Module report, PM12

System Integration report, PM26 ARTISTE Web, PM2 Dissemination and Exploitation

plans, PM6 Collection Management systems

Migration report, PM24 ORDBMS Requirements analysis,

PM12 ORDBMS support evaluation, PM24 ORDBMS enhancements, PM24 ARTISTE TIP, PM30

PM = Project Month

11

User Groups

• User Partners: Partners of the project who provide detailed requirements and monitor and test the system (Uffizi, C2RMF, VAM, NG).

• User profiles: The project targets a wide range of profiles. More generally, the User profiles profile group, is set by those, who will use the application directly and will have their activities supported. (museums curators, researchers, historians, conservators, publishers and editors, auctioneers, art amateurs).

• Other Users: who has an interest in the system or is affected by its functioning without directly using it (education and mass end users, support personnel).

12

User Goals

• G1: Matching of similar images

• G2: Automatic search using synonyms

• G3: Search based on the concept of style

• G4: Search based on features oriented to the restoration framework

• G5: Access information quickly and easily

• G6: Search based on colour, pigment features

• G7: Query by low quality images (faxes)

• G8: Query by sketch

• G9: Query refinement

• G10: Joint retrieval by content and by text

• G11: Use of publishing products built on the Artiste system

• G12: Detail finding

• G13: Search using multilingual vocabulary

13

Some Examples

Victoria and Albert Museum

14

Some examples (continued) C2RMF

Seneque: Colour image

(Louvre) normal light acquisition, craquelure network

racking light acquisition, crack in the wood

15

Some examples (continued): C2RMF

Seneque: Colour image

(Louvre) UV acquisition, repeints

reverse acquisition, tool marks, crack in the wood

16

ARTISTE AIUG and Advisory Panel

Members of the Artiste Interest User’s Group will: Receive the AIUG Newsletter giving regular updates on the project's progress, plus news

on related subjects and events Receive invitations to attend workshops where you will see how the project vision is

developing and meet other professionals to exchange views (first workshop due to take place towards the end of 2000)

Have other opportunities to provide feedback to the project and influence how it develops to meet the needs of professionals

Members of the ARTISTE Advisory Panel will: Review selected deliverables or assess ARTISTE prototypes Provide guidelines on the overall direction of the project. Occasionally participate in ARTISTE PMT Meetings