Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of...

34
QuickTime™ et un décompresseur TIFF (non compressé) sont requis pour visionner cette image. QuickTime™ décompresseur sont requis po Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence Nigay

Transcript of Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of...

Page 1: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

QuickTime™ et undécompresseur TIFF (non compressé)

sont requis pour visionner cette image.

QuickTime™ et undécompresseur TIFF (non compressé)sont requis pour visionner cette image.Grenoble Informatics Laboratory (LIG)HCI Engineering Research Group (IIHM)

Helping the design of Mixed Systems

Céline Coutrix

PhD Supervisor: Laurence Nigay

Page 2: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

2

Problem statement

QuickTime™ and aPhoto - JPEG decompressor

are needed to see this picture.

• merge physical and digital worlds• lot of applications

Page 3: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

3

Motivation

Analysis

design

prototyping

evaluation

Page 4: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

4

Goals

• Support for the design– Description– Exploration– Comparison

• Support for prototyping

Page 5: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

5

Methodology

Related Work

Concrete Mixed Systems:- RAZZLE- ORBIS- Snap2Play

Software Tool- Flexible- Extendable- …

Mixed Interaction Model- Descriptive- Generative - Comparative

Conceptual Work

Software Tools

Examples of systems

Design SoftwareDevelopment

Evaluation

Page 6: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

6

Example: ORBIS

Page 7: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

7

Mixed Interaction Model

Physical object

Physicalproperties

Digital object

Digitalproperties

Mixed object

Physicalproperties

Digitalproperties?

Page 8: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

8

Mixed Interaction Model

• Interaction Modality m = (d, l)

• speech = (microphone, natural language)

Mixed object

Physicalproperties

Digitalproperties?

Page 9: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

9

Mixed Interaction Model

• Linking Modality

Physical properties

Digitalproperties

Inputdevice

Outputdevice

Outputlanguage

Inputlanguage

Page 10: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

10

Design Space Exploration

List of Pictures

Page 11: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

11

Comparison of Design Alternatives

acquiredmaterialized

non acquirednon materialized

acquirednon materialized

non acquiredmaterialized

Page 12: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

12

Comparison of Design Alternatives

List of Pictures

Page 13: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

13

Design Space Exploration

List of Pictures

QuickTime™ et undécompresseur TIFF (non compressé)sont requis pour visionner cette image.QuickTime™ et undécompresseur TIFF (non compressé)sont requis pour visionner cette image.

QuickTime™ et undécompresseur TIFF (non compressé)sont requis pour visionner cette image.

Page 14: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

14

size

resolution

QuickTime™ et undécompresseur TIFF (non compressé)sont requis pour visionner cette image.

QuickTime™ et undécompresseur TIFF (non compressé)sont requis pour visionner cette image.

QuickTime™ et undécompresseur TIFF (non compressé)sont requis pour visionner cette image.

dynamic static

local

global

Comparison of Design Alternatives

• Capitalizing existing characteristics

Page 15: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

15

Design Space Exploration

List of Pictures

QuickTime™ et undécompresseur TIFF (non compressé)sont requis pour visionner cette image.ImageMaterialShape

Page 16: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

16

Design Space Exploration

Page 17: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

17

Design Space Exploration

Page 18: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

18

Design Space Exploration

List of Pictures

QuickTime™ et undécompresseur TIFF (non compressé)sont requis pour visionner cette image.

ImageMaterialShapeOrientation

Page 19: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

19

Comparison of Design Alternatives

non sensedgenerated

sensednon generated

sensedgenerated

non sensednon generated

Page 20: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

20

Comparison of Design Alternatives

Image

Orientation of the shape

MaterialShape

Orientation of the Image

Page 21: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

21

Design Space Exploration

List of PicturesTop

(camera, computer vision)(accelerometer, transformation1)(magnetometer, transformation2)

QuickTime™ et undécompresseur TIFF (non compressé)sont requis pour visionner cette image.

ImageMaterialShapeOrientation

Page 22: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

22

Outline

• Support for the design• Support for prototyping• Validation

Page 23: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

23

Support for Prototyping

Page 24: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

24

Support for Prototyping

Page 25: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

25

Support for Prototyping

Page 26: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

26

Support for Prototyping

• Integration of lower-level toolkits– ARToolKit– Phidgets– Interface-Z MIDI sensors

Page 27: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

27

Support for Prototyping

Page 28: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

28

Support for Prototyping

QuickTime™ et undécompresseur H.264

sont requis pour visionner cette image.

Page 29: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

29

Support for Prototyping

Page 30: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

30

Outline

• Support for the design– Description– Exploration– Comparison

• Support for prototyping• Validation

Page 31: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

31

Validation

1. Mixed Interaction Model evaluationPower/Evaluation Empirical Theoretical

Descriptive Modeling existing systems

Comparative Classifying existing systems

Comparison with other taxonomies

Generative

• Design of concrete systems• Ergonomic evaluation in a real exploratory design situation

• Exploratory design task [Cognitive Dimensions of Notations Framework] • Interconnection between existing approaches [Olsen]

Page 32: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

32

Validation

2. Software Tool evaluation

empirical theoreticalPairs of designer+developer prototyping the same system working with/without the toolkit

Evaluating User Interface System Research [Olsen]

Page 33: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

33

Ongoing Work

Related Work

Concrete Mixed Systems :- RAZZLE- ORBIS- Snap2Play

Software Tool- Flexible- Extendable- …

Mixed Interaction Model- Descriptive- Generative - Comparative

Conceptual Work

Software Tools

Examples of systems

Design SoftwareDevelopment

Evaluation

Page 34: Grenoble Informatics Laboratory (LIG) HCI Engineering Research Group (IIHM) Helping the design of Mixed Systems Céline Coutrix PhD Supervisor: Laurence.

QuickTime™ et undécompresseur TIFF (non compressé)

sont requis pour visionner cette image.

QuickTime™ et undécompresseur TIFF (non compressé)sont requis pour visionner cette image.Grenoble Informatics Laboratory (LIG)HCI Engineering Research Group (IIHM)

QUESTIONS?