Designing for the Internet of Things : models and principles for augmented products

150
models and principles for the design of augmented products Pierrick Thébault Designing for the Internet of Things: LABORATOIRE ARTS ET METIERS PARISTECH D’ANGERS (LAMPA) - EQUIPE PRESENCE & INNOVATION & ALCATEL-LUCENT – BELL LABS FRANCE May 31th, 2013

description

The Internet of Things, whose underlying vision and technologies aim at bridging the physical and digital worlds together, lead to the creation of new types of applications coupling Web services with everyday products. Such product-oriented applications, which enable the functional exposition, control or enhancement of artifacts that embed information processing capabilities, question the established design principles and conventions. They open up the possibility for Internet-enabled products, whose functions can be "augmented" and adapted to better support users' changing needs, to be designed. This research, which is at the intersection of Design Science, Ubiquitous Computing and Human-Computer Interactions, aims at studying the impact brought about by applications on product design. It highlights the need to build an application model that facilitates their representation by users, and to explore the pragmatic issues rose by their integration into products. It leads to the definition and evaluation, through practice, of principles for the design of augmented products' form and interactions. It describes the ductility of future products, the novel coupling between functions, behavior and structure they implement and their potential evolutions. This work contributes to the Internet of Things research by reframing the discussion and by providing researchers and practitioners with tools that can be leveraged during the design process.

Transcript of Designing for the Internet of Things : models and principles for augmented products

Page 1: Designing for the Internet of Things : models and principles for augmented products

models and principles for the !design of augmented products

Pierrick Thébault!

Designing for the!Internet of Things:!

LABORATOIRE ARTS ET METIERS PARISTECH D’ANGERS (LAMPA) - EQUIPE PRESENCE & INNOVATION & ALCATEL-LUCENT – BELL LABS FRANCE

May 31th, 2013!

Page 2: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 2

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

PIERRICK THEBAULT _ 31/05/2013

Extending the Web to products

2

Page 3: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 3

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

PIERRICK THEBAULT _ 31/05/2013

Extending the Web to products

3

Page 4: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 4

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

PIERRICK THEBAULT _ 31/05/2013

Extending the Web to products

4

Page 5: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 5

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

PIERRICK THEBAULT _ 31/05/2013

Extending the Web to products

5

Page 6: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 6

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

PIERRICK THEBAULT _ 31/05/2013

Extending the Web to products

6

Page 7: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 7

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

PIERRICK THEBAULT _ 31/05/2013

Extending the Web to products

7

Page 8: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 8

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Towards product-oriented applications

PIERRICK THEBAULT _ 31/05/2013 8

Web service!

Web service! Web service!

Product!

Product!

Product!

digital world!

physical world!

Video available on  h"p://vimeo.com/67927424  

Page 9: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 9

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

The collaboration of many stakeholders

MANUFA -CTURER!

TELECOM!PROVIDER!

END-USER!

SERVICE!PROVIDER! WEB SERVICES! PRODUCTS!

INFRASTRUCTURE!

Page 10: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 10

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

PIERRICK THEBAULT _ 31/05/2013

What is the impact of applications on the design of products?

10

Page 11: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 11

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

A design research…

Mackay et al., 1997!

The artefact as a gateway between!practice and theory!

Design researchers continually !reframe the problem as they attempt to make the right !thing.!

Zimmerman, 2007!”!“!

Page 12: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 12

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

… through practice

A mix of qualitative and interpretative ! methods situated in action.!

Findeli, 2004!

§  Ethno-methodology!§  Participatory design methods!§  Prototyping!§ Usability testing!

§  Through design!Frayling, 1993!

§ Design praxiology! and phenomenology Cross, 1999!

§  Through projects!Findeli, 2004!

§  Pragmatic and empirical Koskinen, 2011!

!

”!“!

Fallman, 2008!

Page 13: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 13

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

A research at the intersection of three disciplines

§  Network infrastructures!§  Embedded systems!§  Applications!

§  User interfaces!§  Interaction techniques!§  Design principles!

§  Components and materials!§  Manufacturing techniques!§  Design processes!

UBICOMP!

HCI!DESIGN!SCIENCE!

Ubiquitous Computing!

Human-computer interactions!

Design science & engineering!

Page 14: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 14

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

The Internet of Things at Bell Labs

PIERRICK THEBAULT _ 31/05/2013 14

Network infrastructures!Y. Gasté’s team!

Application models!M. Boussard’s team!Virtual objects

Connected Real-World

Objects Virtual Objects Framework

Eventing

HTTP APIs

Access Control

Provisioning

Environment-aware Applications

User Interaction Patterns

End-user programming!L. Trappeniers’ team!

User experience!

design!F. Pain’s team!

Social networks of things!J. Daigremont’s team!

Partenaires!

Page 15: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 15

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Products Applications

Research question #1!

1) Perception of interconnections!

2) Perception of mechanisms!

3) Perception of applications!

Experiments!

Descriptive model!

State of the art!

Research question #2!

1) Product design!

Operationalization!

Design principles!

2) Experiments!

3) Revised principles!

State of the art!

Page 16: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 16

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Applications

Problématique 1 & hypothèse 1!

1) Perception of interconnections!

2) Perception of mechanisms!

3) Perception of applications!

Experiments!

Descriptive model!

State of the art!

Research question #1!

Page 17: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 17

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Can we create a model that describes their inner working?!

Hypothesis:! Designers need to work with end-users!to create a shared definition of applications!

How to make sure our definition is accepted by end-users?!

Research question #1

How to define !product-oriented applications?!

Page 18: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 18

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Applications

Research question #1!

State of the art!

1) Perception of interconnections!

2) Perception of mechanisms!

3) Perception of applications!

Experiments!

Descriptive model!

Page 19: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 19

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Applications

State of the art!

1) Perception of interconnections!

2) Perception of mechanisms!

3) Perception of applications!

Experiments!

Descriptive model!

Research question #1!

Page 20: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 20

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

PIERRICK THEBAULT _ 31/05/2013 20

« ambient »!

Embodied applications

Want et al., !2001!

Chevrest et al., !2000!

Ullmer et al., 1998!Kidd et al., !1999!

Brock et al. 2001! Mann, 2001!

« ubiquitous »!

« context!aware »! « machine to

machine »!

« tangibles »!

« wearable »!

Page 21: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 21

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Applications to access applications…

Cooltown!Kindberg et al., 2002!

Speakeasy!Newman et al., 2002!

BIT!Roduner et a., 2010!

Mashup Editor!Guinard et al., 2009!

Object browser!Boussard et al., 2010!

Sentient Visor!Roduner et a., 2011!

Page 22: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 22

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Atzori et al., 2010!

A software layer  

Kawsar, 2009!

Flow chart  

A graph  

Lieberman, 2001!

A very broad concept

Applications!

Service!composition!

Service!orchestration!

Product!abstraction!

Product!

Page 23: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 23

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Applications

State of the art!

1) Perception of interconnections!

2) Perception of mechanisms!

3) Perception of applications!

Experiments!

Descriptive model!

Research question #1!

Page 24: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 24

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Applications

Experiments!

State of the art!

How do users perceive applications?!

Research question #1!

1) Perception of interconnections!

2) Perception of mechanisms!

3) Perception of applications!

Descriptive model!

Page 25: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 25

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Applications

State of the art!

Research question #1!

1) Perception of interconnections!

2) Perception of mechanisms!

3) Perception of applications!

Descriptive model!

Experiments!

Page 26: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 26

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Applications

1) Perception of interconnections!

Perception of interconnections between product and services!

Product!

Service!

Product!

Service! Product!Service!

Product! Product! Product!

State of the art!

Research question #1!

2) Perception of mechanisms!

3) Perception of applications!

Descriptive model!

Experiments!

Page 27: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 27

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Generating ideas

Video available on  h"p://vimeo.com/67925676  

Page 28: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 28

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

22 - 27 years old (m=23,64; σ=1,63) Graduate students in design

11! répartis en!2!groupes! min!45!

User panel and procedure

min!15!+!(evaluation)!

Page 29: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 29

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

A lamp that displays the air quality.!

An alarm clock that automatically change its settings based on your habits.!

A wireless USB flash drive.!

A mailbox that warns users when they got mail.!

The light and temperature of the house are programmed.! A mailbox that

displays the status of an online order. !

A lamp that warns you when someone is at the front door.!

An alarm clock that triggers other products of the house. !

A barbecue that send invitations on social networks.!

A camera that publishes pictures on the Web and share them with friends!

Automatic kitchen appliances.!

Products that exchange information.! A vacuum cleaner

that delete e-mails.!

A mobile application to navigate through the cities!

Examples of users’ ideas

Page 30: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 30

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

A lamp that displays the air quality.!

An alarm clock that automatically change its settings based on your habits.!

A wireless USB flash drive.!

A mailbox that warns users when they got mail.!

The light and temperature of the house are programmed.! A mailbox that

displays the status of an online order. !

A lamp that warns you when someone is at the front door.!

An alarm clock that triggers other products of the house. !

A barbecue that send invitations on social networks.!

A camera that publishes pictures on the Web and share them with friends!

Automatic kitchen appliances.!

Products that exchange information.! A vacuum cleaner

that delete e-mails.!

A mobile application to navigate through the cities!

Examples of users’ ideas

Page 31: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 31

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

3,64!ressources!/ application!

2,47!products!

1,17!service!

61,84%!selected!

76!ideas!

Results

Composition of applications

Page 32: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 32

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

3,64!ressources!/ application!

2,47!products!

1,17!service!

61,84%!selected!

76!ideas!

31,9%  only use!products  

72,34%  are embodied into!a specific product!

Results

Composition of applications

Page 33: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 33

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

36,17%   24,40%   21,28%   19,15%   0%  

Types of interconnections

Results

3,64!ressources!/ application!

2,47!products!

1,17!service!

61,84%!selected!

76!ideas!

31,9%  only use!products  

72,34%  are embodied into!a specific product!

Composition!of applications

Products!

Services!

Products!

Services!

Products!

Services!

Products!

Services!

Page 34: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 34

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Two types of interconnections are!rarely combined!

Analysis

and  Product! Product! Web!

service!Product!

Page 35: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 35

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Two types of interconnections are!rarely combined!

It is hard to distinguish!

Analysis

Mobile!applications!≠ !

Product-oriented

applications!

Web!services!

and  Product! Product! Web!

service!Product!

≠ !

Page 36: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 36

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Products are considered!as autonomous!

It is hard to distinguish!

Analysis

≠ ! ≠ !Mobile!applications!

Product-oriented

applications!

Web!services!

Two types of interconnections are!rarely combined!

and  Product! Product! Web!

service!Product!

Page 37: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 37

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Applications

State of the art!

Research question #1!

1) Perception of interconnections!

2) Perception of mechanisms!

3) Perception of applications!

Descriptive model!

Experiments!

Page 38: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 38

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Applications

2) Perception of mechanisms!

State of the art!

Research question #1!

3) Perception of applications!

Descriptive model!

Experiments!

1) Perception of interconnections!

Page 39: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 39

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Applications

Product!

Service!

Product!Service!

Service!

Perception of mechanisms underlying the applications!

State of the art!

Research question #1!

3) Perception of applications!

Descriptive model!

Experiments!

1) Perception of interconnections!

2) Perception of mechanisms!

Page 40: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 40

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

A scenario to draw

Video available on  h"p://vimeo.com/67926008  

Page 41: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 41

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

22 – 45 years old (m=25,48; σ=5,21) Graduate students in design or innovation

23! split in! 3!groups! min!45!

User panel and procedure

min!15!+!(evaluation)!

Page 42: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 42

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Examples of drawings Pictures available on  http://www.regarde.org/fichiers/thebault-experimentation2.pdf!

Page 43: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 43

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

23!drawings!

Results

4,3!countable!« applications »!

65,22%!illustrate the logic!

Transcription of applications

Page 44: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 44

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

23!drawings!

Results

4,3!countable!« applications »!

65,22%!illustrate the logic!

Strategies!of transcription

Transcription!of applications

60,87%   21,27%   13,04%   4,35%  

____ ____!____ ____!____ ____!____ ____!

____!____!____!____!

____!____!____!____!____!____!____!____!

Page 45: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 45

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

23!drawings!

Results

4,3!countable!« applications »!

65,22%!illustrate the logic!

73,91%!put resources!in categories!

« Applications »!Indoor/outdoor!Generated data!Physical/digital!Rooms of the house!Random categories!None!

Strategies!of categorization

Strategies!of transcription

Transcription!of applications

60,87%   21,27%   13,04%   4,35%  

____ ____!____ ____!____ ____!____ ____!

____!____!____!____!

____!____!____!____!____!____!____!____!

Page 46: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 46

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

23!drawings!

Results

4,3!countable!« applications »!

65,22%!illustrate the logic!

73,91%!put resources!in categories!

60,87%   21,27%   13,04%   4,35%  

____ ____!____ ____!____ ____!____ ____!

____!____!____!____!

____!____!____!____!____!____!____!____!

« Applications »!Indoor/outdoor!Generated data!Physical/digital!Rooms of the house!Random categories!None!

Page 47: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 47

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Analysis

Applications are!hard to represent

Page 48: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 48

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Analysis

Two types of applications!can be distinguished

Applications are!hard to represent!

Service!Product!

Page 49: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 49

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Analysis

Applications are!hard to represent!

Recurring metaphors et  Product! Service!

Product! Service!

Locations!

Two types of applications!can be distinguished

Page 50: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 50

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Applications

State of the art!

1) Perception of interconnections!

2) Perception of mechanisms!

3) Perception of applications!

Experiments!

Descriptive model!

Research question #1!

Page 51: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 51

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Applications

State of the art!

1) Perception of interconnections!

2) Perception of mechanisms!

3) Perception of applications!

Experiments!

Descriptive model!

Research question #1!

Page 52: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 52

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Applications

Perception of !application types!

State of the art!

2) Perception of mechanisms!

3) Perception of applications!

Experiments!

Descriptive model!

Research question #1!

1) Perception of interconnections!

Page 53: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 53

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Selecting three types of applications

Applications coupled!to a product  

Applications coupled!to a web service  

Applications coupled!to the environment  

Page 54: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 54

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

A tool to browse and interact with applications

Video available on  h"p://vimeo.com/67926318  

Page 55: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 55

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

22 - 45 years old (m=31,25; σ=7,28) Researchers, PhD students and interns from Bell Labs

21! min!15!

User panel and procedure

min!15!+!(evaluation + interview)!

Page 56: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 56

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Results

87%!sucesses!

74,36%!mistakes!

25,64%!failures! 74,5!

SUS score ! >70%!>80%!6!minutes!

25!seconds!/ task!

Effectiveness!and efficiency

Page 57: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 57

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Results

87%! 74,36%!25,64%!

74,5! >70%!>80%!6!

25!

96,66%  

Applications coupled!to a product  

4,45 /5!

« Relevant because they avoid unnecessary travels. »!

Effectiveness!and efficiency

Results by!types of!applications

sucesses! mistakes!

failures!

SUS score !

minutes!seconds!/ task!

Page 58: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 58

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Results

87%! 74,36%!25,64%!

74,5! >70%!>80%!6!

25!

96,66%  

Applications coupled!to a product  

98,33%  

Applications coupled !to a web service  

4,45 /5! 4,3 /5!

« Relevant because they avoid unnecessary travels. »!

« Useful because the information is quickly communicated. »!

Effectiveness!and efficiency

Results by!types of!applications

sucesses! mistakes!

failures!

SUS score !

minutes!seconds!/ task!

Page 59: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 59

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Results

87%! 74,36%!25,64%!

74,5! >70%!>80%!6!

25!

96,66%   98,33%   66,25%  

Applications coupled!to the environment  

4,45 /5! 4,3 /5! 4,40 /5!

4,10 /5! Sound level!

Video stream!

« They help making plans. »!

Effectiveness!and efficiency

Results by!types of!applications

sucesses! mistakes!

failures!

SUS score !

minutes!seconds!/ task!

Applications coupled !to a web service  

« Useful because the information is quickly communicated. »!

Applications coupled!to a product  

« Relevant because they avoid unnecessary travels. »!

Page 60: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 60

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Analysis

Users understand!the applications

Page 61: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 61

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Analysis

The real-time aspect!is hard to grasp

Users understand!the applications

Page 62: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 62

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Analysis

The real-time aspect!is hard to grasp!

Users understand!the applications

Locations help!structuring thoughts!

Page 63: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 63

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Applications

State of the art!

2) Perception of mechanisms!

3) Perception of applications!

Experiments!

Descriptive model!

Research question #1!

1) Perception of interconnections!

Page 64: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 64

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Applications

State of the art!

2) Perception of mechanisms!

3) Perception of applications!

Experiments!

Descriptive model!

Research question #1!

1) Perception of interconnections!

Page 65: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 65

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Description of mechanisms

Deliver!content!

Page 66: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 66

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Description of mechanisms

Deliver!content!

Leverage!knowledge!

Page 67: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 67

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Description of mechanisms

Deliver!content!

Leverage!knowledge!

Shape!behaviors!

Page 68: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 68

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

A taxonomy of applications

Applications representing!

resources!

Page 69: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 69

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

A taxonomy of applications

Applications representing!

resources!

Applications augmenting!

products’ functions!

Page 70: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 70

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

A taxonomy of applications

Applications representing!

resources!

Applications augmenting!

products’ functions!

Applications automating!resources!

Page 71: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 71

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

A conceptual model

Applications representing!resources!

Applications augmenting!products’ functions!

Applications automatingles ressources!

Page 72: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 72

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

A conceptual model

Applications augmenting!products’ functions!

Applications representing!resources!

Applications automatingles ressources!

Page 73: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 73

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Research question #2!

1) Product design!

Operationalization!

Design principles!

2) Experiments!

3) Revised principles!

State of the art!

Products

Page 74: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 74

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Hyptohesis:! Designers need to modify the shape and the interactions of products to ensure the intelligibility of applications.!

How to make sure applications made visible to users?!

Are new design principle necessary?!

Research question #2

How to design products whose functions are augmented by applications? !

Page 75: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 75

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Research question #2!

1) Product design!

Operationalization!

Design principles!

2) Experiments!

3) Revised principles!

State of the art!

Products

Page 76: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 76

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Research question #2!

1) Product design!

Operationalization!

Design principles!

2) Experiments!

3) Revised principles!

State of the art!

Products

Page 77: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 77

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Definition of augmented products

Unique!identifier!

Self awareness!

Sociality!

Autonomy!

State-fulness!

  A computationally instrumented tangible object [...] providing supplementary services without compromising its original appearance and interaction metaphor significantly.!!!

Kawsar, 2009! ”!“!

Characteristics!

Page 78: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 78

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Taxonomy of augmented products

Digital!

Physical!

Creation!Modification!

APPROACH!

TYPE

OF

AU

GM

ENTA

TIO

N!

Page 79: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 79

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Taxonomy of augmented products

Smarter Object!Heun et al., 2013!

Digital modification  1  

Digital!

Physical!

Creation!Modification!

APPROACH!

TYPE

OF

AU

GM

ENTA

TIO

N!

Page 80: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 80

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Taxonomy of augmented products

Siftables!Merrill et al., 2007!

Surface creation  2  

Digital!

Physical!

Creation!Modification!

APPROACH!

TYPE

OF

AU

GM

ENTA

TIO

N!

Page 81: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 81

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Taxonomy of augmented products

Mediacup!Beigl et al., 2001!

Physical modification  

3  

Digital!

Physical!

Creation!Modification!

APPROACH!

TYPE

OF

AU

GM

ENTA

TIO

N!

Page 82: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 82

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Taxonomy of augmented products

Olinda!Schulze et al., 2008!

Product creation  

4  

Digital!

Physical!

Creation!Modification!

APPROACH!

TYPE

OF

AU

GM

ENTA

TIO

N!

Page 83: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 83

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Turning products into services

Information processing capabilities of products should be used as a design material. !

Redstrom, 2001, !Hallnäs et al., 2002, !

Kuniavsky, 2010!

”!“!

Boussard et al., 2011!

API!(REST)  

Semantic!description!

(OWL)  

End-user !representation !

(HTML)  

Page 84: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 84

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Research question #2!

1) Product design!

Operationalization!

Design principles!

2) Experiments!

3) Revised principles!

State of the art!

Products

Page 85: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 85

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Research question #2!

1) Product design!

Operationalization!

Design principles!

2) Experiments!

3) Revised principles!

State of the art!

Products

Page 86: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 86

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

A new phase in the design process

G: goal!F: functions!C: behavior!S: structure!

Traditional product   Augmented product  

G!

F!

B!

S!

G!

F!

B!

S!

G!

F!

B

FB!FBS!FBS!

SEC

ON

D P

HA

SE!

FIR

ST P

HA

SE!

Page 87: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 87

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

A new phase in the design process

G: goal!F: functions!C: behavior!S: structure!

Traditional product   Augmented product  

G!

F!

B!

S!

G!

F!

B!

S!

G!

F!

B

FB!FBS!FBS! FBS!

SEC

ON

D P

HA

SE!

FIR

ST P

HA

SE!

Page 88: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 88

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

A new phase in the design process

G: goal!F: functions!C: behavior!S: structure!

Traditional product   Augmented product  

G!

F!

B!

S!

G!

F!

B!

S!

G!

F!

B

FB!FBS!FBS!

SEC

ON

D P

HA

SE!

FIR

ST P

HA

SE!

Page 89: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 89

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Integrating applications into products

Functions (F)!

Page 90: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 90

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Integrating applications into products

Impact on functions!

Functions (F)!

Page 91: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 91

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Integrating applications into products

Impact on functions!

Impact on behavior!

Functions (F)!

Page 92: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 92

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Integrating applications into products

Impact on!functions!

Impact on!behavior!

Impact on!structure!

Functions (F)!

Page 93: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 93

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

The intelligibility of applications

Observability   Ability of users to evaluate the internal state of a system based on what can be observed.!

Coutaz, 2007!

Page 94: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 94

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

The intelligibility of applications

Observability  

Tracability  

Coutaz, 2007!

Ability of users to evaluate the internal state of a system based on what can be observed.!

Ability of users to observe the evolution of a system over time, but without being able to modify this evolution.!

Page 95: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 95

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

The intelligibility of applications

Observability  

Tracability  

Controllability   Ability of users to observe, trace, and intervene on the evolution of a system.!

Ability of users to observe the evolution of a system over time, but without being able to modify this evolution.!

Coutaz, 2007!

Ability of users to evaluate the internal state of a system based on what can be observed.!

Page 96: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 96

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Intelligibility criteria

Observe! Trace! Control!

Availability of!applications!

How many applications are deployed on the product?!

How to add or remove an application?!

Has the application been correctly added or removed?!

Status of applications!

Which applications are currently active?!

How to enable or disable an application?!

Has the application been correctly enabled or disabled?!

Scope of applications!

Which resources are currently being interconnected with the product?!

How to add, modify or delete interconnections between the product and other resources?!

Have interconnections been correctly added, modified or deleted?!

Inner-working!of applications!

Which mechanisms or parameters are currently tied to each application?!

How to modify the mechanisms or the parameters of an application?!

Which actions or functions have been triggered or modified?!

Potential!dysfunctions!

Are applications currently working well and compatible with each others?!

How to solve a conflict between two applications?!

Why do problems or bugs occur?!

Page 97: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 97

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Intelligibility criteria

Observe! Trace! Control!

Availability of!applications!

How many applications are deployed on the product?!

How to add or remove an application?!

Has the application been correctly added or removed?!

Status of applications!

Which applications are currently active?!

How to enable or disable an application?!

Has the application been correctly enabled or disabled?!

Scope of applications!

Which resources are currently being interconnected with the product?!

How to add, modify or delete interconnections between the product and other resources?!

Have interconnections been correctly added, modified or deleted?!

Inner-working!of applications!

Which mechanisms or parameters are currently tied to each application?!

How to modify the mechanisms or the parameters of an application?!

Which actions or functions have been triggered or modified?!

Potential!dysfunctions!

Are applications currently working well and compatible with each others?!

How to solve a conflict between two applications?!

Why do problems or bugs occur?!

Page 98: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 98

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Design spaces

Embodiment!

External representation!

Modular!Integrated!

REP

RES

ENTA

TIO

N!

OF

APP

LIC

ATIO

NS!

PRODUCT’S STRUCTURE!

Page 99: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 99

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

1  

Design spaces

Approach #1  

Embodiment!

External representation!

Modular!Integrated!

REP

RES

ENTA

TIO

N!

OF

APP

LIC

ATIO

NS!

PRODUCT’S STRUCTURE!

Mediation tool!

Functions!

Structure!

Behavior!

Page 100: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 100

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

2  

Design spaces

Approach #2  

Embodiment!

External representation!

Modular!Integrated!

REP

RES

ENTA

TIO

N!

OF

APP

LIC

ATIO

NS!

PRODUCT’S STRUCTURE!

Behavior!

Functions!

Structure!

Page 101: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 101

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

3  

Design spaces

Approach #3  

Embodiment!

Structure!

Modular!Integrated!

REP

RES

ENTA

TIO

N!

OF

APP

LIC

ATIO

NS!

PRODUCT’S STRUCTURE!

Behavior!

Functions!

Structure!

Page 102: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 102

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Research question #2!

1) Product design!

Operationalization!

Design principles!

2) Experiments!

3) Revised principles!

State of the art!

Products

Page 103: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 103

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Products

Research question #2!

1) Product design!

Operationalization!

Design principles!

2) Experiments!

3) Revised principles!

State of the art!

Page 104: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 104

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Research question #2!

1) Product design!

Operationalization!

Design principles!

2) Experiments!

3) Revised principles!

State of the art!

Products

Page 105: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 105

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Defining six applications

Agenda!Set up the time of the alarm based on a personal calendar!

Traffic!Set up the time of the alarm based on traffic.!

Applications modifying !the settings of the alarm!

Applications modifying !the way you wake up!

Applications triggered !after stopping the alarm!

Page 106: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 106

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Defining six applications

Radio!Turns on your favorite radio channel.!

Podcast!Downloads and plays a podcast.!

Applications modifying !the settings of the alarm!

Applications modifying !the way you wake up!

Applications triggered !after stopping the alarm!

Page 107: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 107

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Defining six applications

Facebook!Posts a status message when you stop the alarm.!

Weather!Reads the weather forecast of the day.!

Applications modifying !the settings of the alarm!

Applications modifying !the way you wake up!

Applications triggered !after stopping the alarm!

Page 108: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 108

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Exploring possible structures

Camille Lefer!Intern in 2011!

Page 109: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 109

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Prototyping

Robert Huynh!Intern 2012!

Camille Lefer!Intern in 2011!

Page 110: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 110

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Product 1: external representation of applications

Page 111: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 111

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Product 1: external representation of applications

Video available on  h"p://vimeo.com/67927011  

Page 112: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 112

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Product #2: embodiment of applications

Page 113: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 113

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Product #2: embodiment of applications

Video available on  h"p://vimeo.com/67927133  

Page 114: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 114

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Product #3: embodiment of applications

Page 115: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 115

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Product #3: embodiment of applications

Video available on  h"p://vimeo.com/67927254  

Page 116: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 116

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Research question #2!

1) Product design!

Operationalization!

Design principles!

2) Experiments!

3) Revised principles!

State of the art!

Products

Page 117: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 117

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Research question #2!

1) Product design!

Operationalization!

Design principles!

2) Experiments!

3) Revised principles!

State of the art!

Products

Page 118: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 118

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Perception of the shape and interactions of the product.!

Research question #2!

1) Product design!

Operationalization!

Design principles!

2) Experiments!

3) Revised principles!

State of the art!

Products

Page 119: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 119

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

List of tasks

Observe the configuration of the product.!Which applications are currently active?!

Tomorrow’s meeting has been canceled. Has the alarm time been modified?!

It is time to wake up. What will be today’s temperature?!

Configure the product in a way that only the following applications are active: […]!

Can the following applications run at the same time? […]!

Page 120: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 120

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

120

List of tasks

Observe the configuration of the product.!Which applications are currently active?!

Tomorrow’s meeting has been canceled. Has the alarm time been modified?!

It is time to wake up. What will be today’s temperature?!

Configure the product in a way that only the following applications are active: […]!

Can the following applications run at the same time? […]!

Page 121: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 121

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

List of tasks

Observe the configuration of the product.!Which applications are currently active?!

Tomorrow’s meeting has been canceled. Has the alarm time been modified?!

It is time to wake up. What will be today’s temperature?!

Configure the product in a way that only the following applications are active: […]!

Can the following applications run at the same time? […]!

Page 122: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 122

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

List of tasks

Observe the configuration of the product.!Which applications are currently active?!

Tomorrow’s meeting has been canceled. Has the alarm time been modified?!

It is time to wake up. What will be today’s temperature?!

Configure the product in a way that only the following applications are active: […]!

Can the following applications run at the same time? […]!

Page 123: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 123

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

List of tasks

Observe the configuration of the product.!Which applications are currently active?!

Tomorrow’s meeting has been canceled. Has the alarm time been modified?!

It is time to wake up. What will be today’s temperature?!

Configure the product in a way that only the following applications are active: […]!

Can the following applications run at the same time? […]!

Page 124: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 124

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

22 - 46 years old (m=33,28; σ=7,78) Researchers, PhD students and interns from Bell Labs

21! min!20!

User panel and procedure

min!15!+!(evaluation + interview)!

Page 125: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 125

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Results

0!20!40!60!80!

100!

Observe!

Visible !applications.!

22! sec! 35! sec! 24! sec!95,24%   71,43%   95,24%  

A familiar interface.!

Page 126: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 126

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Results

80,95%   83,33%   59,52%  

Trace!

Movements help tracing !the action.!

Lack of feedback.!

0!20!40!60!80!

100!

Page 127: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 127

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Results

97,61%   95,24%   100%  

Control!

22! sec! 38! sec! 20! sec!

0!20!40!60!80!

100!

Simple and intuitive interactions.!

Page 128: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 128

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Analysis

The embodiment of applications allows for direct interaction to be shaped

Page 129: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 129

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Analysis

The embodiment of applications allows for direct interaction to be shaped

The modular structure of products!reflects the dynamic aspect of applications

Page 130: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 130

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Analysis

The embodiment of applications allows for direct interaction to be shaped

Products still lack feedback

The modular structure of products!reflects the dynamic aspect of applications

Page 131: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 131

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Research question #2!

1) Product design!

Operationalization!

Design principles!

2) Experiments!

3) Revised principles!

State of the art!

Products

Page 132: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 132

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Products

Research question #2!

1) Product design!

Operationalization!

Design principles!

2) Experiments!

3) Revised principles!

State of the art!

Page 133: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 133

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Principles

Shape! Icons! Light! Actuation!

INTEGRATED STRUCTURE!

MODULAR STRUCTURE!

Page 134: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 134

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Principles

Shape! Icons! Light! Actuation! Skin! Shape-changes!

INTEGRATED STRUCTURE!

MODULAR STRUCTURE!

Page 135: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 135

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Principles

Radical atoms!Ishii et al., 2012.!

Shape-shifting interfaces!Rasmussen et al., 2012.!

Shape! Icons! Light! Actuation! Skin! Shape-changes!

INTEGRATED STRUCTURE!

MODULAR STRUCTURE!

Page 136: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 136

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Contributions

Descriptive model of applications!1  

<  

Description!of mechanisms!

Taxonomy of!product-oriented applications!

Conceptual model!

Page 137: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 137

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Contributions

Principles for the design of products!1   2  

Design process! Intelligibility criteria!

Design spaces!

Design principles!

<  

Descriptive model of applications!

Description!of mechanisms!

Taxonomy of!product-oriented applications!

Conceptual model!

Page 138: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 138

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Contributions

Coffee!spot!

Things !Lab!

Meeting!room!

+ other locations!

Artifacts or « physical hypothesis »!3   Frens, 2006!

Page 139: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 139

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Contributions

Resources!

3   Artifacts or « physical hypothesis »! Frens, 2006!

Coffee!spot!

Things !Lab!

Meeting!room!

+ other locations!

Page 140: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 140

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Next steps

Formalize!design methods!

Apply the design principles!

Develop appropriate software architecture!

Page 141: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 141

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Next steps

Open a discussion on !the future of products!

Formalize!design methods!

Apply the design principles!

Develop appropriate software architecture!

Page 142: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 142

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Towards shape-changing products

Functions/!applications!

Structure!

Page 143: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 143

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Towards shape-changing products

Maxime Nicoul, Pierre Méar, Yoann Jestin, Matthieu Laroche!

Jules Rattier, Cécile Fleuret, !Alexis Porhiel, Guillaume Faure,!Ge Wang!

Rahman Kalfane, Nadim Raad, !Faustine Bougro, Laure Charton!

Functions/!applications!

Structure!

http://vimeo.com/40607550! http://vimeo.com/40624601! http://vimeo.com/39879956!

Page 144: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 144

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

When applications define the structure of products

Augmented product   Composeable product    

G: goal!F: functions!C: behavior!S: structure!

G!

F!

B!

S F

B!

S!

G!

F

B!

G! G GFBS

FBS

FBS!FBS! FB!

Sx!

SEC

ON

D P

HA

SE!

FIR

ST P

HA

SE!

Page 145: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 145

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

When applications define the structure of products

G: goal!F: functions!C: behavior!S: structure!

Augmented product   Composeable product    

SEC

ON

D P

HA

SE!

FIR

ST P

HA

SE!

Page 146: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 146

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

When applications define the structure of products

G: goal!F: functions!C: behavior!S: structure!

Augmented product   Composeable product    

SEC

ON

D P

HA

SE!

FIR

ST P

HA

SE!

Page 147: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 147

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

§  Each chapter describes a step!of the research process.!

!§  Situating my pratice!

in existing theorical frameworks.!!

§  An opportunity to share !intuitions and propositions.!

!§  A choice to raise questions, explore and

discuss perspectives.!

Thesis

Page 148: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 148

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Papers

Workshop on Interacting with !Smart Objects!

Transactions !on Interactive !Intelligent Systems!

Workshop on !the Web of Things !

Embodying services into physical places: !towards the design of a mobile environment browser!Pierrick Thébault, Dominique Decotter, Mathieu Boussard, Monique Lu!

EnvB: An Environment-based Mobile Browser !for the Web of Things!Pierrick Thébault, Mathieu Boussard, Monique Lu, Cédric Mivielle, Simon Richir!!Towards the Design of Intelligible Object-based applications for the Web of Things!Pierrick Thébault, Dominique Decotter, Simon Richir!

International Journal !of Design and Innovation Research!

IJODIR Designing for the Ubiquitous Computing era: towards the reinvention of everyday objects and the creation of new user experiences!Pierrick Thébault, David Bihanic, Henri Samier, Simon Richir!!

Virtual Reality !International Conference!

The bridge between physical and digital worlds: implications for the design of Internet-enabled products!Pierrick Thébault, David Bihanic, Henri Samier, Simon Richir,!

Page 149: Designing for the Internet of Things : models and principles for augmented products

PIERRICK THEBAULT _ 31/05/2013 149

PRODUCT-ORIENTED APPLICATIONS AUGMENTED PRODUCTS PERSPECTIVES PAPERS CONTEXT & APPROACH

Thanks to

Fahim!Kawsar!

Natalie!Lehoux!

Jean-Baptiste!Labrune!

Robert !Huynh!

Camille !Lefer!

Dominique !Decotter!

Florentin !Rodio!

Alexis !Eve!

Cédric!Mivielle!

Arnaud!Gonguet!

Matthieu!Boussard!

Yann!Gasté!

Patrick!Legrand!

Lieven!Trappeniers!

Frédérique!Pain!

Bruno!Aidan!

Vincent!Hiribarren!

Fabrice Poussière!

Simon!Richir!

Henri!Samier!

David!Bihanic!

Thesis committee!

Team leaders!

Interns!

Social scientists!

Mentors!

Participants!

Page 150: Designing for the Internet of Things : models and principles for augmented products

models and principles for the !design of augmented products

Pierrick Thébault!

Designing for the!Internet of Things:!

LABORATOIRE ARTS ET METIERS PARISTECH D’ANGERS (LAMPA) - EQUIPE PRESENCE & INNOVATION

Thesis supervisor: Simon RICHIR!Co-supervisors: Henri SAMIER, David BIHANIC, Frédérique PAIN!

& ALCATEL-LUCENT – BELL LABS FRANCE