Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional...

38
Ambient Learning Displays Distributed Mixed Reality Information Mash-ups to support Ubiquitous Learning Dirk Börner Promotor: Prof. Dr. Marcus Specht Supervisor: Dr. Marco Kalz

Transcript of Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional...

Page 1: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Ambient Learning DisplaysDistributed Mixed Reality Information Mash-ups to

support Ubiquitous Learning

Dirk Börner

Promotor: Prof. Dr. Marcus SpechtSupervisor: Dr. Marco Kalz

Page 2: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Background

• Mobile Technologies + Ubiquitous Connectivity + Pervasive Functionalityare changing the conditions for lifelong and non-formal learning

• Rethinking the relationship of environment, technology, and learning to build a bridge between different contexts and situations learners are operating in

Learning

Lifelong

Ubiquitous

Mobile

AuthenticSituated

Page 3: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Background

• Mobile Technologies + Ubiquitous Connectivity + Pervasive Functionalityare changing the conditions for lifelong and non-formal learning

• Rethinking the relationship of environment, technology, and learning to build a bridge between different contexts and situations learners are operating in

Learning

➡ Interdisciplinary approach to explore the potentials of mobile and pervasive technologies to support ubiquitous learning in authentic situations

Lifelong

Ubiquitous

Mobile

AuthenticSituated

Page 5: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Research FocusUbiquitous Learning

PermanencyAccessibilityAdaptability

ImmediacyInteractivity

Situatedness

Mobile TechnologiesPervasive Functionality

LearningEnvironments

UbiquitousLearning

Environments

[Ogata & Yano, 2004]

Page 6: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Research FocusUbiquitous Learning

Information

Interaction

Instruction

PermanencyAccessibilityAdaptability

ImmediacyInteractivity

Situatedness

Mobile TechnologiesPervasive Functionality

LearningEnvironments

UbiquitousLearning

Environments

[Ogata & Yano, 2004]

Page 7: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Information

Research FocusInformation, Interaction, Instruction

• Support and assist learners to enable them to navigate more efficiently through information and find the right information in any given situation

ProductionEnrichment

Mash-UpsAwareness

Context

Page 8: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Mixed Reality

Information

Research FocusInformation, Interaction, Instruction

• Support and assist learners to enable them to navigate more efficiently through information and find the right information in any given situation

ProductionEnrichment

Mash-UpsAwareness

• Move the information off the screen into the physical environment and make use of the entire physical environment as an interface

InteractionModalities Ambient

Embodied

Context

Page 9: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Mixed Reality

Information

Research FocusInformation, Interaction, Instruction

• Support and assist learners to enable them to navigate more efficiently through information and find the right information in any given situation

ProductionEnrichment

Mash-UpsAwareness

• Move the information off the screen into the physical environment and make use of the entire physical environment as an interface

InteractionModalities Ambient

Embodied

• Support the learning process in the physical environment where it is happening and enable learners to construct knowledge as a personal, social, and environmental process

Instruction

Knowledge

Situated

Authentic

Context

Support

Page 10: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Research Questions

Problem: Ubiquitous learning is not supported in its situatedness, authentic context, and social dependencies. Although ubiquitous learning environments offer a variety of display and interaction modalities learners are confronted with missing awareness indicators reflecting the available learning support in their current environment.

Page 11: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Research Questions

Which methods of interaction and information presentation can be used to create awareness in ubiquitous learning environments?

Which sensors, displays, and artefacts can be used and

how must they be aggregated, filtered, and implemented in

ubiquitous learning environments?

Which types of digital content can support learning in ubiquitous

learning environments? How can these content be condensed to

create meaningful mash-ups?

How are the awareness methods assimilated and perceived in

ubiquitous learning environments and what are the implications

for the design?

Problem: Ubiquitous learning is not supported in its situatedness, authentic context, and social dependencies. Although ubiquitous learning environments offer a variety of display and interaction modalities learners are confronted with missing awareness indicators reflecting the available learning support in their current environment.

Does the utilization of contextualized digital content support and enhance the learning experience in ubiquitous learning environments and what are the effects?

Page 12: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Research Questions

Problem: Ubiquitous learning is not supported in its situatedness, authentic context, and social dependencies. Although ubiquitous learning environments offer a variety of display and interaction modalities learners are confronted with missing awareness indicators reflecting the available learning support in their current environment.

Which information is relevant for learners in authentic learning situations within ubiquitous learning environments and how can this information be obtained and aggregated?

How can ambient interaction modalities improve the availability and accessibility of this information within ubiquitous learning environments?

Is the improved availability and accessibility of relevant

information an effective support in authentic learning situations?

Page 13: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Research Questions

Problem: Ubiquitous learning is not supported in its situatedness, authentic context, and social dependencies. Although ubiquitous learning environments offer a variety of display and interaction modalities learners are confronted with missing awareness indicators reflecting the available learning support in their current environment.

Which information is relevant for learners in authentic learning situations within ubiquitous learning environments and how can this information be obtained and aggregated?

How can ambient interaction modalities improve the availability and accessibility of this information within ubiquitous learning environments?

Is the improved availability and accessibility of relevant

information an effective support in authentic learning situations?

➡ What are the learning effects of ambient information presentation in a situated learning context within ubiquitous learning environments?

Page 14: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Research Objectives

Support learners in authentic learning situations within ubiquitous learning environments: establish the awareness for information relevant for situated learning, examine the personal, social, and environmental

sense-making process facilitated through ambient information presentation, evaluate the situated learning support in authentic learning situations on

its effectiveness for learning, especially to solve problems in context.

Ambient Learning Displays

Page 15: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Research Objectives

Support learners in authentic learning situations within ubiquitous learning environments: establish the awareness for information relevant for situated learning, examine the personal, social, and environmental

sense-making process facilitated through ambient information presentation, evaluate the situated learning support in authentic learning situations on

its effectiveness for learning, especially to solve problems in context.

Ambient Learning Displays

Define functional requirements for a ubiquitous learning support framework: give suggestions and provide guidelines for the design and implementation of future ambient systems and applications for learning.

Page 16: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Conceptual Framework

Types of Awareness for Ubiquitous Learning[Ogata, 2009]

Page 17: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Conceptual Framework

[Specht, 2009]Ambient Information Channels (AICHE)

Page 18: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Conceptual Framework[Pousman and Stasko, 2006]

Design Dimensions of Ambient Systems

Page 19: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Conceptual Framework[Anderson and Krathwohl et al., 2001]

Revised Taxonomy of Educational Objectives

Page 20: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Conceptual Framework

Physical World(Real Environment)

Digital World(Virtual Environment)

Ubiquitous Learning Environment

Page 21: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Conceptual Framework

Physical World(Real Environment)

Digital World(Virtual Environment)

Ubiquitous Learning Environment

SocialWorkspace Task Knowledge Context Concept

Awareness

Page 22: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Conceptual Framework

Physical World(Real Environment)

Digital World(Virtual Environment)

Ubiquitous Learning Environment

Ambient Information Channels

Auditory HapticVisual

SocialWorkspace Task Knowledge Context Concept

Awareness

Page 23: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Conceptual Framework

Physical World(Real Environment)

Digital World(Virtual Environment)

Ubiquitous Learning Environment

Ambient Information Channels

Auditory HapticVisual

SocialWorkspace Task Knowledge Context Concept

Awareness

Page 24: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Conceptual Framework

Physical World(Real Environment)

Digital World(Virtual Environment)

Ubiquitous Learning Environment

Ambient Information Channels

Auditory HapticVisual

SocialWorkspace Task Knowledge Context Concept

Awareness

Remember Understand Apply Analyze Evaluate Create

Ambient Learning Displays

Page 25: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Research DesignLiterature Review

Scenarios

Characteristics

Educational Objectives

Design Patterns

Evaluation

Theoretical Framwork

Literature Review

Expert Study Concept Mapping

Educational Problems Contextual Cluster

Mobile and Ubiquitous Learning

Ambient Displays

AmbientLearningDisplays

Learning Taxonomy

Information Awareness

Ambient Displays

AICHE

Learning?

Evaluation?

Page 26: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Research DesignLiterature Review

!

Page 27: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Research DesignMethodology

CognitiveProcess

Dimension

AmbientDesign

Dimensions

InformationCapacity

NotificationLevel

RepresentationalFidelity

AestheticEmphasis

high

somewhathigh

medium

somewhatlow

low (ignore)user pull

changeblind

makeaware

interrupt

demandattention

symbolic(abstract)

symbolic

iconic(methaphors)

iconic

indexical high

somewhathigh

medium

somewhatlow

low

RememberUnderstand

Page 28: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Research DesignMethodology

CognitiveProcess

Dimension

AmbientDesign

Dimensions

InformationCapacity

NotificationLevel

RepresentationalFidelity

AestheticEmphasis

high

somewhathigh

medium

somewhatlow

low (ignore)user pull

changeblind

makeaware

interrupt

demandattention

symbolic(abstract)

symbolic

iconic(methaphors)

iconic

indexical high

somewhathigh

medium

somewhatlow

low

RememberUnderstandApplyAnalyze

Page 29: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Research DesignMethodology

CognitiveProcess

Dimension

AmbientDesign

Dimensions

InformationCapacity

NotificationLevel

RepresentationalFidelity

AestheticEmphasis

high

somewhathigh

medium

somewhatlow

low (ignore)user pull

changeblind

makeaware

interrupt

demandattention

symbolic(abstract)

symbolic

iconic(methaphors)

iconic

indexical high

somewhathigh

medium

somewhatlow

low

RememberUnderstandApplyAnalyzeEvaluateCreate

Page 30: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Research DesignMethodology

CognitiveProcess

Dimension

AmbientDesign

Dimensions

InformationCapacity

NotificationLevel

RepresentationalFidelity

AestheticEmphasis

high

somewhathigh

medium

somewhatlow

low (ignore)user pull

changeblind

makeaware

interrupt

demandattention

symbolic(abstract)

symbolic

iconic(methaphors)

iconic

indexical high

somewhathigh

medium

somewhatlow

low

RememberUnderstandApplyAnalyzeEvaluateCreate

Page 31: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Research DesignMethodology

CognitiveProcess

Dimension

AmbientDesign

Dimensions

InformationCapacity

NotificationLevel

RepresentationalFidelity

AestheticEmphasis

high

somewhathigh

medium

somewhatlow

low (ignore)user pull

changeblind

makeaware

interrupt

demandattention

symbolic(abstract)

symbolic

iconic(methaphors)

iconic

indexical high

somewhathigh

medium

somewhatlow

low

RememberUnderstandApplyAnalyzeEvaluateCreate

Page 32: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Research DesignMethodology

CognitiveProcess

Dimension

AmbientDesign

Dimensions

InformationCapacity

NotificationLevel

RepresentationalFidelity

AestheticEmphasis

high

somewhathigh

medium

somewhatlow

low (ignore)user pull

changeblind

makeaware

interrupt

demandattention

symbolic(abstract)

symbolic

iconic(methaphors)

iconic

indexical high

somewhathigh

medium

somewhatlow

low

RememberUnderstandApplyAnalyzeEvaluateCreate

Page 33: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Research DesignMethodology

CognitiveProcess

Dimension

AmbientDesign

Dimensions

InformationCapacity

NotificationLevel

RepresentationalFidelity

AestheticEmphasis

high

somewhathigh

medium

somewhatlow

low (ignore)user pull

changeblind

makeaware

interrupt

demandattention

symbolic(abstract)

symbolic

iconic(methaphors)

iconic

indexical high

somewhathigh

medium

somewhatlow

low

RememberUnderstandApplyAnalyzeEvaluateCreate

DashboardAudio SignalMessenger

Page 34: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Research DesignMethodology

CognitiveProcess

Dimension

AmbientDesign

Dimensions

InformationCapacity

NotificationLevel

RepresentationalFidelity

AestheticEmphasis

high

somewhathigh

medium

somewhatlow

low (ignore)user pull

changeblind

makeaware

interrupt

demandattention

symbolic(abstract)

symbolic

iconic(methaphors)

iconic

indexical high

somewhathigh

medium

somewhatlow

low

RememberUnderstandApplyAnalyzeEvaluateCreate

➡ Which domain? MathematicsEcological FactsSocial Game

DashboardAudio SignalMessenger

➡ Evaluation technique?

Experience Sampling Method

Page 35: Ambient Learning Displays - COnnecting REpositories · Ambient Learning Displays Define functional requirements for a ubiquitous learning support framework: give suggestions and provide

Thank you!

Dirk Börner

tel: +31 45576 2506skype: dirk_boerneremail: [email protected]

Valkenburgerweg 1776419 AT HeerlenThe Netherlands