Ubiquitous Computing Field Studies - parkjonghyuk.net
Transcript of Ubiquitous Computing Field Studies - parkjonghyuk.net
Table of contents
Introduction
Three Common Types of Field Studies
Current Behavior
Proof of Concept
Experience Using a Prototype
Study Design
What will Participants Do?
What Data Will You Collect?
How Long is Your Study?
Table of Contents 2
Introduction
People and their use of technology are the
center of ubiquitous computing
Various method to know Human Computer
Interaction.
This chapter describes Field Study.
Field study observe people in the real world
Trade-off is from realism is loss control over
the participant’s experience
Introduction 4
Three Common Types of Field Studies
Help you determine the research question
for your study
Think carefully about what you wish to learn
by conducting field study
Three common types are
Studies of current behavior
Proof-of-concept studies
Experience using a prototype
3 Common Type of Field Studies 6
Current Behavior (1 of 2)
Explores how people use existing
technology
Contribution : understanding of current
behavior and implications for future
technology
Research Questions : typically emphasize
how people use technology
3 Common Type of Field Studies 7
Current Behavior (2 of 2)
Example 1
Home Technology Sharing and use.
Research Question : How do families use and
share technology in their homes?
Example 2
Proximity of Users to Their Mobile Phones
(Phone Proximity)
Research Question : Is mobile phone a
suitable proxy for the owner’s location?
3 Common Type of Field Studies 8
Proof of Concept (1 of 2)
Develop novel technology or seek to
validate new algorithm and approaches
Contribution : Technological advance. Field
study is to validate the feasibility of an
approach or prototype
Research question : generally focus on
whether the prototype or algorithm
functions appropriately in a real
environment
3 Common Type of Field Studies 9
Proof of Concept (2 of 2)
Example 1:
Team Aware (Augmented basketball jersey)
Research Question: Are augmented jersey
usable and useful? Do people understand
the displays?
3 Common Type of Field Studies 10
Experience Using a Prototype (1 of 3)
Deploying Ubiquitous computing prototype
for longer period
Contribution : Experience of the people
using the prototype that not commercially
available. In some cases use Wizard of Oz.
Research question : focus on concept of
the prototype embodies or tests.
3 Common Type of Field Studies 11
Experience Using a Prototype (2 of 3)
Example 1:
CareNet, Ambient Display and sensed data
for elder care.
Hypothesis: Ambient displays can positively
impact the local members of an elder’s care
network
3 Common Type of Field Studies 12
Table of contents
Study Design
What will Participants Do?
Control Condition
What Data Will You Collect?
Logging
Surveys
Experience Sampling Methodology
Diaries
Interviews
Unstructured Observations
How Long is Your Study?
Study Design 14
What Will Participants Do? (1 of 2)
Depends on type of field study and
research question
Traditionally, researcher create hypothesis
Do the field study to reject the hypothesis
Identify variable called Independent
variable vary between Conditions in order
to understand the Dependent variable they
are measuring.
What will participants do 15
What Will Participants Do? (2 of 2)
The two main laboratory study designs are within-subjects and between-subjects
Within-subject design also called repeated measures design. Each participant experiences all condition.
Between-subject divide participants into different groups, typically randomly, each participant experiences only one condition.
Some studies use a mixed design where some independent variables are within-subjects and some are between-subjects
What will participants do 16
Control Condition
Measure the dependent variables for a
certain period before you introduce the
technology
To obtain baseline information about your
participants and their expectations.
However, collecting control data is not
appropriate for all ubicomp studies
What will participants do 17
Addition to deciding on your study method
If you are introducing new technology,
some considerations :
Will participants use the technology as they
wish or to complete specific tasks?
Will you give the participant technology to
use or augment the technology the
participant already owns?
Should you simulate any part of the
participant’s experience?
What will participants do 18
What Data Will You Collect
Quantitative data can be objectively
observed and represented numerically
Qualitative data helps understand what
people think and hopefully why people
behaved in certain ways during study
It is valuable to collect both quantitative
and qualitative data.
There are various methods for collecting
data (such as Logging, Surveys, etc)
What data will you collect 19
Logging
Often the main method for collecting
quantitative data about technology usage.
Prototype writes information to a data file.
Considerations for logging
How will you use the logged data?
Have you forgotten to log something
important?
Will your logging help you know if the study is
going smoothly?
What data will you collect 20
Surveys (1 of 2)
Often used to gather data before field
study begins (presurvey)
After any changes of condition in a
between subjects study (postcondition)
At the end of the study (postsurvey)
They may also be used at regular intervals
(e.g. a weekly survey).
Common types of survey question like
open-ended, multiple choice and likert
question
What data will you collect 21
Surveys (2 of 2)
Several factors to consider when creating
survey questions
Are the questions stated to allow both
positive and negative responses?
Are the questions clear to other?
Will the questions obtain the information
needed from participants?
What data will you collect 22
Experience Sampling Methodology
A technique borrowed from psychology.
Fill out questionnaires at various points
To get qualitative data
Considerations
How often should you ask participants to
answer question?
How many questions will you ask on each
survey?
Do you want to collect sensor data using ESM
techniques?
What data will you collect 23
Diaries
Participants are making diary entries
To get something that would not be possible to sense using ESM tool
Greater concerns about participation, because participant not carrying a device that interrupts them
Considerations
How will you remind participant to complete their diary entries?
How will you incent participants to complete their diary entries?
What data will you collect 24
Interviews & Unstructured Observation
To get qualitative data.
Researcher frequently use semi structured interview
Considerations
Are your questions phrased as neutrally as possible?
Are you prepared to take negative feedback without becoming defensive
When collecting data through observation, participants are observed as they engage in their normal lives.
What data will you collect 25
How Long Is Your Study?
No definitive answer. Considerations :
What type of study is it?
Do you expect novelty effects to be an issue?
How much work do participants have to do?
How frequently will participants use your
technology or engage in the behavior you
are trying to study?
How many times during the study will you
interact with participants?
How long is your study 26