January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook...

36
January 2008 1 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook [email protected] http://eecs.wsu.edu/~cook

Transcript of January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook...

Page 1: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

January 2008 1

Smart Environments:Artificial Intelligence in the Home and Beyond

Diane J. [email protected]

http://eecs.wsu.edu/~cook

Page 2: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

BodyNets Topics

2

Smart Environments

Both generate largeamounts of data

Both need:

• data mining• prediction• classification / identification

Page 3: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

What Is a Smart Environment?

An environment able to acquire and apply knowledge about the resident and the physical surroundings to improve the resident’s experience.

Page 4: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Imagine…

Face recognition, automated door entry

Smart sprinklers

Lighting control

Door/lock controllers,Surveillance system

Robot vacuum cleaner

Robot lawnmower

Intelligent appliancesClimate control

Automated blinds

Remote site monitoring and control

Page 5: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

What Good Is a Smart Environment?

• Comfort and Productivity

• Health and Safety

• Energy and Sustainability

Page 6: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Our Initial Hypothesis

Resident interactions with smart environments can be automatedby analyzing and predicting resident behavior and using the informationto learn an automation model.

Page 7: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Smart Apartment

Page 8: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Smart Workplace

Page 9: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Technology

Perception

Sensornetwork

Off-the-shelfsensors

Action

PLC

Sensornetwork

ReasonData miningPrediction

Decision makerRule engine

Page 10: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Data Mining

Raw data

2005-01-03 09:47:30 i 5 1 100 mavpad2005-01-03 09:47:30 i 5 1 100 mavpad2005-01-03 09:56:17 i 5 0 0 mavpad2005-01-03 09:56:17 i 5 0 0 mavpad2005-01-03 13:04:45 a 1 1 100 mavpad2005-01-03 13:04:45 a 1 1 100 mavpad2005-01-03 13:05:37 i 3 1 2005-01-03 13:05:37 i 3 1 100 mavpad mavpad2005-01-03 13:06:11 c 4 1 100 mavpad2005-01-03 13:06:11 c 4 1 100 mavpad2005-01-03 13:06:22 c 4 0 0 mavpad2005-01-03 13:06:22 c 4 0 0 mavpad2005-01-03 13:16:33 S 19 1 100 mavpad2005-01-03 13:16:33 S 19 1 100 mavpad2005-01-03 13:16:33 S 70 1 100 mavpad2005-01-03 13:16:33 S 70 1 100 mavpad2005-01-03 13:16:34 i 5 1 100 mavpad2005-01-03 13:16:34 i 5 1 100 mavpad2005-01-03 13:16:44 i 3 0 0 mavpad2005-01-03 13:16:44 i 3 0 0 mavpad……

Patterns

% Turn on kitchen light when in room [PRODUCTION_PATTERN]ID = 560086344 V_19_1 V_19_0 i_1_1 x_0_0NumberOccurrences = 5V_19_1 V_19_0 V_19_1 V_19_0…x_0_0 1

% Kitchen Activities[ABSTRACT_PATTERN]ID = 549644 1487735365 1487712271 56008634 100100NumberOccurrences = 11487735365 1487712271 56008634 100100 1

101000101101000…101000101101000…

Page 11: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Prediction

•Parse sensor events using text compression

•Given recent history, predict next symbol (sensor event) with highest probability

a (5) b(4) d(2)c(1)

b(2)a (2)

c(1)a (1)

c(1)b(2)a (1)

a (1)

“aaababbbbbaabccddcbaaaa”

Page 12: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Decision Model

• Learn hierarchical model from data

• Learn automation rules with user and rule engine feedback

Page 13: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Results - Workplace

Page 14: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Results - Apartment

Page 15: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Prototype Smart Apartment

Page 16: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

What Good Is a Smart Environment?

• Comfort and Productivity

• Health and Safety

• Energy and Sustainability

Page 17: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

The Crisis of an Aging Population

Page 18: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

The Crisis for Individuals

Page 19: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Financial Impact

Page 20: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

10 / 2 / 15

• If we can keep 10% of population home 2 years longer, we will save Washington State $341 million/year

• $15 billion/year nationally

Page 21: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Mission

• Our vision is to keep older adults functioning independently in their own homes as long as possible.

• Our method integrates artificial intelligence, machine learning, and pervasive computing technologies into their everyday environments, turning them into smart environments.

Page 22: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

What Assistance Is Needed?

NowNowNowNow PartialPartialPartialPartial FutureFutureFutureFuture

Page 23: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Activities of Daily Living (ADL) Technology

23

Page 24: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Sense

Page 25: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Identify

Page 26: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

MotionMotion11

ENDEND

MotionMotion22

MotionMotion33

WateWaterrOnOn

MotionMotion44

WateWaterrOffOff

0.4

0.6

1.0

1.0 1.0

0.1 1.0

0.9

Model

P(“wash hands” | [Motion 1, Motion 3, Water On, Water Off]) = 0.54

P(“cooking” | [Motion 1, Motion 3, Water On, Water Off]) = ?

Page 27: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Remind

Page 28: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Remind• Medicine compliance

Page 29: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Assist

29

0

0.5

1

1.5

2

2.5

3

Voice / HandDisability

Page 30: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Assess

Page 31: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

What Good Is a Smart Environment?

• Comfort and Productivity

• Health and Safety

• Energy and Sustainability

31

Page 32: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Load Profiling for Smart Home

Page 33: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Energy-Efficient Automation

Page 34: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

Smart Communities

Page 35: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

What’s Next?

35

Page 36: January 20081 Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook cook@eecs.wsu.edu cook.

To Learn More

36

http://eecs.wsu.edu/[email protected]