a general approach to Environment Design

Haoqi ZhangDavid Parkes Yiling Chen Krzysztof Gajos Eric Huang

Harvard UniversitySchool of Engineering and Applied Sciences

Interested Party Environment Agent

I like couch

http://www.courier-journal.com/blogs/

poore/uploaded_images/

homer_running-754097.jpg

http://www.courier-journal.com/blogs/

poore/uploaded_images/

homer_running-754097.jpg

Interested Party Environment Agent

DONUTS!?

design environment desired behavior

design environment

actions

agent function

design environment

goal

actions

agent function

design environment

goal

?? ?

change environment

observe behavior

θtrue

environment actions

actionsenvironment

θtrue

θ'

desired actionsenvironment

θtrue

θ'environment

actual actionsenvironment

actions

θtrue

environment

actual actionsenvironment

actions

θtrue

environment

actual actionsenvironment

actions

Application to Amazon Mechanical Turk

# images

# tags

reward

time allotted expiration date

# of HITS

approval process

Design task Observe results

Automatic Task Design

Worker model

View Model Accept Model Effort model

post position,site activity

rateofviews

reward, work amount

% of accepts

reward, 1 / work amount

unit outputquality

Project is currently in pilot

θtrue

Environment Design in the real world

senselearn

modeloptimize

knowadapt

enhance

hq@eecs.harvard.edu

thanks!