a general approach to Environment Design
23
a general approach to Environment Design Haoqi Zhang David Parkes Yiling Chen Krzysztof Gajos Eric Huang Harvard University School of Engineering and Applied Sciences
-
Upload
claudia-rivera -
Category
Documents
-
view
24 -
download
0
description
a general approach to Environment Design. Haoqi Zhang David Parkes Yiling Chen Krzysztof Gajos Eric Huang. Harvard University School of Engineering and Applied Sciences. Interested Party. Environment. Agent. I like couch. Interested Party. Environment. Agent. - PowerPoint PPT Presentation
Transcript of a general approach to Environment Design
a general approach to Environment Design
Haoqi ZhangDavid Parkes Yiling Chen Krzysztof Gajos Eric Huang
Harvard UniversitySchool of Engineering and Applied Sciences
Interested Party Environment Agent
I like couch
http://www.courier-journal.com/blogs/
poore/uploaded_images/
homer_running-754097.jpg
http://www.courier-journal.com/blogs/
poore/uploaded_images/
homer_running-754097.jpg
Interested Party Environment Agent
DONUTS!?
design environment desired behavior
design environment
actions
agent function
design environment
goal
actions
agent function
design environment
goal
?? ?
change environment
observe behavior
θtrue
environment actions
actionsenvironment
θtrue
θ'
desired actionsenvironment
θtrue
θ'environment
actual actionsenvironment
actions
θtrue
environment
actual actionsenvironment
actions
θtrue
environment
actual actionsenvironment
actions
Application to Amazon Mechanical Turk
# images
# tags
reward
time allotted expiration date
# of HITS
approval process
Design task Observe results
Automatic Task Design
Worker model
View Model Accept Model Effort model
post position,site activity
rateofviews
reward, work amount
% of accepts
reward, 1 / work amount
unit outputquality
Project is currently in pilot
θtrue
Environment Design in the real world
senselearn
modeloptimize
knowadapt
enhance
