ReBot: a Recommendation Robot as a Fundamentally Distinct Approach towards Complexity

.

Social Robotics

Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 2/27...

2/27

.

Social Robotics is ...• ... when robots replace people in social networks


3/27

.

.... that was a JOKE! (in case you have not figured it out)


4/27

.

(the real) Social Robotics

02 E.Berger+4 "Inferring Guidance Information in Cooperative Human-Robot Tasks" HUMANOIDS (2013)


5/27

.

Social Robotics in a Nutshell.The Problem.....

.... is that search space in a robot's decision making process is too big

.

... The Solution...

..

.

... is to reduce search space via social interactions betweenrobots and humans

• a fundamentally distinct approach to robotics 02 04 05

• social robotics is a new area 03 07, but tradition is still strong 06

• this paper: the same basic idea applied to software automation02 E.Berger+4 "Inferring Guidance Information in Cooperative Human-Robot Tasks" HUMANOIDS (2013)

04 A.Thomas+1 "Reinforcement Learning with Human Teachers..." 21st AAAI (2006)

05 H.Suay+1 "Effect of Human Guidance and State Space Size ...." IEEE RO-MAN (2011)

03 W.Knox+2 "Training a Robot via Human Feedback: A Case Study" Social Robotics (2013)

07 B.Mutlu+4 "Social Robotics" Springer LNAI vol.7072 (2011)

06 P.Corke+0 "Robotics, Vision and Control" Springer (2011)


6/27

.

Hardware vs Software Robots


7/27

.

Software Robots: the Missing Topic

01 "Software Robots: The Long Tail of Automation" http://www.wired.com (2013)


8/27

.

Robots and ReBots as Complexity• software robots (rebots) are all about knowledge management• note: the same basic approach can be applied both to hardware and software

A very complex system

A less complex system

Tell what to do

Robot

Human

Search the space

Robot

Human

Search the space What

should I do?

Guide through feedback


9/27

.

The Hardware and Software Stories

1. hardware: we always know exactly what the job is◦ software: we know the data, but we do not know what knowledge it contains

2. hardware: training is difficult because robots make decisions(humans are guides)◦ software: training it easy since humans make decisions◦ ... but robots have to visualize the outcome properly

3. hardware: long-term jobs are rare -- tasks are normally specific and now◦ software: long-term, even continuous, is the intended mode of operation◦ hence the ReBot -- recommendation bot is possible◦ recommendations can take time to be generated


10/27

.

Similarities and Differences• ReBot is centered around a classification problem 08

• ReBots do not have or need eyes

• ReBots are dumb, humans make decision

Generic Use

Teaching, Guidance Reasoning

Human Role

Social Robotics

Wide range of behavior

Reinforced Learning

YES. Vision, recognition Guide only

The Rebot (proposal)

Any kind of context

Bayesian Classification

NO Not needed

Guide and decision - maker

08 C.Manning+3 "Introduction to Information Retrieval" Cambridge University Press (2008)


11/27

.

ReBot the Recommendation Bot


12/27

.

ReBot versus Tradition• in a way, ReBot is an ideal context manager -- compared to existing tools 09

• note: multiple items is when more than one item are linked by some kind ofstructure -- ReBots use metromaps 11

Multiple Items? Visual?

Underlying Structure? Learning?

Traditional Search NO NO NO NO

Facetted Search NO NO YES NO

Advanced Tools / Others NO YES YES YES

Rebot (the proposal) YES YES YES YES

09 M.Mas+0 "Faceted semantic search for personalized social search" Cornell University (2011)

11 K.Nesbitt+0 "Getting to more abstract places using the metro map metaphor" IV Conf. (2004)


13/27

.

ReBot: Components

Rebot

(careless) Input

Human Human

{structure }

(pinpoint) Select

Browse (or use otherwise)

Some Knowledge

(folksonomies, knowledge bases, databases, indexes, ontologies, etc.)

(metromaps )


14/27

.

ReBot: Where is The Originality?

1. folksonomy-style input is OK

◦ folksonomy means (1) many contributors, (2) no rules, (3) careless input 10

2. metromaps as the best visual interface 12

◦ traditional research only uses graphs,, metromaps are very very different◦ new layout engines are proposed -- out of scope here 13

3. recommendation engine based on classification -- hence the ReBot◦ classes are based on trains and stations in metromaps

4. social scalability 10

◦ allowing for large-scale social collaboration on publically shared metromaps

10 myself+0 "MetroMaps versus Facets: What Exactly is the Ontological Context?" IEICE AI研究会 (November 2013)

12 myself+0 "...the Most Cost Effective Method in Browser-Based Visualizations..." IIEEJ Visual Computing Workshop (2013)

13 myself "Rebot Project Page" http://www.github.com/maratishe/rebot (current)


15/27

.

ReBot: Simple Implementation


16/27

.

ReBot: Simple Implementation

• the simple design is:

1. learning during input via recommendation and feedback

• on input, ReBot recommends which trains to assign your paper to• you provide feedback by (possibly) picking an unexpected order

2. classification design which would make sure that ReBot getsbetter with time• Naive Bayes classifier is used

• but the design is unusual -- one item can belong to multiple classes

• next page shows that the engine gets better with time

3. build a great visual interface based onmetromaps and rings• metromaps: the traditional concept of metromaps

• rings: simpler 3D visual aggregates of items


17/27

.

ReBot Part 1: Folksonomical Input• (1) read the item, (2) select tags from the order recommended by ReBot, (3) letReBot learn from your selection -- not all assignments need learning

1

2

2

3 3


18/27

.

ReBot Part 2: Recommendation

0 5.2 10.4 15.6 20.8 26Time/Learning Sequence

0

4

8

12

16

20

Rebo

t Ord

er o

f Use

r Sel

ectio

n


19/27

.

ReBot Part 3: Visual Interface• note: layouts are non-traditional 13 -- more suited to browser viewing

• note 2: rings are simplified metromaps -- like Tokyo city with its Yamanote ring

13 myself "Rebot Project Page" http://www.github.com/maratishe/rebot (current)


20/27

.

ReBot.Papers: A Working Example


21/27

.

ReBot.Papers: The Objective

• a ReBot which wouldmanage my papers◦ in submission, rejected, passed, ...

• a very powerful visual browsing function -- metromaps

• ReBot would recommend new stuff◦ similar papers in the Internet, references, etc.◦ recommendation to add more papers to the same train◦ recommendations for a more optimal metromaps for my papers


22/27

.

ReBot.Papers: Smarter Interface• sorry, will omit small details ... but will show a demo!

Surface

Rebot Human

Knowledge Base (the data itself)

Maintain

Selectors (trains) Write

The Raw Metromap (papers)

Metromap (groupings) Create

Browse Depth


23/27

.

Next Step: Collaborating ReBots


24/27

.

ReBot in the Cloud• the screenshot: ReBot implemented asChrome Extension• with cloud storage there is no need for web servers -- APIs aresufficient

• makes large-scale collaboration possible -- same for recommendations, etc.

Places/members

Knowledge(in the wild)

{structure} (shared access)

Cloud Storage

Visual interface

Crawl, recommend,

maintain


25/27

.

Wrapup

• software robots are proposed as recommendation bots◦ share the basic idea with social robotics

• simple design and a more complex working example are presented

• the socially scalable version is on its way


26/27

.

That’s all, thank you ...


27/27

.

[01] (2013)Software Robots: The Long Tail of Automationhttp://www.wired.com

[02] E.Berger+4 (2013)Inferring Guidance Information in Cooperative Human-Robot TasksHUMANOIDS

[03] W.Knox+2 (2013)Training a Robot via Human Feedback: A Case StudySocial Robotics

[04] A.Thomas+1 (2006)Reinforcement Learning with Human Teachers...21st AAAI

[05] H.Suay+1 (2011)Effect of Human Guidance and State Space Size ....IEEE RO-MAN

[06] P.Corke+0 (2011)Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 27/27

...

27/27

.

Robotics, Vision and ControlSpringer

[07] B.Mutlu+4 (2011)Social RoboticsSpringer LNAI vol.7072

[08] C.Manning+3 (2008)Introduction to Information RetrievalCambridge University Press

[09] M.Mas+0 (2011)Faceted semantic search for personalized social searchCornell University

[10] myself+0 (November 2013)MetroMaps versus Facets: What Exactly is the Ontological Context?IEICE AI研究会

[11] K.Nesbitt+0 (2004)Getting to more abstract places using the metro map metaphor


27/27

.

IV Conf.

[12] myself+0 (2013)...the Most Cost Effective Method in Browser-Based Visualizations...IIEEJ Visual Computing Workshop

[13] myself (current)Rebot Project Pagehttp://www.github.com/maratishe/rebot

[14] myself (current)Graphviz: Graph Visualization Softwarehttp://www.graphviz.org/


27/27

ReBot: a Recommendation Robot as a Fundamentally Distinct Approach towards Complexity

Technology

Transcript of ReBot: a Recommendation Robot as a Fundamentally Distinct Approach towards Complexity