Smart M3-Based Robot Interaction Scenario for Coalition Work · Alexander Smirnov, Alexey...

15
August 24-26, 2016. Budapest, Hungary Smart M3-Based Robot Interaction Scenario for Coalition Work Alexander Smirnov, Alexey Kashevnik, Sergey Mikhailov, Mikhail Mironov, Mikhail Petrov St.Petersburg Institute for Informatics and Automation RAS (SPIIRAS), Russia ITMO University, St.Petersburg, Russia

Transcript of Smart M3-Based Robot Interaction Scenario for Coalition Work · Alexander Smirnov, Alexey...

Page 1: Smart M3-Based Robot Interaction Scenario for Coalition Work · Alexander Smirnov, Alexey Kashevnik, Sergey Mikhailov, Mikhail Mironov, Mikhail Petrov St.Petersburg Institute for

August 24-26, 2016. Budapest, Hungary

Smart M3-Based Robot InteractionScenario for Coalition Work

Alexander Smirnov, Alexey Kashevnik, Sergey Mikhailov,Mikhail Mironov, Mikhail Petrov

St.Petersburg Institute for Informatics and Automation RAS (SPIIRAS), RussiaITMO University, St.Petersburg, Russia

Page 2: Smart M3-Based Robot Interaction Scenario for Coalition Work · Alexander Smirnov, Alexey Kashevnik, Sergey Mikhailov, Mikhail Mironov, Mikhail Petrov St.Petersburg Institute for

Table of Contents

l Motivationl Introductionl Scenario Descriptionl Proposed Approachl Implementationl Conclusion

2

Page 3: Smart M3-Based Robot Interaction Scenario for Coalition Work · Alexander Smirnov, Alexey Kashevnik, Sergey Mikhailov, Mikhail Mironov, Mikhail Petrov St.Petersburg Institute for

Motivation

3

Source: McKinsey Global Institute, Report MGI “Disruptive technologies: Advances that willtransform life, business, and the global economy” (May 2013). http://www.mckinsey.com/insights/business_technology/disruptive_technologies

Page 4: Smart M3-Based Robot Interaction Scenario for Coalition Work · Alexander Smirnov, Alexey Kashevnik, Sergey Mikhailov, Mikhail Mironov, Mikhail Petrov St.Petersburg Institute for

Introduction:Cyber-Physical-Social Systems

4

RobotsRobots

PersonalMobile Devices

Planningresources

PhysicalSpace Information

Space

People

Control resourcesControlresources

SocialSpace

Page 5: Smart M3-Based Robot Interaction Scenario for Coalition Work · Alexander Smirnov, Alexey Kashevnik, Sergey Mikhailov, Mikhail Mironov, Mikhail Petrov St.Petersburg Institute for

Scenario Description

5

MobileRobot

MobileRobot

Letter2Letter1

Letter3

Letter4

ИТМО

Userinterfaceforwordspecification

Userinterfaceforcolorsdetermination

Page 6: Smart M3-Based Robot Interaction Scenario for Coalition Work · Alexander Smirnov, Alexey Kashevnik, Sergey Mikhailov, Mikhail Mironov, Mikhail Petrov St.Petersburg Institute for

Smart-M3 Platform Description

l Smart-M3 includes:l SIB: Devices and software entities (applications) can publish their

embedded information for other devices and software entities through simple, shared Semantic Information Brokers.

l The interface for managing information in the SIB is provided by Knowledge Processors (KP)

l The understandability of information is based on the usage of the common RDF ontology models and common data formats.

6

Smart Space

SIB

Knowledge Base

(RDF Store)

Application

Application

KP

RDF Ontology

KP

RDF Ontology

l Smart-M3 allows user KP to:l add,l remove,l change, andl subscribe,

on information in SIB.

Ontology Matching

Ontology Matching

Page 7: Smart M3-Based Robot Interaction Scenario for Coalition Work · Alexander Smirnov, Alexey Kashevnik, Sergey Mikhailov, Mikhail Mironov, Mikhail Petrov St.Petersburg Institute for

Approach: Ontology-Based Robots Interaction in Smart Space

7

Physical Space

Social Space

Mobile Application

Cyber Space

Computation Service

Smart M3 Space

Robot Control Service

Robot Control Service

Page 8: Smart M3-Based Robot Interaction Scenario for Coalition Work · Alexander Smirnov, Alexey Kashevnik, Sergey Mikhailov, Mikhail Mironov, Mikhail Petrov St.Petersburg Institute for

8

Lego® Mindstorms EV3 Kit

Large motor

Large motor

Main block

Medium motor

Ultrasonic sensor

Touch sensor

Gyroscopic sensor

Color sensor

Page 9: Smart M3-Based Robot Interaction Scenario for Coalition Work · Alexander Smirnov, Alexey Kashevnik, Sergey Mikhailov, Mikhail Mironov, Mikhail Petrov St.Petersburg Institute for

Lego Mindstorms Robot Example

9

Control blockWi-FiUSB-adapter

Right-sideultrasonicsensor

Frontultrasonicsensor

Largemotors for wheels

Gripper

Smallmotorforgrippingandpickingup

Pickupmechanism

Page 10: Smart M3-Based Robot Interaction Scenario for Coalition Work · Alexander Smirnov, Alexey Kashevnik, Sergey Mikhailov, Mikhail Mironov, Mikhail Petrov St.Petersburg Institute for

ComputationServiceFlowchartDiagram

10

Main functions:• Get information from smart

M3 space about letter sequence.

• Subscribe for the information about the letter found by a robot.

• Calculate and share with smart M3 space information about the letter destination.

Page 11: Smart M3-Based Robot Interaction Scenario for Coalition Work · Alexander Smirnov, Alexey Kashevnik, Sergey Mikhailov, Mikhail Mironov, Mikhail Petrov St.Petersburg Institute for

Robot Control Service

11

Main functions:• Control robot movements• Control gripping of letters• Share information with smart M3 space about the letter found.• Get information from smart M3 space about destination for letter found.

Finding Letter Using ultrasonic sensor (example for letter “M”)

Page 12: Smart M3-Based Robot Interaction Scenario for Coalition Work · Alexander Smirnov, Alexey Kashevnik, Sergey Mikhailov, Mikhail Mironov, Mikhail Petrov St.Petersburg Institute for

Mobile Application

12

Main functions:• Share with smart M3 space information about letter sequence.• Share with smart M3 space information about correspondence between a

letter and a color.

ИТМО

Page 13: Smart M3-Based Robot Interaction Scenario for Coalition Work · Alexander Smirnov, Alexey Kashevnik, Sergey Mikhailov, Mikhail Mironov, Mikhail Petrov St.Petersburg Institute for

13

Page 14: Smart M3-Based Robot Interaction Scenario for Coalition Work · Alexander Smirnov, Alexey Kashevnik, Sergey Mikhailov, Mikhail Mironov, Mikhail Petrov St.Petersburg Institute for

Conclusion

l The paper presents mobile robot interaction scenario for coalition work.

l Scenario aims at word from letter formation.l Robots are based on Lego® Mindstorms EV3 Kit. Letters

have been developed using 3D printer.l Implementation is based on Smart-M3 information sharing

platform that provides possibilities of information sharing based on Semantic Web.

14

Page 15: Smart M3-Based Robot Interaction Scenario for Coalition Work · Alexander Smirnov, Alexey Kashevnik, Sergey Mikhailov, Mikhail Mironov, Mikhail Petrov St.Petersburg Institute for

Thank you for Attention.Questions are Welcome

15

Alexey Kashevnik, PhDSt. Petersburg, Russia, E-mail: [email protected]