RobOps – Approaching a Holistic and Unified...

24
RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft Steffen Jaekel, Bernhard Brunner (1) Christian Laroque, Zoran Pjevic (2) Felix Flentge (3) Thomas Krueger, and André Schiele (4) (1) German Aerospace Center (DLR), Robotics and Mechatronics Center (2) OHB System AG (3) ESOC (4) ESTEC www.DLR.de • Chart 1 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

Transcript of RobOps – Approaching a Holistic and Unified...

Page 1: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic SpacecraftSteffen Jaekel, Bernhard Brunner (1)Christian Laroque, Zoran Pjevic (2)Felix Flentge (3)Thomas Krueger, and André Schiele (4)

(1) German Aerospace Center (DLR), Robotics and Mechatronics Center(2) OHB System AG(3) ESOC(4) ESTEC

www.DLR.de • Chart 1 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

Page 2: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

Introduction – Space Robotics

www.DLR.de • Chart 2

- Future and already deployed robot applications in space:

- In-space robotic assembly (ISRA): SSRMS, SPDM

- EVA assistance: SSRMS, Robonaut, DLR‘s Justin, (small) satellitesfor inspection: SPHERES

- Robotic exploration: MER‘s

- On-orbit servicing (OOS) for prolonging lifetime of operational satellites, repair & refuel (RRM), extend or upgrade functionality (Hubble)

- OOS for active debris removal from LEO or re-orbiting into graveyard orbit in GEO

RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

Justin

ROKVISS

e.Deorbit

Page 3: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

Challenges of Robotic Spacecraft

www.DLR.de • Chart 3 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

Source: Airbus, DLR

Page 4: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

Distributed Mission Architecture - METERON

www.DLR.de • Chart 4 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

Page 5: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

Current Mission Operation Standards

www.DLR.de • Chart 5 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

- Current Mission Operations standards – e.g. Packet Utilization Standard (PUS) - are madefor the operation of classic spacecraft – mostly from one ground station - not for autonomousspace robots

- Partly new CCSDS approaches to standardization:- File delivery, Asynchronous Message Service (AMS), Disruption-tolerant Network

(DTN)- MO: Message Abstraction Layer (MAL), Monitor and Control Common Services (MO)

- RobOps approach:

- Effective control approach for autonomous robotic spacecraft, attached roboticdevices and arbitrary subsystem equipment holistic

- Clear distinction between interface service semantics and method of transport

Transport

Semantics

Page 6: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

RobOps Study Contents

www.DLR.de • Chart 6 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

1. Communication

2. Control Modes

3. Roles & Responsibilities

4. Scenario Analysis

5. Service Definition

6. Technology Analysis & Implementation

7. Demonstration Prototype

Page 7: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

Communication

www.DLR.de • Chart 7 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

- Dominant barrier: space- Properties of communication channel restricts capabilities- Higher delay, jitter, low data bandwidth increased autonomy- Communication window – relay satellites- Deep-space communication with DTN

Page 8: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

Possible Control Modes

www.DLR.de • Chart 8 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

- Possible control modes depend on mission architecture and given communication delay as major barrier between operator and robot

- More system autonomy equals less human control and intervention

- Manual control, assisting, shared and supervized autonomy

- Monitoring: global, subsystem specific in real-time (telepresence), ad-hoc, post-hoc

Autonomous Control

Shared/Supervized Autonomy/Control

Manual Control

Syst

em A

uton

omy

• Algorithms pass real-time decisions based on a variety of sensor input and control the spacecraft and robotic manipulator

• No human control

• Autonomous algorithms execute human high-level control inputs, e.g. waypoints for path planningalgorithms

• High-level human control

• The human operator steers the system completely manual

• Low-level human control• Telepresence with haptic feedback

Interaction / Hum

an Control

Assisting Autonomy

• Autonomous algorithms support the operator in his manual system control, e.g. collision avoidance

• Mid-level human control

Page 9: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

Roles and Responsibilities

www.DLR.de • Chart 9 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

- Classic roles and responsibilities were analyzed for classic satellite operations

- Partly confusing nomenclature differences between ESOC, GSOC and NASA

- Robotic operations:

Remote site

Orbiter

Mission control center

SOM SOE SPACON

report

command

Satellite

RO

RO

Robotic Spacecraft

Commander

Robotic satellite operations

Ground-controlled robot

Classic satellite operations

astronaut-controlled robot

- Very small time scale for reaction

- Direct control of robotic payload and decision-making by robotic operator (RO)

- Robotic Operations Manager (ROM) and Engineer (ROE) set goals and supervise operations

Page 10: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

Scenario Analysis

www.DLR.de • Chart 10 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

OOS Free-FlyerRover

Scenarios

Service List

Use Cases

Page 11: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

1.2.

3. Levels of Autonomy

Structuring Telerobotic Services

www.DLR.de • Chart 11 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

1. Functions

2. Mission Architecture

sensesense2. Sequencing Layer

3. Reactive Layer

Pre-condition

Post-conditionAction

sense

Action

Re-plan

Action finished

New action

New plan

Three Tier (3T ) layers Main service classes

Scheduling

EventEvent

Planning1. Deliberative Layer

Configuration Monitoring Control

Subsystem

System

Mission Mission

System 1

Subsystem 1 Subsystem n

System n…

System Level 3

System Level 2

System Level 1 System 1

System 2

System 5 System 6

System 4…

Page 12: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

www.DLR.de • Chart 12 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

Del

iber

ativ

e La

yer

3T Layers of Autonomy

(1) Control

(A) Mission

Sequ

enci

ng L

ayer

Rea

ctiv

e La

yer

Classic SpacecraftOperations

AutonomousOperations

System Scheduling

Sybsystem Planning(e.g. path planning)System Planning

Mission Scheduling

Mission Planning

Subsystem Action(privatizable)

System Event

Mission Action

(2) Mon. (3) Config. (1) Control (2) Mon. (3) Config. (1) Control (2) Mon. (3) Config.

(B) System (C) Subsystem

1:n1:n

Architecture:

Function:Operator

Subsystem Scheduling(e.g. path sequencing)

System Action

Com

mon

Ser

vice

s

System Monitoring

Subsystem Monitoring

Mission Monitoring

MonitoringPath

Control & Config.Path

MissionEvent Subaystem Event

Planning

Scheduling Event

Action

Monitoring

Page 13: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

Service Privatizations

www.DLR.de • Chart 13 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

- Functional approach to Monitoring & Control – focus on autonomy rather than specific subsystem or device (PCDU, AOCS, Robot Arm)

- Specific functionality is addresses via Privatizations

- Privatizations become Subservices, to be used across missions

Service, e.g. Action

Service Operation, e.g. executeAction

Operation specification1. Subservice, e.g. Robotic

2. Type: Motion

Parameters (defined by Subservice)e.g. cmd=SETPOSE, device=ARM, mode=CART,

syntax=XYZ_EULER, reference=ABS, poseData=(trans_x, trans_y, trans_z, rot_x, rot_y, rot_z)

Page 14: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

Technology Analysis - Overview

www.DLR.de • Chart 14 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

- Message Abstraction Layer (MAL) and Mission Operations Services (MO)

- Communications:- Message Based Communications

- Data Distribution Service (DDS)- ActiveMQ- øMQ (ZeroMQ)- Asynchronous Message Service (AMS) over DTN

- File Based Communication- CCSDS File Delivery Protocol (CFDP)- File Transfer on Ground

- Decision fell on MAL over DTN for transport

DTN

MAL

RobOps

Page 15: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

Implementation - Overview

www.DLR.de • Chart 15 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

Page 16: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

High-Level Architecture of Robot Demonstrator

www.DLR.de • Chart 16 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

Page 17: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

Demonstration at ESTEC

www.DLR.de • Chart 17 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

- Iterative implementation and testing approach

- Picture: local testing at ESTEC Teleroboticsand Haptics Laboratory with KUKA LWR-III setup and DTN over Intranet

- Privatizations…

Page 18: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

www.DLR.de • Chart 18 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

Page 19: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

Study Conclusions

www.DLR.de • Chart 19 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

- Holistic control approach for autonomous robotic spacecraft

- Action & Monitoring services were implemented and demonstrated with KUKA LWR and MOCUP rover from Telespazio

- Possible future developments: Event service, artificial communication delay and disruptions in DTN link, complex scenario with control authority hand-over

OOS Free-FlyerRover

Page 20: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

The future of robots in space…

www.DLR.de • Chart 20 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

robotic exploration satellite servicing EVA support

Page 21: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

Use Cases and Mission Scenario Analysis

www.DLR.de • Chart 21 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

- Use case analysis for space-robotic mission - What tasks have to be bedone?

- Layout of detailed scenarios as a composition of use cases for OOS, rover exploration and EVA support (free-flyer around ISS) in order to identify required service functionality

uc Ov erv iew of General Use Cases

Spacecraft

FDIR

Commissioning of Components

Superv ised Autonomy Operations

Manual Operations

Mission Monitoring

Mission Operations

Autonomous Operations

Mission Data Logging

Operation of Heterogeneous

Components

Shared Autonomy Operations

Agent

Mission Briefing

«invokes»

«invokes»

«include»

«include»

«invokes»

«include»

«include»

«include»

«include»

«include»

«extend»

Page 22: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

Architecture of Remote Robot System

www.DLR.de • Chart 22 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

Page 23: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

Iterative Development and Demonstration

www.DLR.de • Chart 23 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

DLR

DLR

DLR

ESTEC

servicelayer.robotKUKA LWR

RobotSimulator

servicelayer.mcmonitoring

action

RobotViewer

CommandUI

servicelayer.robot(server)

rmc-thalia

KUKA LWRRobot

SimulatorUDP servicelayer.mc

(client)

monitoring

action

Telespazio Vega

RobotViewer

CommandUI

servicelayer.robotKUKA LWRRobot

monitoring

action

Telespazio Vega

servicelayer.mc

RobotViewer

CommandUI

servicelayer.robot

KUKA LWRRobot

Simulator& cmd GUI

servicelayer.mcmonitoring

ESTEC

servicelayer.robotKUKA LWRRobot servicelayer.mc

monitoring

action

RobotViewer

CommandUI

monitoring & actionPort 4556

bidirectionalOn both sides

Page 24: RobOps – Approaching a Holistic and Unified …robotics.estec.esa.int/ASTRA/Astra2015/Presentations...RobOps – Approaching a Holistic and Unified Interface Service Definition for

Demonstration at ESTEC

www.DLR.de • Chart 24 RobOps – Approaching a Holistic and Unified Interface Service Definition for Future Robotic Spacecraft

- Demonstration of selected interface services: Action and Monitoring

- Possible future developments: Event service, artificial communication delay and disruptions in DTN link, complex scenario with control authority hand-over