Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception...
Transcript of Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception...
![Page 1: Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception Architecture for the Tele-Operation of Humanoid Robot COMAN . 2 ROSCon, Chicago, September](https://reader034.fdocuments.us/reader034/viewer/2022042210/5eae57224941ab579a61789a/html5/thumbnails/1.jpg)
E. Mingo Hoffman, A. Rocchi, A. Settimi, M. Ferrati, C. Pavan, A. Ajoudani, J. Lee, Z. Li, L. Muratore, A. Cardellino, N. G. Tsagarakis
and all the WALK-MAN Team
ROSCon
12-13 September 2014,
Chicago
Control and Perception Architecture for the Tele-Operation of Humanoid Robot
COMAN
![Page 2: Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception Architecture for the Tele-Operation of Humanoid Robot COMAN . 2 ROSCon, Chicago, September](https://reader034.fdocuments.us/reader034/viewer/2022042210/5eae57224941ab579a61789a/html5/thumbnails/2.jpg)
2
ROSCon, Chicago, September 2014
COMAN & The WALK-MAN Project
![Page 3: Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception Architecture for the Tele-Operation of Humanoid Robot COMAN . 2 ROSCon, Chicago, September](https://reader034.fdocuments.us/reader034/viewer/2022042210/5eae57224941ab579a61789a/html5/thumbnails/3.jpg)
3
• semi – autonomous
• operational space tasks
• robust
• basic environment recognition
• monitoring & diagnostic
• different levels of control
• high computational power
Command & Control Station
Humanoid Rescue Robot
ROSCon, Chicago, September 2014
Scenario
![Page 4: Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception Architecture for the Tele-Operation of Humanoid Robot COMAN . 2 ROSCon, Chicago, September](https://reader034.fdocuments.us/reader034/viewer/2022042210/5eae57224941ab579a61789a/html5/thumbnails/4.jpg)
4
ROSCon, Chicago, September 2014
Architecture
![Page 5: Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception Architecture for the Tele-Operation of Humanoid Robot COMAN . 2 ROSCon, Chicago, September](https://reader034.fdocuments.us/reader034/viewer/2022042210/5eae57224941ab579a61789a/html5/thumbnails/5.jpg)
5
Control modules: YARP based + ROS facilities
Perception modules: ROS based
Visualization & Diagnostic: ROS based
ROSCon, Chicago, September 2014
Our choice: Frameworks
![Page 6: Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception Architecture for the Tele-Operation of Humanoid Robot COMAN . 2 ROSCon, Chicago, September](https://reader034.fdocuments.us/reader034/viewer/2022042210/5eae57224941ab579a61789a/html5/thumbnails/6.jpg)
6
• Ports, RPCs, Interfaces
• TCP/IP, UDP, ShMem, …
• Typed/Non-Typed ports
• Successfully used in iCub and
many other robots
A B /a /b
yarp.connect(‘/a’, ‘/b’)
ROSCon, Chicago, September 2014
http://wiki.icub.org/yarp/
YARP
![Page 7: Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception Architecture for the Tele-Operation of Humanoid Robot COMAN . 2 ROSCon, Chicago, September](https://reader034.fdocuments.us/reader034/viewer/2022042210/5eae57224941ab579a61789a/html5/thumbnails/7.jpg)
7
ROSCon, Chicago, September 2014
left_arm.setPosition(qd)
left_leg.setTorque(τd)
.
.
.
left_leg.getTorque(τ)
left_arm.getVelocity(dq)
Robolli
API
COMAN Interface
![Page 8: Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception Architecture for the Tele-Operation of Humanoid Robot COMAN . 2 ROSCon, Chicago, September](https://reader034.fdocuments.us/reader034/viewer/2022042210/5eae57224941ab579a61789a/html5/thumbnails/8.jpg)
8
ROSCon, Chicago, September 2014
left_arm.setPosition(qd)
.
.
.
API
https://github.com/robotology/gazebo-yarp-plugins
gazebo_yarp_plugins
left_leg.setTorque(τd)
left_arm.getVelocity(dq)
left_leg.getTorque(τ)
![Page 9: Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception Architecture for the Tele-Operation of Humanoid Robot COMAN . 2 ROSCon, Chicago, September](https://reader034.fdocuments.us/reader034/viewer/2022042210/5eae57224941ab579a61789a/html5/thumbnails/9.jpg)
9
RF Module
Rate Thread config Param
Helper
start/stop/pause
module status
input output
• Internal model of the robot (URDF + SRDF,
REP 120)
• Decentralized IK/FK + ID (iDynTree)
• All kinematic chains controllable
threadInit() { … }
run() { getFeedback()
updateModel()
ctrlLaw()
move()}
close() { … }
ROSCon, Chicago, September 2014
https://github.com/robotology-playground/idyntree
Control Modules (YARP)
![Page 10: Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception Architecture for the Tele-Operation of Humanoid Robot COMAN . 2 ROSCon, Chicago, September](https://reader034.fdocuments.us/reader034/viewer/2022042210/5eae57224941ab579a61789a/html5/thumbnails/10.jpg)
10
ROSCon, Chicago, September 2014
Walking Module + Stabilizer
Openni2 Driver
DSP DSP DSP
Boards Status
WB IK Engine
Trj. Generator
COMAN Interface
PC, Images, Video
Actions
Actions
YARPSERVER
ROSCORE
Sensors & Boards Status
Robot Modules
![Page 11: Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception Architecture for the Tele-Operation of Humanoid Robot COMAN . 2 ROSCon, Chicago, September](https://reader034.fdocuments.us/reader034/viewer/2022042210/5eae57224941ab579a61789a/html5/thumbnails/11.jpg)
11
Pilot Interface
tf
robot_state_publisher
Boards Status
robot_state_publisher_ext
CoM, …
PC, Images, Video
Robot Status Actions
Cartesian Ref
q ref
yarp_ros_joint_state_publisher
yarp_ros_wrench_imu_publisher
ROSCon, Chicago, September 2014
Command & Control Station Modules
![Page 12: Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception Architecture for the Tele-Operation of Humanoid Robot COMAN . 2 ROSCon, Chicago, September](https://reader034.fdocuments.us/reader034/viewer/2022042210/5eae57224941ab579a61789a/html5/thumbnails/12.jpg)
12
ROS Node similar to robot_state_publisher
with more informations related to
Humanoid Robots:
• CoM Position
• CoM Projection
• Convex Hull
• CoP
• …
ROSCon, Chicago, September 2014
robot_state_publisher_ext
![Page 13: Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception Architecture for the Tele-Operation of Humanoid Robot COMAN . 2 ROSCon, Chicago, September](https://reader034.fdocuments.us/reader034/viewer/2022042210/5eae57224941ab579a61789a/html5/thumbnails/13.jpg)
13
ROSCon, Chicago, September 2014
Cameras, PC,
Cartesian Control, Status, … Module’s related commands
Module status
Pilot Interface
![Page 14: Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception Architecture for the Tele-Operation of Humanoid Robot COMAN . 2 ROSCon, Chicago, September](https://reader034.fdocuments.us/reader034/viewer/2022042210/5eae57224941ab579a61789a/html5/thumbnails/14.jpg)
14
ROSCon, Chicago, September 2014
+ sot_VelKinCon
![Page 15: Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception Architecture for the Tele-Operation of Humanoid Robot COMAN . 2 ROSCon, Chicago, September](https://reader034.fdocuments.us/reader034/viewer/2022042210/5eae57224941ab579a61789a/html5/thumbnails/15.jpg)
15
ROSCon, Chicago, September 2014
+ sot_VelKinCon
![Page 16: Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception Architecture for the Tele-Operation of Humanoid Robot COMAN . 2 ROSCon, Chicago, September](https://reader034.fdocuments.us/reader034/viewer/2022042210/5eae57224941ab579a61789a/html5/thumbnails/16.jpg)
16
ROSCon, Chicago, September 2014
+ Valve
![Page 17: Control and Perception Architecture for the Tele-Operation ...€¦ · Control and Perception Architecture for the Tele-Operation of Humanoid Robot COMAN . 2 ROSCon, Chicago, September](https://reader034.fdocuments.us/reader034/viewer/2022042210/5eae57224941ab579a61789a/html5/thumbnails/17.jpg)
17
ROSCon, Chicago, September 2014
Conclusion & Future Work
• Future Work
• Network management
• Advanced perception
• More autonomy in task execution
• Automatic generation of modules
• Final Remarks
• Dedicated build system (SuperBuild)
• Automatic generation of URDF/SRDF