Faculty of Electronics and Telecommunications University of...

33
AUTOMATION & ROBOTICS LABORATORY Faculty of Electronics and Telecommunications University of Engineering and Technology Vietnam National University

Transcript of Faculty of Electronics and Telecommunications University of...

Page 1: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

AUTOMATION & ROBOTICS LABORATORY

Faculty of Electronics and TelecommunicationsUniversity of Engineering and TechnologyVietnam National University

Page 2: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

Industrial Robot for Training

2

ED7220 (Korea) SCORBOT – ER Vplus

(Isarel)

Page 3: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

Industrial Robot Projects

3

Tele-Presence

Product Classification

Page 4: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

4

Tele-operations

Supervise and control Micro-gripper

MEMS + Haptic + Microscope + Computer Vision

Page 5: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

5

Intelligent Robot

Page 6: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

6

Autonomous Mobile Robotics

Robot Navigation

Localization & Mapping

sensor

Path-planing

Control Obstacle avoidance

"Position" Global Map

Perception Motion Control

Cognition

Real WorldEnvironment

Localization

PathEnvironment ModelLocal Map

Page 7: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

7

Approachesof research

Sensor Fusion

remote control of robot throughthe network

Networkedmulti-robot

Applications

Autonomous Mobile Robotics

Page 8: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

8

Sensor Fusion Autonomous Mobile Robotics

Multi-sensor Robot

CCD Camera

Joystick Controller

LMS-221

Omni Camera

SRF-05

CMPS03(0.1)

HOLUX GPS UB-93

Page 9: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

9

Sensor Fusion Autonomous Mobile Robotics

Data fusion of one sensor with an Extended Kalman Filter EKF

Page 10: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

10

0

1

2

3

4

0 0.5 1 1.5 2 2.5

X(m)

Y(m)

OdometryCompassLRFOmniFusionTRUE

Fusion 4 sensors (optical encoder + compass + laser range finder + omni-directional camera) to increase the accuracy of position estimation.

Sensor Fusion Autonomous Mobile Robotics

Page 11: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

11

Sensor Fusion Autonomous Mobile Robotics

3D laser image using for obstacle avoidance

Page 12: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

12

Mapping and path planing using sensor fusion’s data with A* algorithm or Voronoi graph.

Sensor Fusion Autonomous Mobile Robotics

Page 13: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

13

Networked robot Autonomous Mobile Robotics

Page 14: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

14

Localization of NRSs using Past-Observation based EKF (PO-KF)

Experimental configuration with local Internet service providers.

Experimental configuration with VPN connections to servers located at the United State.

Networked robot Autonomous Mobile Robotics

Page 15: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

15

The theory, observation, POEKF-based estimate, and true trajectories of the robot in motion plane.

RMSE between the theory,observation, PO-EKF-based estimate and the true trajectories in X direction.

Networked robot Autonomous Mobile Robotics

Page 16: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

16

Networked robot

Stabilization Control using Lyapunov Stability Theory and Predictive Filter

Control of NRS with the use of the predictive filter: (a) Trajectory of the robotin the motion plane; (b) Variation of the direction of the robot.

Page 17: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

17

Networked robot

Navigation using behavior-based and multi-protocol models

Network state during the experiment: (a) Time delay; (b): Delay jitter.

Communications in an NRS system using multi-protocol model.

Autonomous Mobile Robotics

Page 18: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

18

Networked robot

Multi-robot Searching System in a disaster area using Particle Swarm Optimization Algorithm PSO.

Ant Colony Bird Flocking Fish School

Graph of pbest tracking gbestNuclear contamination distribution

in the operation area of robot

Maintaining the connection between the robotsThe system has the duty to find a location which is highly affected by radioactivity.

Page 19: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

19

Servicing robots Search and rescue in disaster Remote monitoring in forest fire Positioning in nuclear contamination Anti-terrorism, military, security, … …..

Applications

Page 20: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

student’s projects

20

Intelligent Serviced Robots

Page 21: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

Embedded programming for Hexapod 12-DOF

21

Page 22: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

22

Color Tracking using Omni-directional Camera

Page 23: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

23

Smart Cleaning Robot

Not fall in the stair. Moving along the setting paths. Go out the shadow before switch off. Using computer-vision for self-identification the electric socket in order to charge.

Technical specifications:

Page 24: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

24

Balancing Robot

24

System model Simulation Implementation

First prize in the student scientific researching contest

Page 25: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

Brainwaves for Control of Robot

25

Electroencephalograph EEG

Page 26: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

26

Moving Object Tracking by Computer Vision

Eye Tracking –NTT project Moving Motor Tracking

Page 27: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

Publications

27

Journal Papers:

Manh Duong Phung, Thi Thanh Van Nguyen, Thuan Hoang Tran, Quang Vinh Tran, “Localizationof Internet-based Mobile Robot”, Journal of Science, Natural science and Technology, VietnamNational University,Vol.29, 2013 .

Thuan Hoang Tran, Manh Duong Phung, Thi Thanh Van Nguyen, Quang Vinh Tran, “StablizationControl of the Differential Mobile Robot Using Lyapunov Function and Extended Kalman Filter,”Journal of Science and Technology, Vietnam Academy of Science and Technology, pp.441-452, Vol.50 (4), July-October, 2012.

Nguyen Thi Thanh Van, Phung Manh Duong, Pham Dinh Tuan, and Tran Quang Vinh,“Development of a Fuzzy-based Patrol Robot Using in Building Automation System”, Journal ofComputer Science and Cybernetics, pp.83-92, vol.27 no.1, June, 2011.

Tran Quang Vinh, Pham Manh Thang, Phung Manh Duong, “Controlling Communication Networkin the Building Automation System,” Journal of Science, Natural science and Technology,VietnamNational University, pp.129-140, Vol.26 no.2, September, 2010.

Phung Manh Duong, Tran Hieu and Tran Quang Vinh, “Supervision and control of a mobile robotthrough WLAN and the Internet”, Journal of Science, Natural science and Technology, VietnamNational University, Vol.21 no.2, April 2005.

Page 28: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

28

International Conference Papers:

T. T. Hoang, D. T. Hiep, P. M. Duong, N. T. T. Van, D. A. Viet and T. Q. Vinh (2013),“Proposal of Algorithms for Navigation and Obstacles Avoidance of autonomous MobileRobot”, 8th IEEE Conference on Industrial Electronics & Applications (ICIEA2013),Melbourne, Australia, pp.1308-1313. T. T. Hoang, P. M. Duong, N. T. T. Van, D. A. Viet and T. Q. Vinh, “Development of an EKF-based Localization Algorithm Using Compass Sensor and LRF,” The 12th IEEE InternationalConference on Control, Automation, Robotics and Vision (ICARCV), pp.341-346, Guangzhou,China,December 2012.(ISI Conference)

Manh Duong Phung, Thuan Hoang Tran, Thanh Van Thi Nguyen and Quang Vinh Tran, “Controlof Internet-based Robot Systems Using Multi Transport Protocols”,The First IEEE InternationalConference on Control, Automation and Information Sciences (ICCAIS),pp.294-299,Ho Chi MinhCity, Vietnam, November 2012.

T. T. Hoang, P. M. Duong, N. T. T. Van, D. A. Viet and T. Q. Vinh, “Multi-Sensor PerceptualSystem for Mobile Robot and Sensor Fusion-based Localization”, The First IEEE InternationalConference on Control, Automation and Information Sciences (ICCAIS), pp.259-264, Ho Chi MinhCity, Vietnam, November 2012.

Publications

Page 29: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

29

Thi Thanh Van Nguyen, Manh Duong Phung, Thuan Hoang Tran, Quang VinhTran, “Mobile Robot Localization Using Fuzzy Neural Network Based ExtendedKalman Filter”, 2012 IEEE International Conference on Control System, Computingand Engineering (ICCSCE), pp. , Penang, Malaysia, November 2012. Tran Hiep Dinh, Manh Duong Phung, Thuan Hoang Tran, Quang Vinh Tran,“Localization of a Unicycle-like Mobile Robot Using LRF and Omni-directionalCamera”, 2012 IEEE International Conference on Control System, Computing andEngineering (ICCSCE) , pp. , Penang, Malaysia, November 2012. T. H. Hoang, P. M. Duong, N. V. Tinh and T. Q. Vinh, “A Path Following Algorithm forWheeled Mobile Robot Using Extended Kalman Filter”, The 3rd IEICE International Conferenceon Integrated Circuits and Devices in Vietnam (ICDV), pp.179-183,Danang, Vietnam, August2012.

P. M. Duong, T. T. Hoang, N. T. T. Van, D. A. Viet and T. Q. Vinh, “A Novel Platform forInternet-based Mobile Robot Systems”, The 7th IEEE Conference on Industrial Electronics andApplications (ICIEA), pp.1969-1974, Singapore,July 2012.(ISI Conference)

T. T. Hoang, P. M. Duong, N. T. T. Van, D. A. Viet and T. Q. Vinh, “Development of a Multi-Sensor Perceptual System for Mobile Robot and EKF-based Localization,” The IEEE 2012International Conferenceon Systems and Informatics (ICSAI),pp.519-523, Yantai, China, May2012.

Publications

Page 30: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

30

Manh Duong Phung, Thanh Van Thi Nguyen, Cong Hoang Quach, Quang VinhTran, “Development of a Tele-guidance System with Fuzzy-based SecondaryController”, The 11th IEEE International Conference on Control, Automation,Robotics and Vision (ICARCV), pp.1826-1830, Singapore, December 2010.(ISIConference) Manh Duong Phung, Quang Vinh Tran, Kok Kiong Tan, “Transport Protocols for Internet-based Real-time Systems: A Comparative Analysis,” The Third International Conference onCommunication and Electronics (ICCE),Nha Trang, Vietnam, August 2010.(ISI Conference)

Manh Duong Phung, Quang Vinh Tran, K. Hara, H. Inagaki and M. Abe, “Easy-Setup EyeMovement Recording System for Human-Computer Interaction,” The 2008 IEEE InternationalConference on Research, Innovation and Vision for the Future (RIVF), pp.292-297, HochiminhCity, Vietnam,July 2008.(ISI Conference)

Phung Manh Duong, K. Hara, H. Inagaki and M. Abe, “Fast Pupil Center Detection Using ADouble Circle Fitting Algorithm,” IEICE General Conference, Japan, 2008.

Phung Manh Duong, K. Hara, H. Inagaki and M. Abe, “Fast and Robust Pupil CenterDetection Algorithm for Eye Movement Tracking,”IEICE Technical Report, vol.107 no.491,PRMU2007-236, pp.127-130,Tsukuba, Japan, February 2008.

Manh Duong Phung, Thanh Van Thi Nguyen, and Tran Quang Vinh, “Control of an Internet-based Robot System Using Fuzzy Logic”, The 2011 IEICE International Conference onIntegrated Circuits and Devices in Vietnam (ICDV), pp.98-101, Hanoi, Vietnam, August 2011.

T. T. Hoang, D. A. Viet, T. Q. Vinh (2011), “A 3D image capture system using a laser rangefinder”, IEICE Proceeding of the 2th international conference on Integrated Circuit DesignICDV, Ha Noi,Vietnam, pp. 76-81.

Page 31: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

31

Thank you for attention

Page 32: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

Intellgent Robot

32

DrRobot

Trilobots

Aibo Robot

Page 33: Faculty of Electronics and Telecommunications University of …fet.uet.vnu.edu.vn/.../uploads/2012/05/Robotics_Lab_Introduction_20… · Faculty of Electronics and Telecommunications

Intelligent Robot Projects

33

Internet Robot

Color Tracking

Cleaning Robot