ARTEC (Research Group)

ARTEC (Research Group)

Dr. Pedro Morillo TenaInstituto de Robótica (IRTIC)

Universitat de València (UVEG)

Dr. Pedro Morillo TenaInstituto de Robótica (IRTIC)

Universitat de València (UVEG)

Advanced Research & Technological Expansion in Computer Graphics

Summary

1.Introduction2.Presentation of the research group:

ARTEC 3.Human interaction metaphors4.2D/3D Tracking5.Video-based interaction (AR)

A. Marker / Markerless approach

6.Sensing of real-word elements7.Conclusions

Research groups at IRTIC (UVEG)

• ARTEC- Advanced Research & Technological Expansion in Computer Graphics

• AUTISMO- Autism and Learning Difficulties Group

• LISSIT- Intelligent Transportation Systems (ITS)

• LSYM- Modeling and Simulation Laboratory

• GSIC- Group of Information and Communication Systems

• SITRA- Image Processing and Computer Vision

ARTEC was founded in 1992 and has been oriented to the Research and Development of 3D Real Time Systems including Virtual/Augmented Reality technologies and Immersive Visualization Systems. Currently, the group is composed of roughly 35 full-time researchers in the following research areas:

Basic Research in 3D Interactive Graphics, Multimodal Interaction, V/A R Virtual Architecture and Historic Reconstruction Driving Simulation High-Quality Terrain Visualization AR Systems for training and maintenance Entertainment and Learning Systems (Edutainment) Civil Simulation for Training and Educational purposes VR Systems for Industrial environments Custom devices for Immersive Visualization Systems (VISIONARC) X-DOF Motion Platforms Multiplatform Developments (Windows, OSX, and Linux) From Cluster computing support to mobile devices….

IRTIC and the activities in VR an AR IRTIC and the activities in VR an AR

Main human interaction metaphorsMain human interaction metaphors

Virtual RealityVirtual Reality

“Virtual Reality” involves the creation of a computer-generated world that a person can interact with in such a way that he or she

believes that the virtual world is real

Some snapshots of VR-based projects developed by ARTEC

Augmented RealityAugmented Reality

The “Augmented Reality” generates a composite view for the user that is the combination of the real scene viewed by the user and a virtual scene generated

by the computer that augments the scene with additional information

Project FTB: RA formación BMW (Bertolín)/Vodafone (Bonatel)

Basic input mechanisms for VR/AR SystemsBasic input mechanisms for VR/AR Systems

• Mechanic Tracking • Electromagnetic• Ultrasounds• Inertial systems• Gyroscopes• Localization (GPS ,etc)• Optic/Infrared systems• Marking/Markerless computer vision systems• Sensing real elements (cabins, cockpits, levers, etc.)

• Mechanic Tracking • Electromagnetic• Ultrasounds• Inertial systems• Gyroscopes• Localization (GPS ,etc)• Optic/Infrared systems• Marking/Markerless computer vision systems• Sensing real elements (cabins, cockpits, levers, etc.)

ENSISAM: Simulation environment for maritime rescue(FOREM-Andalucía –DECOM)

Electromagnetic TrackingElectromagnetic Tracking

INMER: Social integration for people with autism

Electromagnetic TrackingElectromagnetic Tracking

Mirror Metaphor: Real-Time motion capture in a CAVE environment

3D Tracking using infrareds &

accelerometers3D Tracking using infrareds &

accelerometers

3D Tracking using infrareds &

accelerometers3D Tracking using infrareds &

accelerometersBIOMIMO: Motion analysis for ergonomic purposes using Augmented Reality techniques

3D Tracking using infrareds &

accelerometers3D Tracking using infrareds &

accelerometersBIOMIMO: Motion analysis for ergonomic purposes using Augmented Reality techniques

Virtual Training Systems: PREVISOR, assembly of elements and driving of machinery in construction site environments

3D Tracking using infrareds &

accelerometers3D Tracking using infrareds &

accelerometers

3D Tracking using infrareds &

accelerometers3D Tracking using infrareds &

accelerometersVirtual Training Systems: PREVISOR, assembly of elements and driving of machinery in construction site environments

3D Tracking using infrareds &

accelerometers3D Tracking using infrareds &

accelerometersVirtual Training Systems: ENSISAM II, collaborative training in processes for maritime rescue

3D Tracking using infrareds &

accelerometers3D Tracking using infrareds &

accelerometersVirtual Training Systems: ENSISAM II, collaborative training in processes for maritime rescue

3D Tracking using infrareds on screens3D Tracking using infrareds on screensVirtual Training Systems: processes for a safe manipulation of electrical panelboards

3D Tracking using infrareds on screens3D Tracking using infrareds on screensVirtual Training Systems: processes for a safe manipulation of electrical panelboards

3D Tracking using infrareds on screens3D Tracking using infrareds on screensVirtual Training Systems: Multitouch surface platform for general purposes

MoCap

Control Model

Data InputMoCap

Critical Hardware

Simulation of the IDEALstate(Augmented Reality)

Visualization of the REAL state

(Virtual Reality)

Video-based interaction. Using AR marksVideo-based interaction. Using AR marks

BIOMIMO II: Evaluation of virtual prototypes and control systems

Video-based interaction. Using AR marksVideo-based interaction. Using AR marks

SUPERVISAR, ANGEL & SICURA-TUN: Training in action protocols using RA technologies

FASYS: Absolutely Safe and Healthy Factory. Security protocols using Augmented Reality

Testing the FASYS system (TRW-Pamplona)

Video-based interaction. Using AR marksVideo-based interaction. Using AR marks

Video-based interaction. Markerless systemsVideo-based interaction. Markerless systems

PictogramROOM: Using AR to enhance the communication skills in people with autism

Video-based interaction. Markerless systemsVideo-based interaction. Markerless systems

FASYS: Absolutely Safe and Healthy Factory. Security protocols using Virtual Reality

Orange ARFS: PROMOTION OF CULTURAL AND HERITAGE TOURIMS: Augmenting the Sagrada Familia monument using mobile devices. Monitoring the evolution of the constructions works for the Sagrada Familia monument

3D Model

Recognition Process

Combined Visualization:Real World +

3D Model

Video-based interaction. Markerless systemsVideo-based interaction. Markerless systems

Video-based interaction. Markerless systemsVideo-based interaction. Markerless systems

Orange ARFS: PROMOTION OF CULTURAL AND HERITAGE TOURIMS: Augmenting the Sagrada Familia monument using mobile devices. Monitoring the evolution of the constructions works for the Sagrada Familia monument

Video-based interaction. Markerless systemsVideo-based interaction. Markerless systems3DOrangeWorkd: 3D navigation using simulated accelerometers by real-time video analysis

(WebPages, videos, forms, etc.)On-line information of the business establishment

Services offered trhough Intennet

INTELLIGENT EYE

Internet

- Search server- Database- Classifier

Mobile Client Mobile Client

Server

Video-based interaction. Markerless systemsVideo-based interaction. Markerless systemsOrange IntelligentEye: Urban navigation with contextual help using real-time image recognition

Driving Simulation Systems: SIRCA, TUTOR, PREVISIM & SIAUTO

Interaction by sensing real-world objects Interaction by sensing real-world objects

Interaction by sensing real-world objects Interaction by sensing real-world objects PREVISIM: A collaborative simulator for traffic risk prevention

Interaction by sensing real-world objects Interaction by sensing real-world objects Simulation systems oriented to increased the skills of crane operators: Stewart, Transtainer,..

Interaction by sensing real-world objects Interaction by sensing real-world objects ESTRIBOR: Simulation system oriented to the operation of rescue boats

ARTEC (Research Group)

ARTEC (Research Group)

Dr. Pedro Morillo TenaInstituto de Robótica (IRTIC)

Universitat de València (UVEG)

Dr. Pedro Morillo TenaInstituto de Robótica (IRTIC)

Universitat de València (UVEG)

Advanced Research & Technological Expansion in Computer Graphics