ASE 2014 Augmented Reality Teaching

U N IV E R S ITAT D E B A R C E L O N AU

Unitat de Farmacologia i Farmacognòsia - Facultat de Farmàcia

AugmentedRealityTeachingDr. Francisco Pérez GarcíaHead of Technology Dept. , Pompeu Fabra High School, MartorellHead of i-Campus Project, University of Barcelona, Barcelona

ASE Conference University of Birmingham, 9th January 2014

Dr. Francisco Pérez García - Institut Pompeu Fabra

The author respects article 32 of the Spanish Law of Intellectual Property to use images and other materials contained in this presentation.The Berne Convention provides for a specific exception to allow uses of copyrighted works for the purpose of teaching:“ Art.10.2.-It shall be a matter for legislation in the countries of the Union, and for special agreements existing or to be concluded between them, to permit the utilization, to the extent justified by the purpose, of literary or artistic works by way of illustration in publications, broadcasts or sound or visual recording for teaching, provided such utilization is compatible with fair practice”

Contents of this presentation

1. Augmented reality (AR) as a disruptive technology?2. Level 0: AR with no programming knowledge

a) App: Google Googles (QR and GeoWeb)b) Online: www.learnar.orgc) Free software: BuildAR

3. Level 1: AR with minor programming skillsa) Open Source software: processing 2b) libraries NyAR4psg, OBJLoader, etcc) Online: Create 3D objects

http://www.123dapp.com/catch4. Level 2: AR with programming skills: Google Glasses

Augmented reality

A disruptive technology?Lavandula angustifolia Something that generates a very

important change

Augmented reality

A disruptive technology?Lavandula angustifolia Something that generates a very

important change

Level 0

Level 1

Level 2

LEVEL OF PROGRAMMING SKILLS REQUIRED TO CREATE AUGMENTED REALITY APPLICATIONS

Programming skills

Higher

Types of Augmented Reality

Trigger by

Hiperlinks in the real world

Marker based augmented reality

Markers

Markerless augmented reality

Objects or pictures

Geoweb-Internet of places Objects and GPS positionInternet of things Sensors, objects and GPS

Level 0 AUGMENTED REALITY: QR CODE

http://www.goqr.me (among many other ways to generate QR)Zint Barcode Generator

Internet of places - GeowebDr. Francisco Pérez García - Institut Pompeu Fabra

http://www.learnar.org AUGMENTED REALITY WITH A BROWSER AND MARKERS

http://6007.stem.org.uk Gravity, Bugs, Sounds and Materials

Creating book with Augmented Reality with www.zooburst.com

Download Build AR free version at http://www.buildar.co.nz/home/download/?did=6

Two examples in the next slides

http://www.arined.org/ARfiles/Final_lecture_AR_Text.pdfMovement to understand eclipse

http://www.buildar.co.nz/buildar-showcase-2/Movement to understand Stirling engine

Students using technology or students creating technology?Dr. Francisco Pérez García - Institut Pompeu Fabra

TO CREATE AUGMENTED REALITY APPS WE NEED CREATIVE STUDENTS…

WITH COMMON HARDWARE, AND…

SOME SOFTWARE, AND PROGRAMING SKILLS?

Processing

Open Source softwareDerived from JavaMany available examplesMany contributed libraries: for Arduino, 3DObject, QRCode, Box2D for games, Open Computer Vision, for Augmented Reality like NyAR4psg or NyAR2, etc.

Marker augmented reality(NyAR4psg, NyAR2 libraries)

Markerless augmented reality(OpenCV library)

Loading 3D objects(Saito OBJLoader library)

QR code library

Data communication(libraries for SMS,SQL databases,…)

Machine learning(Gnet library)

Arduino library(http://tecnologies.net/?page_id=206)

Games (pBox2D library)

Lego robots(NTXcomm library)

AUGMENTED REALITY MARKERS

We need extra libraries and programs to start executing augmented reality code with Processing:

• Libraries

GSVideo

http://sourceforge.net/projects/gsvideo/files/gsvideo/1.0 OBJLoader

https://code.google.com/p/saitoobjloader

/ Nyar4psg-1.3.1

http://sourceforge.jp/projects/nyartoolkit/releases/?package_id=8920

• Programs

QuickTime

http://www.apple.com/es/quicktime/download

WinVDIG

http://www.eden.net.nz/7/20071008/

Quicktime 7:http://www.apple.com/ca/quicktime/download/

http://www.eden.net.nz/7/20071008/

http://sourceforge.net/projects/gsvideo/files/gsvideo/1.0/

GSVIDEO LIBRARY (ONLY FOR PROCESSING 1.5.1)

http://sourceforge.jp/projects/nyartoolkit/releases/?package_id=8920

MAIN AR LIBRARY FOR PROCESSING: NyAR4psg

http://cpbotha.net/files/nyar4psg_multimarker/

MULTIMARKER LIBRARY FOR AUGMENTED REALITYUSING PROCESSING

http://code.google.com/p/saitoobjloader/downloads/list

WHERE WE HAVE TO PUT THE EXTRA LIBRARIES

Libraries: Inside processing (modes>java>libraries)

Programs: At the same folder than processing

WHERE WE HAVE TO PUT THE EXTRA PROGRAMS

SIMPLELITE.PDESIMPLEST CODE FOR AUGMENTED REALITY

USING PROCESSING

CODE CHANGES IF GSVIDEO LIBRARY IS USED

import processing.video.*; //core libraryimport codeanticode.gsvideo.*; //gsvideo contributed library

Capture cam;GSCapture cam;

cam=new Capture(this,width,height);cam=new GSCapture(this,width,height);

cam.start();

CREATING 3D OBJECTS FROM PHOTOGRAPHS

Creating 3D objects withwww.blender.org

www.sketchup.org

http://flash.tarotaro.org/ar/MarkerGeneratorOnline.swf

http://www.brosvision.com/ar-marker-generator/

Online quiz about processing:http://blocs.xtec.cat/pile/2013/05/quiz1.swf

Computer vision OpenCV library + Processing 2.1

Level 2. AR WITH GOOGLE GLASSES

Woodpecker images from @tecnotic

THE INTERNET OF THINGS

I detected a weigth of 60.4kg

My sensor measured 70.2kg

John and Anne are getting fat. I

must send a message now

John’s seat

Anne’s seat

References

http://www.tecnologies.net http://www.processing.orghttp://www.learningprocessing.com/http://www.openprocessing.orghttp://www.creativeapplications.net/category/processing/https://www.coursera.org/course/digitalmedia

MOOC from University of London about www.processing.org

http://www.wiley.com/WileyCDA/WileyTitle/productCd-1118036638,miniSiteCd-SYBEX,descCd-DOWNLOAD.html

ACKNOWLEDGEMENTS

-To the Government of Catalonia, Department of Educationfor the school innovation project “Technological Creativity” atPompeu Fabra High School-To the University of Barcelona for the innovation project “i-Campus”

THANK YOU VERY MUCH FOR YOUR ATTENTION

QUESTIONS?

ASE 2014 Augmented Reality Teaching

Education

Transcript of ASE 2014 Augmented Reality Teaching

Augmented Reality and Industry - WebHomecampar.in.tum.de/.../klinker2015ismarKeynote.slides.pdf · Augmented Reality and Industry Prof. Gudrun Klinker, Ph.D. ... Augmented Reality

AUGMENTED REALITY Case Study AUGMENTED REALITY.

Augmented Reality and Marketing - NVISION · 5 | Augmented Reality and Marketing 3 ESSENTIAL PARTS TO AN AUGMENTED REALITY EXPERIENCE The 3 Essential Parts to an Augmented Reality

Augmented experience: Augmented Reality

AUGMENTED AND VISUAL REALITY. WHAT IS AUGMENTED AND VISUAL REALITY?

Augmented and Mixed Reality - oamk.fi · Project “AR4BC” Augmented Reality for Building and Construction ... Augmented Reality + Augmented Virtuality ... CATIA -> STEP -> Reduced

NBN Ready Augmented Reality Using Augmented Reality in vocational training.

Augmented Reality in Education at Augmented Reality Planet November 2014

Augmented Reality

Augmented Reality or Augmented Space?

Augmented Reality George McKeague (ABB)...Augmented Reality George Mc Keague, ABB — Virtual Reality vs. Augmented Reality • Virtual Reality(VR) is an artificial, computer-generated

VIRTUAL & AUGMENTED REALITY · VIRTUAL REALITY AUGMENTED REALITY Quriuz VIRTUAL AUGMENTED REALITY REALITY Quriuz . Title: PowerPoint-presentatie Author: Niessing, Sander Created Date:

Enrich life with Augmented Reality UI of the Future What is Augmented Reality? z Reality Virtual Reality Augmented Reality • By definition, Augmented Reality means augmenting the

The Emergence of Augmented Reality in Orthopaedic Surgery ... · PDF fileThe Emergence of Augmented Reality in Orthopaedic ... Augmented Reality in Orthopaedic Surgery ... augmented

Augmented Reality (AR) - Razvoj karijere | Center for ... · PDF fileProširena stvarnost - Augmented Reality (AR) Dr Nenad Gligorić. Šta je Augmented Reality? •Termin Augmented

Enable Your Virtual Reality & Augmented Reality Technology on … · 2019-10-17 · Augmented Reality vs Virtual Reality – Similar or Different? Augmented Reality (AR) and Virtual

Augmented Reality Gaming | Augmented Reality Games

Strategic Customer Innovation Augmented Reality …...Strategic Customer Innovation Augmented Reality Soccer Featured Technologies ConversationalAI Augmented Reality Instant Messaging

Augmented and Virtual Reality - Massachusetts Institute of ...groups.csail.mit.edu/.../2017-fall/5-augmented-reality.pdf · Augmented Reality (AR) mixed reality real environment augmented

DoF-based Classiﬁcation of Augmented Reality Applicationsfar.in.tum.de/...Classifying_AR/...Augmented-Reality-Applications.pdf · DoF-based Classiﬁcation of Augmented Reality