MIDDLEWARE - kth.se file2014 My Teaching • DD3336, Interactive Entertainment Technologies (PhD...

DD3336/DH2650

Christopher Peters

HPCViz, KTH Royal Institute of Technology, Sweden

chpeters@kth.se http://www.csc.kth.se/~chpeters/

MIDDLEWARE A Brief Overview

Who am I?

• Christopher Peters – email: chpeters@kth.se

– https://www.kth.se/profile/chpeters/

• Unofficial Irish Doom E1M1 champ., ~1994

• Havok, 1999

• Associate Prof. (Docent)

• Research:

Computer graphics & animation

Game technologies

Perceptual computing

Christopher Peters DD3336/DH2650 Middleware chpeters@kth.se

PhD, Visual Attention for Animating Characters

My Teaching

• DD3336, Interactive Entertainment Technologies (PhD level)

• DT2350, Human Perception for Information Technology

• DH2323, Computer Graphics and Interaction

• DH2320, Introduction to Visualization and Graphics

• DD1354, Models and Simulation

• Visualization (VIC) Studio

4K screen, Oculus Rift, eye-trackers, etc

DD3336

My Teaching

• DH2323, Computer Graphics and Interaction (P4)

• DD1354, Models and Simulation (P3)

4K screen, Oculus Rift, eye-trackers, etc

Today’s Question

How to go from this…

2014 Christopher Peters DD3336/DH2650 Middleware chpeters@kth.se

Today’s Question

…To this?

Battlefield 4, DICE

Game Complexity

Blow, J. (2004).Game Development: Harder than you think, ACM Queue 1(10)

Image courtesy [Blow2004]

Game Complexity

Game Complexity: 2004++

Game Complexity >2014?

Rees, Kreiman and Koch, Neural correlates of consciousness in humans, Nature Reviews Neuroscience 3, 261-270, 2002

Do you have to reinvent the wheel?

No: Reuse game components

Game Components

Core Code – Engines and middleware

(from programmers)

Content

(from artists, designers, sound engineers...)

Game Components

Core Code – Engines and middleware

(from programmers)

Content

(from artists, designers, sound engineers...)

A Typical Chain

2D paint package

3D modelling package Real-time engine

2D textures 3D models and animations

Real-time rendering, animation and interaction

A Typical Chain

2D paint package

3D modelling package Real-time engine

2D textures 3D models and animations

Real-time rendering, animation and interaction

Plugins

Engines

Middleware

No Reinventing the Wheel

●API (Application Programmers Interface)

Software that interfaces with operating systems, libraries and services

●SDK (Software Development Kit)

Collection of libraries, API’s and tools made available for programming

●Graphics/rendering engine Takes care of rendering activities – visible surface determination, shading etc.

●Game engine Integrated game development kit encompassing graphics and many other game-related aspects …

Example: OpenGL

Example: Bullet Physics SDK

http://www.youtube.com/watch?v=J9HaT23b-xc

Example: OGRE

Object-oriented Graphics Rendering Engine

OGRE is primarily a graphics engine http://www.ogre3d.org/

Does not concentrate on sound, AI, networking, collision, physics (but often available as add-ons...)

Ambient occlusion, parallax mapping, soft shadows, etc

Example: Bitsquid

Bitsquid is primarily a games engine http://www.bitsquid.se

Graphics and...

Sound, AI, networking, collision, physics, particles, animation, lighting, scripting, mobile support, etc

The Old/Hard Way (1)

Integrate your own components…

Choose a graphics library

OpenGL

Add in peripherals

GUI (Crazy Eddie)

Model loading (AssImp)

Physics (Bullet)

Networking (Raknet)

Code your own shaders, etc

The Old/Hard Way (2)

Integrate your own components

Choose a graphics engine

Add in peripherals

GUI (CrazyEddie)

Networking (Raknet)

Add your own specialised algorithms

More feasible: no need to create a full graphics engine

Component integration is still an issue

The Modern Way

Just use a game engine already…

Modern engines deliver great off-the-shelf features

Great for rapid prototyping (GameMaker)

For specialised features, you will still need to make your own plugins, libraries, SDKs, etc the old/hard way

E.g. C++ dll, DD3336, ACM Siggraph

Example: Crowd Rendering

Specialist game technology

Not an ‘out of the box’ feature (yet)

Rendering challenges

Real-time operation -> Imposters

Representation and variety of appearance -> Perception

Eye-posters: https://kth.box.com/s/pxup6er92amskuxocu25

Crowd Variety and Perception

Left for Dead 2 zombies, Valve

Clone Attack! Perception of Crowd Variety

Rachel McDonnell, Micheal Larkin, Simon Dobbyn, Steven Collins, Carol O'Sullivan, ACM Transactions on Graphics (SIGGRAPH 2008), 27, (3), 26:1 - 26:8, 2008

Middleware Considerations

Check licenses and costs (first!)

Developer support

There’s a reason for it…

Forum activity

Integration issues with your engine

Source code access sometimes critical

Tool and engine support

Blender/Maya/Max integration

Middleware Landscape

Ranked:

Physics (big!)

AI Navigation

Virtual characters

Weather rendering

Real-time global illumination

Occlusion culling

Trees and foilage*

Miscellaneous (networking, UI)

Physics

Mainly rigid-body and cloth simulation Some fluids

Bullet

AI Navigation

Recast (nav meshes), Detour (pathfinding and spatial reasoning), MIT license https://www.youtube.com/watch?v=XyfLSocd9ec

Real-time Global Illumination

Geomerics Enlighten http://www.geomerics.com/enlighten/

Face Animation

http://www.facefx.com/content/english-un-declaration-human-rights

http://www.facefx.com/

Intelligent Virtual Characters

Smartbody, LGPL http://smartbody.ict.usc.edu/video

Sky and Weather

Simul TrueSky, £150 http://simul.co/truesky/truesky-alpha-for-unity/

Sky and Oceans

Silverlining and Triton ($100 per seat) http://sundog-soft.com/sds/

Trees and Foilage

Speed Tree http://www.speedtree.com/

http://www.youtube.com/watch?v=r18c7QlWLBQ

In General

Many other libraries, SDKs and tools out there

Have not really covered low level libraries for programming and math (vital!)

The landscape shifts quite quickly

Many engine specific libraries available

For a slightly different (older) cross section of middleware, see: Anderson and Peters, No More Reinventing the Virtual Wheel: Middleware for Use in Computer Games and Interactive Computer Graphics Education, Eurographics

Using Unity?

To the Asset Store Immediately!

https://www.assetstore.unity3d.com/en/

Postscript: Student Projects

http://www.csc.kth.se/~chpeters/projects.html

Example

Procedural footpath generation using a texture synthesis approach

Yang Zhou, see: http://projectfharlanghn.wordpress.com/

Remember

• Aim to create portfolio work

• DH2413, Advanced Graphics and Interaction

• DH2323, Computer Graphics and Interaction

• DD1354, Models and Simulation

MIDDLEWARE - kth.se file2014 My Teaching • DD3336, Interactive Entertainment Technologies (PhD...

Documents

Transcript of MIDDLEWARE - kth.se file2014 My Teaching • DD3336, Interactive Entertainment Technologies (PhD...

DATA-DRIVEN RESOURCE MANAGEMENT2013.ict4s.org/wp-content/uploads/B1-data_driven_turpeinen_ict4s.pdf · JORGE ZAPICO zapico@kth.se HANNES EBNER hebner@kth.se . Title: Slide 1 Author:

Benign Neglect - kth.se

Embodied Cognition Course Gert Kootstra. Embodied Cognition Embodied Cognition Course Course coordinator Gert Kootstra, CVAP kootstra@kth.se kootstra@kth.se.

MOCAP, TRUCKS AND VISUALIZATION TOOL USER’S MANUAL/Menu... · Pedro Lima, Joao Pedro Alvito˜ pfrdal@kth.se, jpfa@kth.se, MOCAP, TRUCKS AND VISUALIZATION TOOL USER’S MANUAL Stockholm

Artur Podobas podobas@kth.se SCS Seminar 2015 KTH/A.Podobas.pdf · Improving performance of parallel OpenMP programs Artur Podobas podobas@kth.se SCS Seminar 2015 KTH SCS Seminar,

fkartasev, carlora, dominikfg @kth.se arXiv:1809.07759v1 [cs.CV] … · 2018-09-21 · KTH Royal Institute of Technology fkartasev, carlora, dominikfg @kth.se ... [cs.CV] 20 Sep 2018.

Analysis and comparison of capital allocation techniques ... · Héloïsede Sauvage Vercour Supervisor: HenrikHult hdsv@kth.se hult@kth.se Cosupervisor: PierreDevolder ... (C i,k)e−r

Reservoir simulation and meliorate the hydropower production Hadi Madani,WST program mhmadani@kth.se Supervisors: Anders worman worman@kth.se Sezar moustafa.

William Sandqvist william@kth.se Övning 9 Trådar och Semaforer.

Lecture 1 - kth.se

Motion Perception - DT2350 Human Perception for …...DT2350 Human Perception for Information Technology Giampiero Salvi KTH/CSC/TMH giampi@kth.se HT 2016 1/44 Literature Goldstein,

3UHGLFWLYHYHKLFOHPRWLRQ FRQWUROIRUSRVW …1140559/FULLTEXT01.pdf · jonas1@kth.se Valerio Turri turri@kth.se. Abstract The aim of the project is to design an active safety system

Smart Sustainable Cities – a strategic innovation agenda Project leaders: Mattias Höjer, hojer@kth.se and Olga Kordas olga@kth.se Financed by Swedish Energy.

Teacher : Joanne Fernlund 790 7045 joanne@kth.se

Saab AB - kth.se

Quality Assurance - REDEEM Project · KTH Quality Assurance team for joint programmes . uf-bus@kth.se . Karin Knutsson . kkntssn@kth.se, tel: +46 (0)8 7906814 . KTH . Brinellvägen

Electron Propagation in Periodic Potentials...Theoretical Physics Electron Propagation in Periodic Potentials Klas Karis kkaris@kth.se Deborah Merzan deborahm@kth.se Jakob Wärnhjelm

Alireza Tavakoli Targhi att@kth.se

Ester Barinaga, Ph.D.; esterb@kth.se Kista - A Digital Divide? Ester Barinaga, Ph.D. Royal Institute of Technology esterb@kth.se.

Shannon decomposition William Sandqvist william@kth.se Claude Shannon mathematician / electrical engineer (1916 –2001) William Sandqvist william@kth.se.