UCSD Center for Hybrid Multicore Productivity Research

UCSD Center for Hybrid Multicore Productivity Research

sgbrown@ucsd.edu

crca.ucsd.edu/sheldon

sgbrown@ucsd.edu

crca.ucsd.edu/sheldon

Center for Research in Computing and the Arts

Inventing new art formsby creating

new technologies

Director, Sheldon BrownAssociate Director, Miller Puckette

http://crca.ucsd.edu

Calit2• 215,000 gross square feet • Clean room including:• Circuits laboratory • Optical networking laboratory • Rooftop "antenna garden"• New Media Arts research labs:• 200-seat auditorium • Gallery, Black Box,• High Def production, motion capture,• Gamelab, spatialized audio, virtual • reality, 3D fabrication

PI - Sheldon Brown, Director of CRCAStaff -

Todd Margolis – CRCA Technical Director

Erik Hill - Programmer Analyst

Daniel Tracy - Programmer Analyst

Kristen Kho – Programmer Analyst

Robert Twomey - Programmer Analyst

Potential Affiliated Faculty -

Henrik Wann Jensen, Associate Professor CSE

Bill Lin, Associate Professor, ECE

Geoff Voelker - Professor CSE

Scott Baden - Professor CSE

Rajesh Gupta, Professor CSE

Tom Defanti, Research Professor Calit2

Keith Marzullo - Professor CSE

Larry Smarr - Professor CSE

UCSD/CRCA/Calit2 CPMR StaffUCSD/CRCA/Calit2 CPMR Staff

UCSD CRCA/Calit2 FacilitiesUCSD CRCA/Calit2 Facilities• IBM z10 mainframe with the San Diego Supercomputer Center• 4 Blade QS20 Cell Cluster, QS22 Blade• Cluster computer resources• Experimental Game Lab - quad core PC's - Nvidia 280 and Quadro 5400• Larrabee development systems (forthcoming)• 16 sided StarCAVE (immersive VR stereo surround environment)• 200 Megapixel tiled display wall• 55 screen tiled 3D Varrier screen display.• 4K cinema technology - Sony SXRD Projector, JVC 4K projection, Zaxel• 4K servers, JPEG2000 encoder/decoder, 10gb network streams, Prototype 4K and stereo display panel

prototypes• Spatialized Audio Research Lab - 26 Channel 3D sound lab• Motion Capture/Computer Vision Research Lab - 24 channel VICON motion

capture system, 3D laser scanning, structured light, multi-channel video.• VR Development Lab - variety of interfaces and display types• HD Production Environment - Studio and multibay editing• Optiputer network environment - Global Lambda Infrastructure• 3D Fabrication Lab - rapid prototyping and CNC machining tools

Visualization Labs

Multi-screen, multi-user virtual reality environments accessing large database servers. Clustered, Multi-core computers drive innovative display and HCI.

Digital Cinema Auditorium ultra-high resolution cinema, 3-D sound; tele-presence conferencing; stereo imaging, Cine-Grid optical ultra-high bandwidth

Mutable Media Production Environments

Networked Mainframe and Hybrid Multicore Blade Servers for interrelating the development of new forms of digital cinema and virtual worlds. Peking University the San Diego Supercomputer Center and CineGrid networks as project partners.

Leveraging global lambda networks to improve performance for extremely high bandwidth and time dependent applications such as cinema, teleconferencing and virtual reality.

WAAG, AmsterdamWAAG, AmsterdamCalit2, UCSDCalit2, UCSD

Calit2 and NSF Optiputer Project Allow for High Speed Networks and Ultra-High Fidelity environments.

Experimental Game Experimental Game LabLab: An Atelier / : An Atelier / Technology Technology Development Studio Development Studio which creates hybrid which creates hybrid forms of culture at forms of culture at the intersection of the intersection of new media, public new media, public space, architecture space, architecture and art. and art.

Underlying this work Underlying this work is the creation of is the creation of digital technologies digital technologies as a translational as a translational medium that allows medium that allows for a mutable for a mutable exchange of forms, exchange of forms, sensibilities and sensibilities and gestures. Modeling, gestures. Modeling, simulation and simulation and software are the software are the common tools for common tools for shaping time and shaping time and space.space.

Experimental Game LabExperimental Game Lab

Technology InnovationTechnology Innovation•Procedural AssetsProcedural Assets

Next Generation ComputingNext Generation Computing

•Hybrid Multicore – Cell ProcessingHybrid Multicore – Cell Processing•Multicore x86Multicore x86•Larrabee prototype developmentLarrabee prototype development•Mainframe computing for Virtual WorldsMainframe computing for Virtual Worlds

Heterogenous FormsHeterogenous Forms•Cinema, Media, Architecture, HCI, DisplaysCinema, Media, Architecture, HCI, Displays

Development ProcessesDevelopment Processes•PrototypingPrototyping•Integration of Modeling and VisionIntegration of Modeling and Vision•Pedagogical Approaches Pedagogical Approaches

Cultural InnovationCultural Innovation

Critical EngagementCritical Engagement

•New types of game narrativeNew types of game narrative

•How do games produce meaning?How do games produce meaning?

Gaming is the defining cultural form of Gaming is the defining cultural form of the 21the 21stst century. We bring innovative, century. We bring innovative, multi-disciplinary expertise to push multi-disciplinary expertise to push forward the technological and expressive forward the technological and expressive fronts.fronts.

Visualization provides early testbeds for Visualization provides early testbeds for future forms of Gaming, which in turn future forms of Gaming, which in turn create new opportunities of visualization create new opportunities of visualization research.research.

Intersecting technologies of scientific visualization and the Intersecting technologies of scientific visualization and the game industry through the creation of new forms of art.game industry through the creation of new forms of art.

Games are cultural experiences that Games are cultural experiences that are also social structures – are also social structures – increasingly the situation for cultural increasingly the situation for cultural forms.forms.

Scalable City – exhibited at museums around the worldScalable City – exhibited at museums around the world

Zacheta Gallery – Warsaw

E3 – Los Angeles

Ars Electronica –Austria

India International Center – New Delhi

Museum of Contemporary Art - Shanghai

National Academy of Science, Wash. DC

Siggraph 2007 - San Diego

Exploratorium – San Francisco Supercomputing 2007

Sao Paulo, Brazil

Los Angeles Barnsdall Art Gallery

Gallery@calit2

Beall Center for Art and Technology

Rio de Janeiro, Brazil

Tokyo

Motion Capture and Computer VisionIntegrates the human body into digital media with telepresence, computer vision, motion capture and experimental interfaces, extending the fidelity of the human computer interface.

Motion Capture and Computer VisionIntegrates the human body into digital media with telepresence, computer vision, motion capture and experimental interfaces, extending the fidelity of the human computer interface.

The Audio Spatialization Lab 26 channel, real time spatialized audioThe Audio Spatialization Lab 26 channel, real time spatialized audio

Ultra High Fidelity Video and Audio Production Ultra High Fidelity Video and Audio Production

ExperimentExperimental Game Labal Game Lab

XML metadata tags facilitate XML metadata tags facilitate actionsactions

VICON Inc. supports VICON Inc. supports development of computer development of computer

vision asset creation. vision asset creation.

CRCA FabLabCRCA FabLab

Rapid Prototyping and CNC Rapid Prototyping and CNC output of Virtual World Data output of Virtual World Data FormsForms

Rapid Prototyping and CNC Rapid Prototyping and CNC output of Virtual World Data output of Virtual World Data FormsForms

Cultural forms destabilize every 18 months as their underlying technology base transforms. This leads to the instability of “mediums” as we used to know them.

Culture is now a Moore’s law condition.Culture is now a Moore’s law condition.

Our media now consists of visualizations of data, algorithms and user interactions (social spaces).

Culture = Data + Algorithms + Users

Our media now consists of visualizations of data, algorithms and user interactions (social spaces).

Culture = Data + Algorithms + Users

The Cultural Landscape of the 21st century is radically different from the 20th century in

methods, use and meanings.

The Cultural Landscape of the 21st century is radically different from the 20th century in

methods, use and meanings.

Next Generation Culture will develop out of the capabilities that Multicore Computing enables in relationships that we can create

between these areas:

Assets, Dynamics and Behavior Computation for Virtual worlds and games

Multi-user, Extensible Virtual Worlds

Future Cinema – 3D, Ultra-high Resolution Production

Next Generation Culture will develop out of the capabilities that Multicore Computing enables in relationships that we can create

between these areas:

Assets, Dynamics and Behavior Computation for Virtual worlds and games

Multi-user, Extensible Virtual Worlds

Future Cinema – 3D, Ultra-high Resolution Production

Initial proposed industry partners:

IBM, Intel, Sony, Emergent Game Technologies, Zaxel Inc.