1CITRIS 2010

New Media Research

Profs. Ken Goldberg and Greg NiemeyerProfs. Ken Goldberg and Greg NiemeyerCITRIS at UC BerkeleyCITRIS at UC BerkeleyProf. Marilyn WalkerProf. Marilyn WalkerCITRIS at UCSCCITRIS at UCSCMaurizio ForteMaurizio ForteCITRIS at UC MercedCITRIS at UC Merced

California is the Mecca of new media“The world spends over 110 billion minutes per month on social networks and blog sites.” - NielsenWire, June 2010

Apple, Google, Facebook, HP, Intel, Cisco, eBay, Adobe, Agilent, Oracle, Yahoo, Netflix, and EA.

3CITRIS 2010

OutlineOverview of CITRIS New Media ResearchOverview of CITRIS New Media ResearchCase StudiesCase Studies

Game-Based Learning for Health Game-Based Learning for Health ApplicationsApplications

Tele-Immersion and ArchaeologyTele-Immersion and ArchaeologyCrowdsourcing Insights and InnovationCrowdsourcing Insights and Innovation

Research PartnersResearch PartnersNext Ten YearsNext Ten Years

4CITRIS 2010

What is a medium?

5CITRIS 2010

6CITRIS 2010

8CITRIS 2010

9CITRIS 2010

10CITRIS 2010

11CITRIS 2010

Mission: To critically analyze and shape developments in new media from cross-disciplinary and global perspectives that emphasize humanities and the public interest.

CITRIS 2010 12

machine learning and social interaction (ryokai)

CITRIS 2010 13

phenomenology and second life (dreyfus)

CITRIS 2010 14

trust and video conferencing (canny)

15CITRIS 2010

donation dashboard (goldberg)

16CITRIS 2010

17CITRIS 2010

The New Media Research Roundtable

A bi-weekly series for faculty and graduate students to discuss current research in new media with emphasis on identifying new collaborative research opportunities among participants and presenters.

CITRIS 2010 18

Public Events:

•ATC Lecture Series•Design Futures Lecture Series•Continuous Bodies Symposium•Rip.Mix.Burn. Art Exhibit•ParaSite Symposium•Out of Time-Space•Embodiment and New Media•Conversation on Digital Film•Artist Appropriation Rights•Attention Literacy

CITRIS 2010 19

BCNM Research Lab and Reading Room4th Floor

20CITRIS 2010

Game-Based Learning for Health Applications

Prof. Marilyn WalkerProf. Marilyn WalkerCITRIS at UCSCCITRIS at UCSCProf. Greg NiemeyerProf. Greg NiemeyerCITRIS at UC CITRIS at UC Randi HagermanCITRIS at UC Davis

CITRIS 2010 21

Spy Feet: Using mobile gaming to promote physical activity in girls

Research on preventive health has shown that despite various interventions, physical activity declines precipitously in adolescents, especially in girls – leading to obesity, diabetes and cardiovascular problems.

Novel interventions for motivating teenagers to exercise would thus help address a national health problem.

The interest of youth in computer games and in smart phone applications suggests that mobile computer games aimed at increasing physical activity could providing compelling contexts for transforming health-related behaviors in young people

22CITRIS 2010

New Media: RPG’s + Dynamic Dialogue Generation

33

When a scheming mad scientist starts taking over drivers in the player's hometown, it's up to them to solve an ever-deepening mystery. As a budding Nature Warden, players learn to use their secret abilities to speak with animal spirits, uncovering a previously invisible world where ants are foot soldiers and beetles sing opera. Players will go on a series of journeys through familiar streets now alive with animals to befriend, missions to accomplish, and mysteries to unlock. The non-linear dynamically configured story and dialogue generation gives players the freedom to investigate only the characters or story elements that interest them.

CITRIS 2010 23

Research Questions

Technical: Hypotheses: Dynamic elements will increase

motivation to play, replayability, and immersion

SpyGen: A new generation engine to support dynamic adaptive dialogue generation for characters in role playing games

Grail GM: a new role playing game manager that supports dynamic reconfiguration of quests to allow user choices to matter

Societal: What types of motivational elements can

influence behavior change? What is the role of social interaction vs.

narrative world?

CITRIS 2010 24

Summary

Societal Will be ready to test with users in November Experiment with role of technical elements in motivating

behavior change

Technical Android Platform very re-usable Dynamic, easily reconfigurable architecture Spy Gen 1.0 Grail GM 2.0

37

From Anticipation to Prediction: Games, Data and Collective Gain

Greg NiemeyerCITRIS at UC BerkeleyRandi HagermanCITRIS at UC Davis

The CITRIS Promise: Multi-Campus Interdisciplinarity

• Presentation of "Balance Game" at UC Davis Tele-Immersion conference

• Seed funding for Multi-Campus pilot project• Close collaborations with Drs. Randi Hagerman,

Susan Rivera and Faraz Farzin now include Fragile X game (TrackFX) and RuleMaker.

• Collaboration led to international joint venture with the Montreal Neuroscience Institute.

The CITRIS Promise: Service to Society

The CITRIS Promise: Service to Society

• Reduce age at time of intervention

• Distribute application at lowest possible course

• Aggregate data broadly

• Play anywhere• Use existing

platforms and play frameworks

• Android version announced

Track FX: A study about game-based learning and therapeutic intervention

• Game Type: Intervention and Outcome Measure• Initial study with Typicals age 28 to 60 months at Child

Study Center• Game played on Tablet PCs, Data collection on online

database.• Four types of players seen in data  (cf. Bartle,

Richard): Learners, Novelty Seekers, Explorers, Competitors

• MOT skills accelerate at 36 months• TrackFX is outcome measure for

Minocycline study

Playable Links:

• TrackFX: http://www.trackfx.org/motgame/motbugs/• Thanks to CITRIS for connecting support, space,

doctors and game designers.• Thanks to the Townsend Center for summer interns. • Thanks to the Montreal Neuroscience Institute and UC

DAVIS for research support. 

31CITRIS 2010

Cyber-ArchaeologyVirtual Environments and New Media

Maurizio ForteMaurizio ForteCITRIS at UC MercedCITRIS at UC MercedRuzena BajcsyRuzena BajcsyCITRIS at UC BerkeleyCITRIS at UC Berkeley

Reconstructing the Material Past

The reconstruction of the past, in terms of cultural material, is one of the biggest challenges for contemporary societies.

The link of archaeology and digital technologies is fundamental for revisiting, interpreting and communicating the past

One of the bottlenecks in archaeology is the difficulty to contextualize and share data, models, archives, metadata in a collaborative way.

32

What kind of information can we transmit to the future generations? How do we preserve the knowledge of the past?How can we communicate this knowledge in the Digital Era?

ARCHAEO-PEDIA 3D: A POSSIBLE FUTURE COLLABORATIVE NETWORK ACROSS UC CAMPUSES

Outcomes and Perspectives

The prototypal virtual collaborative work open very challenging perspectives in other research and educational areas in and out the UC system. Ideas > 3D learning, Virtual Classes, Museum Studies, CRM,

Visual Art, Image Processing, Environmental Simulation, Environmental Monitoring, Virtual Labs, 3D Modeling, 3D Publications, Teleimmersive Networks

We are well positioned for the next ten yearsMigration and preservation of 3D digital archives and datasetsSimulation studies, Networking, Collaborative inter-campus

Scenarios, Intelligent Distribution of Digital Resources, Advanced Cognitive Impacts

34

Results of the Prototype Platform (UC Merced, UC Berkeley, UC Davis)

• Two users in the shared virtual space (rendering with applied texture mapping)

• User immersed in the virtual environment

The Cyber Map

Is the 3D modeling sufficient to show and explain the tomb iconographic complexity?

Virtual Reconstruction of a Chinese tomb at Xi’an (Virtual Collaborative System)

CITRIS 2010 37

The Powerwall at UC MercedCollaborative VR. M.Kalmann, M.Forte

CITRIS 2010 38

UCM Students at the Powerwall

Current and Future Partners

NEH

NSF

Trimble Navigation

Nextengine

Erdas

Avie Systems

UNESCO

39

40CITRIS 2010

Social Media for Crowdsourcing Social Media for Crowdsourcing Innovation and InsightsInnovation and Insights

Profs. Ken GoldbergProfs. Ken GoldbergCITRIS at UC BerkeleyCITRIS at UC Berkeley

The challenge: too much of a good thing

20 sec. per comment X 35,387 comments

= 8 days

42CITRIS 2010

Goals

For Organizations Understand the diversity of their community

Engage their community Solicit feedback and creative suggestions Rapidly identify patterns, insightful ideas

For Community Members Understand relationships with other

community members

Engage with a diversity of viewpoints and ideas

Express ideas, and be heard hybrid vigor

Our Approach

1. Visualization 2. Level Playing Field

3. Wisdom of Crowds 4. Game Structure

Opinion Space

Step 1: Enter your opinions and response

Step 2: Visualize your position

Step 3: Read and rate others users

48CITRIS 2010

March-Oct 2010

4,963 Users94 Countries

24,815 Opinions

CITRIS 2010 49

Interpreting Eigenvectors

Direction and magnitude of motion in PCA-space as slider value changes for each individual proposition.

50CITRIS 2010

Research Team:David Wong: EECS MS StudentEphrat Bitton: IEOR PhD StudentSiamak Faridani: IEOR PhD StudentElizabeth Goodman: School of Information PhDStudentTavi Nathanson: EECS Graduate StudentAlex Sydell: EECS Undergraduate StudentSanjay Krishnan: EECS Undergraduate Student

Ken Goldberg: IEOR, EECS, iSchoolGail de Kosnik: Theater, Dance, Performance StudiesKimiko Ryokai: School of InformationMeghan Laslocky: Outside Consultant on ContentAri Wallach: Outside Consultant on Content and StrategySteve Weber: Outside Consultant on ContentPeter Feaver: Outside Consultant on Content

U.S. State Department:Alec Ross: Senior Advisor for InnovationKatie Dowd: New Media Director

Partners thus far

"Opinion Space will harness the power of connection technologies to provide a unique forum for international dialogue. This is ... an opportunity to extend our engagement beyond the halls of government directly to the people of the world."

- Secretary of State Hillary Clinton

52CITRIS 2010

New Media ResearchNext 10 Years…

Profs. Ken Goldberg and Greg NiemeyerProfs. Ken Goldberg and Greg NiemeyerCITRIS at UC BerkeleyCITRIS at UC BerkeleyProf. Marilyn WalkerProf. Marilyn WalkerCITRIS at UCSCCITRIS at UCSCMaurizio ForteMaurizio ForteCITRIS at UC MercedCITRIS at UC Merced

53CITRIS 2010

Were the objectives and goals described in the original CITRIS proposal met by our research?

Absolutely! Our goals have been exceeded but there is exciting work ahead for the next 10 years!:

54CITRIS 2010

55CITRIS 2010

56CITRIS 2010

57CITRIS 2010

Thank you.