California Institute for Telecommunications and Information Technology

Talk to Qualcomm

San Diego, CA

March 8, 2002

Dr. Larry Smarr

Director, California Institute for Telecommunications and Information Technologies

Professor, Dept. of Computer Science and Engineering

Jacobs School of Engineering, UCSD

Abstract

After twenty years, the “S-curve” of building out the wired internet with hundreds of millions of PCs as its end points is flattening out, with corresponding lowering of the growth rates of the major suppliers of that global infrastructure. At the same time, several new “S-curves” are reaching their steep slope as ubiquitous computing begins to sweep the planet. Leading this will be a vast expansion in heterogeneous end-points to a new wireless internet, moving IP throughout the physical world.

Billions of internet-connected cell phones, embedded processors, hand-held devices, sensors and actuators will lead to radical new applications in biomedicine, transportation, environmental monitoring and interpersonal communication and collaboration. The combination of wireless LANs, the third generation of cellular phones, satellites, and the increasing use of the FCC unlicensed wireless band will cover the world with connectivity enabling both scientific research and emergency preparedness to utilize a wide variety of sensor-nets. Building on advances in MEMS and nanotechnology, smart sensors will be cheap enough to deploy widely, capable of multiple types of detection, and survivable for long periods of time. The data from these sensor-nets will be integrated with legacy data in optically networked visualization analysis or command and control facilities. The enhanced knowledge products will then flow out over the same wireless internet to personal devices in the hands of field scientists or first responders. These end points will themselves form electronic communities enhanced by accurate geolocation. Cal (IT)2 is carrying out experiments in its "Living Laboratories" with its industrial partners in all of these areas.

• Wireless Access--Anywhere, Anytime– Broadband Speeds– “Always Best Connected”

• Billions of New Wireless Internet End Points– Information Appliances– Sensors and Actuators– Embedded Processors

• Emergence of a Distributed Planetary Grid– Broadband Becomes a Mass Market– Internet Develops Parallel Lambda Backbone– Scalable Distributed Computing Power– Storage of Data Everywhere

The Next S-Curves of Internet Growth:A Mobile Internet Powered by a Planetary Grid

Over Fifty Industrial Sponsors From a Broad Range of Industries

Akamai Technologies Inc.AMCCAmpersand VenturesArch VenturesThe Boeing CompanyBroadcom CorporationCAIMIS, Inc.Conexant Systems, Inc.Connexion by BoeingCox CommunicationsDiamondhead VenturesDupontEmulex Corporation

Network SystemsEnosys MarketsEnterprise Partners

Venture CapitalEntropia, Inc.Ericsson Wireless

Communications, Inc.ESRIExtreme NetworksGlobal Photon SystemsGravitonIBM

ComputersCommunications

SoftwareSensors

BiomedicalStartups

Venture Capital

Newport CorporationOracleOrincon IndustriesPanoram TechnologiesPrintronixQUALCOMMQuantumThe R.W. Johnson Pharmaceutical Research InstituteSAICSamueli, Henry (Broadcom)SciFrame, Inc.Seagate Storage ProductsSGISilicon WaveSonySTMicroelectronics, Inc.Sun MicrosystemsTeraBurst NetworksTexas InstrumentsTime DomainUCSD HealthcareThe Unwired FundWebEx

IdeaEdge VenturesThe Irvine CompanyIntersil CorporationIrvine Sensors CorporationJMI, Inc.Leap Wireless InternationalLink, William J. (Versant Ventures)Litton Industries, Inc.MedExpert InternationalMerckMicrosoft CorporationMission VenturesNCR

Cal -(IT)2 Industrial PartnershipsEnable Many Initiatives in the University

• Endowed Chairs for Professors

• Start-Up Support for Young Faculty

• Graduate Student Fellowships

• Research and Academic Professionals

• Sponsored Research Programs

• Equipment Donations for Cal-(IT)2 and Campus

• Named Laboratories in New Institute Buildings

• Pro Bono Services and Software

Cal-(IT)2 “Living-in-the-Future” Laboratories

• Technology Driven– Ubiquitous Connectivity– SensorNets– Knowledge and Data Systems– LambdaGrid

• Application Driven– Ecological Observatory– AutoNet– National Repository for Biomedical Data

• Culturally Driven– Interactive Technology and Popular Culture

Cellular Internet is Already Here At Experimental Sites

• UCSD Has Been Beta Test Site – Qualcomm’s 1xEV Cellular Internet

• Optimized for Packet Data Services– Uses a 1.25 MHz channel

– 2.4 Mbps Peak Forward Rate– Part of the CDMA2000 Tech Family– Can Be Used as Stand-Alone

• Chipsets in Development Support– PacketVideo’s PVPlayer™ MPEG-4– gpsOne™ Global Positioning System– Bluetooth– MP3– MIDI– BREW

Rooftop HDR Access Point

New Software Environments for Wireless Application Development

• Binary Runtime Environment for Wireless (BREW)– Works on Qualcomm CDMA Chipsets– Middleware Between

– the Application and the Chip System Source Code

– Windows-based Software Development Kit (SDK) – Native C/C++ applications will run most efficiently – Supports Integration of Java™ Applications– Different Model of Security from JAVA

• UCSD Brew Plans– Access to 40 Brew Enabled Kyocera Handsets– Free Air-Time Through “Campus Wide” QOTA System– BREW SDK and Technical Support Environment

www.qualcomm.com/brew/

Goal: Smooth Handoff by Mobile Device As One Moves from Local to Wide Area

WLAN GPRS

CDMA CDPD

Internet

(802.11b,a)

(CDMA20001xEV)

Identify Issues Related to Handoff Between WLAN and WWAN Networks

and Implement a Test-bed

Ramesh Rao, Kameshwari ChebrolouUCSD-CWC, Cal-(IT)2

Using Students to Invent the Futureof Widespread Use of Wireless Pocket PCs

• Year- Long “Living Laboratory” Experiment 2001-02– 500+ Wireless-Enabled HP Pocket PCs – Incoming Freshmen in Computer Science & Engineering

• Software Developed– ActiveClass: Student-Teacher Interactions– ActiveCampus: Geolocation and Resource Discovery– Extensible Software Infrastructure for Others to Build On

• Deploy to New UCSD Undergrad College Fall 2002– Sixth College Will be “Born Wireless”– Theme: Culture, Art, and Technology– Study Adoption and Discover New Services

Cal-(IT)2 Team: Bill Griswold, Gabriele Wienhausen

ActiveCampus Explorer: Personal Digital Assistant Interface

Source: Bill Griswold, UCSD CSE, Cal-(IT)2

Makes Campus “Transparent”

See Into Departments, Labs, and Libraries

ActiveCampus Explorer:Personal Digital Assistant Interface

Source: Bill Griswold, UCSD CSE, Cal-(IT)2

Millions of Video Cameras Will Add Image Data Streams to the Net

• London Underground– Initially 25,000 Video Cameras– Expansion to 250,000 Possible– British Transport Police Switch to Any Camera in 1 Sec.

– Source: Telindus

• British CCTV System– Currently 2.5 Million CCTV Cameras Installed (NY Times)

– Average London Citizen is Seen by 300 Cameras Per Day

– Face Recognition Software Added in High Crime Areas

• Up to 6 Million Surveillance Cameras Across the USA in 5-7 Years– Privacy International Prediction

Experimenting with the Future -- Wireless Internet Video Cams & Robots

Computer Vision and Robotics Research LabMohan Trivedi, UCSD, Cal-(IT)2

Mobile Interactivity Avatar

Linked by 1xEV Cellular Internet

Useful for Highway Accidents

or Disasters

Future Wireless Technologies Are a Strong Academic Research Discipline

Two Dozen ECE and CSE Faculty

LOW-POWEREDCIRCUITRY

ANTENNAS AND PROPAGATION

COMMUNICATIONTHEORY

COMMUNICATIONNETWORKS

MULTIMEDIAAPPLICATIONS

RFMixed A/D

ASICMaterials

Smart AntennasAdaptive Arrays

ModulationChannel CodingMultiple Access

Compression

ArchitectureMedia Access

SchedulingEnd-to-End QoS

Hand-Off

ChangingEnvironment

ProtocolsMulti-Resolution

Center for Wireless Communications

Source: UCSD CWC

Required Wireless Services Middleware

Real-TimeServices

Mobile Code

LocationAwareness

PowerControl Security

Wireless Services Interface

UCI WirelessInfrastructures

UCSD WirelessInfrastructures

Applications

J. Pasquale, UCSD, Cal-(IT)2

Data Management

Operating System Services for Power / Performance Management

• Management of Power and Performance – Efficient Way to Exchange Energy/Power Related Info

– Among Hardware / OS / Applications– Power-Aware API

Application

Power Aware API

Power Aware Middleware

POSIX PA-OSL

OperatingSystem

OperatingSystem

Modified OS Services

Hardware Abstraction Layer

PA-HAL

Hardware

Rajesh Gupta UCI, Cal-(IT)2

Prototyping Early Warning Systems and Disaster Response Systems

• Three-Tier System– Wireless SensorNets Bring Data to Repositories– Collaborative Crisis Management Centers– Remote Wireless Devices Interrogate Databases

• Cal-(IT)2 Will Focus on High-Performance Grids– Analysis, Collaboration, and Crisis Management– Broadband Wireless SensorNets– Metro Optical Network Testbed

• Build a “Living-in-the-Future” Laboratory– UCSD, UCI, and SDSU Campuses– San Diego, Orange County, Cross Border– Early Access to HW/SW from Industrial Partners

What is a SensorNet?

• Sensors – Physical, Chemical, Biological, Imaging,…

• Sensor Platform– Computing, Power, Storage, Radios, …

• Telecommunications Infrastructure– Wired, Wireless, Internet, …

• Sensor Arrays– Homogeneous, Inhomogeneous, Ad Hoc, …

• Layered Software

• Backend Data Systems

Challenges of Emergency PreparednessThat the Future Internet Will Impact

• How Do We Know:– The Detailed Current State of the System NOW?– What the Future Evolution of the Situation is Likely to Be?

• How Can We Achieve:– An Overall Situational Awareness?– A Common Operational Picture?

• How Do We Communicate With:– Crisis Managers?– First Responders?

• How Can We Decide:– Which Problem to Attack First?– Which Assets Should Be Deployed Where and When?

The FCC Unlicensed Band Can be Used to Create a High Speed Wireless Backbone

• The High PerformanceWireless Research and Education Network

• A Cal-(IT)2

Academic Partner

• Enabling a Broad Set of Science Applications

• Allows for Internet Deployment to Remote Locations

http://hpwren.ucsd.edu/topo.html

NSF FundedPI, Hans-Werner Braun, SDSC

Co-PI, Frank Vernon, SIO45mbps Duplex Backbone

HPWREN Project Demo of Fast Setup Wireless Internet for Crisis Response

http://hpwren.ucsd.edu/Presentations/HPWREN/Slide26.JPG

A Cal-(IT)2

Academic Partner

Sensors Enable Real-Time Monitoring of BridgesThrough Wireless Internet

Mt. ______

Wireless internet

Bridge site (Coachella, CA)

UCSD

Data conditioningand acquisitionStructures

Frieder Sieble

UCSD Structural Engineering

Environmental SensorNets

• Air and Water Pollution Sensor Development– Lead is Michael Sailor, UCSD Chemistry– Initially Temperature, Humidity, CO

– Later Add CO2, Ozone, NOx

– Partnering with Graviton

• Wireless Internet Prototyping Sites – UCSD Campus– Santa Margarita

– Ecological Preserve – Rapid Prototyping Site– Linked to UCSD via HPWREN

Life of a sensor network

• In the beginning nodes are deployed with a supply of – Energy– Capability– Awareness– Location

• At the end nodes – Die – no energy, stranded, loss of capability– Reborn – new battery, sensor, radio,…

• During its life nodes– Trade resources with neighbors to deliver on mission

Source: Ramesh Rao, UCSD Cal-(IT)2

Design Challenges

• Develop resource sharing algorithms– Trade Energy for Location

– Dynamic topology construction –mobility– Trade Communication for Computing

– Distributed Computing– Trade Energy for Awareness/Alertness

– Next hop communication and end-to-end delivery

• Develop platforms that implement them– Overcome limitations of layered principle– Share salient costs across layers

– Energy, Delay, Complexity…

Source: Ramesh Rao, UCSD Cal-(IT)2

Topology Construction

• AIBO platform– 64 bit RISC processor, – 32 Mb memory– Temp., distance, acceleration,

pressure, IR, vibration sensors

– 100 K pixel CMOS image sensor

– 802.11b enabled

• Topology construction algorithms for mobile nodes– Maximize network

lifetime– Maximize coverage– Minimize energy

consumption

Source: Ramesh Rao, UCSD Cal-(IT)2

Automobiles will Become SensorNet Platforms

• Autonet Concept– Make Cars Mobile, Ad Hoc, Wireless, Peer-to-Peer Platforms– Distributed Sensing, Computation, and Control– Autonomous Distributed Traffic Control– Mobile Autonomous Software Agents– Decentralized Databases

Congestion-free flowCongestion-free flowUrbanUrbanMobilityMobility

UrbanUrbanMobilityMobility

Rigid Line-Haul PerformanceRigid Line-Haul PerformanceClean Limited-Clean Limited-Range MobilityRange Mobility

Clean Limited-Clean Limited-Range MobilityRange Mobility

Will Recker, UCI and Mohan Trivedi, UCSD, Cal-(IT)2

• ZEVNET Partners– UCI Institute for Transportation Studies Testbed– UCSD Computer Vision and Robotics Research Lab (CVRRL)

REACT! ApplicationApplication ApplicationApplication TRACER

Internet Website

Service Provider

CDPDWireless Modem

Website

ISP

REACT!On-line Survey

Activity diary Tracing RecordsActivity diary Tracing Records

Initial Interview

Pre-Travel PlanningPost-Travel Updating

Initial Interview

Pre-Travel PlanningPost-Travel Updating

Activity diary Tracing RecordsActivity diary Tracing RecordsActivity diary Tracing RecordsActivity diary Tracing Records

Initial Interview

Pre-Travel PlanningPost-Travel Updating

Initial Interview

Pre-Travel PlanningPost-Travel Updating

Source: Will Recker, UCI, Cal-(IT)2

ZEVNetCurrent Implementation

GPSGPS SensorSensor SensoSensorrSensorSensor ......

Extensible Data Collection Unit

Currently 50 Toyotas

Embedded and Networked Intelligence

• On-Campus Navigation Enabled– Web Service and Seamless WLAN Connectivity– 50 Compaq Pocket PCs

• Virtual Device / Instrument Control Over Bluetooth Links• Energy-Aware Application Programming• Battery-Aware Communication Links

Source: Rajesh Gupta, UCI, Cal-(IT)2

Low Power Biological, Chemical, Pollutant, Magnetic, Particulate Sensor Development

• Designed to Be Easily Manufactured– Sensitive Nanostructured Photonic Bandgap Material – Can Be Chemically Modified to Be Specific – Compatible With Silicon Microfabrication Technologies

• Special Properties:– Low False Alarm Rate, Sensitive – Miniature, Portable, Lower Cost

• Target Markets: – Industrial Waste, Pollution Monitoring – Law Enforcement, First Responders, Medical Personnel

Handheld Nanosensor Device for Sarin Nerve Agent

Developed for DARPA Micro Unattended Ground Sensors program

Mike Sailor, UCSD Chemistry, Cal-(IT)2

Adding Wireless Sensors to Systems-on-Chip Will Create Brilliant Sensors

Applications

Memory

Protocol Processors

ProcessorsProcessors DSP

EmbeddedSoftware

Sensors

Source: Sujit Dey, UCSD ECE

Radio

Critical New Role of Power Aware Systems

Internet

Ad Hoc Hierarchical Networks of Brilliant Sensors

Sensornets—Real-Time Data• ROADNet• ActiveCampus• Health of Civil Infrastructure• AUTONET

Storage hardware

Database Systems, Grid Storage,Filesystems

Data Mining, Simulation Modeling, Analysis, Data Fusion

Applications: Bioinformatics,Ecoinformatics, Geoinformatics, …

Knowledge-Based Integration Advanced Query Processing

Networked Storage (SAN)

Visualization

High speed networking

Data and Knowledge SystemsTechnology Layers

Knowledge and Data Engineering Lab

Enabling querying,analysis, and creative exploration of large, integrated data sets

Knowledge Environments to Support Digitally Enabled Genomic Medicine

Bioimaging

Bioengineering

Proteomics

Genomics

Chemical Pathways

Medical Records

IntegratedInformation

An

alysis Sta

tist

ics

KnowledgeDiscovery

wireless access

School of Medicine / VA Hospital

BioengineeringDepartment

Industry Partners

• Enosys – XML-based database integration– Enosys and Polexis will join in joint demo to NSF and FedStats

• Polexis – Java-based application integration– Possible joint demos at AFCEA Homeland Security conference

• Oracle – database engine technology– Supporting BIRN project

• ESRI – geographical information systems (GIS)– Discussing variety of options for greater collaboration

• BAE Systems – XML-based GIS systems• IBM – database, data integration, and data mining technology

– Recent meeting with Life Sciences, Database groups at SDSC; NetDB2 project (UCI)

• SAIC – TeraText XML database engine– Will discuss their participation in I2T

• Velocigen – possible partner for converting Web sites to Web services

CONTROL

PLANE

Clusters

DynamicallyAllocatedLightpaths

Switch Fabrics

PhysicalMonitoring

Apps Middleware

A LambdaGrid Will Be the Backbone for an e-Science Network

• Metro Area Laboratories Springing Up Worldwide

• Developing GigE and 10GigE Applications and Services

• Testing Optical Switches

• Metro Optical Testbeds-the next GigaPOP?

Multi-Sensor Data Fusion Control Rooms Will Integrate SensorNets with Legacy Data

• Integrate– Situational Awareness– Common Operational Picture– Local Data Warehouse with Remote Data Access– AI Data Mining of Distributed Databases– Spatial Data Analysis – Consequences Assessment Tool Set

Source: Panoram Technologies

Cal-(IT)2 Multi-Megapixel Displays for Seismic, Geosciences, and Climate Analysis

Cal-(IT)2 / SIO / SDSC / SDSU