1

TCS Research Scholar Program

Topic - Intelligent Infrastructure: Applications and Technology

Speaker -Arpan Pal (Head, Innovation Lab, Kolkota)

4th May 2012

HOTEL TAJ PALACE, NEW DELHI

Theme Outline

3

Intelligent Infrastructure

Sense

Extract

Analyze

Respond

Learn

Monitor

Platfo

rm

ResearchVer

tica l

Ap p

s

• Transportation• Electricity / Water• Buildings / Home / Campus / Store• Automotive• Agriculture• Healthcare• Government

• Sensor Signal Processing and Informatics• M2M Communication• Cyber-physical Systems Modeling• Analytics• Platform Performance and Scalability

• Service Level APIs and SDK• Integration Interfaces• Development Framework

IntelligentInfra

@Home

@Building

@Vehicle@Utility

@Mobile

@Store

@Road

“Intelligent” “Infrastructure”

APPLICATION SERVICESBACK-END PLATFORM

INTERNET

GATEWAY

Internet-of-Things (IoT)

4

Integrated Platform for Intelligent Infrastructure

People Feedback & Emotions

Social Media

Integrated Services

Sensors & IoTPlatform

Traditional Monitoring & Control Systems Citizen Data

Smart Integration Platform

Transportation Healthcare Electricity

WaterPublic Safety Tourism

Smart Integrated Services

Sense

Analyze

Extract

Respond

Intelligence

Smart Domain Services

Community

etc.

Sense: People Activity, Appliances, Vehicles , Road, Home/Bldg, Utility Infrastructure

Detect gas leakage/water contamination : mobilize rescue team, suggest optimum route

Divert Road Traffic in case of Water Pipeline Burst

Correlate Electricity/Water /Gas consumption patterns

Intelligent Integration Platform

Integrated Intelligent Services

Research Focus

6

Research Areas

• Modeling of Cyber physical Systems

• Back-end Analytics Toolbox

• Web as a Soft Sensor for Intelligence

Communication

AnalyticsData Collection

• Protocols• Identity Mgmt.• M2M Comm.• Security and

Privacy

• Device Management & Monitoring

• Sensor Observation, Event and Management Services

• Sensor Signal Processing and Informatics

Storage & Systems

• Low-cost Storage• Distributed Query

Processing• Big Data Support• Object Store

Middleware

Modeling and AnalyticsPerformance and ScalabilityContext Extraction

7

Research Challenges

Challenges• Reducing the cost of Communication• Preserving the Battery power• Extracting information from ambient-noise-corrupted sensor

data• Multi-sensor fusion and analytics, sometimes in real-time• Preserving the Privacy

Solution Approach•Edge processing (sensor, audio, image, video) for context extraction

addresses the information extraction, cost of communication, privacy and battery power preservation issue

•Lightweight communication protocols over Internet addresses the cost of communication and battery power

preservation issue

•Algorithms for real-time analytics addresses the real-time multi-sensor fusion and analytics issue

•Privacy framework for sensor data with access control and authentication

addresses the security and privacy issue

8

Research Focus – Sensor Data Collection

•Partner with established players providing sensors and gateways

•Open-Geospatial Consortium (OGC) based sensor data acquisition, storage and management

• Sensor Observation Service (SOS)• Sensor Event Service (SES)• Sensor Planning Service (SPS)

• Device Management – Integrate sensor provider solutions

• Sensor Signal Processing and Informatics• Sensor / microphone / camera / biosensor

processing for constrained platforms• Intelligent Sensing• Sensing for Human-centric Computing• Signal Source Separation and data disaggregation

9

Research Focus – Storage and Systems

•Large-scale Sensor Data Storage• Affordable yet reliable• Open source based Q0S controlled solution

•Distributed Query Processing• Handling large and complex queries

•Big Data Support• Hadoop – Map-reduce• Efficient Databases 0 RDBMS and Key-value

Stores

• Object Store• Efficient Storage Blobs for large files• Linked to Metadata for efficient query

10

Research Focus – Analytics

•Back-end Analytics• Streams Processing, Complex Event

Processing and Streams Reasoning• Hierarchical Task Network based Planning• Non-parametric Statistical Data Processing

•Modeling of Cyber-physical Systems• Model-driven Sensor Data Interpretation

and Analytics• Model-driven design space exploration for

Sensors

•Web as a Soft Sensor for Intelligence• Sensor-assisted Social Network and Web

mining for Intelligence (Optra and Listening Platform)

• Using Social Network Structure for Co-operative Sensing

• Television-Web Mash-ups

11

Research Focus – Communication

•Protocols• Lightweight yet Reliable Protocols for delivery over

Internet

•Identity Management• Ubiquitous Identity of Things

•M2M Communications• Error-control Coding for Robustness• Secure M2M• Upper-audio band Communication

•Privacy Preservation• Access-Control Framework• Data Masking (Safemask)

Platform

13

Platform Architectural Layers

Internet

End Users & Renderers

Administrators

Device Integration & Management Services

Analytics Services

Application Services

Storage

Messaging & Event Distribution Services

Ap

plic

ati

on

Serv

ices

Presentation Services

Application Support Services

OS & Device Drivers

Edge Middleware

Analytics Persistence

Application Services

Mid

dle

ware

(S

ecu

rity

/Pri

vacy

and P

roto

cols

)

Gateway

Sensors

Internet

Back-end

RIPSAC – Real-time Integrated Platform for Services & Analytics in Cars / Cities

14

Platform Use Cases

Internet

Inte

rnetInte

rnet

Sensor Services

Analytics

StorageServices

RIPSAC Platform

App Developers

PaaS Provider

End User

Sensors

Sensor Providers

Use Cases, Demonstrators and Customer Case Studies

16

Intelligent Campus – Bus Fleet, Night Car Fleet, Parking Lot

Sensor Interface Services

Storage & Database Services

Analytics Services

RIPSAC + Apps

iDigi M2m Cloud

Bus Tracking System

Parking Management

Cab & Passenger Tracking

Reports & Alerts

Location ( GPS), Speed, Accelerometer, Passenger Ids

Valid passenger lists, Route Info

Images / video feeds of entry & exit ramps of underground parking lots

Images of cab registration number, Passenger Ids

Being deployed in TCS Campus at Siruseri, Chennai that houses 25000 people

Project Partners: Sensor Gateways – Digi

17

Intelligent Transportation – Vehicle Model Driven Sensor Data Analysis

KNOWN PARAMETERS EFFECTS TARGET INDUSTRYVehicle Type & Driving Behavior Road Condition Monitoring City MunicipalityRoad Condition & Driving Behavior Car Prognosis Automotive

Road Condition & Vehicle Type Driving Behavior Analysis Insurance

Acceleration a(t) = f (H(t), v(t), R(t), D(t))

H(t)

• Demo available for road condition monitoring on RIPSAC

18

Intent-based Social Network Formation• Social sub-graph formation between

ride-givers and ride-takers• Real-time decision system based on

instantaneous location and route matching

• Trust model based on “Friend-of-Friends” kind of relationship

• Reduction of search complexity

Intelligent Transportation – Share-a-Ride

• Demo available

19

Intelligent Healthcare – Remote Medical Consultation

ECG

Body Fat Analyzer

Blood PressureMonitor

Pulse OxyMeter

Healthcare

Portal

Mobile gateway

433MHz Wireless gateway

Web Request

• Demo available – possible pilot in a China City• Integration planned with TCS Clinical Decision Support System

PatientRecords

Health Center / Home

Expert Doctor

20

Intelligent Energy: Home Utility Management Solution (HUMS)

• Multi-protocol Gateway compliant to multiple standards• Integrated with Utility Back-end (MDM)• Appliance Identification from aggregated meter data using

source separation• Demand-response and load-scheduling• Carbon-footprint Analytics

• Demo available• Pilot with a Green Utility Company in

Netherlands on Appliance Identification from Meter Data using Source Separation

Utility

Appliances Smart Plugs

IntelligentGateway

Smart Meter

Demand ForecastingDemand ResponseAppliance Management

Consumption ViewAppliance SchedulingOn-off Control

Social Network Integration

Consumer Home

Analytics

21

Intelligent Store – Indoor Localization

Upper Audio Band Communication in Mobiles

• Complete baseband communication chain design using upper audio band (16 to 22 KHz) carrier

• Low computational complexity to preserve battery power

• Novel waveform design for fast detection time (less than 1 second)

• Programmable range (1 m to 8 m) through power control

• Error Control Coding for Robustness

• Demo available• Customer traction in Retail Stores and Airports

22

Safe City - Multimodal Surveillance and Response Planning

• Filter with city soundscape info• Heat-map based on participatory sensing• Categorize Crowd, Traffic or Explosion

• Filter with social network analysis• NLP and Semantic analysis of geo-tagged social

n/w tweets

Filter with local participatory surveillance- Event triggered participatory sensing- Low complexity Compression

Events withreduced false alarm

Events from video surveillance system

Fusion of information HTN based Response Planning

23

Intelligent Compliance – Insurance Claim Automation

• Mobile phone based design• Uses Mobile Camera Image of VIN /

Number Plate and Mobile mic. based Voice-assist

• Low Complexity Noise cleaning, pre-processing and OCR

• Vehicle Contour based Damage Estimation based on Template matching for Insurance

• Under Development• Interest from Insurance Companies

24

Intelligent Home and Office – People Counting and Identification

Indoor People Counting for TV Viewership

• Multi-algorithm fusion to improve detection probability

• Face Detection, Body Posture Detection and Background Modeling are combined to improve the detection above 92 % from 75 %

• Customer – A large TV viewership rating company in USA

People Identification• Gesture sensing through Kinect –

Multimodal sensing through Camera and Audio

• Identification through Gesture / Gait modeling

25

Intelligent Agriculture – Mobile Agro-advisory System

Power-efficient Wireless Mesh Network

• Real-time sending of Soil Temperature, Soil Moisture, Atmospheric Temperature and Atmospheric Humidity

• Cellular Backhaul• Zigbee based wireless mesh

network• Power-efficient sleep mode design

• Demo available• Integrated with mKrishi – TCS mobile agro-advisory

solution

26

Alliances

Industry• Digi (Energy, Transportation, Environment

Monitoring)• Mobile Devices (Car Telematics)• ETComm (Medical)• Intel / TI (Edge Platform)• IBM (CEP Platform)

Academic• Singapore Management University (iCity

Platform)• Indian Statistical Institute (Privacy, Image /

Video Processing)• IIT Kharagpur (Analytics, Personal Context

Extraction)• IIT Bombay, IIT Madras, IISc Bangalore – in

pipeline

27

Thank You

TCS Research Scholar Program