Post on 09-Jul-2020
Learn. Connect. Explore.Learn. Connect. Explore.
Architecture ethos for Internet of Things( IoT)
Muni Pulipalyam
Senior Architect, Microsoft Services, India
The “Internet Of Things” …
… is neither really about “Things” …
… nor really about “The Internet”, …
… it’s about creating systems.
… that make the tools of our daily lives better, …
… safer, more reliable, more efficient, …
… and more fun.
A Changing World – a new perspective
“A computer in every pot and chicken.”~ Steve Teixeira (2014)
Microsoft Director of Program Management | Internet of Things | Operating Systems Group
“A chicken in every pot.”
“A computer on every desk
and in every home.”
~ Henry IV of France – 17th Century
~ Bill Gates (1977)
What is the Internet of Things?
“ ”The network of physical
objects that contain
embedded technology to
communicate and interact
with their internal states or
the external environment.
Source: Gartner
Smart Products
Grid
Renewables
Oil/Gas/Coal
Recovery and
Distribution
Points
of Sale
Restaurants
Hotels
Fuel
Stations
Patients
Clinics
Hospitals
Nursing
Homes
Mobile
Care
SafetySecurity
ComfortLighting
Automation
Manufacturing
Integration and
AutomationRemote
Servicing
Predictive and
Reactive
Maintenance
Water
Waste
Pollution
Control
Fire
Emergency
Public
Safety
Law
Enforcement
Letters
Packages
Containers
Tanks Bulkware
Games
Events
Sports
TelevisionStreaming
Traffic Buses
Cars
Trucks
Trains
Vessels
Aircraft
Bikes
Smart
Energy
Smart Pro
Services
Smart
Retail
Smart
Mobility
Smart
Logistics
Smart
Factory
Smart
Cities
Smart
Entertain-
ment
Smart
Health-
care
Smart
Building
Home
Now we are here….
“No the doctor doesn’t do house calls. But he does do
Skype calls!”
And then….
And think of this….
Bad news –
the scale is
threatening to
cut off our
access to the
refrigerator!!!
The Internet of Things (IoT) is driving significant change
Dramatic growth
in connectable endpoints
By 2020:
26B IoT endpoints
Significant opportunities
for partners
By 2020:
$300B in incremental revenue for
IoT product and service suppliers
Increased capability
to connect
Fix
953:00 PM
25% humidity
70 preset
Train
View Pay
Minimal Wait
👫1
1
12
4
1
13
3
2
1
3
2
1
3
2
3
Ad-Hoc Stop
Traffic Alert!
2
4
1
13
3
3
2
1
3
2
3
🔔 14:30
🚌 14:41
6 (+5)
4 (+2)
E-ChargingPreventive Repairs
45km
7km
What is the Internet of Things (IoT)?
14
3
1
2
3
4
2
How small are the things?
Anyone for Raspberry pie pi?
It’s getting smaller, cheaper and more powerful everyday….
Introducing Intel “Sharks Cove”
Simplifying hardware development for Windows Platforms
Intel® Galileo and Quark X1000
5mm
32-bit x86 @ 400Mhz, single core
Industry-standard I/Os
DDR3 memory controller
15x15mm package
Scalar instruction set architecture
Arduino-compatible board
Quark CPU
256M RAM
USB, SD slot, Ethernet
How is this thing?
The Internet of Things: By the Numbers – How big?
B5075212Predictions….
Information Exchange Patterns
Telemetry
Information flowing
from a device to other
systems for conveying
status of device and
environment
Inquiries
Requests from devices
looking to gather
required information or
asking to initiate
activities
Commands
Commands from other
systems to a device or a
group of devices to
perform specific
activities
Notifications
Information flowing
from other systems to a
device (-group) for
conveying status
changes in the rest of
the world
Telemetry• Scheduled or event-driven stream of device status
information
• Physical or logical status or sensor readings.
• Records are usually tiny; timestamp plus numbers.
• Grand variety in frequencies. Once per week to 10 kHz for each of multiple metering points for factory machines.
Collect, Reduce, Route• Telemetry Processing
• Collect – acquire readings
• Reduce – filter and/or aggregrate
• Route – forward to processing or storage
• Tiered Processing• On-Machine CRR routing aggregates
• Higher-value records representing data aggregate over longer period of time
• Reliable handoff desirable
• Cloud Processing• Collect to cloud
• Higher frequencies may allow lossy transfer
Collect
Reduce
Route
Collect
Reduce
Route
Real-time Analysis• Observe Telemetry “as it happens”
• React to state changes or trends
• React to aggregate observations
• Examples• “device input voltage drops below 11V for more
than 3 minutes”
• “temperature readings from sensors on this floor average above 23°C for last 10 minutes”
• “sensor failed reporting data for 5 minutes”
• Very short reaction time required
fn
Data-At-Rest Analysis• Mine Telemetry through DB Queries
• Find and track trends or maxima
• Analyze expected vs. actual behaviors
• React to longer term observations
• Hoard for future use
• Variety of Data Store Options• SQL/OLAP
• Cassandra, Riak
• Hadoop
• Store choice depends on what questions you’dlike to ask
flt
Command/Control• Tell a device, remotely, to execute a logical or
physical activity• “Give me the status of X”
• “Roll 2 feet forward”
• “Track this object with the camera”
• “Fetch firmware update”
• Remote: Control service, handheld device, etc.
• Latency requirements vary, but often “perceptibly imminent”
The Last Mile• Huge Battleground
• Mobile Carriers try leverage GPRS/UMTS/LTE investments
• Public APNs via Internet
• Private APNs to private networks
• (Analog TV) Whitespace Radio
• Power-line Networks
• Two Models• Datagram Messaging
• IP Connectivity
• Device Direct or via Gateway
Protocol Wars• COM vs. CORBA vs. HTTP and REST vs.
SOAP/WS-* all over again, but much, much worse• Many industries, each probably having
competing consortia
• Field bus and LAN legacy protocol experience
• Proprietary technology is the norm
• Very limited security awareness
• Popcorn Time!
“The IT Pro Way”: VPN• “You Gravitate to What You Know”
• Device makers make devices, not Internet distributed systems
• Networking experience mostly with LAN technology and techniques
• First attempt at command/control path is almost invariably on VPN technology.
• Provides Addressability and Security (well, no, … later)
VPN
VPN Limits• “Ethernet Hub with Virtual Cables”
• One TCP/IP link per Device
• Expensive handshake
• VPN is very expensive to scale• Compute, memory intensive
• Expensive appliances
• Weak failover model
• Pricing models anchored on information worker connections
• Increased device complexity
Relay Technologies• Application-level connectivity
• HTTP (long-polling)
• HTTP + Web Sockets (bi-di)
• AMQP
• Custom
• Device connects outbound to Relay through NAT/FW
• Device becomes addressable at Relay when connected
R
Customer
Relationship
Management
Maintenance
and Dealers
Roadside
AssistanceERP
Notification
Fan-OutWeb PaaS/BaaS Messaging Messaging
Notification Fan-
Out
Scenario Architecture – Vehicles
3G
100,000s of Vehicles100,000s of Drivers 100,000s of Drivers
+ Driving Behavior
+ Predictive Maintenance
+ User Targeting Data
+ Find My Car
+ Geo Fencing
+ Remote Diagnostics
Fleet Information
Systems
+ Points Of Interest
+ Traffic & Parking
+ Seamless Navigation
Web PaaS
Vehicle
Information
Systems
Driver Assistance
Systems
Mobile Experience Portal Experience
3rd Party Content
Points of Interest,
Coupons, Easy Parking
User Profiles
Preferences, Entertainment
Navigation Destinations, Presence
Customer
Relationship
Management
Maintenance
and Dealers
Roadside
AssistanceERP
Notification Hubs Web Sites Service Bus / Device Hub SignalR +
Service BusNotification Hubs
Seamless Navigation / Car Sharing
3G
100,000s of Vehicles100,000s of Drivers
Windows
Push Messaging
100,000s of Drivers
+ Driving Behavior
+ Predictive Maintenance
+ User Targeting Data
+ Find My Car
+ Geo Fencing
+ Remote Diagnostics
Fleet Information
Systems
+ Points Of Interest
+ Traffic & Parking
+ Seamless Navigation
Vehicle
Information
Systems
Driver Assistance
Systems
Mobile Experience
3rd Party Content
Points of Interest,
Coupons, Easy Parking
User Profiles
Preferences, Entertainment
Navigation Destinations
Web Sites
Portal Experience
• Seamless, Urban Door-to-Door Navigation Experience, Pedestrian & Vehicle
• Seamless Handoff between Mobile Phone Experience and Car
• Weather, Traffic, Parking, Points of Interest
• Set up your route at night and get alerted on the phone when it’s time to leave
Scenario-Enabling Technologies
Actor-Based
High-Scale
Computing
Service-Assisted
Trustworthy
Communication
Federated
Identity and
Access Control
Data Storage,
Analysis, and
Machine Learning
Data Storage, Analysis, and Machine Learning
• Insight is based on collection and analysis of vast amounts of data across a multitude of devices and sensors in the system scope
• Real-Time/NRT Analysis: • Aggregation/Reduction, Temporal Queries
• State Correlation, Alerting, Limit Detection
• Data-At-Rest Analysis: • Time-Series, Map/Reduce, Correlation
• Machine Learning• Pattern Detection, Behavior Prediction
• Plausibility Analysis, Fraud Detection
Data Storage,
Analysis, and
Machine Learning
Actor-Based Computing• Scale-appropriate compute model for service-side
logic complementing device functionality on a per-device basis• Distributed compute fabric, hosting simple device- or
device-group scope programs (Actors)
• Message-based activation of Actors and dispatch of messages to active Actors
• Managing of volatile or durable state
• Millions of concurrently active Actors per cluster
• Simple programming experience in vastly scalable compute infrastructure hosts
Actor-Based
High-Scale
Computing
Service Assisted Communication• Service-Based Device Gateways
• Standards-based (AMQP, MQTT, HTTP) messaging
• Millions of concurrent active, bi-di connections
• Integrates with all communication paths including mobile/wireless operator networks
• Minimal idle-chatter and low-footprint session recovery for signal loss and roaming scenarios
• Trustworthiness through strong peering of devices and associated gateways
• No VPN, No Firewall Holes, No DNS, No DHCP, No Public IPv6, No IP Roaming
Service-Assisted
Trustworthy
Communication
Federated Identity and Access Control• Embracing the reality of multitudes of identity authorities and
providers and enabling interoperability in spite of it.• OpenID Connect
• OAuth 2.0
• Cross-Provider Trust Federation
• Scalable, Token-Based Authorization
• Dramatically lighter weight and more flexible and scenario appropriate than PKI
• Strong Device/Gateway peering w/ TLS/PSK Federated
Identity and
Access Control
Why Cloud for IoT? Higher Scale, Lower Risk.• Example
• 2 Million Concurrent Device Goal
• (High Density) 80,000 Concurrent Connections Per Node
• 80,000 * 128KB TCP Buffer, SSL State, Aggregation = ~10GB RAM Footprint
• 25 Front-End Nodes + 3 Failover Capacity Reserve
• 10+ Back-End Nodes for Data Offloading
• Database and Analysis Capacity?
• Disaster Recovery Standby Reserve
• Scale-Ramp? Traffic Volume? Geo-Distribution?
• Product Success?
Microsoft Azure
Actor-Based
High-Scale
Computing
Service-Assisted
Trustworthy
Communication
Federated
Identity and
Access Control
Data Storage,
Analysis, and
Machine Learning
SQL Database
Table Storage
Blob Storage
HDInsight
…
Service Bus
AMQP
Cloud Services
MSR Orleans
Active Directory
Identity
Foundation
Microsoft Azure as IOT Platform
Network
Compute
Storage
VMs
VM Disks
VPN Public IP
Pre-Built
Images +
Open VM
Depot
Un
ifie
d H
TTP
/REST M
an
ag
em
en
t A
PI &
Po
rtal
Inte
llig
en
t Syst
em
s Serv
ices
Syst
em
Cen
ter
Op
era
tio
ns
Man
ag
er
Cloud
Storage SQL
Hadoop
HDInsight
Web SitesCloud
Services
Media
Services
Active
Directory
Multi Factor
Auth
Mobile
Services
Service BusNotification
Hub
BizTalk
Services
Traffic Manager, Load Balancing, Firewall
Partners
Twilio,
SendGrid
Node.js
Java, PHP,
Perl, Python,
Ruby
NoSQL
Team
Fo
un
datio
n S
erv
er, G
it
Visu
al S
tud
io, E
clipse
Office 365, Dynamics, Microsoft Account, Bing
Identity
Serv
ices
(WA
AD
)
Command/Notification APITelemetry/Inquiry Dispatcher
Service Bus + BizTalk Services + BizTalk Server + Virtual Networks
Notification
Hubs
Mobile Services
Web SitesService Bus
SignalR
Service BusNotification Hubs
Microsoft Azure Platform Mapping
3G
Fleet Information
Systems
Web Sites
Vehicle
Information
Systems
Driver Assistance
Systems
Mobile Experience Portal Experience
Corporate and Divisional Line of Business and Information Systems, 3rd Party Systems
Service Bus & Web APITelemetry Adapter Framework
SQL Database, Blob and NoSQL Storage
Real-Time Analytics, HDInsightVirtual Machines (IaaS)
Cloud Services and Web Sites (PaaS)
Media Services
Service Bus & Web APIService Bus & Web API
Communication
IP
TCP UDPICMP
etc.
HTTP/S AMQP/S MQTT Custom Protocols CoAP
PowerLAN/Homeplug
Zigbee IEEE 802.15.4
Ethernet IEEE 802.3WiFi IEEE 802.11x
GSM/GPRS/HSPA/LTE Weightless
Bluetooth IEEE 802.15.1
ATM
White WiFi 802.11af
Device Capabilities• Volume products mean miniscule price
differences having huge impact• Broad array of very special microcontrollers and
communication circuits
• Microcontrollers ~$1+, Ethernet + TCP/IP ~$3+, GSM/GPRS ~$15, RF ~$3
• Physical constraints matter • Small size footprint, minimal energy consumption
• Few KBytes of RAM and program storage are fairly common
Key Challenges• Addressing?
• Domestic and Global Roaming, Base Station Switches
• Sparse Connectivity?• Tunnels, Parking Garages, Mobile Coverage, Congestion
• Security?• Device Isolation, Environment Isolation, Device Identity, Trust
• Scale?• Millions of concurrently active devices with bi-directional
communication needs
Architectural Baseline
Scale Unit
Data Analysis
Cluster(s)
x10,000 devices
Gateway
Filtering and Aggregation
Routing
Control
System
Scale
Unit
Scale
Unit
Scale
Unit
x1,000,000 devices
Scale
Unit
DC
Bo
un
dary
Device
Identity and
Metadata
Store
Provisioning
System
OT/IT Convergence
M2M
Co
nn
ect
ivit
y P
rovid
ers
Mobility
Logistics
Factory
Cities
Entertainment
Energy
Healthcare
Buildings
Retail
Actor-Based
High-Scale
Computing
Service-Assisted
Trustworthy
Communication
Federated Identity
and Access Control
Data Storage,
Analysis, and
Machine Learning
Operational Technology
Workflow, Document
Management and Communication
Sales and Marketing Information
Systems
Procurement and Logistics
Billing, Collections, and Finance
People Management
Production Control
Customer Service and Support
Platform
Services
Information Technology
M2M
Co
nn
ect
ivit
y P
rovid
ers
Mobility
Logistics
Factory
Cities
Entertainment
Energy
Healthcare
Buildings
Retail
Workflow, Document
Management and Communication
Sales and Marketing Information
Systems
Procurement and Logistics
Billing, Collections, and Finance
People Management
Production Control
Customer Service and Support
Platform
ServicesActor-Based
High-Scale
Computing
Service-Assisted
Trustworthy
Communication
Federated Identity
and Access Control
Data Storage,
Analysis, and
Machine Learning
Operational and Information Technology Convergence
M2M
Co
nn
ect
ivit
y P
rovid
ers
Actor-Based
High-Scale
Computing
Service-Assisted
Trustworthy
Communication
Federated Identity
and Access Control
Data Storage,
Analysis, and
Machine Learning
Common Information
Technology Services
Workflow, Document
Management and Communication
Sales and Marketing Information
Systems
Procurement and Logistics
Billing, Collections, and Finance
People Management
Production Control
Customer Service and Support
Skype
Office 365
SharePoint
Dynamics CRM
Dynamics AX
Mobility
Logistics
Factory
Cities
Entertainment
Energy
Healthcare
Buildings
Retail
Smart Products
Platform Services
Windows
Server/Azure
SQL
Server
Hyper-V
ReferencesRelated references for you to expand your knowledge on IoT
• Things. M2M. IoT - Connecting Special Purpose Devices to and through the Cloud
http://channel9.msdn.com/Blogs/Subscribe/Things-M2M-IoT-Connecting-Special-Purpose-Devices-to-and-through-the-Cloud
• Intelligent Systems Service
http://www.microsoft.com/windowsembedded/en-us/intelligent-systems-service .aspx
technet.microsoft.com/en-in
aka.ms/mva
msdn.microsoft.com/
Your Feedback is Important
OPTION 3: Feedback stations outside the hall
Fill out evaluation of this session and help shape future events.
OPTION 1 OPTION 2
Follow us online
Facebookfacebook.com/MicrosoftDeveloper.India
twitter.com/msdevindia
Twitter: @munipuli
Email: munipuli@microsoft.com