Microsoft Azure IoT Suite - How to approach remote...
Transcript of Microsoft Azure IoT Suite - How to approach remote...
Microsoft AZURE
IoT Connect 2017
¡Da vida a tus cosas y
aprovecha todo el poder de tus datos!
Fernando Moreno – Digital Advisor - Microsoft
#IoTconnect
Connecting technology, administration, and care
Healthcare Systems
Administration and Care
Data, statistics,
metrics,
and reports
Claims
and billing
Electronic
records
Resources
Asset
management
Systems
and apps
Risk
management
Compliant Tools Community
PatientsProvidersCliniciansEducation,
research,
and training
Secure mobile
devices
Integrated health transformation pillars
Digital
Health
Integrate.
Track.
Empower.
• Integrate systems that effectively bridge
care and patient
• Track data and communications to enable
accountable care
• Empower caregiver and patient to help
improve outcomes
Connecting patients with healthcare
Digital
Healthcare
Laboratory
and testing
Outpatient
care
Hospitalization
and hospice
Patients
Preventative
care
Therapy and
rehabilitation
Electronic health
and medical
records
Personal
device
access
Health
history and
records
Patient
portals
Video reporting
and diagnoses Test and
laboratory
alerts
Office and
in-home visit
schedulingRegulatory compliance
and risk management
Case
management
Improved data-supported healthcare decisions
Dynamic, validated patient insights
Predictive health analytics, workflow management, and best practices
Patient data alignment and interpretation
Identification of health and claims patterns
Predictive health modeling and visualization
Deliver actionable health insights
Patient and health data queries and reports
Alignment of patient data with health benchmarks and statistics
Data source identification and integration
ApplyInsights
AggregateCompilation
AnalyzeVisualization
Customer Use Case | Remote Patient Monitoring
DT Pillars: Engage Customers
Use Case Overview
Remote Patient Monitoring involves following people with chronic
diseases and monitoring all data that comes from the patients using a
variety of devices. Analysis of data helps detecting anomaly situations
and taking preventive actions before problem becomes crisis.
Remote Patient Monitoring helps create care plans and take corrective
actions that prevent hospital admissions.
Business Outcomes
» Reduced hospital admissions and
readmissions
» Enhanced patient care and safety
» Physicians providing optimal care with
actionable data
» Preventive action for patient before
problem becomes crisis
» View to patient’s personalized care
plan
» Reduced emergency room visits
Digital Capabilities
» Customer data management and
analytics
» Complete hybrid cloud approach
providing health organizations with
system flexibility
» Robust data protection practices while
retaining full ownership & control of
sensitive data
» Address wide range of international,
country & industry-specific regulatory
requirements
Business Drivers
» Meeting increased demand due to
growing and aging population
» Shifting from reactive to proactive
health system
» Responding to individual’s health
status in real time
» Reducing hospitalization of people with
chronic diseases
» Monitoring people at home instead in
an elderly or care home
Get Started
COO Book of Dreams
Healthcare Book of Dreams
Patient Engagement Playbook
Healthcare Digital Maturity Model
Cortana Intelligence Suite Essentials
Smartphones
Automate alerts
Advanced Analytics
Increase accuracy
Provide proactive care
Reduce cost of care
Reduce hospital admissions
Customize care plan
Patient Surveys
Sensors
EHR Data
Activity Trackers
Business Process: Service Delivery
Centrally
located data
DATA ACTIONINTELLIGENCE
Customer Stories
Predictive Human Telemetry
The American Heritage® Medical Dictionary Copyright © 2007, 2004 by Houghton Mifflin Company. Published by Houghton Mifflin Company
Anywhere, anytime patient care
Empowered careThe solution securely connects to smartphones and
devices such as blood pressure and glucose meters in
patients’ homes, and integrates the data with a program
prescribed by a Kaiser Permanente clinician.
Real-Time DataEnhances patient care and safety through near-real-time,
remote monitoring of vital signs and automated alerts
Improving efficiency•Provides better insight into patient data, improving
efficiency and workflow for nurses, dietitians and other
staff.
Rehabilitation
Kinect Hololens
Assisted Rehabilitation
Experience
Real-Time DataThe Kinect recording is analyzed in near-real time and
scored using Stream Analytics and Machine Learning
Fastest recovery
The project aims to support remote rehabilitation scenarios, with the
support of motion detection to track the quality of the exercises and
to give the physician a way to figure out how the patient is
performing
Continuous Improvement
Training partnerThe Golf training solution is observing the body movement
using Kinect and can analyzes and corrects your body
motion throughout your swing. The trainer can predict the
height and distance of the stroke and the development
over time during several training sessions
Real-Time DataThe Kinect recording is analyzed in near-real time and
scored using Stream Analytics and Machine Learning
Improving efficiencyProvides better golf statistic over time and have the ability
to replay captured training session with an professional
golf instructor to get recommendations on how to improve
IoT Integrated Architecture
Analyze and act
on new data
Integrate and transform
business processes
Connect and scale
with efficiency
Capture and analyze biometrics
And
more
Real-time
operating
systems
Device Registry
Rules and Actions
Analytics
Dashboards & Visualization
Accelerate time to value with preconfigured solutions
Expand with other human biometrics devices and
build your own healthcare solution
Integrate with back-end systems
Highly visual for your real-time operational data
Get started in minutes with Microsoft Band 2
and one of the partner solutions
Explore the near-real time capabilities
1Establish
monitoring
objectives
and
requirements
2Profile the
devices
involved
3Determine
additional
solution
components
4Categorize
the data 5Define
alerts and
actions
6Operationalize
the solution
and scale
Imagine if you could monitor health of thousands of people located around the world
without physically inspecting them. Or use Kinect and wearable sensors to accelerate
rehabilitation or to improve performance of sports athletes.
Predictable Human Telemetry FrameworkOur approach to a remote monitoring project
Mark is part of an ever aging workforce, looking after an ever aging
group of people! Mark wants to help as many people as he can, of
course, and is eager to use Predictive Human Telemetry
to help more patients improve more over time.
It’s a different way of working for sure, but his knowledge gets to help
more people, and he likes that.
Goals
Help patient get better faster
Help more patients in the same time
Meet Dr Mark
Meet Sarah
Sarah has lived a long and good life with her husband, Otto.
They are both retired for 15 years and live a quiet but
comfortable life at home. Sarah was recently diagnosed with
COPD and low blood pressure. She is struggling to stop
smoking, but is determined to do it, for her health, and
for Otto. She is frail in general and needs extra
oxygen a lot of the time.
Goals
Managing her condition
Leading a better life in the time she has left
Wears
Oxygen wristband
Blood pressure checker
Microsoft Band
Smart Phone with an Health app
At-home blood pressure measurementMicrosoft Band
When her wristband notified her
on to attach her blood pressure
cuff to get a reading.
”The system speaks for me
when I’m not with you”, Dr Mark
explained to her. She trusts Dr
Mark, even if she doesn’t trust
technology just yet…
The data is automatically
collected and stored in her
records.
Sarah’s blood pressure has
been lower than usual for
several consecutive days.
The system has identified a negative trend in Sarah’s
blood pressure data, which triggers a notification.
Thanks to machine learning, Dr Mark is able to monitor
his patients even though they never leave their home.
He is kept up to date on everyone’s status, and is able
to identify potential problems and take action much
sooner than he would otherwise have.
Demo
Remote health monitoring using Microsoft Band and Band Sensor Monitor
Meet Teresa
Teresa is an adventurous lady with a busy schedule but a lot of
willpower and some discipline. She plays golf with more enthusiasm
than skill, but wants to take the step up to competitive level. To do this
she has the support of a personal trainer to create her exercising
schedule, but she does most of the work on her own, independently.
Well… she gets a little help from technology.
Goals
Get fit
Qualify for the local golf competition finals
Wears
Microsoft Band
Smart socks
Teresa and her personal trainer (PT)
set up an optimized training
schedule together.
The PT explains how everything will
work, utilizing the mirror neurons,
when she works out by herself.
Making sure it’s you…
When she starts the system at home, she is automatically logged in to her profile, just by standing in front of the Kinect. When logged in, she can see all her exercises, her personal profile.
There is a lot of predictive data for each exercise. It will take a lot of time to get to her goal, clearly, even though she is helped by the mirror neuron stimuli, but Teresa is willing to invest in it.
She finds the appropriate exercise
and watches the video.
Her mirror neurons are activated,
mimicking the motions in her
brain, as she watches the
instructor perform the exercise.
Her brain learns to perform the
motion, even without her doing
anything, her personal trainer
explained. It’s quite fascinating!
Mirror neurons
Kinect
After watching the video, she repeats the exercise.
Her devices gathers data about motions, heartrate, temperature.
When she doesn’t do it right, the system helps her get there by providing useful feedback in real time.
Almost there,
straighten your
front knee to 90
degrees.
After her workout is done, she can
review the data. As can her PT!
They both have a look at the actual
data, and compare it to the desired
state. Together they can work on how
to improve over time.
Every day Teresa also practices
her golf stroke in front of the
system. She watches the expert
in the video, and then repeats it
herself.
Kinect
Microsoft
Band
After each session she looks at all
the data in detail.
By analyzing and aggregating data,
and comparing it to historical data,
the system gives her incredible help
to improve even as she gets a lot
better, because the data is so
precise.
She can see the evidence in the
data, that her hard work is really
paying off! She really is continuously
improving, ever so slightly every
day.
It took a lot of time and hard work; first her brain
learned to perform the tasks, then after a lot of hard
work, so did her muscles.
Teresa improved her skill tremendously, and played one
of her best rounds of golf ever when the day came!
Thanks to KHARE, Teresa is in better shape than ever
before, and has raised her level of golf skill from casual
to competitive level in just some months time!
Demo
Claudia
Claudia, today…
• got injured and needs rehabilitation
frustrated
annoyed
Thanks to KHARE, tomorrow, Claudia…
• Will be able to do part of the rehab at home
• will not need to go everyday
Natural User Interface
Capture of gestures and movements to see and interact with virtual and added
elements.
Microsoft Kinect
Kinect HoloLens Assisted Rehabilitation Experience goes beyond video communication
adding three-dimensionality and intelligence.
It helps the doctor to verify the quality of the exercises while assisting the
patient in the execution.
*
Hololens integration, will be
added in future release
*
Future improvements- Augmented reality
The doctor can see the movements of the patient in a three-dimensional space
without the need for the latter to have expensive and sophisticated medical
devices.
• Delocalization
• Telemetry
• Data collected
when doctors are
not present
Patient experience journey map
37
• Seeking health information online
• Choosing a physician or facility for
treatment
• Remote interactions with physician and
clinicians
• Appointment scheduling
• Accessing electronic health records (EHR)
• Sharing EHR /EMR with other physicians
• Digitally receiving prescriptions
• Interactions with other care team members
• Filling, refilling and approving refills for
prescriptions
• Reporting satisfaction
• Ongoing patient care and patient
reminders
Experience symptoms
Schedule an appointment by self or with assistance
Visit lab for tests
Digital Hotspots
Use portal or apps to schedule an appointment or receive guidance
Report symptoms
Schedule appointment with lab
Chat or meet with physician or nurse
about results
Receive treatment
plan
Meet with care team members, as needed
Schedule appointments with care team
members
Visit pharmacy for prescriptions
Treat issues
Chat or meet with physician to discuss progress
Discuss satisfaction with others
Obtain prescription refills
Visit the physician in person or remotely
Chat with physician or nurse about symptoms
Receive lab orders
Access history, lab results, insurance
claims
Receive reminders for follow-up care?
Choose physician, if needed, based on evaluations
“ ”
Source: Gartner IT Glossary
http://www.gartner.com/it-glossary/internet-of-things/
The network of physical
objects that contain
embedded technology to
communicate and interact
with their internal states or
the external environment.
Anywhere, anytime patient care
Kaiser Permanente
“There’s far less expense in having the patient record their vitals remotely
from home, instead of coming to the clinic… And because it’s easier
for the patients, they’re more willing to participate.”
Mehul Shah
Associate Director of Product Engineering, Cognizant Technology Solutions
ObjectivesKaiser Permanente was
exploring ways to provide care
to its patients in the most
convenient place for them,
while improving connectivity
between hospitals, clinics and
medical devices to enable
secure, remote access to
patient data.
TacticsA remote patient
monitoring system based
on Microsoft technology
that securely connects to
smartphones and devices
like glucose meters, and
integrates the data with a
program prescribed by a
clinician.
Results• Enhanced patient care and safety
through near-real-time, remote
monitoring of vital signs and
automated alerts
• Reduced outpatient visits for routine
checks and reporting of vital signs
• Improved insight into patient data
Improving physical therapy with mobile app
D+R Therapy
“Microsoft was vital to us getting D+R Therapy HIPAA compliant, which opens up
the US market for the app. Because of Microsoft, we have been able to expand the
business overseas much faster than we anticipated.”Vivian Austin
Technical Lead, D+R Therapy
ObjectivesD+R Therapy sought to
increase post-op physical
therapy success by improving
communications between the
patient and physical therapist.
TacticsCreated a motion-sensing
mobile app that enables
physicians to plan
treatments for each patient,
reminds them to complete
the regimen, and ensures
at-home exercises are
performed properly.
Results• Enhanced communication between
therapists and patients, resulting ing
better care and fewer repeat injuries
• Increased patient capacity by
allowing therapists to monitor
patients with fewer in-person
appointments
• Ensured the safety of patient data by
storing on a secure database
Remove communication barriers
Care Innovations
“We can show customers that they can cut costs and improve patient adherence to
treatment protocols. For example, if we can keep a diabetic’s blood glucose level steady,
that is a huge value to the patient as well as to those who pay for that patient’s care.”
Kumar Subramaniam
Chief Information and Technology Officer, Care Innovations
ObjectivesCreate healthcare technologies
that foster healthy independent
living at home and in senior
housing, and to reduce the
barriers to adopting remote
care management solutions
involving IoT.
TacticsUsing Microsoft
technology, GE and Intel
partnered to
add predictive analytics and
simplified update
deployment to their data
management platform,
simplifying IoT sensor
integration.
Results• Migrated over 4,000 residences and
50 facilities to new system
• Created easy-to-deploy system for
new IoT sensors and connected
devices
• Analyzed over 6.8 billion data points
to provide treatment
recommendations
Proactive, personalized healthcare
Dartmouth-Hitchcock
“It’s a seamless technology solution.”
Nathan Larson
Director of Remote Medical Sensing, Dartmouth-Hitchcock
ObjectivesProviding a technology
platform to health
organizations that ensures
healthier people who are more
in control of their own well-
being, receiving proactive care
at home where they are most
comfortable.
TacticsA cloud-based system that
synthesizes vast amounts
of real-time and historical
patient data from myriad
sources to predict when
care is needed and create
personalized, evidence-
based treatment plans.
Results• Saved millions of dollars in
readmission costs, unnecessary
visits, and missed work
• Improved patient monitoring with
real-time 360-degree views of
health, mood, and behavior
https://blogs.microsoft.com/business-matters/2015/07/13/dartmouth-hitchcock-ushers-in-a-new-age-of-
proactive-personalized-healthcare-using-cortana-analytics-suite/
http://www.cio.com/article/2954656
/healthcare/how-predictive-
analytics-will-revolutionize-
healthcare.html
References and
customer quotes
Virtual Care Rooms (Sweden)
Virtual health room is a customized, unstaffed healthroom with the aim of staying open 24 hours a day for recipients of care in rural areas. It will also be possible to install the virtual health rooms of the future in people’s own homes or on their mobiles. If necessary, doctors and other health professionals will be able to connect to these rooms via video and the rooms will be equipped with a range of devices. The solution is running on Azure as platform..
“We will see a clear improvement. Accessibility for residents is one of the benefits, as well as taking services out to patients and reducing the cost of travel and transport”
Björn Eriksson of Region Jämtland Härjedalen.
Link to customer story
References and
customer quotes
St. Olavs Hospital Home Patient Monitoring (Norway)
The project is called HelsaMi and implemented by Microsoft partner Imatis and aims to help patients with chronic illness to take care of their own health at home with remote support of health service professionals and improve the wellbeing of patients with chronic disease while at home.
“HelsaMi is a project which defines the overall strategy in Trondheim based on a technological model which aims to help people feel safer while living at home and to simplify the interaction of health services within the municipality and hospitals.”
Helge Garasen
Director for Health and Welfare, Trondheim Municipality
Link to customer video
Why Azure IoT Suite
Get started quickly with preconfigured solutions for common
IoT scenarios.
Leverage a worldwide ecosystem of experienced IoT partners to tailor IoT solutions to your needs.
Azure IoT Suite
Connect millions of devices and integrate your business systems with new insights to transform your business.