Cyber-Social Learning Systems
-
Upload
diannepatricia -
Category
Technology
-
view
92 -
download
1
Transcript of Cyber-Social Learning Systems
![Page 1: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/1.jpg)
Cyber-Social Systems Kevin Sullivan
University of VirginiaFebruary 2, 2017
![Page 2: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/2.jpg)
Overview
● Progress on scientific / engineering principles for cyber-physical systems○ world of physical systems, computational and connected at all scales○ radical improvements in system function and performance
● Next frontier in integration of cyber with complex human/social phenomena● Cyber-social learning systems -- high functioning and continually improving● Health, healthcare, transportation, education, housing, justice, defense, etc● Focus on realizing and operating large-scale cyber-social service systems● With audacious goals: e.g.,
○ 10X fewer deaths from avoidable medical errors ○ Most children reading at grade level in the 3rd grade○ Radical transparency into state and dynamics of cities/communities
![Page 3: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/3.jpg)
Outline● Distinguish socio-technical, cyber-physical, and cyber-social systems● Introduce some key elements/assumptions of CSLS perspective● Survey subset of thoughts on research agenda from CCC WS participants
![Page 4: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/4.jpg)
Socio-Technical Systems● Systems comprising people, machines, computing, physical elements ● Many service system examples: air-traffic control, healthcare delivery, ed, etc.● Limited learning at systems scale, often glacial pace of system improvement
![Page 5: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/5.jpg)
Human-in-the-Loop Cyber-Physical Systems● Central objective is to optimize performance of physical devices/phenomena● Enabled by advances in sensing and the integration of discrete, logic-based
computing with continuous control via hybrid discrete-logic/physics models ● Increasingly use machine learning, and integration of logic and probability● Often involve humans-in-the-loop to handle control when machine can’t● Tendency is to progressively reduce human role, to the extent achievable● Examples: Robotic manufacturing; learning fleets of autonomous vehicles
![Page 6: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/6.jpg)
Example CPS: Mercedes Benz Manufacturing Line
![Page 7: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/7.jpg)
Example of Human-in-the-Loop Learning CPS
![Page 8: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/8.jpg)
Cyber-Physical Systems Learning LoopTesla Cloud
SlowerFleet-WideLearning
Fast Local Control
Control Policy and Other Updates
ReducedTelemetry
Fast Local Control
Fast Local Control
Fast Local Control
~1B miles of driving data
![Page 9: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/9.jpg)
Tesla - Performance Improvement (lane centering)
https://electrek.co/2016/05/24/tesla-autopilot-miles-data/
![Page 10: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/10.jpg)
Tesla -- Performance Improvement (auto-steering)
https://electrek.co/2017/01/19/tesla-crash-rate-autopilot-nhtsa/
![Page 11: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/11.jpg)
Tesla Accident, Failure of Human-in-Loop Control
![Page 12: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/12.jpg)
What happened
![Page 13: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/13.jpg)
Trust and Reliance are Human Issues
● Issues of trust in, trustworthiness of, and reliance on AI/autonomy● Mr. Brown over-trusted the technology relative to its actual capabilities● Under-trust can be just as harmful; correct calibration of trust is required● CPS inevitably edge into more complex human/social issues, but CPS
foundational theories not designed to deal with such phenomena● Note: A second, less widely recognized failure mode in this case
○ Car continued autonomous driving after its “shearing” until it hit telephone pole○ Just evaluating control functions on input sensor data and acting accordingly○ No awareness whether operating within their envelopes of competence
![Page 14: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/14.jpg)
Cyber-Physical Systems Learning LoopTesla Cloud
SlowerFleet-WideLearning
Fast Local Control
Control Policy and Other Updates
ReducedTelemetry
Fast Local Control
Fast Local Control
Fast Local Control
~1B miles of driving data
![Page 15: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/15.jpg)
Cyber-Social Learning System for Health (LHS)
![Page 16: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/16.jpg)
Cyber-Social Learning Systems● Objective is to enable/improve performance of human-intensive systems
○ Public services, healthcare delivery. education, intelligence, defense, food/energy/water, etc
● Enabled by advances in and integration of computational, systems, design and social thinking, policy & law, implementation science, governance, etc.
● Reflective, learning, predictive, adaptive; including norms, policies, goals ● Examples in wild: emerging CSLSs in advertising, social credit, politics
![Page 17: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/17.jpg)
Participant-oriented view (Ben Shneiderman)
![Page 18: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/18.jpg)
Control loop view (influence loop view, and highly simplified)
![Page 19: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/19.jpg)
Rationale for & Scope of CSLS Research Program ● Today, practice outstrips science, engineering, and design knowledge ● Beyond descriptive/predictive theory to prescriptive/interventionist design● Principles, methods, technologies for CSLS understanding and development● With impact seen in major improvements in many critical societal systems
![Page 20: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/20.jpg)
Key questions● What are the critical gaps in knowledge: in theory, systems, applications?● What kinds of approaches might power & characterize CSLS field? (What
unique points of research & technical leverage could enable a transition to a discipline of CSLS design?)
● What methods should be used to evaluate impact of systematic approach to CSLS design against baseline of in-the-wild, ad hoc CSLS emerging today?
● What features in a research roadmap address uncertainties and get to scale?
![Page 21: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/21.jpg)
Overview of ideas submitted ahead of time● Solicited inputs from all participants● Enumeration of main topics● Details of individual contributions● To help bootstrap discussion, not a final structure
![Page 22: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/22.jpg)
Sampling of research topics of interest● Motivational structures for technology-mediated social participation in CSLS● Cyber-social mechanisms for large-scale coordination of complex tasks● Quality and analysis of data acquired from online social networks/sources● Humans as sensors and (noisy/biased) information channels/transducers● Social media exploitation tools as CSLS (distillation, rumor/bias countering,
cultural understanding, voice to disenfranchised, cultural understanding)● Greatly elaborated theories of learning to underpin theory of learning in CSLS● Principles for integration of human and AI/robotic elements into CSLS
![Page 23: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/23.jpg)
Sampling of interests (continued)● Organization of computable knowledge at scale for decision support at scale● Closed loop and person in/on loop system design and evaluation● Ethical, legal, regulatory aspects of statistical/heuristical deciding machines● Design for & measurement, control, & assurance of critical system properties● Designing CSS for ease of observation, experimentation, and adaptation● Foundations for multi-disciplinary theory- and data-based system modeling● Dynamics of public opinion as enabler of action based on knowledge
![Page 24: Cyber-Social Learning Systems](https://reader031.fdocuments.us/reader031/viewer/2022021813/58aa61e51a28ab5a7a8b5311/html5/thumbnails/24.jpg)
CCC Workshop Process and Beyond● Three workshops, the last one just completed● Formulated gaps, approaches, evaluation ideas for cyber, social, systems● Workshop materials on CCC workshop web site; report forthcoming● Engaging universities to explore network of campus-wide initiatives in CSLS● Interested now in engaging with industry and government more broadly● Possibility to establish an deep and impactful new area of R&D● Invite interest and engagement from all sectors