8/13/2019 04. Technology Review _ Greg Zaoui
1/56
8/13/2019 04. Technology Review _ Greg Zaoui
2/56
IN-VEHICLE CONNECTTECHNOLOGY
8/13/2019 04. Technology Review _ Greg Zaoui
3/56
WHAT'S ON ?
Connectivity SystemsIVI Infotainment OSSmartphone Solution or Gateway ?OBD On-board Computer and diagnosis tools
OEM Value chainPosition your system/application ?How to work with OEMs ?
HMIConstraintsRegulations
Connected ServicesSelectionIHU Specification through an example
Big DataValue
8/13/2019 04. Technology Review _ Greg Zaoui
4/56
OS HMI NAV BANDWIDTH
Android, MeeGo O QNX B
A S E
H M
I Automot UX (high
N A V Nokia/N
Tomtom Google
B D W
M2M Op voda, ora
S E M I TI
Intel
Freescale
8/13/2019 04. Technology Review _ Greg Zaoui
5/56
SYSTEMSCONNECTIVITY TYP
8/13/2019 04. Technology Review _ Greg Zaoui
6/56
CONNECTED CARS ARCHITECTUR
TCU-basedInfotainment-centricProvides services, content for both drivers and passengersHotspot/LTE/wifiAutomotive and Operator driven
BYOD-based (tethered mode)Smartphone-centric
Needs to be adapted to local needs and availabilityTethering/pairing technology dependentNeeds to be deployed by service technology companies
CAN basedDonglesConnectivity
8/13/2019 04. Technology Review _ Greg Zaoui
7/56
3 COMPUTERS BEHIND 1 WHEEL
OBD computerCommunicates with the cloud to upload information from the car
Smartphone Integration tethered solutionUses the smartphone as a modemReplicates the phone screen onto the IVI screen (smartphone is not only a modem also the brain
IVI systemsAutonomous and connectedBased on embedded systems and software
8/13/2019 04. Technology Review _ Greg Zaoui
8/56
A NON-OSMOTIC BARRIER
Separates the On board Computer from the Infotainment Systems (where the visiblevalue is)
The 2 systems are operating autonomouslySome communication is permitted via the OBD portMainly to read values and retrieve information
Vast sets of protocols are available to access (even write) mechatronics informationBut each set is different from OEM to OEMAccess Engine Control Unit deals with
Cruise control, transmission, anti-skid, anti-theft
OEMs can provide whichever access they want across the barrier (pending regulations)but this means long validation and development cycles not including CR management
Can only be considered at very early stage of project
8/13/2019 04. Technology Review _ Greg Zaoui
9/56
Online ServiceS
PoGoEnhanced UI
Fleet & DiagnosisServiceS
WEB Access
CONNECTED IVI ARCHITECTURE - CURRENTLY D
Online Services
8/13/2019 04. Technology Review _ Greg Zaoui
10/56
LOW-END CONNECTED IVI PLATFORM
8/13/2019 04. Technology Review _ Greg Zaoui
11/56
OBD CONNECTED DONGLES - AFTERM
Whats inside ? Connected vehicle technologyDiagnostic interfaces (OBD/J1939)Wifi, Bluetooth, cellularAccelerometer / GPS
What is it for ?Usage based insurance (UBI)Driver and vehicle performanceDiagnosticsOccupant information services
A vehicles self-diareporting ability exa standardized convehicle cabin
Check behind yourthe carpet !
Required in the USall cars and light trDefined by a collestandards include JJ1978, J1979,J201Defines a large setelements about theengine and emissio
Only a few data elesupported
8/13/2019 04. Technology Review _ Greg Zaoui
12/56
OBD II PROTOCOL
5 different physical networks arerepresented on the connectorThis was simplified to one protocol in 2008Vehicles may use more than one physical network
SAE Spec J1979 defines a list of ParameterIdentification Numbers (PIDs) used torequest data from a network.
The network is a transaction basednetwork. Send a PID, get a result.
Other information may appear on the network butit is for other ECUs and varies from vehicle tovehicle
10 modes of operation$01 used to identify what PIDs$02 Freeze Frame Data (informduring a fault)$03 Emissions related confirmestored.$04 Used to clear emissions rela
information.$05 Oxygen sensor monitor and$06 Request for On-Board Mon$07 Emission related troubles dlast drive cycle$08 Enable off-board test devicon-board system
$09 Request VIN and other veh$0A List permanent trouble cod
8/13/2019 04. Technology Review _ Greg Zaoui
13/56
SMARTPHONES CONNECTIVITY
Cradle vs. handleDistraction vs. regulation
Password, LockScreenBT phone
Tethering vs. Contracting
It is good enough for (free) navigationBut navigation is entering the car through the IVICannot access cars internals
Caveat: OBD + SP + ServerTried by Verizon in US
Do we use or LTE phones as hotspots in the living room for smart TVs ?
8/13/2019 04. Technology Review _ Greg Zaoui
14/56
MIRRORLINK SMARTPHONE CONNECTIV
Consists of a VNC-type architecture whereas the phone replicates its screen oinfotainment screen
CCC Driven (nokia initiative)Car connectivity Consortium
Uses RTP and uPnP
Putting the "Mirror" in MirrorLink ... and then the " Link Only approved apps can work obviously no playing your torrents on the big screenWho approves it ? How much ?
How does your car communicate when you take your phone out?
8/13/2019 04. Technology Review _ Greg Zaoui
15/56
ARCHITECTURE MIRROR-LINK
Flow andRelationship
SWArchitectur
8/13/2019 04. Technology Review _ Greg Zaoui
16/56
VNC THE SYSTEM BEHIND ML
8/13/2019 04. Technology Review _ Greg Zaoui
17/56
SMARTPHONES AS A COMPANION A
OEM specific apps to be available for driver when not driving
Use cases:Remote access (lock/unlock)Pre-heat and pre-con the carTrack the car PAYD informationGeneric information such as fuel consumption, diagnosis status, driving behavior
Server-Meddling Architecturecar reports condition to secure cloud and smartphone accesses secure cloudLimited direct communication except for R/C (alarm, lights, windows, lock precon)
The smartphone is a relay of information between driver and car and in-no-way aControl Unit
8/13/2019 04. Technology Review _ Greg Zaoui
18/56
COMPANION APP ARCHITECTUROnline Services
Fleet & DiagnosisServiceS
WEB Access
SMARTPHONES FOR COMPANION A
8/13/2019 04. Technology Review _ Greg Zaoui
19/56
SEMCOS INITIATIVES & PLATFORMS
8/13/2019 04. Technology Review _ Greg Zaoui
20/56
CARS SW ENVIRONMEOS & HMI
8/13/2019 04. Technology Review _ Greg Zaoui
21/56
OPERATING SYSTEMS
QNX owned by RIM/BlackberryQNX OS;HMI framework supporting HTML5, QT, and other native UI toolsetsSDK for app environments
Support for audio and environment controlsacoustic, noise reductionhands-free solution, voice recognition
Climate controlVehicle Diagnosis
Car Resources access (customized only)Project dependent CustKitOEM proprietary: needs 3-party agreement
8/13/2019 04. Technology Review _ Greg Zaoui
22/56
EMBEDDED ARCHITECTURE
The trick is to have access to APIs Many are restricted to prevent meddling
with car systems gps info Environment control Open in SDK does not mean available
in cars final SW architecture Not just security but cost of recalls and
customer satisfaction Tablet on wheels When buying a car the infotainment
control and comfort count heavily inthe buying decision process
8/13/2019 04. Technology Review _ Greg Zaoui
23/56
FRAGMENTED ENVIRONMENT GLUED
HW HW HW
Linux WinCE QNX Android
Infotainment Suite / Proprietary
TCPIP over wifi, BT, 3G/4G,
AppModule
AppModule
AppModule
AppModule
DriverAssistanc
eNavi
Maps
CanBus / mecatronics
MMEngine
TTS/VREngine
DrivingBehavi
our
Climate
CTRLDiagnosis Engine
Onboard Computer
8/13/2019 04. Technology Review _ Greg Zaoui
24/56
USE CASE: ONSTAR IN-VEHICLE A
I/O commands control for connected filesystems, or IHU FS
Read/Write/WriteB/getRes/deleteFile
CommunicationBT profile, watchNetworkConnectivity, watchForData ,
Media commands control the vehicles audioand video playback functionality
Play/Stop/Pause/Sync
Navigation commands control thefunctionality of the GPS navigation unit
Destination: Get/Set/watch/Clear
Phone command controls the infotainmentunit's built-in telephone, to make outboundcalls
Dial
System commands allow infotainment unit's systemhandling abilities
Speed/Focus AppClose/Update
User Interface command screen alerts and message
showAlert
Utilities command allows foexceptions and analytics inf
getLogEvent
Vehicle Info getPosition (watch, clear)/ getvehicleData, ActiveDevice
getVin, getRadioInfo, getvehic
8/13/2019 04. Technology Review _ Greg Zaoui
25/56
USE CASE: ONSTAR - REMOTE AP
Consent methods allows for the addition and removal ofconsent for select vehicles and accounts
AccountConsent/ VehicleConsent/ FleetConsent/ Revoke
Subscriber Data provides detailed information aboutOnStar subscribers, accounts, and supported vehicles
SubscribersInfo, VehicleInfo, VehicleCommands, Vehicle Features
Telemetry methods allow for the use of a vehicle'stelemetry data
TelemetryEnable / TelemetryDisable / History / Callback
Batch methods allow fleet customers to handle multiplecommands with a single requestDestination:
Submit/Status/Results
Vechicle Commands provide services whichcommunicate with the vehicle to perform an action.
Do things like unlock the doors, start navigation, or sound the alarm all withthe call of a methodStartVehicle, CancelStart, Lock/UnlockDoor, VehicleLocation, TurnByTurnRoute,
8/13/2019 04. Technology Review _ Greg Zaoui
26/56
USE CASE: OTHERS
OPENCarNokia, Pandora, InrixAPI library backed by documentationApp submission guidelines, dashboard and certification process to support third-party deveProfiles supporting vehicle-specific graphics design/resolutions/capabilities, extensible vehtouch and voice interaction devices/models
GeneviPan-industry initiativeMore about compliance andstandards than about platform
8/13/2019 04. Technology Review _ Greg Zaoui
27/56
USE CASE: OPENCAR
The center console is both the brain and heart of themodern driving experience. Creating a custom, brandedexperience leveraging the latest software standards willtransform customer engagement.
Drivers love their smartphones and want the always-connected, digital entertainment lifestyle that is one touchaway." But simply replicating this experience in the car isneither safe or properly integrated with the vehicle's dataand controls..
Nokia
8/13/2019 04. Technology Review _ Greg Zaoui
28/56
A CONTROLLED AND CLOSED ENVIRO
OS and HMI fixes to be rolled out through dedicated bandwidth as RupdatesCreates unavailability of the system for some timeCustomer/driver expectations must be managed
Automotive in-apps store to be operated by OEMs and integrators toand push new apps/services to drivers:
HMI consistency, usage learning curveLooking for apps in menu can result in distraction and loss of control
Semi-open market such as android or apple cannot be replicated heresystems are linked to life-critical systems
Even if controlling breaks or stirring from rogue app is highly unlikelyNo-one wants to be the first one to deal with this
8/13/2019 04. Technology Review _ Greg Zaoui
29/56
OEMSSERVICES ENABLER
8/13/2019 04. Technology Review _ Greg Zaoui
30/56
IN-VEHICLE CONNECTIVITY VALUE C
8/13/2019 04. Technology Review _ Greg Zaoui
31/56
HOW TO WORK WITH THE OEM VALUE
1. Target a model/region the higher up you are in the value chain (internet layer) the more diversified is2. Understand all their suppliers because your product will create dependencies on their systems
inevitably create conflict with already existing offer OEMs policy is heavily multi-source biased tallow for contingency
3. OEMS are locked in heavy complex dealer distribution flows and very few solutions (if any) can beintegrated post sales
a. Involves re-training
b. Very expensivec. Must be bullet proof4. OEMs are subcontracting all app-store/cloud services to large integrators or directly to Network
operatora. They understand appsb. They do not want to cut their margin for youc. IT/Firewall structure & Security are unnegotiable (what if you have a licensing or distribution
server?)
8/13/2019 04. Technology Review _ Greg Zaoui
32/56
OEMS ARE BECOMING SERVICE PROV
8/13/2019 04. Technology Review _ Greg Zaoui
33/56
HMI INSIGHTS FOR WHEN YOU DEVAN APP
Manufacturer requirementsWindow on automotive valuesNeeds to be tightly integrated with Look and Feel and to respect ergonomicsMust address ease-of-access requirements (cannot be smartphone-like)
Industry/Regulators regulationsCannot distract drivers
Huge consequences risk of accidentsRisk of failing validation
Movement-locked featuresNeeds tight integration with solution providerAccess to HW info is critical and not always disclosed (CANBUS read-access needed)
8/13/2019 04. Technology Review _ Greg Zaoui
34/56
HMI INSIGHTS FOR WHEN YOU DEVAN APP
VR/TTSAlready availableNuance is leading the dance
Camera/sensor basedAlready available for detection preventions (rear-view camera)Brought over for driver monitoring
Gesture and eye-movementsPupil dilatation (snoozing on the wheel)
Reading the roadCracks in pavement, sign post recognitions
8/13/2019 04. Technology Review _ Greg Zaoui
35/56
HMI AND DISTRACTION
There is a dedicated website in the UShttp://www.distraction.gov/content/get-the-facts/state-laws.html
Stringency is the key word
California Court Rules Anti-Texting Laws Apply to Checking Maps While Driving
National Highway Traffic Safety Administration has issued its first set of voluntaryguidelines that encourage automobile manufacturers to limit the distraction risk
connected to electronic devices . feb 2013Guidelines recommend that automakers develop infotainment system that limit the timedrivers have to take their eyes off the road to two seconds for each input (for, say, findinaddress using a navigation system) and 12 seconds to perform an overall task (such asinputting a destination and routing to it).NHTSA Recommends Getting Rid of Moving Navigation Maps
HMIIS NOT JUST TOUCHING IT IS ABO
8/13/2019 04. Technology Review _ Greg Zaoui
36/56
HMIIS NOT JUST TOUCHING IT IS ABOPASSIVE
VR/TTSAlready availableNuance is leading the dance
Camera/sensor basedAlready available for detection preventions (rear-view camera)Brought over for driver monitoring
Gesture and eye-movementsPupil dilatation (snoozing on the wheel)
Reading/Sensing the roadCracks in pavement, sign post recognitions
8/13/2019 04. Technology Review _ Greg Zaoui
37/56
THE FIRST BATCH OF SERVICES VS BAN
8/13/2019 04. Technology Review _ Greg Zaoui
38/56
THE FIRST BATCH OF SERVICES VS. BANNEEDS
Transiting through TCU
Smartphone tethering unlikely in
pre-built market due to regulations
and operator consent
After-market tethering is open but muchless lucrative
- although a very good play-ground
- needs integration with navigation apps
8/13/2019 04. Technology Review _ Greg Zaoui
39/56
8/13/2019 04. Technology Review _ Greg Zaoui
40/56
TECHNICAL CLUSTERING TO ENSURE
Trend is to offer navigation, maps and services as one supplierTechnical updates and synchronization rationale
One OEM uses different suppliers for different modelautomotive multi-sourcing policyProvide many verticals transversally
Multiplication of Standards, semi-proprietaryTpeg vs HTMLOLR, ULR, Agoras'Tight with map formats to optimize data transfer while reducing efficiency of mixingsuppliersRoute computation, map matching done on server behind OEM/Supplier firewall80/20 rule. Most maps updates and live information are needed in high-coverage netwoareas
8/13/2019 04. Technology Review _ Greg Zaoui
41/56
WHAT PEOPLE WANT IN THEIR CA
8/13/2019 04. Technology Review _ Greg Zaoui
42/56
4SQ APPLICATION FOR INFOTAINM
The 4SQ service shall be integrated within the navigation application
Users will be offered a 4SQ-enabled experience to enhance navigation with Community-based features User-generated POIs and information trail
This implementation is for connected infotainment unit and OEMs Co-marketing: navigation to the power of community Port smartphone-like features to car built-in environment
Implement essential features to be developed such as TTS, VR andmessaging capabilities
8/13/2019 04. Technology Review _ Greg Zaoui
43/56
MAJOR COMPONENTS OF SERVIC
Explore POIsaround me@ destination (only displayed if a route isavailable) Along route (only displayed if a route isavailable)\Ability to select a free search by selecting
top categories and specifying location in asearch box
Check-inSimple functionality, user clicks and ischecked-inFunction is grayed if user is not logged in
Display Nearby friendsAround me @ destination (only displayavailable)Along route (only displayedavailable)Function is grayed if user is
Settings Control PanelCredentialsAlways Show friends YesPre-Select categories for POlevel categories defined in csheets)Show reviews and Picture
8/13/2019 04. Technology Review _ Greg Zaoui
44/56
FOURSQUARE CONTROL SCREEN
Application in IHU Screen
8/13/2019 04. Technology Review _ Greg Zaoui
45/56
8/13/2019 04. Technology Review _ Greg Zaoui
46/56
POI - EXPLORE SCREEN
Showing POIs on map around me, for all categories pre-selected in settings Around me @ destination (only displayed if a route is active) Along route (only displayed if a route is available)
Select a free search by clicking on categories and by specifying
location in a search box Eat & Drink, Sleep, Community, Fun Health, Wellbeing, Shop, Transports Each top category might suggest dynamically associated
subcategories if available (TBD with 4SQ) Friends @ location will be displayed as a specific category
8/13/2019 04. Technology Review _ Greg Zaoui
47/56
IN-VEHICLE POI SEARCH SCREE
8/13/2019 04. Technology Review _ Greg Zaoui
48/56
IN-VEHICLE POI DETAILED INFORMA
Available detailed information of POI listed on POI screen
Each entry shall be expandable to display the full details of each POI as proviby 4SQ
pics, reviews, map snapshotsMight show reviews of friends or FoF (closer connection) first
check with 4SQ if profile affinity function is available
Add Navigate to button for each entry Navigates to selected POINavigates to friend
Feedback to server when navigating to POI/Friend
Feedback to server when selecting explored POIs
8/13/2019 04. Technology Review _ Greg Zaoui
49/56
IN-VEHICLE FRIENDS PLACES AROUN
This feature enables users to view friends (and FoF ) favorite places around:reviewedstarredcreated
Friends places appear in a list as for other POIs
All functions as for regular POIs are applicable (if applicable) InfoNavigate to option
C S C S O
8/13/2019 04. Technology Review _ Greg Zaoui
50/56
IN-VEHICLEFRIENDS PLACES AROU
8/13/2019 04. Technology Review _ Greg Zaoui
51/56
IN-VEHICLE CHECK-IN ONCE A
8/13/2019 04. Technology Review _ Greg Zaoui
52/56
IN VEHICLE CHECK IN ONCE ADESTINATION
Arrival at the final destination screen + check-in to the 4SQ venuepromptYou have arrived at destination, would you like to check-in ?Check-in button appears on the screen for user to activate
If not automated
8/13/2019 04. Technology Review _ Greg Zaoui
53/56
BIG DATA
THE INTRINSIC VALUE OF CAR
8/13/2019 04. Technology Review _ Greg Zaoui
54/56
THE INTRINSIC VALUE OF CARCONNECTIVITY
LocationDevices know where they are and we know where they are too. Its true for the vehicle andwhatever devices drivers and passengers carry around with them.
ContextWe can build a picture of the situation at any given time. This may be about who is driving,may be about how the car itself is performing. It may be about points of relevant interest al
ConnectivityWe can make this information work together to make good things happen for the driver; to the bond between the driver and the automotive brand; and to generate and collect revenue contributing businesses.
THE HIDDEN VALUE: TRACING & PRO
8/13/2019 04. Technology Review _ Greg Zaoui
55/56
BIG DATA
Thats where and when the car becomes a smartphone on wheels Driving behavior and location patterns have a considerable marketing valueProvides customer profiled information to OEMs, dealers and to a larger extent, to market analysis compSimilar to location-based advertising on mobile phones
Real-time on devices through ads feedbackWill be hidden and asynchronous for cars
Security driven initiativeE111, e-callPro- diagnosis, maintain good quality of fleet (and a dealers portfolio is a virtual fleet
Car can self-book itself to garageDealer can order parts in advance and optimize stock
Control of metropolitan flows
Guarantees privacyScrambled identity for profilingDrivers confirmation for diagnosis
WHATS NEXT FOR CONNECTED CAR
8/13/2019 04. Technology Review _ Greg Zaoui
56/56
WHATS NEXT FOR CONNECTED CAR
Within the next three years, every new car will, to a greater olesser extent, be a connected car. When most drivers alreadyhave a smart-phone in a cradle on the dashboard, this deeperconnectivity is inevitable. The real question is not if itsquestion of how far can we go ?
The car is no longer a capsule - for drivers and passengers, thvehicle must be a safely connected extension of theirenvironment, for automotive manufacturers and their partnerconnectivity drives a shift from product to service relationshi
Top Related