Track 2 session 4 - st dev con 2016 - opensoftwarex

October 4, 2016

Santa Clara Convention Center

Mission City Ballroom

Open Software eXpansion

Fabrizio Rovati

Agenda

• STM32 Open Development Environment

• Open Software eXpansion

• Audio

• Sensors

• RF

• Frameworks

• Ecosystem

• Conclusions

2

STM32 Open Development Environment



• Audio

• Sensors

• RF

• Frameworks

• Ecosystem

• Conclusions

3

Lowering the Barriers for Developers 4

Market

Device

Prototype Integrated Boards Final

Device

IdeaApplication

Test SW

Field

Test

Commercial

SW

Fast, affordable prototyping with development continuity to final device

STM32 Open Development Environment 5

Developer community and supportCompatibility with free and commercial Development Environments

STM32 Nucleo

development boards

STM32 Nucleo

expansion boards

Sensors – motion,

environment, light ..

Ultra-low power

connectivity

ULP Memories and

NFC Tags

Analog and mixed

signal components

Power and energy

management

STM32Cube

expansion softwareSTM32Cube

development software

Function packsSet of function examples for some of the most common application cases

Fast, affordable prototyping & development

pre-integrated ST components and SW

Cloud

Connectivity

Sensing

Safety &

Security

STM32 ODE X-CUBE packages 6

Tools & IDEs

Application

Middleware

Hardware

Abstraction

Hardware

IAR EWARN, Keil MDK-ARM, GCC-based IDEs

(e.g. AC6 System Workbench for STM32)

Sample applications

STM32Cube

middleware

STM32Cube Expansion

middleware

STM32Cube Expansion

HAL

STM32Cube Hardware Abstraction Layer (HAL)

STM32 Nucelo expansion boards (X-NUCLEO)

STM32 Nucelo development boards

Open Software eXpansion



• Audio

• Sensors

• RF

• Frameworks

• Ecosystem

• Conclusions

7

OpenSoftwareX 8

Open Software eXpansion environment

Middleware

open.MEMS open.AUDIO open.RF

open.FRAMEWORK

STM32 Nucleo

development

boards

STM32 ODE

STM32 Nucleo

expansion

boards

STM32Cube

software

STM32Cube

expansion

software+

HARDWARE SOFTWARE DRIVERS and HAL

Application examples

Open = Open Licensing

• Added value binary libraries for use with ST products

• Normally provided in binary form

• Free, automated and quick access to development license

• Clear path to production license

9

OpenSoftwareX licensing frameworkLicense types

• Two different licensing type supported:

• EVALUATION license

• The license is NODE-LOCKED, i.e. the licensed library is usable on a specific STM32 only.

• The request/authorization of this license type can be initiated and completed by the licensee

autonomously via a licensing server.

• The licensee is given a unique KEY for the specific device

10

Enabling rapid evaluation of software IPs

through a simple automated email-based activation process

OpenSoftwareX licensing frameworkLicense types

• Two different licensing type supported:

• PRODUCTION license

• The license is NODE-FREE, i.e. the licensed library is usable on any STM32-based mass–

produced devices

• Licensee agrees on the PRODUCTION license Limited License Agreement

• Licensee will get a new NODE-FREE KEY

• No need to rework the application, just insert the new key

11

OpenSoftwareXLicense Wizard

12

Node-free

license request flag

License type field

Select libraryIdentify boardGenerate requestEmail request

Licensee info

OR… license directly via the APP! 13

Option menu

ST BlueMS APP


License status pageST BlueMS APP

OR… license directly via the APP!

ST BlueMS APP

15


ST BlueMS APP


license enabled! ST BlueMS APP

Audio



• Audio

• Sensors

• RF

• Frameworks

• Ecosystem

• Conclusions

18

Acoustic Processing - MEMS MicrophonesOpen.Audio

19

Sound Source

Localization

osxAcousticSL

Beamforming

osxAcousticBF

Acoustic Echo

Cancellation

osxAcousticEC

Using a MEMS microphone

array, it estimates the angle of

arrival of audio signal

Small and compact directional

virtual microphone based on

ST MEMS microphone array

Based on the Speex.org Open

Source libraries

Support for µ4 (micro-4)

The smallest microphone array architecture ever!

Sensors



• Audio

• Sensors

• RF

• Frameworks

• Ecosystem

• Conclusions

20

Open.MEMS for developersSensor Fusion

21

osxMotionFX – inputs/outputs

osxMotionFX – GUI osxMotionFX – features

• Magnetometer calibration routine

• Gyroscope bias compensation

• Dynamic distortion (hand jitter),

measured by the accelerometer

• Power saving

Open.MEMS for developersMotion and Gesture processing

Activity Recognition

osxMotionAR

Carry Position Determination

osxMotionCP

Gesture Recognition

osxMotionFX

Detects

Walking, Fast Walking, Running,

Biking, Driving, Stationary

Detects

In Hand, Near Head, Shirt Pocket,

Trouser Pocket, On Desk, Arm Swing

Detects

gestures such as Glance, Pick-up,

Wake-up

Optimized for low power and always on experience

Uses Machine Learning based models to achieve higher accuracy

22

RF



• Audio

• Sensors

• RF

• Frameworks

• Ecosystem

• Conclusions

23

Bluetooth Low Energy ProfilesList of profiles supported by OSXSmartConnPS

24

• Slave profiles (peripheral role):

• Alert Notification Client

• Blood Pressure Sensor

• Find Me Locator

• Find Me Target

• Glucose Sensor

• Health Thermometer

• Heart Rate

• Phone Alert Client

• Proximity Monitor

• Proximity Reporter

• Time Client

• Time Server

• Master profiles (central role):

• Heart Rate Collector

• Time Client

• Find Me Locator

• Blood Pressure Collector

• Health Thermometer Collector

• Alert Notification Client

• Glucose Collector

Test it with STM32 BLE Profiles App

STM32 BLE Profiles

6LoWPAN

• Source code available in the osxContiki6LP package

• This package is based on STM32Cube and it provides a porting of the

Contiki OS and IPv6/6LoWPAN protocol stack 3.0, for STM32 L1 and F4

families, using the SPIRIT1 sub-1GHz radio transceiver

• Support for mesh networking by

the means of the standard RPL

protocol over IPv6 based protocol

stack, a key technology for large

wireless sensors networks

deployments

25

Sensor

Node

Sensor

Node

Sensor

Node

Sensor

Node

6LoWPAN

Border Router

IPv6 Host

Frameworks



• Audio

• Sensors

• RF

• Frameworks

• Ecosystem

• Conclusions

26

Open.Framework applications

• BLUEMICROSYSTEM

• Bluetooth Low Energy & sensor applications

• BlueVoiceLink

• Bluetooth Low Energy & audio applications

27

BLUEMICROSYSTEM

• A family of fully compatible applications, tailored to your needs

28

Function BMS1 BMS2 BMS3

Microcontroller(NUCLEO-F401RE or NUCLEO-L476RG)

Bluetooth Low Energy(X-NUCLEO-IDB04A1 or X-NUCLEO-IDB05A1)

Motion & Environmental sensors(X-NUCLEO- IKS01A1)

NFC secure pairing & TAG(X-NUCLEO-NFC01A1)

Ambient light & proximity, touchless UI(X-NUCLEO-6180XA1)

MEMS microphones(X-NUCLEO-CCA02M1)

www.st.com/BLUEMICROSYSTEM

ST BlueMS APP

• APP SDK available on GitHub in source code (project name BlueSTSDK)

• Both iOS and Android version

• https://github.com/STMicroelectronics-CentralLabs

• APP available on Google Play and Apple Store

29

ST BlueMS

https://github.com/STMicroelectronics-CentralLabs

BLUEMICROSYSTEMsensing & actuating

30

Environmental page LSM6DS3/DSM EventsLed StatusAccelerometer plot

BLUEMICROSYSTEMleverage HW features

31

LS

M6

DS

3/D

SM

Eve

nts

Pedometer Wake Up OrientationDouble Tap

BLUEMICROSYSTEM: Open.MEMS libraries 32

osxMotionAR osxMotionCPosxMotionGR osxMotionFX

BLUEMICROSYSTEM: Console & debug 33

Serial Console (stdout/stderr) Debug Console (stdin/stdout/stderr)

BLUEMICROSYSTEM: Touchless UI 34

BLUEMICROSYSTEM: Secure pairing 35

BLUEMICROSYSTEM: Firmware upgrade 36

BLUEMICROSYSTEM: Firmware upgrade 37

BLUEMICROSYSTEM supports SensorTile

• The connectable multi-sensor node

38

Sensing, Tracking and Monitoring

Embedded Processing Unit

Motion GamingAlgorithms Augmented livingAudio

BlueVoiceLink SDKVoice over Bluetooth Low Energy

39

Real-time voice streaming for remotely controlled applications

(addressing the RCU and wearable market)

BlueVoice Integration in

BLUEMICROSYSTEM40

Cloud-based

ASR Service

8 kHzADPCM

osxBlueVoice 2.0.0

BLUEMICROSYSTEM2 V XYZ

ST BlueMS – ASR Demo 41

Hold on & speak!

Release

KO

OK

Ecosystem



• Audio

• Sensors

• RF

• Frameworks

• Ecosystem

• Conclusions

42

No soldering.

No components purchasing.

No hardware production plan needed!

Diolan SensiBLEMuch Smaller than STM32 Nucleo dev. Boards

+

+

+ +

43

Download App Insert Battery Explore ST BLUEMS App

Environmental Page Sensor Fusion

SensiBLE

SensiBLE & OSX SW: 100% compatibility

BLUEMICROSYSTEM1 pre-

flashed

ST BlueMS

1 2 3

44

Diolan SensiBLE

• Zero effort and time spent from transition from

prototype to deployment!

• I can demonstrate final form factor and have a first

batch of production in no time!

• Ready off-the-shelf solution at the right price

• no skills needed or no ROI to justify to develop own

board

45

• Zero SW development costs & time!

• Zero SW support costs & time for the standard SW

package!

• Fast & inexpensive development cycle but high

potential returns!

• Implicit promotion by the OSX

• Low volumes but with very high market base –

thousands of potential customers

Ideal for first low-volume trials or productions for customers

Opens door for further opportunities

• If I need a fast modification or design service, I have

professional and skilled support at hand

• If a want to scale up production volume, I can make

optimized deals

• Possibility to promote design customization skills

• A sizable part of the trials/small production customers

can grow exponentially very soon

Develo

pe

r’s v

iew

Part

ner’

s v

iew

Takeaways

• ST has all the building blocks adapted to the different needs of diverse

applications

• STM32 ODE is the right environment for fast affordable developments

• Open Software eXpansion provides added value libraries and end-to-end

applications in sensors, audio and RF field

• Exploit the ecosystem to cover the “last mile” to product introduction

46

We are full of more ideas…. stay tuned for further developments!!!

Thank You

Track 2 session 4 - st dev con 2016 - opensoftwarex

Software

Transcript of Track 2 session 4 - st dev con 2016 - opensoftwarex