realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP...

28
Petrozavodsk Lab127 Lab0x7F Lab0177 Lab1111111b Location Location - - Aware Technologies Aware Technologies for Entertainment, Industry and Science for Entertainment, Industry and Science PhD, CSO of Nanonets LTD, former CSO of RTL-Service JSC, associate professor, Petrozavodsk State University, alexmou @ lab127.karelia.ru Real Real Trac Trac technology overview technology overview Alex P. Moschevikin http://lab127.ru/ 10.05.2016 http://rtlservice.com/ Registered trademark of RTL-Service JSC

Transcript of realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP...

Page 1: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Petrozavodsk

Lab127 Lab0x7F Lab0177 Lab1111111b

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

PhD, CSO of Nanonets LTD,former CSO of RTL-Service JSC,associate professor,Petrozavodsk State University,alexmou @ lab127.karelia.ru

RealRealTracTrac™™technology overviewtechnology overview

Alex P. Moschevikin

http://lab127.ru/10.05.2016

http://rtlservice.com/

Registered trademarkof RTL-Service JSC

Page 2: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

Hardware

Antenna design

Embedded software

Communication protocol INCP

System and network architecture

Server-side software

Client-side software

Voice communication

Localization engine

R&D

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

IT-park of PetrSU,RTL-Service JSC, Nanonets LTD

RealTrac™ project started in 2008.

25 developers (+ part-time researchers and students), including 8 PhDs.

Average age: 30 years

http://lab127.ru/

Page 3: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

RealTrac™ Technology Summary

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

localization

voicecommunication

wireless & mobile

powersaving

wirelesssensors networks

RealTrac

http://lab127.ru/

Page 4: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

RealTrac™ devices for indoor applications

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

Ethernet access points

Tag

Intercom Rio

http://lab127.ru/

Page 5: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

RealTrac™ devices for outdoor and industry

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

In partnership with "Ingortech" (Ekaterinburg, Russia)http://lab127.ru/

Page 6: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

Pressure

Temperature

Received signal strength

3D accelerometer

3D gyroscope

3D magnetometer

RFID proximity tag

Embedded sensors

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

Mobile nodes Access points

Pressure

Temperature

Received signal strength

http://lab127.ru/

Page 7: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

Client software (web browser)

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

http://lab127.ru/

Page 8: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

Movement history

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

http://lab127.ru/

Page 9: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

RealTrac™ Technology Architecture

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

http://lab127.ru/

Page 10: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

RealTrac™ voice communications

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

• Asterisk software PBX

• 16 bit, 8 kHz, G.729A, 8kbit/s, adaptive (up to 5 times) redundancy

• Duplex sessions(peer-to-peer, phone calls)

• Half-duplex radio(one-to-all, voice broadcasting)

http://lab127.ru/

Page 11: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

NanoLOC wireless standard

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

RealTrac™ is based on nanoLOC™ RF standard (IEEE 802.15.4a).

NanoLOC™ features:

• developed by NanotronTechnologies GmbH (Germany)

• license free ISM band 2.4 GHz

• chirp modulation

• low power consumption

• receive signal strength measurements (RSS)

• time-of-flight ranging (ToF)

http://lab127.ru/

Page 12: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

ToF ranging basics, RTT scheme

d = c * t

d = distancec = speed of lightt = time-of-flight

t = (Treply – Tproc)/2

http://lab127.ru/

Page 13: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

Inertial Measurement Unit (walking pattern)

http://lab127.ru/

devicein hanging

hand

devicenear head

Page 14: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

Inertial Measurement Unit (trajectory)

http://lab127.ru/

accelerometer+

gyroscope+

magnetometer=

trajectory

step length, step direction, step number

Page 15: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

Inertial Measurement Unit (corrections)

http://lab127.ru/Navigation: Gyroscope vs Magnetometer

Page 16: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

RealTrac™ localization engine

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

http://lab127.ru/

Page 17: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

RealTrac™ ranging scheme

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

1. Intercoms perform ranging to neighboring anchors/repeaters.

2. Ranging results (if any) are sent by Intercom in IAA packet.

3. IAA packets are received by gateways and then redirected to a server.

4. The server may issue commands to several gateways to perform additional ranging to intercoms if needed.

The main principle of RealTrac™ system –to provide voice communication and localization services with effective radio bandwidth utilization.

http://lab127.ru/

Page 18: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

• Position XYZ in geo-coordinates

• Trajectory (IMU) in local coords.

• Step counter (IMU)

• Battery voltage

• Alive cycle duration

• Pressure

• Temperature

• Received signal strength

Data and events (RTLS CP)

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

Distance to object

Location based events

Voice calls

Temperature monitor

Battery level

RFID proximity event

Activity trigger

Man-down event

Gesture recognition (?)

Obtained data Generated events

Data and events are available through RTLS Communication Protocol.

http://lab127.ru/

Page 19: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

Applications

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

Case: Hotel

Case: Safety, security and control

No need to explainwhere you are,

the service finds you!

Where isa lost passenger?

I need RealTracTechnology!

Help me! Where aremy kids?

Juice, please! Juice, please!

http://lab127.ru/

Page 20: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

Coal mines, Ingortech (since 2011)

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

http://lab127.ru/

Page 21: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

Logistics at Samsung, Kaluga (2014-2015)

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

http://lab127.ru/

Page 22: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

Gas and oil industry, Vankor (2014)

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

http://lab127.ru/

Page 23: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

RTL and voice communication, Australia (2014)

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

http://lab127.ru/

Page 24: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

Awards

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

Winner of the localization competition EVAAL-2013 (http://evaal.aaloa.org)

More than 20 diplomas and awards

International experience of technology using

http://lab127.ru/

Page 25: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

Awards

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

In 2013 "Nanonets LTD" won the regional contest in the nomination "The best start-up" and was one of the winners in the nomination "The best SME in Republic of Karelia".

http://lab127.ru/

Page 26: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

Awards

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

The RealTrac™ local positioning technology won the 1st place in International competition "Evaluating AAL Systems through Competitive Benchmarking, EvAAL-2013" (http://evaal.aaloa.org/).

http://lab127.ru/

Page 27: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Real Time Location Systems

Localization accuracy (EvAAL-2013)

y, m

eter

sy,

met

ers

prob

abilit

ypr

obab

ility

http://lab127.ru/

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

Page 28: realtrac overview spinofflab127.ru/realtrac_overview_20160510.pdf · Communication protocol INCP System and network architecture Server-side software Client-side software Voice communication

Lab127 Lab0x7F Lab0177 Lab1111111b

Ongoing and future research

LocationLocation--Aware TechnologiesAware Technologiesfor Entertainment, Industry and Sciencefor Entertainment, Industry and Science

http://lab127.ru/

• Ultra Wide Band

• Inertial navigation

• Pressure sensor networks

• Magnetic field maps

• Data fusion: IMU, radio and

video localization subsystems

Research works are partly financed by the Ministry of Education and Science of Russian Federation

(contract 14.574.21.0059, ID RFMFIBBB14X0164)

Industrial partners:2014-2015: RTL-Service JSC

2016: GS-Nanotech