MORYNE Enhancement of public transport efficiency through

the use of mobile sensor networks

TETRA/TETRAPOL/GSMNarrowband digital network

GPRS / UMTS wideband digital network

Fixed infrastructure (IP backbone)

Environmental sensors

Camera

Fleets of city buses Wireless networks Public TransportControl Centre

WiMAX/WiFi broadband digital network

City TrafficManagement Centre

Web-site: www.fp6-moryne.org Coordinator: EADS Secure Networks Patrice SIMON 1 Blvd Jean Moulin - CS 4000178996 ELANCOURT CEDEX FRANCE patrice.simon@eads.com

CONTEXT There is a persistent need to improve thesafety, the efficiency and the security ofpublic transportation in Europe. Newtechnologies allowing Public TransportControl Centers and buses to communicatevoice, video and data is a promising solutionto make a step towards these goals. Operators want to get a real-time picture ofthe situation of their bus fleets, andespecially the passengers and surroundingsof any bus they manage. Bus drivers alsoneed to be able to send information bythemselves. Video is the most demanded application.Display of recorded past information is alsoof much interest. Multiple technical solutions exist, but theyhave to be bound together and then testedin a real situation.

Contract: • European Commission • Framework Programme 6 • Specific Targeted Research or

Innovation Project (STREP) • Contract number: 027041

Duration: 01 Jan. 2006 – 31 Mar. 2008 (27 months)

RESULTS & INNOVATION The MORYNE project proposes solutions toimprove the traffic management of publictransport vehicles in urban and sub-urbanareas. MORYNE allows a Public Transport Control Centre (PTCC) to retrieve at any time the information collected by mobile sensors (e.g. cameras, environmental sensors, GPS) embedded on fleets of public transport vehicles (buses) by means of a smart radio communication system. The City Traffic Management Centre (CTMC) is then informed in real-time of the traffic surrounding the buses. Innovations apply in the fields of: - traffic management - video sensors and image analysis - telecommunications A 2-day demonstration in Berlin on 11 and 12 March 2008 will show these solutions in a real context.

www.fp6-moryne.org page 2 / 8 © MORYNE consortium 2008

Traffic management system

DESCRIPTION The Traffic Management module of the MORYNE system covers: - Mobile segment: The main equipment of

the mobile side is the OBU, which exchanges information with the video subsystem, the environmental subsystem, the GPS receiver, the odometer and the driver interface; and after pre-processing, it sends that information to the ground segment.

- Ground segment: The management

centre provides a friendly interface to the user, so as to be able to see in real time the situation of the bus, and interesting information (environmental, traffic status or image) related to it. The interface helps the controller to access, interpret and process this information in order to optimise the control of the entire fleet of buses. Furthermore, all data can be later analysed in order to provide a series of criteria that will be used for the optimum planning of the city traffic.

INNOVATION

- Mobile segment: - Lane position algorithm, and

number of lanes besides bus lane calculation

- Fog and Ice warning calculation - Driver Interface to warn him about

congestion and environmental alarms

- Ground segment: - Environmental warnings, definition

and plotting of alarm zones - Possibility of picture, video or live

streaming request - Environmental information shown

on bus tool tip. - Real-time traffic congestion shown

on map in a 3-coloured scale

BENEFITS TO USERS - Safety improvement by knowing at any

time the location of the bus, the status of traffic and environment, and even seeing it by image/video request.

- Easy traffic management and control of lines and routes capability, with information and tools provided by MORYNE client (detours, reinforcements, messaging and communication with drivers…).

- Availability of information about congestion, fog and ice, to be provided to final users through several ways (SMS, Web, Radio, VMS, etc.)

CONTACT GMV contact: Mr. Antonio ABASCAL email: aabascal@gmv.com phone: +34 983 54 65 54

MORYNE CLIENTS

Odometer

Video Sensors

GPS Antenna

Env. Sensors

OBU

MORYNESERVER

www.fp6-moryne.org © MORYNE consortium 2008

City traffic & public transport

ROLE IN THE PROJECT The Brussels Region Administration of Equipment and Transport (Brussels Mobility) is involved in the project as representative of the City Traffic Control and Management Centres. It was mainly involved in the end users requirements collection and the evaluation phases by the development of questionnaires. IMPACTS City Traffic Management Some cities are using floating cars to improve the relevance and the reliability of real time urban traffic conditions map. When these floating cars are allowed to move on dedicated lanes (e.g. buses or taxis in PT buses and taxis dedicated lanes), they are no more representatives of the real traffic conditions for the private cars. When the buses are using these dedicated lines, the MORYNE on-board cameras are taking pictures of the traffic on the adjacent “non dedicated” lane(s). After analysis of these pictures, an estimation of the road occupancy of this (these) lane(s) used by the private cars is provided by the system and sent to the Traffic Control Centres. With these data, the City Traffic Control and Management Centres are able to continue to use these buses as floating cars. Public Transport Control - A better information on the location and speed of the bus, on the environment of the bus (data and video) will increase road safety and facilitates the day-to-day work in the Public Transport Control Centres. - A more accurate estimation of the time of arrival of buses at bus stops will be enhanced, allowing a better information to passengers.

RECOMMENDATIONS City Traffic Management The MORYNE system of data and images capture and transmission from the buses has to be competitive at the technical and the financial points of view versus the other actual car counting systems generally used by the City Traffic Control and Management Centres. For this reason, it is necessary to reduce the cost of the system. Public Transport Control - The transmission of indoor video and pictures both live and recorded would be of much interest for security and legal reasons: Law enforcement teams would intervene more quickly with more information; and, judicial enquiries would also be helped with the collected information. - As city buses are quite numerous (hundreds in big cities), the amount of images would require too much human analysis work. Moreover, the telecommunication systems cannot transmit all videos in real time from all the buses. So, video and pictures collection have to be associated with powerful onboard video and image analysis systems allowing to identify situations of "interest", and only send alarms and videos when needed. The term "interest" has to be defined with the end users.

CONTACTS Ministère de la Région de Bruxelles Capitale contact: Mr Pierre SCHMITZ email: pschmitz@mrbc.irisnet.bephone: +32 2 204 19 70 Kozlekedestudomanyi intezet contact: Mr Gábor ALBERT email: albert@kti.hu phone: +36 13715801

page 3 / 8

kht. (KTI)

www.fp6-moryne.org page 4 / 8 © MORYNE consortium 2008

Video services

DESCRIPTION The MORYNE System integrates a dedicated platform for image/video operation with following services:

- Acquisition - Analysis - Compression - Recording - Transmission - Monitoring and Displaying

The video platform is composed of 4 main equipments:

- Onboard analog video camera - Onboard Mobile Video Server (MVS) - Ground Video Server (GVS) - Ground Video Station

The video services are operated automatically or on demand according to the need of end users. INNOVATION For this application MARTEC has integrated and adapted various technologies to demonstrate embedded processing of standard onboard video surveillance application (compression, recording, streaming) associated in the same time with image analysis application (traffic status, bus lane violation):

- Hardware implementation of MPEG-4 encoder for real time video compression.

- Video streaming protocol (RTP/UDP). - Real time processing of image

analysis library. - Service messages exchange based on

standard XML file format. To allow a continuous service between ground and vehicles, the video platform presents dedicated interfaces with other equipments (On Board Unit, MORYNE Server) and a graphical interface for operators.

BENEFITS TO USERS

- Next generation of onboard videosurveillance solution combining highperformance embedded technologieswith new image analysis capabilities forautomatic event detection.

- Complete client-server video applicationfor end to end operation betweenground operators and vehicles:configuration, operation, maintenance.

- Interoperability with other systems bythe use of standards for videocompression and formatting, networkcommunication, and data exchangeformat.

CONTACT MARTEC contact: Mr. Frédéric HEER email: frederic.heer@martec.fr phone: +33 (0) 1 69 82 20 13

GVS

MVS

End Users Video Station

Video Camera

www.fp6-moryne.org page 5 / 8© MORYNE consortium 2008

Image processing and analysis

DESCRIPTION The aim of the scene analysis module of theMORYNE platform is to automatically extractinformation from what is seen around thebus by an onboard video sensor. The video analysis takes live video data andodometer information as inputs. The results of the analysis are aclassification of the observed scene intodifferent traffic density classes (fluid, busy orcongested) for the lanes adjacent to the bus. The module sends to the OBU :

- the classification of the traffic onregular time intervals,

- an alarm when a congestion isdetected or when a bus lane violationis presumed.

INNOVATION For this application, MULTITEL hasdeveloped a groundbreaking algorithm. Indeed, as a mean to reduce the amount ofdata to process, the algorithm works with aset of 1-D segments aligned with the road. The relative speed of the vehicles iscomputed by detecting and tracking featuresalong each of these segments. The absolutespeed can be estimated from the relativespeed if the camera speed is known, e.g.thanks to the odometer information. Usingpre-defined speed thresholds, the traffic canbe classified into different categories suchas ‘fluid’, ‘congestion’ etc. The advantages of this algorithm are :

- high reliability - low processing cost - short processing time

BENEFITS TO USERS

- To obtain the traffic status in placeswhere these information were notavailable before, that is wherever thebus is operating and where vehicledetectors are missing.

- To get more localised traffic flowinformation (in case of long roadsections).

- To allow a quick intervention in case ofbus lane violation.

CONTACT MULTITEL contact: Mr. Christophe PARISOT email: parisot@multitel.be phone: +32 (0)65 34 27 83

www.fp6-moryne.org page 6 / 8 © MORYNE consortium 2008

Environment sensors

DESCRIPTION The objective is to enrich the meteorological awareness by acquiring real-time data with moving sensors. As a part of the MORYNE System, theenvironmental subsystem is composed of 3modules witch are located on the bus.

The modules provide 4 environmental datato the OBU (On Board Unit):

- humidity and temperature of the road- humidity and temperature of the air

After data processing, the OBU is able togive the information concerning the fog andice warning to the road management teams. INNOVATION For this application TEMEX CERAMICS has developed a new humidity sensor. The advantages of the sensor are:

- good behaviour against clogging problems

- good humidity sensitivity - good chemical resistance

Those characteristics are useful in order tohave a better accuracy for the weatherforecast. For the MORYNE project, thesensors must react very quickly under hardconditions: high humidity (fog, rain) andpollution (exhaust fumes from cars).Therefore the behaviour against clogging isvery important. The humidity sensors provide twoinnovations to improve this behaviour:

- Material innovation (dense material ceramic instead of porous polymer)

- Electronic innovation (to protect the sensor against condensation)

BENEFITS TO USERS - Safety improvement by the localisation of

the most dangerous areas (fog and ice)warning system for the drivers

- Quick intervention and better use of thepersonal resources for the de-icingprocedure

- Economic and ecologic benefits becauseof the decreased amount of de-icingchemical (optimal use of the salt)

- Augmentation of the number of meshes for a better accuracy in town weather forecast

CONTACT TEMEX CERAMICS contact: Mr Xavier HOCHART email: xavier.hochart@temex-ceramics.comphone: +33 5 56 46 66 66

Data collecting

Data processing(OBU)

Environmental data Fog and ice warning

Module 1

Module 3

Module 2

www.fp6-moryne.org page 7 / 8© MORYNE consortium 2008

Communication system

DESCRIPTION The MORYNE Communication Systemhides the different radio systems used by theon-board softwares to communicate with theground softwares. Uplink and downlink communications. Manages intelligently radio systems andprovides high-level transmission services. Able to manage:

- low data-rate traffic (position, speed,temperatures…) - high data-rate traffic (videos, pictures).

Communication is done through: - PMR (TETRAPOL): 2 kbps - UMTS: 384 kbps UP; 1800 kbps DOWN- WiFi: 2000 kbps

INNOVATION - Transparent transmission of information through the most convenient network among those covering the area (TETRAPOL / GPRS / WiFi) depending on the bus location - Customisable routing policy which can be remotely updated

BENEFITS TO USERS - Lower failure rate of transmissions (redundancy) - Deployment cost reduced by the use of existing radio networks (private or public) - Real-time transmission between Buses and Management Centres (both ways)

CONTACTS EADS Secure Networks contact: Mr Patrice SIMON email: patrice.simon@eads.com phone: +33 161388471 Euskaltel SA contact: MS Leire AGINAKO email: laginako@euskaltel.com phone: +34 944011000 University of Applied Sciences Osnabrück contact: Prof. Dr. Ing. TÖNJES email: r.toenjes@fh-osnabrueck.de phone: +49 541 969 2941

TETRAPOL digital network

Communication System ground block

UMTS digital network

WiFi mesh digital network

TETRAPOL terminal

UMTS terminal

WiFi Access Point

IP backbone

IP

Other on-board bus equipment

MORYNE

communication Server

Communication System on-board block

Wireless transmission

IP

Other ground equipment

TETRAPOL air interface

UMTS air interface

WiFi / WiMAX air interface

Communication System

MORYNE communication

Module

www.fp6-moryne.org page 8 / 8 © MORYN

The Berlin demonstration

SCENARIOS To optimally cope with the different information demands, the consortium decided to stretch the demonstration event to two days. By that it is possible, to address different target groups with increasingly detailed presentations. The first day gives an overview of the MORYNE developments and all research and development done during the project duration. It presents equipment in the BVG control center and in two double-decker buses. The second day focuses on technically interested experts. They see the equipment in operation, while the buses are running in Potsdamer Straße. The sensor data are captured, pre-processed and transmitted via narrowband (TETRAPOL, GSM) and broadband (MeshWiFi, UMTS) radio to the BVG control centre. The participants also have an opportunity to visit the Berlin Traffic Management Centre in Schöneberg, where the MORYNE data are also transmitted to.

LOCATION - DATE The real life demonstration of the MORYNE project accomplishments is hosted by Berliner Verkehrsbetriebe (BVG), Potsdamer Str. 188, 10783 Berlin. The two-day event runs form March 11th to March 12th, 2008.

CONTACTS EADS Secure Network GmbH contact: Mr Detlef GRÜNDLER email: detlef.gruendler@eads.com phone: +49 731 392 1738 Berliner Verkehrsbetriebe Anstalt des öffentlichen Rechts (BVG) contact: Mr Matthias TENBUSCH email: matthias.tenbusch@bvg.de phone: +49 30 256 29666

E consortium 2008