Real-time monitoring of noise and acoustic events: listening identifying and understandingReal-time monitoring of noise and acoustic events: listening, identifying and understanding

Real-time monitoring of noise and ti t li t i g t th dacoustic events: listening to the deep,

identifying and understanding

Michel AndréLaboratory of Applied Bioacoustics (LAB)Technical University of Catalonia (UPC, BARCELONA Tech)http://www.lab.upc.es

Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques

Real-time monitoring of noise and acoustic events: listening identifying and understandingReal-time monitoring of noise and acoustic events: listening, identifying and understanding

LIDO live data flowLIDO live data flow

Country/Location Platform Data streamCountry/Location Platform Data stream

FRANCE ANTARES 36 x 250 kHz

NEPTUNE CANADA Folger Passage 1 x 96 kHz

NEPTUNE CANADA Barkley Canyon 1 x 96 kHz

NEPTUNE CANADA Barkley Slope 1 x 96 kHz

SPAIN (MED SEA) OBSEA 1 x 96 kHz( )

JAPAN (JAMSTEC) Hatsushima 1 x 100 Hz

JAPAN (JAMSTEC) Kushiro 3 x 100 Hz

ITALY (ESONET) NEMO TSS/TSN 2 4 96 kHITALY (ESONET) NEMO TSS/TSN 2x 4 x 96 kHz

SPAIN (ATLANTIC) BIMEP 1 x 96 kHz

CTBTO ? 11 HA 11 x 200 Hz

Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques

Real-time monitoring of noise and acoustic events: listening identifying and understandingaudio data streamReal-time monitoring of noise and acoustic events: listening, identifying and understanding audio data stream 

Segment 1 Segment 2 Segment 3 Segment 4 Segment 6Segment 5......

Classifier 1Classifier 2...

Measure noise

Discard  segment with no acoustic

Real‐Time Mitigation 

no acoustic event

Assign acoustic events to

Sperm whalesBeaked whalesPilot whalesD l hi

Long term assessment and Control of the effects of noise sources on marine organismsevents to 

broad categories

FM‐tonal soundsI l

DolphinsExplosionsShipsSonar Public outreach 

TrackingDensity Estimation 

Impulses...

i i i

Stage 2Stage 2Stage 2Stage 2Stage 1Stage 1Stage 1Stage 1

Bearing, PositionTrajectory, …

Stage 3Stage 3Stage 3Stage 3

Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques

Real-time monitoring of noise and acoustic events: listening identifying and understandingReal-time monitoring of noise and acoustic events: listening, identifying and understanding ction

Detec

catio

nClassific

onLocalisatio

Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques

Real-time monitoring of noise and acoustic events: listening identifying and understanding

Detection of short tonal sounds in the band 0.2‐16 kHz.  Acoustic data from Neptune, 3‐24 March 

d d hReal-time monitoring of noise and acoustic events: listening, identifying and understanding 2010, 10 min recorded  every 3.5 hour. 

DETECTION & CLASSIFICATION

Fin whales,  29th April 2010, 02am, off Kushiro, JAPAN, JAMSTEC observatory(Feed Forward Neural Network)(Feed Forward Neural Network)

Zaugg, S., van der Schaar, M., Houégnigan, L., Gervaise, C., André, M. Real‐time acoustic classification of sperm whale clicks and shipping impulses from deep‐sea observatories. Applied Acoustics, issue doi:10.1016/j.apacoust.2010.05.005, 2010

Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques

Real-time monitoring of noise and acoustic events in cetacean acoustic nichesReal-time monitoring of noise and acoustic events in cetacean acoustic niches

LOCALIZATION

Sperm whale tracking,  09th August 2005, 09pm, East‐Sicily, NEMO observatory(Hybrid spatial spectral estimation: space‐time methods and TDOA‐based methods)(Hybrid spatial spectral estimation: space time methods and TDOA based methods)

Figure 3.9 : Sperm whale tracking, 09th August 2005, 09pmHouégnigan, S. Zaugg, M. van der Schaar, M. André. Space–time and hybrid algorithms for the passive acoustic 3D localisation of sperm whales and vessels. Appl ied Acoustics (2010), doi:10.1016/j.apacoust.2010.05.017

Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques

Real-time monitoring of noise and acoustic events: listening identifying and understanding

Detection of short tonal sounds in the band 0.2‐16 kHz.  Acoustic data from Neptune, 3‐24 March 

d d hReal-time monitoring of noise and acoustic events: listening, identifying and understanding 2010, 10 min recorded  every 3.5 hour. INTERACTION WITH NOISE

( )Sperm Whales at ANTARES (Ligurian Sea), July 2010

André, M., van der Schaar, M., Zaugg, S., Houégnigan, L., Sánchez, A., Mas, A. Listening to the Deep: real‐time f ll d l ll ll ( d)

Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques

monitoring of noise pollution and cetacean acoustic signals. Marine Pollution Bulletin (accepted).

Real-time monitoring of noise and acoustic events: listening identifying and understanding

Detection of short tonal sounds in the band 0.2‐16 kHz.  Acoustic data from Neptune, 3‐24 March 

d d hReal-time monitoring of noise and acoustic events: listening, identifying and understanding 2010, 10 min recorded  every 3.5 hour. 

GLOBAL NOISEGLOBAL NOISE

MEASUREMENTS

(10 segment average)(10 segment average)

Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques

Real-time monitoring of noise and acoustic events: listening identifying and understanding

Detection of short tonal sounds in the band 0.2‐16 kHz.  Acoustic data from Neptune, 3‐24 March 

d d hReal-time monitoring of noise and acoustic events: listening, identifying and understanding 2010, 10 min recorded  every 3.5 hour. 

GLOBAL CETACEANGLOBAL CETACEAN

DISTRIBUTION

(50 segment average)(50 segment average)

Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques

Real-time monitoring of noise and acoustic events: listening identifying and understanding

Detection of short tonal sounds in the band 0.2‐16 kHz.  Acoustic data from Neptune, 3‐24 March 

d d hReal-time monitoring of noise and acoustic events: listening, identifying and understanding 2010, 10 min recorded  every 3.5 hour. 

Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques

Real-time monitoring of noise and acoustic events: listening identifying and understandingReal-time monitoring of noise and acoustic events: listening, identifying and understanding

http://listentothedeep.comp p

Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques

Real-time monitoring of noise and acoustic events: listening identifying and understandingReal-time monitoring of noise and acoustic events: listening, identifying and understanding

Deep‐sea or shallow water cabled observatories

Towed arrays

Radio linkedUnderwater vehicles, e.g. gliders

Radio‐linked , expandable or moored stand‐alone buoys

Underwater neutrino telescopes

Past and Existing recordings

Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques

Monitoring i ti iexisting noise

sources http://www.sonsdemar.eu

Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques

Real-time monitoring of noise and acoustic events: listening identifying and understandingReal-time monitoring of noise and acoustic events: listening, identifying and understanding

The system is designed to be modular and dynamic (allows the choiceof detectors/classifiers) depending on the objectives andVE

S

of detectors/classifiers) depending on the objectives and geographical areas

The system successfully allows:PEC

TIV

The system successfully allows: - the real-time detection and classification of acoustic events- the real-time and long-term monitoring of noise- immediate mitigation actionsPE

RS

P

g- the online display of the audio stream and the statistical analysis

The modular system can be implemented on: ON

S &

P

y p- cabled observatories, - autonomous radio-linked buoys, moored antennas- autonomous vehicles (e.g. gliders),

CLU

SIO

- towed arrays- existing data sets,- etc.C

ON

C

Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques

Real-time monitoring of noise and acoustic events: listening identifying and understandingReal-time monitoring of noise and acoustic events: listening, identifying and understanding

The system can be applied (industry):-during offshore operations, seismic surveys (expandable buoys), VE

Sp p

windmills/wave energy (autonomous buoys during construction, cabled observatory during operation), shipping lines, coastaloperations (e.g. harbour construction), etc.

PEC

TIV

The system can be applied (science):- in existing and future acoustic observatoriesd i CEE d t i t d t d th ti l fPE

RS

P

-during CEE and tagging to understand the acoustic ecology of the individual,- existing recordings

ON

S &

P

The system will be implemented (Fall) with:- an alert procedure that will allow to automatically target acousticevents of interest and receive it live (e g mitigation or research)C

LUS

IO

events of interest and receive it live (e.g. mitigation or research)- automatic display of AIS data and correlation with noisemeasurements to determine the acoustic signature of ships cruisingover the observatoriesC

ON

C

Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques

over the observatories

Real-time monitoring of noise and acoustic events: listening identifying and understandingReal-time monitoring of noise and acoustic events: listening, identifying and understanding VE

S

The data from the existing observatories are availlable to thescientific community

PEC

TIV

The system can be operated by a non-expert

The l i i e f ed t ti ll d d e ’t e i e tPER

SP

The analysis is performed automatically and doesn’t require post-processing

The system is immediately available to be applied to any AcousticsON

S &

P

The system is immediately available to be applied to any AcousticsObservatory

CLU

SIO

CO

NC

Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques