Music Processing Analysis (MPA)Lecture

Meinard Müller

Overview

International Audio Laboratories Erlangenmeinard.mueller@audiolabs-erlangen.de

Music

Music Information Retrieval (MIR)

Sheet Music (Image) CD / MP3 (Audio) MusicXML (Text)

Music Film (Video)

Dance / Motion (Mocap) MIDI

Music Literature (Text)Singing / Voice (Audio)

Music

Music Information Retrieval (MIR)

MusicMusicology

LibrarySciences

User Interfaces

Signal Processing

MachineLearning

Information Retrieval

Piano Roll Representation Player Piano (1900)

Time

Pitch

J.S. Bach, C-Major Fuge

(Well Tempered Piano, BWV 846)

Piano Roll Representation (MIDI)

Query:

Goal: Find all occurrences of the query

Piano Roll Representation (MIDI)

Matches:

Piano Roll Representation (MIDI)

Query:

Goal: Find all occurrences of the query

Music Retrieval

Query

Database

Hit

Bernstein (1962) Beethoven, Symphony No. 5

Beethoven, Symphony No. 5: Bernstein (1962) Karajan (1982) Gould (1992)

Beethoven, Symphony No. 9 Beethoven, Symphony No. 3 Haydn Symphony No. 94

Audio-ID

Version-ID

Category-ID

Music Synchronization: Audio-Audio

Beethoven’s Fifth

Music Synchronization: Audio-Audio

Time (seconds)

Beethoven’s Fifth

Orchester(Karajan)

Piano(Scherbakov)

Music Synchronization: Audio-Audio

Time (seconds)

Beethoven’s Fifth

Orchester(Karajan)

Piano(Scherbakov)

Application: Interpretation Switcher

Music Synchronization: Image-Audio

Imag

eAu

dio

Music Synchronization: Image-AudioIm

age

Audi

o

How to make the data comparable?

Imag

eAu

dio

How to make the data comparable?

Imag

eAu

dio

Image Processing: Optical Music Recognition

How to make the data comparable?

Imag

eAu

dio

Audio Processing: Fourier Analysis

Image Processing: Optical Music Recognition

How to make the data comparable?

Imag

eAu

dio

Audio Processing: Fourier Analysis

Image Processing: Optical Music Recognition

Application: Score Viewer Music Structure AnalysisExample: Zager & Evans “In The Year 2525”

Time (seconds)

Music Structure Analysis

Time (seconds)

Example: Zager & Evans “In The Year 2525”

Music Structure Analysis

V1 V2 V3 V4 V5 V6 V7 V8 OBI

Example: Zager & Evans “In The Year 2525”

Tempo Estimation and Beat Tracking

Time (seconds)

Example: Queen – Another One Bites The Dust

Basic task: “Tapping the foot when listening to music’’

Time (seconds)

Tempo Estimation and Beat Tracking

Example: Queen – Another One Bites The Dust

Basic task: “Tapping the foot when listening to music’’

Tempo Estimation and Beat Tracking

Light effects

Music recommendation

DJ

Audio editing

Audio Fingerprinting

Structure Analysis

Tempo and Beat Tracking

Fourier TransformAudio Features

Music ProcessingMusic Synchronization

Chord Recognition

Book: Fundamentals of Music Processing

Meinard MüllerFundamentals of Music ProcessingAudio, Analysis, Algorithms, Applications483 p., 249 illus., hardcoverISBN: 978-3-319-21944-8Springer, 2015

Accompanying website: www.music-processing.de

Book: Fundamentals of Music Processing

Meinard MüllerFundamentals of Music ProcessingAudio, Analysis, Algorithms, Applications483 p., 249 illus., hardcoverISBN: 978-3-319-21944-8Springer, 2015

Accompanying website: www.music-processing.de