Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis...

15
1 Formant estimation in Singing Studio PROJECT MEETING Vítor Almeida Faculdade de Engenharia da Universidade do Porto, Porto January 19th, 2013

Transcript of Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis...

Page 1: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization

1

Formant estimation in Singing Studio

PROJECT MEETING

Vítor Almeida

Faculdade de Engenharia da Universidade do Porto, Porto

January 19th, 2013

Page 2: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization

2

Formant estimation algorithm

Project Meeting January 19th, 2013

Features:

- Analysis window : 1024 samples, 75% overlap, sine window.

- Sampling frequency: 22050 Hz.

Page 3: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization

3

Formant estimation algorithm

Project Meeting January 19th, 2013

Estimation of noise component:

Page 4: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization

4

Formant estimation algorithm

Project Meeting January 19th, 2013

Estimation of formant candidates using LPC and Cepstrum:

Page 5: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization

5

Formant estimation algorithm

Project Meeting January 19th, 2013

Some difficulties:

• The existence of vibrato makes hard the noise estimation

• The closeness between two or more formants

• Finding a rule for the selection and validation the candidates

Page 6: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization

6

Formant estimation algorithm

Project Meeting January 19th, 2013

In SingingStudio:

Page 7: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization

7

Vibrato analysis in Singing Studio

PROJECT MEETING

Ricardo Sousa

Faculdade de Engenharia da Universidade do Porto, Porto

January 19th, 2013

Page 8: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization

8

Introduction

• Context and Objectives

• Singing analysis and bio-feedback applied to singing training/teaching

• Acoustic vibrato parameterization

Robust

Descriptive

Objective

Physiological meaning

• Automatic vibrato detection

• Visual interface of vibrato analysis

Project Meeting January 19th, 2013

Page 9: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization

9

Method

•Analysis Algorithm

Pitch Segment

selection

Vibrato Segment

detection

Parameter

Computation

Pitch Estimation

Voice

Signal

Pitch curve

Pitch

Segments

Vibrato

Segments

Vibrato

Parameters

Step 1

Step 2

Step 3

Step 4

January 19th, 2013 Project Meeting

-Spectral based methods

-Frame based

- FFT interpolation (accurate

F0 estimation)

Page 10: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization

10

Method

Page 11: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization

11

Method

•Vibrato percentage: Ratio of vibrato duration and the entire theme duration

•Mean Duration: Mean duration of all segments.

•Mean frequency: Mean frequency of all segments.

•Mean extension: Mean extension of all segments.

•Sinusoidal Purity: Measure the regularity of vibrato (similarity to sinusoidal waveform)

•Vibrato parameters

Duration

1/Frequency

Extension

January 19th, 2013 Project Meeting

Page 12: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization

12

Results

• Automatic detection of vibrato segments

Vibrato detection 1 Vibrato detection 2

January 19th, 2013 Project Meeting

Additional features:

• Manual adjustment of vibrato segments

Page 13: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization

13

Results

• Qualitative and Quantitative Evaluation

Irregular vibrato Regular vibrato

Observation:

• Qualitative evaluation: “Good vibrato”, “Bad vibrato”

January 19th, 2013 Project Meeting

Page 14: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization

14

Conclusion

• Qualitative and Quantitative evaluation of vibrato.

• Visualization and bio-feedback.

• Automatic analysis.

• Physiological interpretation.

• Interactive interface.

January 19th, 2013 Project Meeting

Page 15: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization

15

Truly grateful!

January 19th, 2013 Project Meeting