Computational Characterization of
Salsa Music
Gerardo M. Sarria M.
Pontificia Universidad Javeriana - Cali
October, 2014
Cali
Pontificia Universidad Javeriana
• 184.254,84 m2
• 19 undergraduate programs
• 23 graduate programs
• 6928 students
• 800 faculty members
OMLinux
• 1st OM Linux port
• OpenMusic v4.5
• CMUCL - Gtk+ - Midishare
• AGNULA Project
AVISPA and Cordial/PiCO
• Cordial, a high-level visual programming language integrating object-oriented and constraint programming intended for musical applications.
• PiCO, a calculus integrating objects and constraints.
*C. Rueda, G. Alvarez, L. O. Quesada, G. Tamura, F. D. Valencia, J. F. Diaz, and G. Assayag. Integrating constraints and concurrent objects in musical applications: A calculus and its visual language. Constraints, 6(1):21-52, 2001.
rtccProcess calculus:
• Based on ccp
• True concurrency
• Metrical notion of time
• Bounded time
• Transition system with resource handling
• Chu spaces
• Real-time logic
rtcc
rtcc - dissonancesThe cycle of tension-relaxation:
Preparation
Dissonance
Resolution
Stochastic Context-Free Grammars
Stochastic Context-Free Grammars
Degrees representation:
Grammar for major scales:
MuZA• Constraint system in MoZArt
• Harmony
• Music relations implemented as propagators
Music Search Engine
Music Search Engine
Storage Retrieval
Music Search Engine
• Content based retrieval
• MPEG7
• New Oracle datatype: ORDMP7
Project Salsa
Salsa• What is salsa?
• What makes salsa be salsa?
• Instruments
• Rhythm, melody, harmony
• Lyrics
• Singer / Band
• …
Salsa
• Son clave:!"
#"!
# #!! $ !% $&
Salsa• Piano or guitar:
!""#
$% &"' &'"( &&
""""
" $""!
&"
"&$""
&" &
#
""
$#'"
%(
2
'"
""""
&&"""
$"&
"&
'"
%(
3
&""
$' "&
" ""
))))'
& """
"
&&"'"
" $""
%(
4 #
""
$"&
Salsa• Structure:
• Chorus:
Intro Verse Chorus Verse Chorus SoloInstrumental Chorus Ending
Montuno (singer/choir)Normal (choir)
Project Salsa
Data Set
IA
Salsa Data SetFind songs
Pre-analyze the songs (repetitions,metadata)
Audio features and metadata extraction
Addition to data set
Salsa Data SetFind songs
Pre-analyze the songs (repetitions,metadata)
Audio features and metadata extraction
Addition to data set
Chorus extraction
Salsa Data Set
Salsa Data Set
Salsa Data Set
Salsa IA
• Weka
• Support Vector Machine, K-Nearest Neighbors, Decision trees
• Clustering, classification
Salsa IA• Salsa 60s
• Salsa 70s
• Salsa 80s
• Salsa 90s
• Salsa 00s
• Salsa 10s
Future: ComparisonHuman Expert vs Our System
Future: Salsa DanceRelation between dance and music
Thank you
Top Related