Isomer presentation
-
Upload
the-isomer-project -
Category
Documents
-
view
140 -
download
4
Transcript of Isomer presentation
![Page 1: Isomer presentation](https://reader036.fdocuments.us/reader036/viewer/2022062312/555cb113d8b42ab2358b5366/html5/thumbnails/1.jpg)
![Page 2: Isomer presentation](https://reader036.fdocuments.us/reader036/viewer/2022062312/555cb113d8b42ab2358b5366/html5/thumbnails/2.jpg)
MIDI
Audio
Ab
stra
ctio
n
Layer
![Page 3: Isomer presentation](https://reader036.fdocuments.us/reader036/viewer/2022062312/555cb113d8b42ab2358b5366/html5/thumbnails/3.jpg)
Description
Isomer-Symbolic
Ingests single or multiple MIDI files (in parallel) from a specified directory and populates a MySQL database with a symbolic model and associated raw MIDI data. While the raw MIDI data remains uninterpreted, it is organized into individual streams (based on MIDI track) containing collections of raw NodeEvents.
![Page 4: Isomer presentation](https://reader036.fdocuments.us/reader036/viewer/2022062312/555cb113d8b42ab2358b5366/html5/thumbnails/4.jpg)
DescriptionIsomer-Audio ingests single or multiple audio files (in parallel) from a specific directory and populates a MySQL database with an audio model and associated raw audio data. While the raw audio data remains uninterpreted, it is organized into separate streams depending on the type of preprocessing (e.g. source separation) employed.
Isomer-Audio
SMSMEAPsoftopenBliSSARTSIMMJAFE
Externals
![Page 5: Isomer presentation](https://reader036.fdocuments.us/reader036/viewer/2022062312/555cb113d8b42ab2358b5366/html5/thumbnails/5.jpg)
A.R.E. is an acronym defined as: Abstracted Representation Engine. The A.R.E. parses ingested raw symbolic and audio data and populates a MySQL database with abstraction layer data in a cartesian coordinate format. This allows input from various sources to combine in a single representation suitable for further analysis and transformation.
Isomer-A.R.E.
stream
segment
slice
stream
s
time
![Page 6: Isomer presentation](https://reader036.fdocuments.us/reader036/viewer/2022062312/555cb113d8b42ab2358b5366/html5/thumbnails/6.jpg)
melodyharmonyrhythmtimbre
melodyharmonyrhythmtimbre
2ms
time
stream
1stre
am
2
![Page 7: Isomer presentation](https://reader036.fdocuments.us/reader036/viewer/2022062312/555cb113d8b42ab2358b5366/html5/thumbnails/7.jpg)
pitch pitch IR
IR equity proximity equity
registral return
melody
A.R.E. Data(single point)
![Page 8: Isomer presentation](https://reader036.fdocuments.us/reader036/viewer/2022062312/555cb113d8b42ab2358b5366/html5/thumbnails/8.jpg)
pitch pitch IR
IR equity proximity equity
registral return
tension pitches
average chroma
chroma (PCS)
harmony
A.R.E. Data(single point)
![Page 9: Isomer presentation](https://reader036.fdocuments.us/reader036/viewer/2022062312/555cb113d8b42ab2358b5366/html5/thumbnails/9.jpg)
pitch pitch IR
IR equity proximity equity
registral return
tension pitches
average chroma
chroma (PCS)
N1 onset N2 onset
offset onset delta (p)
duration delta (p)
rhythm
A.R.E. Data(single point)
![Page 10: Isomer presentation](https://reader036.fdocuments.us/reader036/viewer/2022062312/555cb113d8b42ab2358b5366/html5/thumbnails/10.jpg)
pitch pitch IR
IR equity proximity equity
registral return
tension pitches
average chroma
chroma (PCS)
N1 onset N2 onset
offset onset delta (p)
duration delta (p)
RMS spectral stability
spectral flatness MFCC
timbre
A.R.E. Data(single point)
![Page 11: Isomer presentation](https://reader036.fdocuments.us/reader036/viewer/2022062312/555cb113d8b42ab2358b5366/html5/thumbnails/11.jpg)
Isomer-Query allows users to retrieve Isomer-generated A.R.E. data (above) and mine that data for musically relevant trends. Displays analyzed A.R.E. data as time points (X-axis) and streams/sub-streams (Y-axis) for a given model and allows on-demand calculation of any/all of the following data for any grid coordinates or range of coordinates:
Isomer-Query
harmonymelody rhythmtimbre
Registral DirectionRegistral ReturnProximity RatioInterval RangeMelodic Accent
Tension DirectionTension InstabilityAverage Tension
Temporal DirectionTemporal Instability
IOI RangeNPVI IOI
NPVI DurationAgogic Accent
Textural FingerprintDynamic Accent
![Page 12: Isomer presentation](https://reader036.fdocuments.us/reader036/viewer/2022062312/555cb113d8b42ab2358b5366/html5/thumbnails/12.jpg)
harmony
melody
rhythm
timbre
PitchPitch IR
IR EquityProximity EquityRegistral Return
Registral DirectionRegistral ReturnProximity RatioInterval RangeMelodic Accent
Event Properties
Event Trends
TensionPitch Collection
Average ChromaChroma (12)
Tension DirectionTension InstabilityAverage Tension
Event Properties
Event TrendsN1 OnsetN2 Onset
OffsetOnset Delta (p)
Duration Delta (p)
Event Properties
Temporal DirectionTemporal Instability
IOI RangeNPVI IOI
NPVI DurationAgogic Accent
Event Trends
RMSSpectral StabilitySpectral Flatness
MFCC (13)
Event Properties
Textural FingerprintDynamic Accent
Event Trends