AUDIO & MUSIC MULTI-DSP PROCESSOR - dream.fr · AUDIO & MUSIC MULTI-DSP PROCESSOR Key features
Digital audio and computer music
description
Transcript of Digital audio and computer music
![Page 1: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/1.jpg)
Digital audio and computer music
COS 116: 2/26/2008
![Page 2: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/2.jpg)
Overview
1. Sound and music in the physical world and in human experience
2. Representations of music3. Analyzing music with computers4. Creating music with computers
![Page 3: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/3.jpg)
1. Sound and music
![Page 4: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/4.jpg)
What is sound?
Discussion Time
“Pressure wave”
![Page 5: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/5.jpg)
What do we hear? Video:
http://www.youtube.com/watch?v=0svoQcMQNYg
Frequency Pitch Loudness Timbre …
![Page 6: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/6.jpg)
Psychoacoustics Relationships between physical phenomenon of sound
and our perception Frequency : pitch
20-20,000Hz Amplitude : loudness Identities and strengths of frequencies present : timbre
+ =
![Page 7: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/7.jpg)
Discussion Time
What is music?
“Organized sound”
• Psychoacoustics play an important role• Also dependence upon history, culture, experience• Engages listeners’ psychological mechanisms for expectation/reward
![Page 8: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/8.jpg)
2. Representations of sound and music
![Page 9: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/9.jpg)
Score:
Audio samples Spectrum
Discussion Time
How do you represent music?
![Page 10: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/10.jpg)
Digital representation of music
![Page 11: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/11.jpg)
Compression A “better” representation with fewer bits Why? Security, transmission, storage How?
Psychoacoustic principles MP3: Masking
Physical principles of sound production (uses modelsof sound source)
![Page 12: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/12.jpg)
Choosing a representation
Representations are compromises Standard representations are somewhat
arbitrary Appropriate representation is task-
dependent
![Page 13: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/13.jpg)
3. Using technology to analyze sound and music
![Page 14: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/14.jpg)
Analyzing speech
Real-life apps: Customer service phone routing Voice recognition software
![Page 15: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/15.jpg)
Computational Auditory Scene Analysis
Applications: Archival and retrieval, forensics, AI
![Page 16: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/16.jpg)
Music information retrieval
Analyzing musical data Query, recommend, visualize, transcribe,
detect plagiarism, follow along with a score Sites you can try
midomi.comThemefinder.comPandora.com (human-driven), last.fm
![Page 17: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/17.jpg)
Machine learning for analysis
![Page 18: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/18.jpg)
4. Using technology to create music and soundA whirlwind tour of the 20th century, with a focus on computer technology
![Page 19: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/19.jpg)
Creating music: Synthesis
![Page 20: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/20.jpg)
Three approaches to synthesis Additive synthesis
1. Figure out which frequencies are present, and in what proportions
2. Synthesize a sine wave at each frequency, and superpose them.
1. Physical modeling1. Start with knowledge about how physical systems
oscillate2. Simulate oscillation of an arbitrary system. (Recall
Lecture 4)
+ + …=
![Page 21: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/21.jpg)
Three approaches to synthesis Cross-synthesis
Choose filter for speech (vowel) Choose source to be another sound
![Page 22: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/22.jpg)
Some continua of computer music creation
Synthesis
Controlling synthesis
Composition
low
highLevel of control
Running a program
Computer follows performer
Live coding, special controllers
Interactivity
![Page 23: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/23.jpg)
Performer-Computer Interaction Augmented instruments Software and hardware interfaces
Demo: PLOrk video, PBS Demo: using a Wii-mote to control sound Demo: SMELT
New instruments Demo: Perry’s Mug
Live coding Demo: Max’s drum machine
![Page 24: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/24.jpg)
Questions: How can we…. develop new ways to synthesize sound? give user control over synthesis parameters? make machines interactive in a musical way? augment human capabilities? design new instruments that are easy to play?
allow expert musicality? create music that is emotionally and
aesthetically compelling?
![Page 25: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/25.jpg)
Final remarks Distinctions in this presentation are superficial
Analysis, representation, and creation interact Technology draws on and contributes to our understanding of the
physics and psychophysics of sound Computer music is interdisciplinary
HCI, AI, programming languages, algorithms, systems building Also psychology, music theory, acoustics, signal processing,
engineering, physics, performance practice, library science, applied math & statistics, …
Technology is constantly complicating and changing the landscape of our musical experiences as creators, participants, listeners, and consumers.
![Page 26: Digital audio and computer music](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815113550346895dbf30bc/html5/thumbnails/26.jpg)
http://soundlab.cs.princeton.edu/
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.