Audio Signal Processing for Music Applications
Audio signal processing is an engineering field that focuses on the computational methods for intentionally altering sounds, methods that are used in many musical applications.
We have tried to put together a course that can be of interest and accessible to people coming from diverse backgrounds while going deep into several signal processing topics. We focus on the spectral processing techniques of relevance for the description and transformation of sounds, developing the basic theoretical and practical knowledge with which to analyze, synthesize, transform and describe audio signals in the context of music applications.
The course is based on open software and content. The demonstrations and programming exercises are done using Python under Ubuntu, and the references and materials for the course come from open online repositories. We are also distributing with open licenses the software and materials developed for the course.
Week 1: Introduction; basic mathematics
Week 2: Discrete Fourier transform
Week 3: Fourier transform properties
Week 4: Short-time Fourier transform
Week 5: Sinusoidal model
Week 6: Harmonic model
Week 7: Sinusoidal plus residual modeling
Week 8: Sound transformations
Week 9: Sound/music description
Week 10: Concluding topics; beyond audio signal processing
Xavier Serra, Professor, Dept. of Information and Communication Technologies, Universitat Pompeu Fabra of Barcelona
Prof Julius O Smith, III, Professor of Music and (by courtesy) Electrical Engineering, CCRMA, Stanford University
The course assumes some basic background in mathematics and signal processing. Also, since the assignments are done with the programming language Python, some software programming background in any language is most helpful.
The main software tools used are in https://github.com/MTG/sms-tools and the sounds to be studied come from https://freesound.org. Most of the external references come from Julius O Smith website, https://ccrma.stanford.edu/~jos, or from https://www.wikipedia.org.
- How much programming background is needed for the course?
All the assignments start from some existing Python code that the student will have to understand and modify. Some programming experience is necessary.
- What is the coolest thing I'll learn if I take this class?
You will play around with sounds a lot, analysing them, transforming them, and making interesting new sounds.
Each week is structured around 6 types of activities:
- Theory: video lectures covering the core signal processing concepts.
- Demos: video lectures presenting tools and examples that complement the theory.
- Programming: video lectures introducing the needed programming skills (using Python) to implement the techniques described in the theory.
- Quiz: questionnaire to review the concepts covered.
- Assignment: programming exercises to implement and use the methodologies presented.
- Advanced topics: videos and written documents that extend the topics covered.
Statement of Accomplishment
You will earn an Statement of Accomplishment if you do well in the course.
Textbooks & Resources
All the materials and tools for the class are available online under open licenses.
This course may not currently be available to learners in some states and territories.