Frameworks for Interactive Sound
Spring 2004, Jeff Feddersen [archive]
Tuesdays, 12:30 - 3:00 and 6:30-9:00 PM

syllabus

[archive]

home  

01 | 02 03 04 05 | 06 07 08 | 09 | 10 11 12 13 | 14

 

1. January 20

 

sketches
12:30 6:30
JA LA MA MB
LB JG EM AN
SO KP MS HS
JV AW GA TA-J
DeA DoA SF MJH
JL BM YHM DP
ES DW AW []
       

 

 

Introductions/Overview - scope and purpose of the class; coursework and assignments; who are you?

Lecture: Fundamentals of acoustic, electronic and digital audio; Different time scales.

Audio and patch from class.

Listening: Steve Reich, Pendulum Music. Version 1 by Sonic Youth, from Goodbye 20th Century; Version 2 by Ensemble Avantgarde.

Reading: Time Scales of Music, Roads, Microsound (handout). For review if necessary: How Digital Audio Works, pp. 8-21 of the MSP Manual (available from Cycling 74 online here).

Assignment 1: Select a tool and set up a personal sketch process, including a place online to post your work; email me before the next class to notify me of what you choose and the location of your sketchbook.

Assignment 2: Careful listening. Step 1 - listen far. Listen first to sounds near you, then proceed outward to the edge of your perception, attempting to hear sounds from as far away as possible. Step 2 - listen close. Find a repeatable sound, like footsteps, a keystroke on a keyboard, etc. Listen as closely as possible to this sound, attempting to perceive the sound not as a singular sonic "icon" but as a complex phenomenon with many components. Write down your observations and be prepared to share them in class next week. Also, record a short sample (1-5 seconds) of the close listening, to present in class, and post it in your sketchbook as /1/1.mp3

 

Weekly class notes:

Pauline Oliveros' Deep Listening Foundation. See especially Quantum Listening.

The MELA Foundation supports LaMonte Young's Dream House. Possible field trip this Thursday?

Leonard Bernstein's lectures are available on CD and DVD.

WNYC's Radiolab recently did a show about Noise and Silence, including John Cage himself recounting his visit to an anechoic chamber and the creation of 4'33". Also, info about directional ultrasonic speakers.

Matt Rogalsky worked with the pauses between speech. Here's his report to CyberSonica (.pdf) about his real-time SuperCollider implementation of that idea.

WireTap is a freeware OSX app that easily records any sound playing on your computer. It will compress audio but not to MP3 format - you'll still need another app to do that.


I. w a v e s

2. January 27

1

Oscillations

Listening:

Afternoon: Liubo, Joe
Evening: Ahmi

Lecture: Pendulums and springs, basic oscillators, unit generators.

Director demo from class.

Reading: Chapter One: Musical Sound Perception, and Chapter Two: Acoustic Principles, Hopkin (handout).

Assignment 1: Oscillator hunt. Find ways to generate basic repeating waves, ramps, and other forms. In Max/MSP, this includes (but is not limited to!) the cycle~ and phasor~ objects; in cSound these are oscil, etc. Explore - slow them down, speed them up, take them to infra- and ultrasonic realms. Watch numbers change; understand phase, radians, etc. Record 8 waves as audio files for your sketchbook.

Assignment 2: Get balloons and metal pipes (EMT from hardware stores is good; other things like long metal rulers work as well) to bring to class next week - we'll be building the balloon mounted bar gongs described in the reading. You may work in groups.

 

 

Pendulum links: descriptions of different coupled pendulums and a how-to with dowel rods; a horizontal pendulum used in seismology; a number of unusual pendulums, some of which exhibit chaotic behavior; more unusual pendula.

How do the revolving pendulums in little desk clocks work? I think they're essentially torsion pendulums. Hang a heavy weight from the right fiber or twisting rod and it will spin one way and then the other for a long time.

A Wilberforce Pendulum(!) is both a spring and torsional pendulum and gives output like this.

Pendulums on air tracks act strange.

How about gyroscopic precession? If we had this machine...

3. February 3

9

Combining Waves

Lecture: Additive synthesis - making waves and putting them together; fundamentals, harmonics, and overtones; fourier.

Max/MSP demo from class; audio samples 1 and 2

Listening:

Afternoon: Jamie
Evening: Jared

Video: "Magic Music of the Telharmonium", Reynold Weidenaar, 1998. (rescheduled for next week)

Reading: "Additive Synthesis", pp. 134-144 from chapter 4 of the Computer Music Tutorial, Curtis Roads, 1996 (handout)

Assignment: Using only sine waves and additive synthesis, create 8 short sonic sketches (under 5 seconds each). Seek extremes: the harshest possible sound vs. the lushest, etc. Take note of the relationships between frequencies and envelopes used.

 

Here's a breakdown of Fourier's theory; have fun.

Find out more about Curtis Roads and the music he makes from his website.

Anyone up for SuperCollider?

The GenR8 gallery opening is this Friday(2/6/04). The gallery is around the corner from Two Lines Music.

4. February 10

17

Intonation

Lecture: Pitches and scales; Just intonation, equal temperament; Partch et al.

Max/MSP equal temper and just intonation demos from class. The examples used the plucked~ string simulation from the Percolate toolkit.

Listening:

Afternoon: Mark (rescheduled for next week)
Evening: Derek

Reading: Chapter Three: Tuning Systems and Pitch Layouts from Musical Instrument Design, Bart Hopkin (handout); Electric and Electronic Musical Instrument Timelines, from Microsound by Curtis Roads and www.obsolete.com

Assignment: Invent two scales. Anything is fair game except 12-tone equal temper (ie, the piano, aka what comes out of the mtof object). What is your basic unit? This is typically the octave, but what if you used something else? How many divisions of the unit is in your scale? Are they all equal, or do you use ratios and a fundamental pitch? If so, what are the ratios? Create short audio samples from your scale, either as scale runs or chords (two or more pitches simultaneously). If you wish, you may use pitch-shifted samples from the additive synthesis last week; or you may choose to create or use entirely different sounds.

 

The "sonic spot" has a summary of various types of audio synthesis.

Arnold Dreyblatt works with a carefully conceived just intonation scale. He wrote a paper that discusses his music projects, and has several recordings online. He used to rock this stuff at CBGB's in the 80s.

Harry Partch is well known for the tuning system he devised, as well as the instruments (located in New Jersey) he built to play it. The excellent American Mavericks radio series site has some virtual Partch instruments.

Some non Partch instruments: balafons and berimbaus.

Kyle Gann is a composer using just intonation; see also Pauline Oliveros, Glenn Branca, Terry Riley, La Monte Young, Lou Harrison, and Ben Johnston. In fact, there's a whole just intonation network.

The Max Magic Microtuner generates Max externals with new tunings (to replace mtof).

The Bohlen-Pierce scale uses 13 steps to fill a non-octave (3:1) ratio.

Goldenratio.com is not a good source of information on the golden ratio. Goldennumber.net is better.

This guitar tunes itself.

 

5. February 17

25

Modulating Waves

Lecture: Ring, Amplitude, and Frequency Modulation (RM, AM, FM) synthesis.

AM and FM patches from class. Also includes the Soundflower audio driver for OSX and Dan Palkowski's transcription of a David Zicarelli feedback FM patch presented at ITP last semester.

Listening:

Afternoon: John, Mark
Evening: Daniel

Reading: Sections 4.5 - Introduction to Modulation and 4.7 - Frequency Modulation, from Computers and Music (online).

Assignment: Create eight or more short sketches using RM, AM and FM synthesis. Use AM or RM synthesis for half the sketches, and FM for the remainder. Be creative in your choice of carriers and modulators - you could use basic oscillators, live microphone input, previously recorded sketches, etc. With FM synthesis, pay particular attention to the ratio between the carrier and modulator frequencies. The synthesis operations can nest - an AM synth algorithm is used for the modulator in an FM algorithm - and feed back - the output of an FM synthesis algorithm could be used to modulate one of the units in the same algorithm (but remember to include a slight delay to avoid an infinite loop).

 

Dartmouth's Electro-Acoustic Music department has produced an online text called Computers and Music that will serve as our text this week; the whole book looks like a promising source for further info. It uses JSyn for its interactive demos.

In FM synthesis, the ratio between the frequencies of the carrier and modulator are significant; here's a discussion.

For the demos this week I found Amadeus II's realtime spectrum analysis plus Soundflower's inter-application audio routing to be a great combination.

Jack might be a robust alternative to Soundflower, and the name is better. AudioXplorer looks like a good audio visualization suite.

There are tutorials on digital music here; they include basic and advanced FM synthesis.

High-quality text-to-speech in a few languages is available from ATT; this was used for the .wav files in this week's example download.


II. n o i s e

6. February 24

33

Noise Hunt

In class: Pendulum Musics

Listening:

Afternoon: Morgan
Evening: Doron

Reading: The Future of Music: Credo, John Cage, from a lecture in 1937. Reprinted in 1958 in Cage's book Silence (online).

Assignment: Search for noise. Take any short sound (probably in .wav or .aif format, possibly others), and open it in a text editor such as BBEdit. You will see more or less garbage. Leaving aside the first hundred characters or so (which contain header information about the file) edit the file in any way you see fit. Cut and paste sections from one place to another. Rearrange lines. Reverse or sort sections of text. Munge it with a perl script. Paste in an email.

After each edit, save the file as a new .aif (or .aif) file and - after turning down the volume - audition it. Repeat: turn down the volume. The edited file is almost always much louder than the source. Some edits will have more interesting results than others. Many edits may have no result, or make your file unplayable - be persistent. Continue incrementally until the source material is unrecognizable. Repeat until you have eight chaotic messes to play in class next week. Enjoy.

Note: Please follow this method. There will be plenty of opportunities to make noise lots of other ways; but this way you have little or no idea what you're going to get, which is the point.

Examples:
quiet bass sound: original, modified1, modified2
random sines: orignial, modified
french: original, twelve edits later

 

Miller Puckett's fiddle.

Could the flash mob model be applied to distributive digital performance/composition?

The Village Voice recently raved about Leig Inge's 9 Beet Stretch, Beethoven's 9th Symphony digitally stretched to consume 24 hours. Someone should adapt the method in one of these patches to do that to any track you want.

The class versions of pendulum music are online. The afternoon class rigged up a number of unusual pendulum mutations; the evening class deconstructed the idea of feedback with a network of computers that listened for and responded with different beeps. The videos show the setup, while the audio documents the final recital.

afternoon:
     audio(3m39s, 3.4mb)
     video (6m45s, 20.7mb)
evening:
     audio (5m23s, 4.9mb)
     video (1m30s, 5.0mb)

last semester:
     1, 2, 3 (10s .avi, 3.7mb)

 

7. March 2

41

Noise Math

Lecture: Degrees and kinds of noise; noise from chaotic equations.

Demos from class: random, random walk, the logistic map (bifurcation diagram) and the henon equations.

Listening:

Afternoon: Elliot
Evening: Guillermo

Reading: TOHU BOHU: Considerations on the nature of noise, in 78 fragments, Guy-Marc Hinant, Leonardo Music Journal vol. 13, 2003 (online)

Assignment: Continue the search for noise, looking for sources in math, nature, machines. What is the sound of a mixer with no input, or a mic in a silent room? A harddrive or a rainstorm? Create or find 8 examples to play in class next week; document where they are from or how they were made.

 

Janet Cardiff and George Bures Miller have an exhibit in the Luhring Augustine gallery in Chelsea.

Sox is the "swiss army knife of sound". For UNIX and DOS.

Goldwave has visualization tools. Dumpster is a resource editor for quicktimes.

Sonoluminescence is the emission of light by liquids excited by sound.

Litter.

8. March 9

49

Filtering

Lecture: Filters - removing and reinforcing sounds; subtractive synthesis, vocoders.

Examples from class: manual low pass filter, delay-line comb filter, vocoder.

Video: Le Chant Harmoniques, Hugo Zemp, 1989

Listening:

Afternoon: Ashleigh
Evening: MJ

Reading: none

Assignment: Starting with noise or noisy samples, create 4 sketches through filtering and subtractive synthesis. Consider using digital delays or spatial acoustics. What if you alter filter parameters at or near audio rate - a kind of AM/subtractive hybrid?

 

The voder was a hand-operated synthetic voice developed in 1939.

Mechanical speech machines date as far back as the 1700's.

Some sweet vintage speech chips are available online.

March 15 - 20

springbreak

 

 

9. March 23

51

Particles

Lecture: Tiny bits of sound; clouds and streams of those bits; granular synthesis.

Examples from class.

Listening:

Afternoon: Akio
Evening: Brian

Reading: Painterly Interfaces for Audiovisual Performance, sections 3.2.4, 3.2.5 and 4.2.1 (pp. 87 - 98 and pp. 107-108), Golan Levin, 2000 (online, also mirrored here).

Assignment: Using only tiny fragments of sound (between 1 and 100 ms in length), create eight short sketches using granular synthesis techniques. Also post a file documenting individual representative grains used in your sketches.

The Audiovisual Environment Suite is documented here.

Neil Young used a vocoder on his 1983 album Trans.

Harmony Central has a good explanation of the chorus effect, as well as many others.

Christian Marclay came up in class. So did Neneh Cherry and John Cale.

Several interesting VST plugins and Max externals, including the granular toolkit, are available from Nathan Wolek's site, under software.

Pluggo.


III. s t r u c t u r e

10. March 30

59

Rhythm

Lecture: Cyclic pulse organization.

Listening:

Afternoon: Luis
Evening: Ephrat

Reading: Microstructures of Feel, Macrostructures of Sound: Embodied Cognition in West African and African-American Musics, Vijay Iyer, 1998. Read the intro of chapter four (from the beginning up to the section beginning "Kinesthetics") and all of chapter five.

Assignment: Eight sketches on the subject of rhythm. Drawing on the reading and your own personal understanding of rhythm, create sketches in which you explore and express concepts of pulse and pulse subdivision / grouping. You may wish to impose constraints on your sketches, such as making them all the same length, or working only with multiples of three, etc.

 

Vijay Iyer's site is here. His interview on Studio 360 is of interest.

11. April 6

Form

Lecture: Structured sounds

Listening:

Afternoon: Matt
Evening: Desireena, Teresa

Reading: Arc Diagrams: Visualizing Structure in Strings, Martin Wattenberg, 2000 (online pdf).

Assignment: Eight sketches in the form of AB(A). What this means is up to you. Be aware of the attributes of sound you are manipulating and what transformations you apply, and be prepared to speak about that in class next week.

 

The Shape of Song applet implements the data structure visualization algorithm outlined in this week's reading. Hosted by turbulence.org; prints available from Bitforms Gallery.

Douglas Hofstadter's 1979 Pultizer-winning book "Godel Escher Bach" is, among other things, an extensive treatment of the perception of form and music.

Martin Wattenberg's creds.

Ethnographer and folklorist Alan Lomax.

SupaTrigga and more.

PropellaHead's ReCycle.

 

12. April 13

Strategy/Scores

Lecture: Encoding and rendering musical information

Listening:

Afternoon: Steve
Evening: Yoonhee

Reading: Score of In C, Terry Riley (1964); Scores for Bubblewrap, Digital, and Hammer Anvil Stirrup, Elliott Sharp (1997) (online pdfs)

Assignment: Create a compositional strategy text OR a graphical score; render 4 sketches from your score.

 

Elliott Sharp has an upcoming installation at the Chelsea Art Museum.

This obscure, out of print book was recommended to me.

Somehow Stanislaw Lem came up in class. So did the Academic Bill of Rights and Britney Spears.

13. April 20

Improvisation

Lecture: Agents of musical interpretation.

Listening:

Afternoon: Steve continued, Hans, Keith
Evening: Scott

Reading: none

Assignment: Trade graphical/text scores; render one sketch from that score.

Check out Steim's Crackle Box, the prototypical circuit bent instrument.

14. April 27

Final Class

Thank you.

Upcoming performances:
5/1: Live Image, 7PM@ITP
5/6: NIME class, 8PM@Tonic
5/9: Thesis in the Tisch Blackbox

Stelarc's Ping Body performance was likened to Songs to Wear Pants To.

Seek ye plugins from Smart Electronix.

Fruity Loops made an appearance this week.

A current installation at Art In General references Cage's Ryoanji, in turn based on the famous rock garden in Kyoto. There's also live audio by the folks at Free103.

Check out the Waag Scoiety for Old and New Media.