Captive Mosquitoes make Music in Innovative Installation

Ali Momeni has recently posted an article about his and Robin Meier’s installation Strategies for Post-Apocalyptic Computation that was shown at the 2009 Spark Festival. Based on the article it looks as though they have renamed the piece Truce. Here’s an excerpt from the article:

Our installation explores reciprocal musical interactions between the mosquito and the computer. The computer produces a stimulus signal to which the living mosquitoes synchronize. Subsequently, the computer sings a third voice that responds to the musical inflections of the mosquitoes’ buzz. These three voices come in and out of harmony depending on the mosquitoes propensity to maintain its sync with the stimulus signal.

I made three or four visits to this fascinating installation during the festival. Here’s a segment from a recording of the piece that I made during one of my visits. To see some well produced video of the installation please visit the original article.

Brief Recording of Truce

1972 Dialogue Processed with Distort Plaster Photoshop Filter

Testing the newest version of Photosounder gave me an opportunity to apply some Photoshop filters to sound that I had not yet tried. I experimented with halftone patterns, lens blur, pixelated color halftones, the patchwork filter, and the smudge tool.

One of the more interesting filters ended up being the plaster effect under distort. The plaster effect has a relief setting to give the image a 3D look, but also smooths the insides of areas within the image. This eliminated the noise between the speech, but also made the dialogue virtually unintelligible.

1972 Dialogue Through Distort Plaster

Improved Processing of Sound with Photoshop

Michel Rouzic has just released version 1.4 of Photosounder that includes a new “lossless” mode so the output is identical to the input. Previously there was some loss of resolution importing the audio. From Michel:

Basically the lossless mode in question is a sort of 2D time-frequency filtering mode, kind of like some other programs like Audition 3 do by letting you airbrush on a spectrogram, that’s the idea basically. The difference here is that besides the brushes that Photosounder has, you can export the image to Photoshop and do some very precise filtering, for example making a sound feature disappear by hand, enhancing parts of a sound, subtracting to sound as I once did by making the difference between a song’s spectrogram and its instrumental version’s spectrogram to isolate the vocals, experiment with contrast, curves, levels, sharpening, various effects (I’m pretty sure you could for example try the glowing edges again and get a different sounding result).

To illustrate the lossless mode, here’s a segment of dialogue from a 1972 social commentary film in the public domain presented with the lossless mode on and again with it off. The lossless mode sounds exactly like the original waveform, while without the lossless mode the audio lacks resolution.

Photosounder Dialogue with Lossless Mode On

Photosounder Dialogue with Lossless Mode Off

Vocalese Vocoder Technique

Pluggo includes an interesting device called Vocalese. Basically, Vocalese is a virtual instrument made up of a collection of phonetic samples. If you’re clever, and very patient, you can paste these samples together to create words, thereby synthesizing speech. I wasn’t really interested in doing that, nor am I patient enough, but I liked the idea of using the instrument to drive a vocoder. In order to do this I created a MIDI sequence that played each one of the phonetic samples in the instrument. Then I used a plugin to randomize the notes in realtime, so the sequence is never the same. Then I directed the output into a vocoder plugin, followed by delay and reverb for atmosphere.

Vocalese Vocoder

Wind Chimes at Night

I recorded these wind chimes that were hanging above the door of my friend Alice and Damon’s house recently. It was early evening and the traffic was light for a Saturday night in Northeast Minneapolis, but you can still hear some motor vehicles nearby in the background. I really like the tuning of these chimes, so I may go back a record them properly soon.

Wind Chimes at Night