More Image to Sound Techniques: Mould by Nick Froud

Today’s fascinating sound is another example of the conversion of digital imagery into sound and was submitted by Manchester based artist Nick Froud. Nick writes:

“I have been following your blog for months and have found it really inspiring. The software featured in your most recent entry is quite similar to a program I (very quickly) put together for an exhibition idea I have. My girlfriend produces photography based and nature and process, I wanted to adopt these ideas into sound that could accompany each of her pictures in a gallery.

The program I made converts an image directly into sound by scanning along each pixel and outputting a sample to a wave file based on an average of the red, green and blue channels. It also outputs the red green and blue channels as CC data in a MIDI file. In this way, I intend to create music entirely generated from an image but with human direction as to choices of effects to be controlled by MIDI data, layering of sounds etc. The sound generated are much noisier than in other sound / image conversion applications, but I think it gives a better feel of the texture of an image.”

You can hear more of Nick’s creations on his myspace sites Crunchy Alligator and Circastate.

Mould

Sticky Key Reveals the Insides

You’ve probably heard enough about my Casiotone 403 by now, but I’m not finished with it yet. What’s my fixation with this outdated, inflexible, cheese filled, imitation wood grain dinosaur? I don’t quite know myself. I can tell you that it’s not the kitsch factor. I actually like the way this relic sounds. So much so that I bothered to open it up to repair a sticky key. What I found inside were well organized electronics in a wooden and metal chassis that opened up like a clam and invited me in. So here’s another example of of sound from the Casiotone. I added a bass line with the Maxi-Korg and delay on the comping. Two great tastes that go great together.

Casiotone Madness in D Minor

Manipulating Sound Through Imagery

There are quite a few applications available that produce audio from imagery. Whether it’s photography, or computer generated graphics the results can be fascinating. For further exploration an article that describes eight programs that convert imagery to sound called Say it With Pictures is available on emusician.com. An additional application that I’ve been looking at recently called Photosounder has the unique capability of allowing you to manipulate sound in its image state. This creates a whole host of effects from time stretching to flipping the sound upside down creating a bizarre, inverse, reflection of the original sound. For this example I used Photosounder to process the sound from More Memory Man Madness. A few of the adjustments I made were the rotation of the image, the gamma property, and pixels per second.

Memory Man Through Photosounder

Conversion of Graffiti into Sound

Recently I was invited by Michel Rouzic to try his software, Photosounder, designed for converting images into sound. Image to sound conversion is something I’ve been meaning to explore, so today I finally had some time to have a look. The software does much more than create strange sound from images. It’s a great time stretching tool, and it also reads in wave files as images allowing you to use the same sort of manipulation you can do on image based files.

This sound was created from the full resolution version of the graffiti photo shown. I settled on this image because of it’s simplicity, and the diagonal strokes of the tag produced a nice cascade of descending pitches. The way the flash lights up the center of the photo gave the sound a dynamic swell that I emphasized by adjusting the gamma parameter. Photosounder allows you to set the time and frequency range of the audio produced, so for this example I put the bottom at 52Hz and the top at 12kHz.

Graffiti Photo to Sound

Some Kind of Adhesive Excerpt from Live Mix

Here’s another segment from the live recording I wrote about in the last entry. This is an excerpt from the piece Some Kind of Adhesive from One Day to Save All Life (2008, Unearthed Music). If you are familiar with the piece you will probably notice that this excerpt bares little resemblance to the original recording.

This is an example of how far a piece can stray from it’s original structure. The tempo hasn’t changed and some of the same instrument recordings are used, but these elements have been shaped into something new by cutting, stretching, looping, processing, and other forms of manipulation in real-time during the performance. This makes every set different from the next and keeps things interesting for us and (hopefully) our listeners.

Some Kind of Adhesive Live Mix (Excerpt)