Manipulating Sound Through Imagery

There are quite a few applications available that produce audio from imagery. Whether it’s photography, or computer generated graphics the results can be fascinating. For further exploration an article that describes eight programs that convert imagery to sound called Say it With Pictures is available on emusician.com. An additional application that I’ve been looking at recently called Photosounder has the unique capability of allowing you to manipulate sound in its image state. This creates a whole host of effects from time stretching to flipping the sound upside down creating a bizarre, inverse, reflection of the original sound. For this example I used Photosounder to process the sound from More Memory Man Madness. A few of the adjustments I made were the rotation of the image, the gamma property, and pixels per second.

Memory Man Through Photosounder

This entry was posted in One Sound Every Day, Processing, Share Remix Adapt and tagged by John CS Keston. Bookmark the permalink.

About John CS Keston

John CS Keston is an award winning transdisciplinary artist reimagining how music, video art, and computer science intersect. His work both questions and embraces his backgrounds in music technology, software development, and improvisation leading him toward unconventional compositions that convey a spirit of discovery and exploration through the use of graphic scores, chance and generative techniques, analog and digital synthesis, experimental sound design, signal processing, and acoustic piano. Performers are empowered to use their phonomnesis, or sonic imaginations, while contributing to his collaborative work. Originally from the United Kingdom, John currently resides in Minneapolis, Minnesota where he is a professor of Digital Media Arts at the University of St Thomas. He founded the sound design resource, AudioCookbook.org, where you will find articles and documentation about his projects and research. John has spoken, performed, or exhibited original work at New Interfaces for Musical Expression (NIME 2022), the International Computer Music Conference (ICMC 2022), the International Digital Media Arts Conference (iDMAa 2022), International Sound in Science Technology and the Arts (ISSTA 2017-2019), Northern Spark (2011-2017), the Weisman Art Museum, the Montreal Jazz Festival, the Walker Art Center, the Minnesota Institute of Art, the Eyeo Festival, INST-INT, Echofluxx (Prague), and Moogfest. He produced and performed in the piece Instant Cinema: Teleportation Platform X, a featured project at Northern Spark 2013. He composed and performed the music for In Habit: Life in Patterns (2012) and Words to Dead Lips (2011) in collaboration with the dance company Aniccha Arts. In 2017 he was commissioned by the Walker Art Center to compose music for former Merce Cunningham dancers during the Common Time performance series. His music appears in The Jeffrey Dahmer Files (2012) and he composed the music for the short Familiar Pavement (2015). He has appeared on more than a dozen albums including two solo albums on UnearthedMusic.com.

2 thoughts on “Manipulating Sound Through Imagery

  1. It’s a most bizarre and intriguing sound you’ve obtained here John! By the way I’ve just released a new version of Photosounder (the original download link I gave you should still work) which supports exporting the current image to an image file, so all sorts of effects on sounds can be done in your favourite image-editing program. I believe that opens a whole new range of possibilities.

    Also, may I interest you in sounds made from images created for the very purpose of being listened to? I’m working on making instruments (mostly drums) in Photoshop and I made a video showing how to create a drum beat that way http://www.youtube.com/watch?v=dbyWINZLUco&fmt=18 , hoping that’s of any inspiration for your future experiments ;-)

  2. That’s fantastic, Michael! You read my mind. Soon after first experimenting with Photosounder I wondered what you could do by manipulating the “sound” of an image in an image editing application like Photoshop. In fact, I did a bit of experimenting by taking a screen shot of a male voice in Photosounder, then bringing it back in. Sort of an example of the copy of a copy experiment.

Leave a Reply