Category Archives: GMS

The GMS (Gestural Music Sequencer), written in Processing.org by Unearthed Music recording artist and AudioCookbook.org founder John Keston, analyzes video input and converts it into a sequence of musical information in real-time. Each frame is processed to find the brightest pixel. The x coordinate is converted into pitch while the y coordinate is translated into dynamics. The application was also designed to use probability distributions on pitch and durations.

GMS as Open Source on Google Code

Posted on December 4, 2009 by John C.S. Keston

The GMS source code is now available on code.google.com. I’ve still got loads of idea for improvements and feature additions, but I’m also interested to see what input other developers might have for the project. Therefore, the code is now officially released and available as Open Source under the GPLv3.

Please let us know how you are using the GMS. I’ve been informed that Grant Muller will be using it experimentally on a jazz improvisation project he’s involved in. Rocky Rosga is producing some work with the GMS. Finally, my duet project with Graham O’Brien on drums has recorded an album (it will be a few months work to edit and mix, so don’t look for it anytime soon) of GMS improvisations with live drums.

GMS Beta Release, September 28, 2009

Posted on September 23, 2009 by John C.S. Keston

gms_grab I have decided on September 28, 2009 as the release date of the GMS, coinciding with my performance with Graham O’Brien, and my birthday. We can call it a combination Ostraka with Dial System and DJ Zenrock show, GMS beta software release, and birthday party. Currently I am releasing a binary version of the software for Mac OS X only. A windows version is in the works, with no prediction of when it’ll arrive.

The GMS is a Gestural Music Sequencer that I developed in Processing (processing.org). The application samples video and displays it either normally or inverted so it looks as though you’re looking into a mirror. Each frame is analyzed for brightness, then the X and Y data of the brightest pixel is converted into a MIDI note. These notes produce a non-repeating sequence based on movement within the range of the capture device.

For more details, including audio examples and video produced using the GMS, checkout the
GMS category. There’s also a Gestural Music Sequencer Documentary Short produced by Josh Clos, that does a good job of illustrating what the software does.

Beta Release of the GMS this September

Posted on August 25, 2009 by John C.S. Keston

I have decided to release beta version binaries of the GMS for both Mac and Windows sometime next month. There a few bugs I have yet to solve, like the application freezing if you choose the video device more than once. I’ll be including a readme that lists the known issues along with the application files.

One of the reasons for doing this is to get some feedback on the tool, and find out if anyone is interested in continuing development on the project as Open Source. There are some pretty tricky issues with Processing and video that perhaps a more advanced developer than me might be able to optimize easily enough. I am interested in moving on to some other projects, and am fairly satisfied with how the GMS works for my own purposes at the moment.

If anyone is interested in experimenting with this tool (I know of a few interested parties so far), let me know in a comment and I’ll gauge my efforts on getting a beta out soon or over a more extended time period based on your feedback.

GMS Leftovers

Posted on August 20, 2009 by John C.S. Keston

San Francisco Mask Shop If you have been wondering why ACB is a little bit on the slow side lately, it’s because I have been quite busy doing other things, like my night class at CNMAT and releasing my solo album, Precambrian Resonance. So, after presenting 365 sounds in 365 days, I’ve been having a bit of a rest.

But now I am ready to dive into some new projects, including my duet with Graham O’Brien (drums) that we’re calling Ostraka with Dial System. We recently performed at a club in Minneapolis, but I neglected to record the show. However, I saved my document with the GMS clips I had captured. Here’s a short mix of a few of the remnants from the performance, unfortunately lacking the drums.

GMS Leftovers

500 Million Years From Now

Posted on August 11, 2009 by John C.S. Keston

dots It was recently estimated by Edward Guinan at the XXVIIth General Assembly of the International Astronomical Union that our lonely planet is nearing the end of its habitability for life as we know. Albeit, on a cosmological timescale. Between .5 and 1 billion years from now, increases in the Sun’s temperature will cause the Earth’s oceans and atmosphere to evaporate.

Shortly after reading this article I opened up my Ableton Live set from Sunday night to listen to some of the loops I had captured with the GMS during the show. After opening the document I pressed play and heard a stark landscape of reverberation. I saw visions of a lifeless, peace 500 million years from now.

What had happened was that when saving the document I had left all my master effects in their last position. I decided to capture these sounds and vary them over time. The effect chain on the master track included a low pass filter, bit reduction, delay, and reverb with nine parameters mapped to knobs on a controller. Here’s what I ended up with on the second take.

500 Million Years From Now