Category Archives: GMS

The GMS (Gestural Music Sequencer), written in Processing.org by Unearthed Music recording artist and AudioCookbook.org founder John Keston, analyzes video input and converts it into a sequence of musical information in real-time. Each frame is processed to find the brightest pixel. The x coordinate is converted into pitch while the y coordinate is translated into dynamics. The application was also designed to use probability distributions on pitch and durations.

Gestural Music Sequencer Generating a Minor Scale

Posted on by
4

In my previous example of audio created with my gestural music sequencer, that I’m tentatively naming GMS, I presented a pattern of sampled Rhodes notes in a chromatic scale. One of the functions I’ve built into the application is the capability of switching scales. Currently the available scales are major, minor, pentatonic minor, and chromatic. Here’s an example of the application producing notes in a minor scale. One thing you may notice is the dynamic range. By gesturing lower within the Y axis the notes get quieter, while gesturing near the top of the screen makes notes that are louder.

GMS Minor Scale

Gestural Music Interface in Processing

Posted on by
6

A big thanks goes out to Jason Striegel and Nick Watts for inviting us to perform at Make: Day at the Science Museum of Minnesota. I performed with my group Keston and Westdal. Other performers included Savage Aural Hotbed and Tim Kaiser. Besides the performances there were some excellent presenters. Myself, Nils Westdal, our drummer Graham O’Brien, and our intern, Ben Siegel greeted visitors at our table. We presented bits and pieces that Graham used with his drums including sticks, pencils, and a chain. We also showed materials from Unearthed Music, Audio Cookbook, and I revealed a gestural music sequencer (GMS) I developed in Processing.

I was really excited to see the reaction to the sequencer. The application samples video and displays it inverted so it looks as though you’re looking into a mirror. Each frame is analyzed for brightness, then the X and Y data of the brightest pixel is converted into a note. The X axis is used to select a pitch, while the Y axis determines the dynamics. As visitors moved, danced, or gestured in front of the camera notes were generated based on a predetermined scale. Here’s a short sample of what the GMS can produce. I’ll post more about this soon.

Gestural Music Interface

Page 11 of 11« First...7891011