Gestural Music Sequencer Generating a Minor Scale

In my previous example of audio created with my gestural music sequencer, that I’m tentatively naming GMS, I presented a pattern of sampled Rhodes notes in a chromatic scale. One of the functions I’ve built into the application is the capability of switching scales. Currently the available scales are major, minor, pentatonic minor, and chromatic. Here’s an example of the application producing notes in a minor scale. One thing you may notice is the dynamic range. By gesturing lower within the Y axis the notes get quieter, while gesturing near the top of the screen makes notes that are louder.

GMS Minor Scale

Gestural Music Interface in Processing

A big thanks goes out to Jason Striegel and Nick Watts for inviting us to perform at Make: Day at the Science Museum of Minnesota. I performed with my group Keston and Westdal. Other performers included Savage Aural Hotbed and Tim Kaiser. Besides the performances there were some excellent presenters. Myself, Nils Westdal, our drummer Graham O’Brien, and our intern, Ben Siegel greeted visitors at our table. We presented bits and pieces that Graham used with his drums including sticks, pencils, and a chain. We also showed materials from Unearthed Music, Audio Cookbook, and I revealed a gestural music sequencer (GMS) I developed in Processing.

I was really excited to see the reaction to the sequencer. The application samples video and displays it inverted so it looks as though you’re looking into a mirror. Each frame is analyzed for brightness, then the X and Y data of the brightest pixel is converted into a note. The X axis is used to select a pitch, while the Y axis determines the dynamics. As visitors moved, danced, or gestured in front of the camera notes were generated based on a predetermined scale. Here’s a short sample of what the GMS can produce. I’ll post more about this soon.

Gestural Music Interface

Six Machines

I’m calling this one minute and twenty four second experiment Six Machines, simply because after applying the first round of processing and looping the phrase a vague melody in six / eight time is discernible. The first round of involved applying destructive processing in Audacity, where I was testing how well VSTs worked in the beta version. However, after applying several randomish effects, I realized that I no longer knew what I had previously applied. Sometimes this is good for creative reasons, but if you ever want to repeat what you’ve done, it’s not. In this case it’s ok. This is odd enough that I don’t mind if I never repeat it, but interesting enough to me to post.

Six Machines

Signature Rhodes Chords: Part 4

This chord is much more similar to an example of close harmony than the open voicings that I posted earlier. Close harmony is essentially the opposite of open harmony. The notes are often clustered together and might include minor seconds. This example could be written, once again, as a poly chord or by referencing the notes used. I tend to think of it as a poly chord because In the left hand I’m playing an incomplete B flat major seventh made up of B flat, F and A, followed by a C major triad in the right, starting with the G below the A in the left hand. This means my thumbs are crossed leaving me in a good position to play arpeggios around the C triad.

Rhodes Chord B Flat Major 7 (b5) Poly C over B Flat 7

Signature Rhodes Chords: Part 3

This chord is a good example of open harmony. Open harmony is simply the use of intervals that are widely dispersed to produce chord structures.

This chord is an E thirteen with a flatted ninth. In sequence from the bottom up I’m playing E, F and G sharp as the tenth with my left hand, followed by D, G, and C (all naturals) with the right.

Rhodes Chord E13 (flat 9)