John CS Keston is an award winning transdisciplinary artist reimagining how music, video art, and computer science intersect. His work both questions and embraces his backgrounds in music technology, software development, and improvisation leading him toward unconventional compositions that convey a spirit of discovery and exploration through the use of graphic scores, chance and generative techniques, analog and digital synthesis, experimental sound design, signal processing, and acoustic piano. Performers are empowered to use their phonomnesis, or sonic imaginations, while contributing to his collaborative work. Originally from the United Kingdom, John currently resides in Minneapolis, Minnesota where he is a professor of Digital Media Arts at the University of St Thomas. He founded the sound design resource, AudioCookbook.org, where you will find articles and documentation about his projects and research.
John has spoken, performed, or exhibited original work at New Interfaces for Musical Expression (NIME 2022), the International Computer Music Conference (ICMC 2022), the International Digital Media Arts Conference (iDMAa 2022), International Sound in Science Technology and the Arts (ISSTA 2017-2019), Northern Spark (2011-2017), the Weisman Art Museum, the Montreal Jazz Festival, the Walker Art Center, the Minnesota Institute of Art, the Eyeo Festival, INST-INT, Echofluxx (Prague), and Moogfest. He produced and performed in the piece Instant Cinema: Teleportation Platform X, a featured project at Northern Spark 2013. He composed and performed the music for In Habit: Life in Patterns (2012) and Words to Dead Lips (2011) in collaboration with the dance company Aniccha Arts. In 2017 he was commissioned by the Walker Art Center to compose music for former Merce Cunningham dancers during the Common Time performance series. His music appears in The Jeffrey Dahmer Files (2012) and he composed the music for the short Familiar Pavement (2015). He has appeared on more than a dozen albums including two solo albums on UnearthedMusic.com.
As I mentioned before I have GMS setup to produce specific scales. At this stage they are all based on the key of C. Eventually I’ll set up the application so that the key and scale are dynamically adjustable. I will also include a wider variety of scales, including all the modes, diminished, whole tone, and more.
One thing I haven’t decided on how to approach is timing and tempo. The way it works at the moment is that the tempo is determined by applying a multiplier to the frame rate. In this example I’m dynamically changing the multiplier using the arrow keys to achieve different note durations.
The intervals in a major scale are really the same as a minor scale. What’s different is the starting point. All the pitches in a major scale are the same as its relative minor, which is down a minor third. So the difference between a melody in a minor key and a major one is the root note. The same melody can be minor or major depending on the perspective of the listener. The last pattern I posted is only in a minor key if you consider C the root. If you consider E flat the root, then the melody is in a major key with C being its relative minor. In this case, the pattern is in C major, so if you listen with an A (the relative minor of C) in mind you’ll hear it in a minor scale.
In my previous example of audio created with my gestural music sequencer, that I’m tentatively naming GMS, I presented a pattern of sampled Rhodes notes in a chromatic scale. One of the functions I’ve built into the application is the capability of switching scales. Currently the available scales are major, minor, pentatonic minor, and chromatic. Here’s an example of the application producing notes in a minor scale. One thing you may notice is the dynamic range. By gesturing lower within the Y axis the notes get quieter, while gesturing near the top of the screen makes notes that are louder.
A big thanks goes out to Jason Striegel and Nick Watts for inviting us to perform at Make: Day at the Science Museum of Minnesota. I performed with my group Keston and Westdal. Other performers included Savage Aural Hotbed and Tim Kaiser. Besides the performances there were some excellent presenters. Myself, Nils Westdal, our drummer Graham O’Brien, and our intern, Ben Siegel greeted visitors at our table. We presented bits and pieces that Graham used with his drums including sticks, pencils, and a chain. We also showed materials from Unearthed Music, Audio Cookbook, and I revealed a gestural music sequencer (GMS) I developed in Processing.
I was really excited to see the reaction to the sequencer. The application samples video and displays it inverted so it looks as though you’re looking into a mirror. Each frame is analyzed for brightness, then the X and Y data of the brightest pixel is converted into a note. The X axis is used to select a pitch, while the Y axis determines the dynamics. As visitors moved, danced, or gestured in front of the camera notes were generated based on a predetermined scale. Here’s a short sample of what the GMS can produce. I’ll post more about this soon.
I’m calling this one minute and twenty four second experiment Six Machines, simply because after applying the first round of processing and looping the phrase a vague melody in six / eight time is discernible. The first round of involved applying destructive processing in Audacity, where I was testing how well VSTs worked in the beta version. However, after applying several randomish effects, I realized that I no longer knew what I had previously applied. Sometimes this is good for creative reasons, but if you ever want to repeat what you’ve done, it’s not. In this case it’s ok. This is odd enough that I don’t mind if I never repeat it, but interesting enough to me to post.
As I mentioned before I have GMS setup to produce specific scales. At this stage they are all based on the key of C. Eventually I’ll set up the application so that the key and scale are dynamically adjustable. I will also include a wider variety of scales, including all the modes, diminished, whole tone, and more. 
The intervals in a major scale are really the same as a minor scale. What’s different is the starting point. All the pitches in a major scale are the same as its relative minor, which is down a minor third. So the difference between a melody in a minor key and a major one is the root note. The same melody can be minor or major depending on the perspective of the listener. The last pattern I posted is only in a minor key if you consider C the root. If you consider E flat the root, then the melody is in a major key with C being its relative minor. In this case, the pattern is in C major, so if you listen with an A (the relative minor of C) in mind you’ll hear it in a minor scale. 
In my previous example of audio created with my gestural music sequencer, that I’m tentatively naming GMS, I presented a pattern of sampled Rhodes notes in a chromatic scale. One of the functions I’ve built into the application is the capability of switching scales. Currently the available scales are major, minor, pentatonic minor, and chromatic. Here’s an example of the application producing notes in a minor scale. One thing you may notice is the dynamic range. By gesturing lower within the Y axis the notes get quieter, while gesturing near the top of the screen makes notes that are louder. 
A big thanks goes out to Jason Striegel and Nick Watts for inviting us to perform at 
I’m calling this one minute and twenty four second experiment Six Machines, simply because after applying the first round of processing and looping the phrase a vague melody in six / eight time is discernible. The first round of involved applying destructive processing in