Convert a Bulky Hardware Synth Project to Travel Friendly iOS

Spoiler Alert: It’s AUM from Kymatica

This summer I am performing a piece at two international conferences and streaming a pre-recorded concert at a third. The generative, audiovisual piece is titled SYNTAX and is in collaboration with Mike Hodnick (aka Kindohm). Mike and I debuted the piece in November, 2021 and when we did, we both had complex hardware setups. Mine included a Prophet REV2, an Arturia Keylab 88, Blokus Midihub, and a Yamaha Reface CP. This was a local performance for us in Minneapolis so I did not hesitate to utilize the best instruments I had access to.

But when those instruments are large and I need to travel light I seek out portable alternatives. Some of the gear I’ve travelled with includes: Novation BSII, Novation Circuit, Korg Volca Keys, PreenFM2, Moog Minifooger Delay, Organelle M, Arturia KeyStep, and Korg nanoKONTROL. These devices allow me to play parts and improvise in a natural and organic way. Visuals are often part of these sets, so usually there’s a computer and/or tablet in tow, but generally I reserve the sound making for dedicated hardware.

Custom iPad UI with MIRA and AVGM (a Max project) on the Mac. Prague CZ, 2014

Custom iPad UI with MIRA and AVGM (a Max project) on the Mac. At Echofluxx in Prague CZ, 2014

For these upcoming performances I came to the conclusion that iOS would do a better job of providing the sound design, signal processing, and multitimbral capabilities that I needed in a carry-on form factor. I surprised myself with this revelation, but it became clear that it was the right decision as I began working. And it wasn’t my first choice. I had started the process using other tools, but using iOS was faster and solved a series of issues I was running into with alternative setups. I paired the iPad with an Arturia KeyStep to play the parts. In addition I included an audio interface (iConnectAUDIO4+), a powered USB hub, and a Korg nanoKONTROL for tactile sliders and knobs.

Toxic from SYNTAX (Mac) with ID700 (iPad)

AUM from Kymatica by Jonatan Liljedahl made this setup possible and convenient. It’s basically a mixer for iOS synths, sequencers, and signal processors supporting AU, AUv3, Audiobus, or Inter-App Audio. Using AUv3 in AUM conveniently allows for multiple instances of the same synth or plugin. The MIDI support is phenomenal and allowed me to configure everything exactly how I wanted. All my effects are on bus sends and controlled with my ancient bus powered Korg nano. I play everything I need to with my Arturia KeyStep. AUM even lets me even split the keyboard (not natively supported on the KeyStep) by specifying a MIDI keyboard range per track. Setup and configuration was much easier than I expected. Every time I wondered if AUM was capable of a feature that I needed I found it with limited menu diving. The interface is clean and only shows you what you need, but access under the hood is merely one or two taps away.

The next thing I needed to do was make similar sounds to what I was getting out of my REV2 and Yamaha CP. I say “similar” knowing that that won’t do for artists who aim for their performances to replicate released recordings of their work. In our case we’ll be performing experimental music interpreting generative, animated, graphic scores. We expect every performance to be different, however every movement also has its own signature, so I need approximations of the original sounds that behave in a similar way. To stand in for the Yamaha CP RdI model I used the excellent VTines, which I wrote about recently. For the Prophet REV2 it took three apps to design the sounds I needed: ID700, Animoog Z, and an early app named Bebot – Robot Synth that’s been around since 2008.

Buchla 700 iOS synthesizer ID700 by Jonathan Schatz

I will write more about these apps in upcoming articles. For now I will say that the Buchla 700 inspired ID700 was new to me and is featured throughout this project. ID700 is unconventional, peculiar, bizarre, and I love it. One of the things that makes it standout are the fourteen complex envelopes per voice. The envelopes have an arbitrary number of “points” or stages that are either linear or logarithmic and each point can be modulated by anything from pressure (including MPE) and note on or off velocity to continuous or one-shot randomness. Furthermore each point has conditional actions that can be used to pause or stop, jump to other points (making looping envelopes possible), and several other actions. ID700 is well worth a look for anyone after experimental sounds, long morphing drones, metallic percussion, and other worldly textures. The learning curve is steeper than conventional synths, but the rewards are well worth the learning it takes to understand this fascinating approach to sound synthesis.

EDIT: In conclusion using iOS isn’t better and doesn’t replace small hardware setups, but it is a fast and convenient choice if you need to approximate a hardware setup/project that’s already been designed. If I was starting on a new project and knew I was traveling with it I might have opted for the Organelle M or Monome Norns over iOS. With so many choices of hardware, software, and combinations of the two the landscape of potential electronic music setups can be daunting. I hope that sharing my approach is useful or interesting. Thanks for listening!

If you’re interested in experiencing SYNTAX, the series of audiovisual works I’ve referenced throughout this article, our three upcoming performances include:

1. June 25, 2022 at the International Digital Media Arts Association (iDMAa) conference in Winona, Minnesota
2. June 29, 2022 pre-recorded performance at the New Interface for Musical Expression (NIME) conference in New Zealand
3. July 5, 2022 at the International Computer Music Conference (ICMC) in Limerick, Ireland Continue reading

Video: Panic by Proxy Live at the Walker

On August 23, 2018 I debuted a new piece in remote collaboration with Syrian artist and filmmaker Khaled Alwarea. PANIC BY PROXY is an audiovisual translation of clips from Alwarea’s award winning film Panic Attack. The piece was commissioned by MN Artists for their MN Artists Presents series at the Walker Art Center, curated by Essma Imady.

The performance featured audiovisual objects projected and amplified while being granulated using Audiovisual Grain Machine (AVGM) — software I developed that performs audiovisual granular synthesis in realtime using a touch controller. Other instruments included Rhodes, Moog Sub 37, Novation Circuit, Korg KP3+, and an Electro-Harmonix Memory Man Delay. The dissonance, distortion, and uncanny synchronization in the sound and visuals illicit feelings of disturbance and confusion as an expression of the artist’s anxiety.

This video includes most of the performance and has only been edited for length. Thanks to Esmaa Imady for inviting me to participate in the event, Khaled Alwarea for his amazing film work, and Emily Gastineau at MN Artists for organizing the event. Read more about Esmaa Imady and the other artists who participated in this event on Hyperallergic.

Panic by Proxy at the Walker Art Center

PANIC BY PROXY is an audiovisual composition produced in collaboration with Syrian architect and multidisciplinary artist Khaled Alwarea. The piece is a long distance response and “musical” reimagining of Alwarea’s film Panic Attack. I will be making the debut performance of the piece at the Walker Art Center this Thursday, August 23, 2018.

The performance will feature audiovisual objects provided by Alwarea projected and amplified while being granulated in real-time along with electronic accompaniment. The dissonance, distortion, and uncanny synchronization illicit feelings of disturbance and confusion as an expression of the artist’s anxiety.

This video is a 0:45 clip from the 30 minute piece that demonstrates the audiovisual granular synthesis technique used to process the video in real-time. Ginormous thank-you’s go to Esmaa Imady for inviting me to participate in the event, Khaled Alwarea for his amazing film work, and Emily Gastineau at MN Artists for organizing the event.

Read more about Esmaa Imady and the other artists participating in this event on Hyperallergic.

VIDEO: Full Sets from Studio Z Nada Showcase

I performed this version of Vocalise Sintetica at on Friday, June 8, 2018 at Studio Z for the Nada showcase. The recording was captured by Mike Hodnick. In addition to the improvised elements, what makes this different from previous versions of the piece is that Studio Z is close to home, so I was able to bring my favorite instrument, the Moog Sub 37 for lead lines, melodies, drones, and arps. All the sound heard in this piece was generated by the AVGM (Audiovisual Grain Machine) controlled by an iPad, a Novation Circuit with custom samples and patches, a Minifooger Delay, and the Moog Sub 37.

This was an amazing evening of performances. The sets from Michael Flora, Mike Hodnick (Kindohm), and Spednar were all excellent. Mike also shared video of his own set of “tightly coupled audio and visuals” that he premiered at the event, which is definitely worth checking out:

Read on for the the official press release:

Continue reading

VIDEO: John C.S. Keston at ISSTA

Last September 2017 I performed at the Irish Sound in Science Technology and the Arts Conference (ISSTA.ie) in Dundalk, Ireland (video by Daryl Feehely). The performance makes use of a custom Max patch controlled by an iPad, a Novation Circuit, a KeyStep, and a Minifooger Delay pedal. It occurred to me that it might be interesting to share the roots and evolution of this piece, so here goes. Continue reading