Convert a Bulky Hardware Synth Project to Travel Friendly iOS

Spoiler Alert: It’s AUM from Kymatica

This summer I am performing a piece at two international conferences and streaming a pre-recorded concert at a third. The generative, audiovisual piece is titled SYNTAX and is in collaboration with Mike Hodnick (aka Kindohm). Mike and I debuted the piece in November, 2021 and when we did, we both had complex hardware setups. Mine included a Prophet REV2, an Arturia Keylab 88, Blokus Midihub, and a Yamaha Reface CP. This was a local performance for us in Minneapolis so I did not hesitate to utilize the best instruments I had access to.

But when those instruments are large and I need to travel light I seek out portable alternatives. Some of the gear I’ve travelled with includes: Novation BSII, Novation Circuit, Korg Volca Keys, PreenFM2, Moog Minifooger Delay, Organelle M, Arturia KeyStep, and Korg nanoKONTROL. These devices allow me to play parts and improvise in a natural and organic way. Visuals are often part of these sets, so usually there’s a computer and/or tablet in tow, but generally I reserve the sound making for dedicated hardware.

Custom iPad UI with MIRA and AVGM (a Max project) on the Mac. Prague CZ, 2014

Custom iPad UI with MIRA and AVGM (a Max project) on the Mac. At Echofluxx in Prague CZ, 2014

For these upcoming performances I came to the conclusion that iOS would do a better job of providing the sound design, signal processing, and multitimbral capabilities that I needed in a carry-on form factor. I surprised myself with this revelation, but it became clear that it was the right decision as I began working. And it wasn’t my first choice. I had started the process using other tools, but using iOS was faster and solved a series of issues I was running into with alternative setups. I paired the iPad with an Arturia KeyStep to play the parts. In addition I included an audio interface (iConnectAUDIO4+), a powered USB hub, and a Korg nanoKONTROL for tactile sliders and knobs.

Toxic from SYNTAX (Mac) with ID700 (iPad)

AUM from Kymatica by Jonatan Liljedahl made this setup possible and convenient. It’s basically a mixer for iOS synths, sequencers, and signal processors supporting AU, AUv3, Audiobus, or Inter-App Audio. Using AUv3 in AUM conveniently allows for multiple instances of the same synth or plugin. The MIDI support is phenomenal and allowed me to configure everything exactly how I wanted. All my effects are on bus sends and controlled with my ancient bus powered Korg nano. I play everything I need to with my Arturia KeyStep. AUM even lets me even split the keyboard (not natively supported on the KeyStep) by specifying a MIDI keyboard range per track. Setup and configuration was much easier than I expected. Every time I wondered if AUM was capable of a feature that I needed I found it with limited menu diving. The interface is clean and only shows you what you need, but access under the hood is merely one or two taps away.

The next thing I needed to do was make similar sounds to what I was getting out of my REV2 and Yamaha CP. I say “similar” knowing that that won’t do for artists who aim for their performances to replicate released recordings of their work. In our case we’ll be performing experimental music interpreting generative, animated, graphic scores. We expect every performance to be different, however every movement also has its own signature, so I need approximations of the original sounds that behave in a similar way. To stand in for the Yamaha CP RdI model I used the excellent VTines, which I wrote about recently. For the Prophet REV2 it took three apps to design the sounds I needed: ID700, Animoog Z, and an early app named Bebot – Robot Synth that’s been around since 2008.

Buchla 700 iOS synthesizer ID700 by Jonathan Schatz

I will write more about these apps in upcoming articles. For now I will say that the Buchla 700 inspired ID700 was new to me and is featured throughout this project. ID700 is unconventional, peculiar, bizarre, and I love it. One of the things that makes it standout are the fourteen complex envelopes per voice. The envelopes have an arbitrary number of “points” or stages that are either linear or logarithmic and each point can be modulated by anything from pressure (including MPE) and note on or off velocity to continuous or one-shot randomness. Furthermore each point has conditional actions that can be used to pause or stop, jump to other points (making looping envelopes possible), and several other actions. ID700 is well worth a look for anyone after experimental sounds, long morphing drones, metallic percussion, and other worldly textures. The learning curve is steeper than conventional synths, but the rewards are well worth the learning it takes to understand this fascinating approach to sound synthesis.

EDIT: In conclusion using iOS isn’t better and doesn’t replace small hardware setups, but it is a fast and convenient choice if you need to approximate a hardware setup/project that’s already been designed. If I was starting on a new project and knew I was traveling with it I might have opted for the Organelle M or Monome Norns over iOS. With so many choices of hardware, software, and combinations of the two the landscape of potential electronic music setups can be daunting. I hope that sharing my approach is useful or interesting. Thanks for listening!

If you’re interested in experiencing SYNTAX, the series of audiovisual works I’ve referenced throughout this article, our three upcoming performances include:

1. June 25, 2022 at the International Digital Media Arts Association (iDMAa) conference in Winona, Minnesota
2. June 29, 2022 pre-recorded performance at the New Interface for Musical Expression (NIME) conference in New Zealand
3. July 5, 2022 at the International Computer Music Conference (ICMC) in Limerick, Ireland Continue reading

Early Ostracon Performance

Here’s an early live recording from Ostracon way back in September, 2009 that I thought would be interesting to share. We have come along way since then, but this documentation has a fragile, exploratory charm to it including hefty amounts of buzz and crackle from a bad cord.

The way I produced the recording was by putting my Sony PCM-50 near the drums, and then recording the Live set during the show. Afterward I put the drum track into the Live set and matched it up. The recorder started a little late, so it’s missing the first three minutes of drums, but there’s 34 more minutes with Graham’s spectacular drumming all over it. Enjoy!

Ostracon Live Recording, September 28, 2009 by Ostraka

Ostracon Debut Excerpt: Photon Coercion

Here’s an excerpt of the second track from the upcoming Ostracon debut album, Unauthorized Modifications. This track is titled Photon Coercion. The album consists of drumming by Graham O’Brien and electronic sound that I produced using GMS, or Gestural Music Sequencer. GMS is Open Source software I developed that converts video signals into musical phrases. A video signal is analysed in real-time and then MIDI notes are produced based on brightness tracking and adjustable probability distribution algorithms.

This excerpt, in addition to looped phrases from GMS, includes a lead melodic voice that I played on the touch based synthesizer, Bebot. I fell in love with the expressive way you can bend notes independently on up to five voices (an impossibility on most conventional keyboards – unless you have one of these) using Bebot.

Photon Coercion (excerpt)

Excerpt from Solo Set at MAW Party

beat_box_insidesRecently I was invited to perform during a rare indoors Minneapolis Art on Wheels event at the West Bank Social Club, a new media artist space above the Nomad in Minneapolis. The space contained a newer (1970s) Hammond organ, sans tone wheels and drawbars, with an after market analog beat box including buttons for “Rock 1”, “Rock 2”, “Rumba”, and more. The idea was to do a bit of improvising on the organ while various projections went on inside and outside the space.

I brought my laptop with Ableton and started by sampling all the patterns on the analog beat box. I also brought along my iPod Touch running Bebot to make some live loops to go along with the beats. Here’s an excerpt from the set. The only sound sources used were Bebot and and the Hammond analog beat box.

MAW Party Ostraka Set Excerpt