Spectral Tablature (2013)

Spectral Tablature (2013)

Spectral Tablature is a series of collaborative installations that explore sound generated through visual processes. Sound is recorded or synthesized using common techniques then converted into images called spectral analysis. These forms are re-interpreted as a visual artifact then converted back into sound. For each pair, or “duet,” the similarities and differences in tone and texture can be heard as well as seen in the work. This series, along with two more of my installations, is currently on display for my thesis exhibition at the Northrup King Building in Minneapolis. Please read on for images and descriptions of each pair of prints along with the audio.

Kah_Lah_Tah_INV

The first pair in the series are titled Vocal Exercises and Vocal Exercises Reprise. In this pair I collaborated with my father (also named John Keston) who was the subject for the vocal recording. The image above represents the spectral analysis of his recorded vocalizations. Frequency is the y-axis and time is the x-axis. The darker lines are the fundamental frequecies. The faded areas show overtones and undertones.

Kah_Lah_Tah_FS1R

To re-interpret this piece I regenerated the recorded vocalizations using formant sequencing, a technique that synthesizes human vowels sounds and sibilance similar to speech synthesis. Instead of sampling the audio, a collection of parameters are extracted from the signal that control filters over time in a formant sequence that is then programmed into the Yamaha FS1R synthesizer.

Synthetic Arches

The second pair are titled Synthetic Arches and Synthetic Arches Reprise. In print the spectral analysis of the original synthesized, arpeggiated sequence generates a precise, geometric pattern that is rarely seen in acoustic signals.

SyntheticArchesReprise

Collaborator Jasio Stefanski’s interpretation of the piece was deconstructed using a system of shapes and colors that simplify and emphasize the original geometric forms. Ironically the texture of the paper and screen printed inks create a more complex sonic texture than the original synthesized oscillations.

vignette9

The final pair in the series are titled Rubato Etude #9 and Rubato Etude #9 Reprise. This sparse piano composition illustrates the dense and organized frequency spectrum of the instrument while the sustain pedal is held.

Rubato Etude #9 Reprise

In this interpretation by Jon Davis the spectral analysis of the piano recording has been composited with a processed photograph of rail cars producing a glitchy, organic noise along with the piano textures.

Note: all of the spectral analysis files were generated using Michel Rouzic’s powerful application, Photosounder. The Yamaha FS1R system exclusive files that contain the formant sequence in Vocal Exercises Reprise were created using Zach Archer‘s online tool FSeq-Flash. You can also view the iPad optimized web application that I designed for the exhibit’s gallery installation.

This entry was posted in Audio News, One Synthesizer Sound Every Day and tagged , , , , , , , , , , , by John CS Keston. Bookmark the permalink.

About John CS Keston

John CS Keston is an award winning transdisciplinary artist reimagining how music, video art, and computer science intersect. His work both questions and embraces his backgrounds in music technology, software development, and improvisation leading him toward unconventional compositions that convey a spirit of discovery and exploration through the use of graphic scores, chance and generative techniques, analog and digital synthesis, experimental sound design, signal processing, and acoustic piano. Performers are empowered to use their phonomnesis, or sonic imaginations, while contributing to his collaborative work. Originally from the United Kingdom, John currently resides in Minneapolis, Minnesota where he is a professor of Digital Media Arts at the University of St Thomas. He founded the sound design resource, AudioCookbook.org, where you will find articles and documentation about his projects and research. John has spoken, performed, or exhibited original work at New Interfaces for Musical Expression (NIME 2022), the International Computer Music Conference (ICMC 2022), the International Digital Media Arts Conference (iDMAa 2022), International Sound in Science Technology and the Arts (ISSTA 2017-2019), Northern Spark (2011-2017), the Weisman Art Museum, the Montreal Jazz Festival, the Walker Art Center, the Minnesota Institute of Art, the Eyeo Festival, INST-INT, Echofluxx (Prague), and Moogfest. He produced and performed in the piece Instant Cinema: Teleportation Platform X, a featured project at Northern Spark 2013. He composed and performed the music for In Habit: Life in Patterns (2012) and Words to Dead Lips (2011) in collaboration with the dance company Aniccha Arts. In 2017 he was commissioned by the Walker Art Center to compose music for former Merce Cunningham dancers during the Common Time performance series. His music appears in The Jeffrey Dahmer Files (2012) and he composed the music for the short Familiar Pavement (2015). He has appeared on more than a dozen albums including two solo albums on UnearthedMusic.com.

2 thoughts on “Spectral Tablature (2013)

  1. This is great stuff, It reminds me of Wendy Carlos experiments in the early 70’s, only with fancy graphics. Thanks

Leave a Reply