Percussive Image Gestural System (PIGS)

PIGS is a software/hardware/percussive framework designed for multi-layered, visual performance. It uses silent percussion to create improvised cinematic performance. It aims to make live visuals more intuitive and fluid, while making the human aspect of visual performance more relatable for audiences.

PIGS is a performable instrument. It’s especially useful for improvising visuals with musicians in live performance, although it’s not limited to that. It focuses on developing an approach to visuals that are not bound to traditions of rectangular frames and “movie” structures — and on developing performable instruments rather than controllable software.


  • “On PIGS:” Chapter-length interview with audiovisual developers/performers Amy Alexander and Curt Miller.
    Amy Alexander and Curt Miller discuss mixed modal improvisation with PIGS (visuals) and The Farm (audio.) Alexander and Miller discuss historical visual, music and programming practices, and how these trajectories feed into the development of PIGS. The artists also discuss the specificities of mixed-modal collaborative improvisation, including the impact of representational content (algorithmically curated YouTube videos). They conclude with a discussion of PIGS as audiovisual performance research and propose some ideas for the future role of “frameless” visuals in music ensemble performance.
  • The PIGS/AlgoCurator FAQ


"Utopian Algorithm #1" — PIGS (Percussive Image Gestural System) Studio Rehearsal/Demo, June 2018

“June 8th, 2018” (excerpt of real-time PIGS animation)

PIGS (Percussive Image Gestural System) Live Studio Jam – People Blowing Things Up on YouTube. October 2016

Here’s PIGS’s first live performance at UCSD’s Qualcomm Institute. The QI crew did a nice job of capturing the performance interfaces:

Rocket's Red Glare at IDEAS

Current PIGS performance interfaces include iPads, Leap Motion controller, and quiet MIDI drums. Strokes are scribbled using the iPads and Leap Motion and can then replayed with variations by striking the MIDI drums. (This in some ways resembles how traditional drums work – each strike of the same drum or cymbal generates roughly the same pitch, but may vary in loudness, choking, etc.) The PIGS system allows for an assortment of variations from the original scribble in both duration and form with each drum stroke. The performer may also use this functionality to create theme and variations or looping structures. Individual drums/video layers may also be set to auto-loop, allowing the performer to improvise on the other drums/layers against the rhythms of the looping background layers.

While PIGS uses musical instruments and strategies as general models for thinking about performativity and temporal structures, care is taken not to attempt to simply translate musical approaches to visual ones. Rather than approaching audiovisual integration as a matter of synchronization of sound and image, the idea is to create an instrument that is performable as a part in a duet or ensemble (analogous to the way various instruments in an ensemble play different musical parts even though they are performing the same piece.) Likewise, while twentieth-century gesture and drawing-based abstract animators like Len Lye and Walter Ruttmann are progenitors, PIGS combines abstract drawing with live action, and it integrates contemporary visual influences from cell phone videos and YouTube, CGI, concert light shows and holographs.

Our research aim in developing PIGS is not to create an “end user” tool for other artists, but to present an expanded approach to live visuals and collaboration between visualists and musicians. Some of the specific issues PIGS addresses are: parity and integration with musicians in improvisation; alternatives to rectangular screen space in live cinematic composition; performance interfaces that are both intuitive for the performer and relatable by audiences as performed with the body and causative to the experience (the way, e.g., audiences understand the movements they see a violinist make as the cause of the music they hear.) Although these problems are by no means completely solved by PIGS, we hope to contribute to the discourse around these issues through its performance and presentation.

PIGS has been performed seven times as of August 2017. In the course of these shows three different “compositions for PIGS” have been performed. Each composition involves building and editing a specific set of video content for performance. Curt Miller created a software instrument in parallel with PIGS, in which he combines live clarinet and talk box with real-time processing of recorded source material. Curt’s instrument focuses on facilitating musical improvisation with visuals. The first four PIGS performances were audiovisual collaborations between Amy and Curt.

As of April 2018, PIGS compositions can be created using a pseudo-artificial intelligence. A “curator” algorithm analyzes newly uploaded YouTube videos for specified characteristics. Loosely provoked by the question: “What if an algorithm attempted to convert YouTube into Stan VanDerBeek’s utopian vision of a networked ‘culture intercom,'” the algo-curator currently works against YouTube’s algorithms, which encourage posters to upload content intended for commercialization, in the fervent hope of finding “real life.”


Amy Alexander has performed PIGS at:

“People Blowing Things Up on YouTube,” the first composition developed for PIGS, is a rumination on the YouTube culture in which people perform explosions for the camera. The videos run along an uneasy continuum from inquisitive experimentation through toxic aggressiveness and beyond.

Percussive Image Gestural System (PIGS) is created by Amy Alexander. Software development by Amy Alexander and Curt Miller with contributions by Wojciech Kosma.
Audio software: Curt Miller
Research assistant: Doug Rosman

Percussive Image Gestural System (PIGS) development has been supported by the iotaCenter, University of California Institute of Research in the Arts (UCIRA), and UCSD Academic Senate. It has been performed at events in the US, Australia, and Canada.