Aquapella
liquid gestural interactions
Aquapella is a hand-held gestural instrument that explores the unique relationship between liquid turbulence and musical expression. The device consists of eight conductive water-level sensors embedded in a custom 3D printed octagonal container. As musicians move and tilt the device, they generate chaotic flow patterns in the water that are translated into real-time MIDI signals for audio-visual interpretation.
Close-up view of a camera mounted above a clear container of water for the Aquapella instrument
Complete Aquapella instrument setup with camera positioned above water container for motion capture
The instrument's design embraces the inherent unpredictability of water while monitoring its movement in detail. This balance between control and chaos creates a uniquely interactive experience, where nearly identical gestures can produce different sonic outcomes due to the fluid's chaotic nature. The device features three primary interaction modes: tilting (which moves water toward container edges), swirling (creating circular motion through centripetal force), and reverberating (using momentum to bounce water off container walls).
Close-up of hands interacting with water in the Aquapella instrument, demonstrating gestural control
Central to the Aquapella's appeal is its tactile, sculptural quality. The weighted feel and hand-held ergonomics provide an immediacy that bridges physical and computational interactions. Unlike fully digital interfaces, the instrument grounds creative expression in the tangible world while offering vast sonic possibilities through its connection to digital audio workstations. An attached USB camera with ring lighting captures the water's surface patterns, enabling tightly coupled audio-visual performances.
Technical drawing or diagram of the Aquapella instrument setup showing the liquid container and sensing components
Multiple perspectives of the Aquapella instrument showing different angles of the water container and camera setup
Our sound experiments have focused on ambient, noise, and glitch aesthetics that move fluidly between harmony and dissonance. Successful mappings include spatial audio techniques where tilting controls sound location in quadraphonic setups, octet arrangements where each sensor controls synthesizer amplitude, and immersive soundscapes that transform white noise into ocean-like environments. The instrument's circular form naturally lends itself to cyclical concepts like phase shifting and euclidean rhythms.
Two performers demonstrating collaborative interaction with the Aquapella instrument
First version of the Aquapella instrument prototype in development
The development process involved extensive iteration on container shapes, sensor technologies, and calibration approaches. We progressed from rectangular plastic containers to shallow circular forms before settling on the current octagonal design, which optimizes both circular gestures and lateral water movement. The conductive sensors, while presenting challenges with drift and adhesion, were chosen for their affordability, compactness, and real-time responsiveness after testing capacitive and optical alternatives.
Second version of the Aquapella instrument showing refined design and construction
Performance with the Aquapella reveals fascinating aspects of human-water interaction. Most first-time users demonstrate intuitive understanding of the instrument's capabilities, suggesting people have natural knowledge of fluid dynamics in containers. The momentum of water carries over from gesture to gesture, creating "aftertouch"-like qualities where physical properties extend sonic output in nuanced ways. This residual effect makes the instrument feel alive and responsive while maintaining an element of beautiful unpredictability.
Credits
concept, hardware: John Lettang
design, imaging, software: August Black
audio design: John Lettang & August Black
Related Publications
Lettang, J., Black, A. Aquapella: Gestural Interactions with Liquid Turbulence as Musical Expression Proceedings of the ACM International Conference on New Interfaces for Musical Expression. June 24-27, 2025, Canberra, Australia. https://doi.org/10.5281/zenodo.15699626