Stacco AI instrument

Stacco is an instrument specifically designed to perform with Neural Audio Synthesis (NAS) that I developed at the Intelligent Instruments Lab (IIL) together with Giacomo Lepri.

Stacco features four magnetic attractors placed under a board, combining permanent magnets and a three-axis magnetometer. The attractors are capable of detecting three-dimensional variations in the surrounding magnetic field. Stacco's four attractors combined allow the simultaneous control of up to twelve continuous parameters.

The performer interacts with Stacco by throwing, displacing and combining onto its board magnetic marbles and other ferromagnetic objects, or using magnetic rings that return the tangible response of their repelling magnetic fields. By using single magnetic marbles and rings it is possible to precisely control each of the parameters; on the contrary, by creating structures with lots of marbles, or by combining them with other ferromagnetic objects, the performer can playfully interact and build on top of the instrument's unpredictable magnetic forces.

Stacco provides a fun, yet precise way of exploring RAVE's latent space, offering an intuitive and immediate approach to composing for Neural Synthesis through the concept of Embodied Sketching, that is, the practice of embedding the score onto the instrument itself. Since the magnetic marbles do not need to touch the sensor to be detected, it is possible to place tailored pieces of cardboard or tracing paper on top of Stacco's board. As the performer finds meaningful areas and interesting performative gestures in the latent space, these can be immediately sketched on the instrument. We are now investigating how people design musical scores with RAVE through our method.