Art project translates music from Teenage Engineering’s OP-Z synth into AI-generated imagery
AI-generated artwork is a brand new frontier rife with potential. However for each thorny query about and the potential for widespread manipulation, generated artwork may encourage marvel and awe. For instance, look no additional than that creates kaleidoscopic visible landscapes for composed music.
A collaboration between quirky synth model Teenage Engineering and design studios Modem and Bureau Cool, attracts inspiration from the neurological situation synesthesia. This uncommon phenomenon leads the mind to understand sensory enter for a number of senses as a substitute of 1. For instance, a listener with synesthesia may even see music as a substitute of solely listening to it, observing colour, motion and form in response to musical patterns. Conversely, a synesthetic individual might style shapes, really feel phrases from a novel or hear an summary portray.
The audiovisual experiment makes use of the Teenage Engineering because the music supply that’s then translated into AI artwork. In real-time, Modem and Bureau Cool’s “digital extension” interprets musical properties into textual content prompts describing colours, shapes and actions. These prompts then feed into Steady Diffusion (an open-source instrument much like and Midjourney) to provide dreamy and synesthetic animations.
Modem co-founder Bas van de Poel sees the experiment as gas for artists’ imaginations. “With the challenge, we see the potential for musicians to discover new types of creativity, facilitating a joint efficiency between human and machine,” van de Poel instructed Engadget at present.
Should you’re a musician who owns Teenage Engineering’s OP-Z, you may’t but use the extension your self — however that will ultimately change. Van de Poel tells Engadget that the businesses are “exploring the potential of launching a public model.”
This AI-based challenge isn’t the primary to convey synesthetic properties to the plenty. Final 12 months, Google Arts & Tradition created an exhibition that , bringing machine-learning-produced sound to Vassily Kandinsky’s work.
All merchandise really helpful by Engadget are chosen by our editorial group, impartial of our mother or father firm. A few of our tales embrace affiliate hyperlinks. Should you purchase one thing via one in all these hyperlinks, we might earn an affiliate fee. All costs are right on the time of publishing.
