Instagram story viewer> @nemus_project> Tagged
221
followers
171
following
• Numerical Restoration of Historical Musical Instruments
• ERC-funded project @erc_research
• physical modelling sound synthesis
POSTS STORIES REELS TAGGED
So happy to finally share this! My performance at this year’s @unitednations @aiforgood Global Summit is now up on YouTube. It was my biggest solo production to date and I am so thankful to everyone involved. It was such a privilege to be on stage surrounded by such a big and supportive team. A special thank you to my two co-conspirators @sugo_steve on visuals and @missing__ear on stage sound and the whole @ituofficial team for believing in this project.

Modes of Vibration AV world premiere, performed on piano, sound sculptures and electric violin with visuals by the incredible @sugo_steve. My custom AI agent swarm TEAL connects the musical improvisation with live synthesis, real-time generative visuals and the sculptures on stage.

This was my first performance using TEAL (Transmodal Emotional Amplification Listener), a custom multi-modal agent comprised of live analysis algorithms and local AI models acting as a bridge between instrumental improvisation, sound synthesis, tangible sound sculptures and generative visuals. TEAL listens to and interprets musical gestures, imagining a “synthetic dream” for every inferred emotion: it then uses that information to influence everything that happens on stage, sound, visuals and even embodied objects. TEAL is a combination of @c74connect #MaxMSP, @Ableton #Live, #javascript, #Ollama, #qwen 2:7b-instruct, #StreamDiffusion, #OpenCV, #MediaPipe and #TouchDesigner.

It’s the first step in building an AI system that interprets and amplifies musical gestures, human emotion and intention, with the intent of empowering artistic expression.

Music, performance and creative direction: Gadi Sassoon
Software development: Gadi Sassoon, @physicalaudiouk , Infinity Studios
Sound Sculptures: Gadi Sassoon, NEMUS @nemus_project 
Live visuals: Stefano Polli @sugo_steve , Sugo Design @sugodesigntv 
Stage sound: Matteo Gualeni @missing__ear 
Stage engineering and video production: @dorierofficial 
Production: Infinity Studios, International Telecommunications Union @ituofficial, AI For Good @aiforgood, Sugo Design
32
back to up