Google Magenta

Magenta is an open source project from Google that explores machine learning as a tool for making music and art. It ships usable software rather than only papers, including a Python library built on TensorFlow for manipulating music and image data, training models and generating new content, and Magenta.js, a JavaScript API for running pre trained models in the browser with TensorFlow.js. The current highlight is Magenta RealTime 2, an open weights live music model and real time synthesis engine that runs on a laptop so developers can build playable AI instruments. The site also lists plugins and demos: Magenta Studio, a collection of plugins for Ableton Live that can also be downloaded as standalone apps, DDSP VST for morphing audio between instruments in real time, and The Infinite Crate, a DAW plugin built on the Lyria RealTime API and released under the Apache 2.0 license. It is aimed at musicians, creative coders and researchers who want to build with generative models. The tools are distributed free as open source through pip and GitHub, and no paid plans are listed.