Harmonai

Harmonai is an open-source generative audio initiative from Stability AI designed to make advanced music and sound creation tools broadly accessible. It provides AI-powered models and frameworks that enable users to generate, transform, and explore audio, with a focus on music production, sound design, and experimental composition. The primary purpose of Harmonai is to give musicians, researchers, and developers a transparent, customizable foundation for AI-driven audio workflows without dependence on closed, proprietary systems.

At the core of Harmonai is Dance Diffusion, a diffusion-based audio generation framework capable of synthesizing realistic sounds, loops, and musical textures from scratch or from learned training data. The project releases model checkpoints, curated datasets, and complete training code, allowing users to fine-tune models on their own musical material and experiment with new architectures. Its research-oriented design supports rapid prototyping of novel generative audio techniques, while permissive licensing encourages integration into DAWs, creative coding environments, and custom audio pipelines. Community-driven development further extends the ecosystem with shared models, tools, and best practices.