Status: Work in progress...
Repository dedicated to the exploration and documentation of cutting-edge AI music models. This repository serves as a central hub for music technologists, researchers, composers, and enthusiasts interested in the intersection of artificial intelligence and music creation.
Within this repository, you will find detailed descriptions of various AI models that have been developed to enhance and innovate the field of music generation and comprehension. Each model is categorized based on its unique capabilities to provide a clear overview of its strengths and applications.
The repository is structured to include individual folders for each model. Each folder contains examples and demonstrations that showcase the model's potential in creating diverse musical pieces.
| Model Name | Demo | Examples | Repo. | Checkpoints | Interface | |
|---|---|---|---|---|---|---|
| MusicGen | Link | Link | Link | ✔️ | ✔️ | |
| M2UGen | Link | Link | Link | ✔️ | ✔️ | |
| MuseCoco | Link | ✔️ | ||||
| Moûsai | Link | |||||
| GETMusic | Link | Link | ✔️ | |||
| Magenta | Link | Link | ✔️ | ✔️ | ||
| MusicLM | Link | Link | ||||
| AudioGen | Link | Link | Link | ✔️ | ||
| Museformer | Link | Link | ✔️ | |||
| ✔️ | Musika | Link | Link | Link | ✔️ | ✔️ |
| MeloForm | Link | |||||
| ✔️ | Riffusion | Link | Link | ✔️ | ✔️ | |
| Jukebox | Link | Link | Link | ✔️ | ✔️ | |
| MAGNeT | Link | |||||
| RAVE | Link | Link | ✔️ | |||
| ChatMusician | Link | Link | ✔️ | |||
| SongComposer | Link | Link | ✔️ | |||
| Tiny Audio Diffusion | Link | |||||
| AudioLDM2 | Link | Link | Link | ✔️ | ✔️ |
| Model Name | Interface | Examples | Demo/Repo. |
|---|---|---|---|
| LLARK | Link | ||
| MuLan | Link | ||
| MERT | Link | ||
| MusicBERT | Link | ||
| RIPO | Link | ||
| CLaMP | Link | ||
| Encodec | Link |
This project is part of a comprehensive study investigating the latest advancements in AI-powered music generation systems. The music examples here are a practical demonstration of how these models interpret and execute prompts related to musical complexity and creativity.
We welcome contributions from the community. If you have suggestions or would like to add more examples, please feel free to open an issue or submit a pull request.
The content in this repository is provided under a Creative Commons Attribution-NonCommercial 4.0 International License. This allows for sharing and adapting the music examples in any medium or format, as long as it is not used for commercial purposes. For clear licensing terms regarding the use of the models themselves, please refer to the license information provided by the developers of models.
For questions or further information, please open an issue in this repository, and we will get back to you as soon as possible.