Instructions to use MiniMaxAI/MiniMax-Music3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use MiniMaxAI/MiniMax-Music3 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("MiniMaxAI/MiniMax-Music3", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Assigning lyrics to voices
I couldn't find any examples where the input caption describes multiple voices and they are assigned within the lyrics (e.g. I want voice 2 to sing this verse).
I had a look through the MiniMax Music 3 demo page (https://minimax-ai.github.io/music3-demo/) but wasn't able to see any examples of being able to do this.
Anyone had luck doing this?
Yes, it works. Not 100% of the time, but pretty well. I'd recommend using the Claude/Codex still to write the prompt if you aren't already. Basically you just need to define your two singers and have lots of verbiage around e.g., "Singer A will only sing the chorus and first verse, Singer B will only sing the second verse and nothing else" etc. Your LLM can probably do a good job of writing out those rules.
Yes, it works. Not 100% of the time, but pretty well. I'd recommend using the Claude/Codex still to write the prompt if you aren't already. Basically you just need to define your two singers and have lots of verbiage around e.g., "Singer A will only sing the chorus and first verse, Singer B will only sing the second verse and nothing else" etc. Your LLM can probably do a good job of writing out those rules.
Thanks! Just confirming you don't put anything in the lyrics, just in the input captions instructions?
Right I didn't need to put anything special in the lyrics. I did put "[Verse 1]" and "[Verse 2]" to make things more explicit, but I'm not sure that's even necessary.