Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

HKUSTAudio
/
AudioX-Turbo

Text-to-Audio
Stable Audio Tools
audiox_turbo
audio-generation
music-generation
video-to-audio
diffusion_cond
distillation
Model card Files Files and versions
xet
Community

Instructions to use HKUSTAudio/AudioX-Turbo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Stable Audio Tools

    How to use HKUSTAudio/AudioX-Turbo with Stable Audio Tools:

    import torch
    import torchaudio
    from einops import rearrange
    from stable_audio_tools import get_pretrained_model
    from stable_audio_tools.inference.generation import generate_diffusion_cond
    
    device = "cuda" if torch.cuda.is_available() else "cpu"
    
    # Download model
    model, model_config = get_pretrained_model("HKUSTAudio/AudioX-Turbo")
    sample_rate = model_config["sample_rate"]
    sample_size = model_config["sample_size"]
    
    model = model.to(device)
    
    # Set up text and timing conditioning
    conditioning = [{
    	"prompt": "128 BPM tech house drum loop",
    }]
    
    # Generate stereo audio
    output = generate_diffusion_cond(
    	model,
    	conditioning=conditioning,
    	sample_size=sample_size,
    	device=device
    )
    
    # Rearrange audio batch to a single sequence
    output = rearrange(output, "b d n -> d (b n)")
    
    # Peak normalize, clip, convert to int16, and save to file
    output = output.to(torch.float32).div(torch.max(torch.abs(output))).clamp(-1, 1).mul(32767).to(torch.int16).cpu()
    torchaudio.save("output.wav", output, sample_rate)
  • Notebooks
  • Google Colab
  • Kaggle
AudioX-Turbo
23 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 8 commits
Zeyue7's picture
Zeyue7
Update README.md
67af549 verified 1 day ago
  • audiox_turbo
    Upload AudioX-Turbo 4-step student model 4 days ago
  • pretrained_ckpt
    Upload teacher/base pretrained checkpoint 4 days ago
  • pretransform
    Upload VAE pretransform 4 days ago
  • synchformer
    Upload Synchformer state dict 4 days ago
  • .gitattributes
    1.52 kB
    initial commit 4 days ago
  • README.md
    6.8 kB
    Update README.md 1 day ago
  • config.json
    87 Bytes
    Create config.json 1 day ago