Fish Audio custom quants
#2
by nikich340 - opened
Hi, I would like to try custom (lower - Q6, Q4) quants for Fish Audio S2 Pro model, I compiled audiocpp_gguf tool, but it requires codec.safetensors, while I can see only codec.pth file in original repo: https://huggingface.co/fishaudio/s2-pro/tree/main
How did you made q8_0 quant, what tools used to convert/edit original fishaudio model files? Thank you.
@nikich340 You need to convert the original pt/pth to the safetensor format first, and then use audiocpp_gguf to convert the safetensor. I used an ad-hoc python script to do the first step. For gguf conversion check https://github.com/0xShug0/audio.cpp/blob/main/docs/gguf.md. If the model isn’t specifically called out under Q8 Packaging Notes, you can just use the generic command.
audio-cpp changed discussion status to closed