MiMo-V2.5-Pro MXFP4 Version?
#2
by rodrigomt - opened
Hi AMD team,
Any chance you could add XiaomiMiMo/MiMo-V2.5-Pro to your MXFP4 conversions? I'd love to see an official MXFP4 version of the Pro model. I think many people in the community would appreciate it.
Thanks for all the great work!
Hi @rodrigomt Thank you for your attention.
I recommend using AMD-Quark to quantize XiaomiMiMo/MiMo-V2.5-Pro, as it provides a quick and straightforward way to generate a quantized model.
You can simply follow the quantization script provided in amd/GLM-5.2-MXFP4 as a reference.