Request to make quants of my teensy model - https://huggingface.co/NILKNARFGonzo/single-floppy-346k-merged
#2756
by NILKNARFGonzo - opened
The model
I would like to request quantizations of my own NILKNARFGonzo/single-floppy-346k-merged model. I would like f16, Q8_0, Q4_K_S, Q2_K, Q6_K, Q3_K_M, Q3_K_S, Q3_K_L, Q4_K_M, Q5_K_S, Q5_K_M, IQ4_XS, and Q4_0_4, if possible. Thank you! (And if you can, please do IQ1)
NILKNARFGonzo changed discussion title from Request to make quants of my teensy model (with Q1 if possible) - https://huggingface.co/NILKNARFGonzo/single-floppy-346k-merged to Request to make quants of my teensy model - https://huggingface.co/NILKNARFGonzo/single-floppy-346k-merged
It's so beautiful 💀
It's so beautiful 💀
is not
is stupid
Train it on 1T tokens and see what happens lol. Simonko or nico will queue later, Im busy for now so cant queue. We will queue on usual quants we provide, so you might get iq1 too lol