Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
danielhanchen 
posted an update 2 days ago

any improvements that can be done the cheapest A100?

Saw PrismML's Bonsai 27B 1-bit/ternary release. Curious about their core training/quantization methods vs Unsloth’s Dynamic Quant 2.0. Do you think Unsloth can reach similar uniform 1-bit/ternary performance?