Article
Training a 2.7B MoE from scratch for $200, one GPU at a time
vovaRL
• • 3Banaxi PRO
Banaxi-Tech
AI & ML interests
SLMs, training from scratch, LoRA, TTS, Ternary models. Contact at banaxitech@gmail.com
Recent Activity
updated a model 2 minutes ago
BananaMind-Model-Previewers/BananaMind-2-Pro-Preview reacted to LH-Tech-AI's post with 😔 14 minutes ago
Announcing The Supra2 Family And Supra2-100M
Today, we are announcing a brand-new series of SupraLabs models: Supra2
This series will feature various models, including such as:
- 🐜 Supra2-Nano (0.4M) → The smallest Supra2 model.
- 🤏 Supra2-Small (1.4M) → The tiny model that runs everywhere.
- 💪 Supra2-Medium (25M) → Our medium class model in the Supra2 family. The powerful midsizer.
- 🔥 Supra2-Pro (100M): base, instruct, reasoning, code, math and more! → The most capable model yet! A real allrounder for all your everyday tasks.
- 🎨 Supra2-IMG → our generative text-to-image model
...and many more...
Current progress:
- Nano (0.4M) and Small (1.4M): in training; almost done. Baseline set.
- Medium (25M): coming soon...
- Pro (100M): in training; finishes in 66 hours - Monday, 3rd August 2026, 12:00AM
- IMG: coming soon...
You can support us with a like and follow if you want!
Don't miss our next release! Stay tuned... liked a model about 6 hours ago
User01110/cma-5M-postOrganizations
upvoted an article 1 day ago
upvoted a paper 3 days ago
upvoted 2
articles 8 days ago
Article
Under The Hood: Inkling from Thinking Machines
balaatdell
• • 2 Article
The influx of specialist models on the Open SLM Leaderboard
Banaxi-Tech
• • 7 upvoted an article 9 days ago
Article
Security incident disclosure — July 2026
system
• • 727