AI & ML interests

None defined yet.

Recent Activity

AtAndDev  updated a model about 22 hours ago
specklabs/Speck1.5-140M-Instruct-GGUF
AtAndDev  published a model about 23 hours ago
specklabs/Speck1.5-140M-Instruct-GGUF
AtAndDev  updated a model about 23 hours ago
specklabs/Speck1.5-140M-Instruct
View all activity

AtAndDev 
updated a Space 1 day ago
AtAndDev 
posted an update 2 days ago
view post
Post
108
SPECK1.5 IS COMING SOON!
Same 5B token budget but much better corpus quality.

Also getting a ton of downloads, thanks for everyone downloading and liking <3

specklabs
AtAndDev 
published a Space 4 days ago
AtAndDev 
posted an update 5 days ago
view post
Post
124
NEW SPECK UPDATES:

Just hit #14 and #15 with out FIRST models on Open SLM Leaderboard. The models were trained on 5B tokens, while competing with similarly sized models trained on more than 6-20x the data.

A new base model Speck1.5-140M being trained right now on a higher quality corpus and will be released soon.
SpeckChat3 is coming very soon with 1 million samples, specifically designed to post train small base models.

Also, just to clarify stuff, we will NOT release anything that is NOT MIT licensed EVER. Openness is needed in small language research.

Thanks to everyone supporting the project, and stay tuned for new releases!