LangMAP

company

https://cimeister.github.io/blog/unigramlm/

AI & ML interests

Language Adaptive Tokenization

MultilingualUnigramLM 's datasets 35

MultilingualUnigramLM/The-Stack-10K

Viewer • Updated Apr 4 • 300k • 120

MultilingualUnigramLM/FineWeb2-100M-olmo3-7b-toks

Viewer • Updated Mar 14 • 1.22M • 42

MultilingualUnigramLM/FineWeb2-10M

Viewer • Updated Jan 20 • 228k • 23

MultilingualUnigramLM/FineWeb2-5M

Viewer • Updated Jan 20 • 113k • 30

MultilingualUnigramLM/FineWeb2-10K

Viewer • Updated Jan 18 • 1.14M • 237