BabyLM 2026 Submission
Collection
2 items • Updated
HRM-rec (hierarchical weight-shared recurrent LM) for the BabyLM 2026 strict track.
Final checkpoint on main (chck_1000M); intermediate checkpoints (if present) on
chck_<N>M branches. Custom model — load with trust_remote_code=True.
from transformers import AutoModelForCausalLM, AutoTokenizer
m = AutoModelForCausalLM.from_pretrained("PatrickHaller/hrm-rec-strict", trust_remote_code=True)
t = AutoTokenizer.from_pretrained("PatrickHaller/hrm-rec-strict")