Speedrun architecture: 8 pretraining seeds/size, anneal marks every 10 TPP as revisions. Plain ladder: “Scaling Ladder — 4 sizes, 135M–973M, 200 TPP”
Julian Minder
jkminder
AI & ML interests
None yet
Recent Activity
updated a model 6 days ago
jkminder/pretraining-priors-doormail4k-d32-treated-base published a model 6 days ago
jkminder/pretraining-priors-doormail4k-d32-treated-base updated a model 13 days ago
jkminder/d20_477m_seed4_sftOrganizations
Scaling Ladder (optimized) — 3 sizes, 286M–897M, 200 TPP
Speedrun architecture: 8 pretraining seeds/size, anneal marks every 10 TPP as revisions. Plain ladder: “Scaling Ladder — 4 sizes, 135M–973M, 200 TPP”
Scaling Ladder — 4 sizes, 135M–973M, 200 TPP
The whole ladder, 200 TPP on ClimbMix; plain GPT (nanochat mechanisms disabled). Bases, then chat-SFTs (_sft).
models 177
jkminder/pretraining-priors-doormail4k-d32-treated-base
Text Generation • 2B • Updated • 151
jkminder/d20_477m_seed4_sft
Text Generation • 0.5B • Updated • 416
jkminder/d20_477m_seed3_sft
Text Generation • 0.5B • Updated • 430
jkminder/d20_477m_seed1_sft
Text Generation • 0.5B • Updated • 480
jkminder/d20_477m_seed2_sft
Text Generation • 0.5B • Updated • 487
jkminder/d26_973m_seed4_sft
Text Generation • 1.0B • Updated • 511
jkminder/d26_973m_seed3_sft
Text Generation • 1.0B • Updated • 469
jkminder/d26_973m_seed1_sft
Text Generation • 1.0B • Updated • 455
jkminder/d26_973m_seed2_sft
Text Generation • 1.0B • Updated • 443
jkminder/d12_135m_seed4_sft
Text Generation • 0.1B • Updated • 514
datasets 15
jkminder/pretraining-priors-pirate-register
Viewer • Updated • 999k • 129
jkminder/normative-reflections-feedback
Viewer • Updated • 5 • 8
jkminder/apertus-annotation-feedback
Viewer • Updated • 52 • 7
jkminder/model-raising-interp-prepared
Viewer • Updated • 100k • 22
jkminder/model-raising-pbsft-eval
Viewer • Updated • 9.99k • 14
jkminder/model-raising-reflection-end-eval
Viewer • Updated • 28.7k • 25
jkminder/model-raising-pb-300k-3c-sft
Viewer • Updated • 302k • 12
jkminder/or-bench-1k-overrefusal
Viewer • Updated • 962 • 42
jkminder/xstest-overrefusal
Viewer • Updated • 214 • 35
jkminder/orfuzz
Viewer • Updated • 1.79k • 7