Speedrun architecture: 8 pretraining seeds/size, anneal marks every 10 TPP as revisions. Plain ladder: “Scaling Ladder — 4 sizes, 135M–973M, 200 TPP”
Julian Minder
jkminder
AI & ML interests
None yet
Recent Activity
updated a collection 1 day ago
Scaling Ladder — 4 sizes, 135M–973M, 200 TPP published a model 1 day ago
jkminder/d12_135m_seed8_sft updated a model 1 day ago
jkminder/d12_135m_seed8_sftOrganizations
Scaling Ladder (optimized) — 3 sizes, 286M–897M, 200 TPP
Speedrun architecture: 8 pretraining seeds/size, anneal marks every 10 TPP as revisions. Plain ladder: “Scaling Ladder — 4 sizes, 135M–973M, 200 TPP”
Scaling Ladder — 4 sizes, 135M–973M, 200 TPP
The whole ladder, 200 TPP on ClimbMix; plain GPT (nanochat mechanisms disabled). Bases, then chat-SFTs (_sft).
models 176
jkminder/d12_135m_seed8_sft
Text Generation • 0.1B • Updated • 218
jkminder/d12_135m_seed7_sft
Text Generation • 0.1B • Updated • 198
jkminder/d12_135m_seed6_sft
Text Generation • 0.1B • Updated • 187
jkminder/d12_135m_seed5_sft
Text Generation • 0.1B • Updated • 176
jkminder/d12_135m_seed4_sft
Text Generation • 0.1B • Updated • 175
jkminder/d12_135m_seed3_sft
Text Generation • 0.1B • Updated • 176
jkminder/d12_135m_seed1_sft
Text Generation • 0.1B • Updated • 175
jkminder/d12_135m_seed2_sft
Text Generation • 0.1B • Updated • 157
jkminder/d12_135m_seed8
Text Generation • 0.1B • Updated • 208
jkminder/d20_optimized_897m_seed3
Text Generation • 0.9B • Updated • 717
datasets 15
jkminder/pretraining-priors-pirate-register
Viewer • Updated • 999k • 132
jkminder/normative-reflections-feedback
Viewer • Updated • 5 • 8
jkminder/apertus-annotation-feedback
Viewer • Updated • 52 • 14
jkminder/model-raising-interp-prepared
Viewer • Updated • 100k • 24
jkminder/model-raising-pbsft-eval
Viewer • Updated • 9.99k • 24
jkminder/model-raising-reflection-end-eval
Viewer • Updated • 28.7k • 14
jkminder/model-raising-pb-300k-3c-sft
Viewer • Updated • 302k • 9
jkminder/or-bench-1k-overrefusal
Viewer • Updated • 962 • 32
jkminder/xstest-overrefusal
Viewer • Updated • 214 • 46
jkminder/orfuzz
Viewer • Updated • 1.79k • 8