ot-q3_32b-original

Qwen2.5-7B-Instruct student model fine-tuned by full-parameter SFT (s1 recipe) on Qwen3-32B (OpenThoughts SWAG, raw / V3-attack intact) reasoning traces.

This repo is part of a 4-victim study comparing student distillation outcomes when the teacher's reasoning traces are extracted via the V3 attack (-orig) vs. when the V3 attack wrapper is stripped before training (-clean).

How to load a specific epoch

Each epoch_N/ subfolder is a self-contained, loadable HF checkpoint.

from transformers import AutoModelForCausalLM, AutoTokenizer

REPO = "Chia-Mu-Lab/ot-q3_32b-original"
model = AutoModelForCausalLM.from_pretrained(REPO, subfolder="epoch_5", torch_dtype="bfloat16")
tok = AutoTokenizer.from_pretrained(REPO, subfolder="epoch_5")

Per-epoch evaluation

All numbers are accuracies in percent on the canonical eval suite (GSM8K-MATH500, AIME24, AIME25, JEEBench Math subset strict/partial, LiveCodeBench v5 pass@1). The base row is the Qwen2.5-7B-Instruct starting point, evaluated identically. Bold values across this row indicate per-victim peaks.

Epoch	Ckpt	MATH500	AIME24	AIME25	JEE Math (s/p)	LCB pass@1
0	base (Qwen2.5-7B-Instruct)	71.0	8.9	2.2	32.2 / 35.9	15.8
1	step-00355	53.5	1.1	4.4	— / —	17.6
2	step-00711	63.8	5.6	8.9	27.7 / 31.6	15.8
3	step-01066	70.4	10.0	15.6	31.1 / 35.7	19.4
4	step-01422	71.7	12.2	13.3	34.6 / 39.0	16.9
5	step-01775	73.9	13.3	13.3	38.1 / 42.2	16.5

Training recipe

• Base model: Qwen/Qwen2.5-7B-Instruct
• Teacher traces: Chia-Mu-Lab/openthoughts_distill_victim_data_10k_swag_qwen3_32b
• Recipe: s1 paper exact full fine-tune (FSDP full-shard, no LoRA)
• Block size: 32768 tokens · effective batch 16 (mb=1, ga=4, 4×H200)
• Optimizer: AdamW, lr=1e-5 cosine, warmup_ratio=0.05, bf16
• Epochs: 5, save_strategy=epoch

Files

ot-q3_32b-original/
  README.md
  metrics.csv          ← machine-readable per-epoch metric table
  epoch_1/             ← full HF checkpoint dir (config.json, model-*.safetensors,
  epoch_2/                tokenizer*, etc.)
  epoch_3/
  epoch_4/
  epoch_5/

Caveats / known issues

• All epochs here are from the canonical s1-distill 3-exp sweep (2026-05-20), evaluated with the unified math500+AIME+JEE+LCB scorer pipeline.
• JEE Math here refers to the subject="math" subset (≈236 of 515 questions) scored per the official dair-iitd compute_metrics.py. The strict number is the headline accuracy; partial gives MCQ(multiple) partial credit.
• These models are research artifacts for the steel-reasoning-trace project (reasoning-trace extraction attack study); do not use for production.