4 Commits

Author SHA1 Message Date
3d05fa42bf Complete FTPO training run; document orchestration bug fix and thermal shutdown
Ran the full FTPO fine-tune to completion: 4h12m wall-clock, early-stopped at
step 380/750 by the configured chosen_win=0.85 threshold, train_loss 4.0->2.19.
Output is a merged 16-bit model plus LoRA adapter.

Also fixes an UnboundLocalError in core/orchestration.py when resuming a run
with generation disabled (--generation-step-enabled false), which is needed to
re-run just the finetune stage against an already-generated dataset.

Documents an unrelated platform incident: an uncapped multi-hour finetune
triggered a thermal shutdown mid-run with no checkpoint saved, requiring a
restart from step 0. Capping GPU clocks/power before the retry let it complete
without issue.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_0141RdLKiMeXLMXsWyb4U3B5
2026-09-04 20:52:55 -05:00
sam-paech
7b8e3217e1 fix for custom lists not being used at antislop generation phase 2025-11-07 23:53:02 +11:00
sam-paech
c7e92a4516 fix extra phrases not being merged 2025-11-03 15:32:56 +11:00
sam-paech
b480cb72f7 initial upload 2025-10-17 03:44:24 +11:00