Summary

This PR adds a main-track submission attempt for the Parameter Golf challenge based on an 11-layer, 512-dim model with:

• EMA (0.997)
• BigramHash (12288, dim 128)
• mixed low-bit quantization
• stride-64 sliding evaluation

3-Seed Results

• Seed 42: 1.13593695 val_bpb, 15,967,704 bytes total
• Seed 471: 1.13389376 val_bpb, 15,663,365 bytes total
• Seed 777: 1.13626774 val_bpb, 15,660,237 bytes total
• Mean: 1.135366
• Std: 0.001286

Notes

• All three runs use the same train_gpt.py snapshot and the same hyperparameter recipe, differing only by seed.
• This draft explicitly discloses that the current FA3 path uses kernels-community/flash-attn3, which fetches the FA3 kernel package at runtime.
• No external model weights, prompts, or user code are fetched; the concern is only the runtime acquisition of the FA3 kernel package itself.
• All three archived logs end with the final exact metric line.
• I understand this may not beat the current open-PR SOTA, but I still wanted to submit a clean, reproducible main-track attempt.