Skip to content

Commit c58742a

Browse files
committed
Fix: remove +1 from chunk boundary in n-gram cache update (reviewer feedback)
1 parent bd5e1b9 commit c58742a

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

  • records/track_10min_16mb/2026-03-25_BackoffNgramMixer_DriftFreeTTT_0.6683

records/track_10min_16mb/2026-03-25_BackoffNgramMixer_DriftFreeTTT_0.6683/train_gpt.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1073,7 +1073,7 @@ def eval_val_sliding_ttt(
10731073
chunk_start_tok = ci * ttt_chunk_tokens
10741074
chunk_end_tok = min((ci + 1) * ttt_chunk_tokens, total_tokens)
10751075
if mixer is not None:
1076-
mixer.update(val_tokens[chunk_start_tok:chunk_end_tok + 1])
1076+
mixer.update(val_tokens[chunk_start_tok:chunk_end_tok])
10771077

10781078
# Swap back training weights after scoring
10791079
if use_polyak and ci > 0:

0 commit comments

Comments
 (0)