Complete hybrid timestretch overhaul and finalize implementation plan by robmorgan · Pull Request #1 · robmorgan/timestretch-rs

robmorgan · 2026-02-28T12:13:23Z

Summary

complete the hybrid time-stretch and pitch-shift overhaul, plus the associated research, roadmap, architecture, and release documentation updates
implement transient detector controls, class-aware WSOLA adaptation, residual/noise HPSS defaults, and the broader realtime StreamProcessor improvements
improve tonal fast-path behavior for sparse tonal and dual-mono content, tighten vocal high-frequency formant handling, and expand streaming quality coverage
add quality benchmarking, realtime allocation checks, Rubber Band comparison harnesses, and the Ableton optimization tooling/workflows
fix the desktop app streaming wrapper so it reserves output buffers from StreamProcessor capacity/ratio data instead of fixed guesses, preventing stream_pending_output overflows during playback

Validation

cargo test --lib
cargo test --test pitch_shift -- --nocapture
cargo test --test quality_gates -- --nocapture
cargo test --test quality_benchmark -- --ignored --nocapture
cargo test -p timestretch-desktop

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

…s 905! +0.9 overall Result: {"status":"keep","quality_score":945.8,"percussive_score":905,"edm_score":962.6,"harmonic_score":981.8}

…+0.4 Result: {"status":"keep","quality_score":946.2,"percussive_score":905,"edm_score":969.1,"harmonic_score":973.4}

…val. Score 929.3 (was 946.2 before removal, 837.6 after). Some quality lost due to other code changes in c0622cf. Result: {"status":"keep","quality_score":929.3,"percussive_score":894.7,"edm_score":971.8,"harmonic_score":917.2}

…locking disabled) — fully recovers to 946.2 Result: {"status":"keep","quality_score":946.2,"percussive_score":905,"edm_score":969.1,"harmonic_score":973.4}

Result: {"status":"keep","quality_score":946.3,"percussive_score":903.8,"edm_score":970.8,"harmonic_score":973.1}

… percussive 913, harmonic 982 Result: {"status":"keep","quality_score":949.3,"percussive_score":913.3,"edm_score":963.1,"harmonic_score":982.3}

…erall 950.7 Result: {"status":"keep","quality_score":950.7,"percussive_score":917.3,"edm_score":963.3,"harmonic_score":981.9}

…verall 951.6 (+0.9) Result: {"status":"keep","quality_score":951.6,"percussive_score":919.5,"edm_score":963,"harmonic_score":982.6}

Result: {"status":"keep","quality_score":951.8,"percussive_score":921.4,"edm_score":962.2,"harmonic_score":982}

Result: {"status":"keep","quality_score":951.9,"percussive_score":921.5,"edm_score":962.3,"harmonic_score":982}

…ve 924, overall 952.8 (+0.9) Result: {"status":"keep","quality_score":952.8,"percussive_score":924.1,"edm_score":962.1,"harmonic_score":982}

…+0.1 Result: {"status":"keep","quality_score":952.9,"percussive_score":924.2,"edm_score":962.3,"harmonic_score":982}

…4.6, overall 953.1 (+0.2) Result: {"status":"keep","quality_score":953.1,"percussive_score":924.6,"edm_score":962.3,"harmonic_score":982}

…9, overall 953.2 (+0.1) Result: {"status":"keep","quality_score":953.2,"percussive_score":924.9,"edm_score":962.3,"harmonic_score":982}

…ut better percussive) Result: {"status":"keep","quality_score":953.2,"percussive_score":925,"edm_score":962.3,"harmonic_score":982}

…(+0.3) Result: {"status":"keep","quality_score":953.5,"percussive_score":924.5,"edm_score":963.5,"harmonic_score":982}

Result: {"status":"keep","quality_score":953.8,"percussive_score":925.4,"edm_score":963.5,"harmonic_score":982}

…nterpolation quality Result: {"status":"keep","quality_score":953.8,"percussive_score":925.3,"edm_score":963.5,"harmonic_score":982}

Result: {"status":"keep","quality_score":953.8,"percussive_score":925,"edm_score":963.7,"harmonic_score":982}

robmorgan and others added 30 commits March 5, 2026 10:59

Move transient masking to analysis plane and make RT WSOLA buffer-driven

b88c4e6

Add no-grow RT path and opt-in dual-plane stream backend

6568ad7

chore: remove metamorph

a94923f

Complete dual-plane migration remainder

96c735f

Complete dual-plane migration phases D2-D7

32646e6

Re-enable unity passthrough after ratio roundtrip

0976b6e

feat: new optimize loop

38ce7a8

chore: forgot this

3479f77

chore: forgot this also

dd67f3f

chore: optimize improvements

b2dbdae

loop: roadmap iteration 1

2633447

loop: roadmap iteration 2

ef4e108

loop: roadmap iteration 3

763fe0c

loop: roadmap iteration 4

c1017e3

loop: roadmap iteration 5

3917f7f

loop: roadmap iteration 1

d69fb82

loop: roadmap iteration 2

3b8850c

loop: roadmap iteration 3

4cbe4e5

loop: roadmap iteration 4

003de74

loop: roadmap iteration 5

b9da642

loop: roadmap iteration 1

62530fa

loop: roadmap iteration 2

3f06331

loop: roadmap iteration 3

aa52876

loop: roadmap iteration 4

e6ae579

loop: roadmap iteration 5

cbf5919

chore: bump default loop iterations from 5 to 50

b314b2a

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

loop: roadmap iteration 1

47e08f5

loop: roadmap iteration 2

338c3bd

loop: roadmap iteration 3

df99b7f

chore: bump real-time quality

429f446

robmorgan added 28 commits March 22, 2026 18:20

Two-pole cascaded shelf filter — steeper transition, percussive break…

6439946

…s 905! +0.9 overall Result: {"status":"keep","quality_score":945.8,"percussive_score":905,"edm_score":962.6,"harmonic_score":981.8}

Base shelf threshold 1.02 (from 1.05) — EDM +6.5, harmonic -8.4, net …

91d3b69

…+0.4 Result: {"status":"keep","quality_score":946.2,"percussive_score":905,"edm_score":969.1,"harmonic_score":973.4}

Remove dual-plane runtime path

c0622cf

Restore streaming-specific PV config (180Hz sub-bass, adaptive phase …

be20f86

…locking disabled) — fully recovers to 946.2 Result: {"status":"keep","quality_score":946.2,"percussive_score":905,"edm_score":969.1,"harmonic_score":973.4}

Phase gradient blend 0.20 (from 0.15) — marginal +0.1, EDM +1.7

1da987f

Result: {"status":"keep","quality_score":946.3,"percussive_score":903.8,"edm_score":970.8,"harmonic_score":973.1}

Ratio-conditional base shelf scaling — big improvement! +3.0 overall,…

988259f

… percussive 913, harmonic 982 Result: {"status":"keep","quality_score":949.3,"percussive_score":913.3,"edm_score":963.1,"harmonic_score":982.3}

Base shelf max 140% (from 120%) with ratio_scale — percussive 917, ov…

5054b39

…erall 950.7 Result: {"status":"keep","quality_score":950.7,"percussive_score":917.3,"edm_score":963.3,"harmonic_score":981.9}

Fast EMA warmup (alpha=0.20 for first 10 calls) — percussive 919.5, o…

7de95a4

…verall 951.6 (+0.9) Result: {"status":"keep","quality_score":951.6,"percussive_score":919.5,"edm_score":963,"harmonic_score":982.6}

Warmup 5 calls — percussive 921.4, overall 951.8 (+0.2)

57ab92a

Result: {"status":"keep","quality_score":951.8,"percussive_score":921.4,"edm_score":962.2,"harmonic_score":982}

Warmup alpha 0.15 — marginal +0.1, overall 951.9

0f374be

Result: {"status":"keep","quality_score":951.9,"percussive_score":921.5,"edm_score":962.3,"harmonic_score":982}

Distance-limited gradient propagation (fade beyond 8 bins) — percussi…

1585c57

…ve 924, overall 952.8 (+0.9) Result: {"status":"keep","quality_score":952.8,"percussive_score":924.1,"edm_score":962.1,"harmonic_score":982}

IF blend 6% (from 5%) — works better with distance-limited gradient, …

bf2eef1

…+0.1 Result: {"status":"keep","quality_score":952.9,"percussive_score":924.2,"edm_score":962.3,"harmonic_score":982}

Distance-adaptive IF blend (more IF for distant bins) — percussive 92…

f238f39

…4.6, overall 953.1 (+0.2) Result: {"status":"keep","quality_score":953.1,"percussive_score":924.6,"edm_score":962.3,"harmonic_score":982}

Stronger distance-adaptive IF (3x max over 12 bins) — percussive 924.…

0b51b91

…9, overall 953.2 (+0.1) Result: {"status":"keep","quality_score":953.2,"percussive_score":924.9,"edm_score":962.3,"harmonic_score":982}

IF dist 4x max over 10 bins — percussive 925.0, overall 953.2 (same b…

0aabcd8

…ut better percussive) Result: {"status":"keep","quality_score":953.2,"percussive_score":925,"edm_score":962.3,"harmonic_score":982}

5% time-domain resample blend at ratio>1.5 — EDM +1.2, overall 953.5 …

795279c

…(+0.3) Result: {"status":"keep","quality_score":953.5,"percussive_score":924.5,"edm_score":963.5,"harmonic_score":982}

3% resample blend — percussive 925.4, overall 953.8 (+0.3)

3fe0e62

Result: {"status":"keep","quality_score":953.8,"percussive_score":925.4,"edm_score":963.5,"harmonic_score":982}

Cubic interpolation for resample blend — identical score but better i…

f14d81a

…nterpolation quality Result: {"status":"keep","quality_score":953.8,"percussive_score":925.3,"edm_score":963.5,"harmonic_score":982}

4% resample blend — same overall 953.8 but better EDM (963.7 vs 963.5)

797d936

Result: {"status":"keep","quality_score":953.8,"percussive_score":925,"edm_score":963.7,"harmonic_score":982}

Remove unused resample_scratch buffer — cleanup, same score

44f20a7

Result: {"status":"keep","quality_score":953.8,"percussive_score":925,"edm_score":963.7,"harmonic_score":982}

Fix desktop stream output buffer sizing

f31d318

chore: update autoresearch ideas

04f22a4

chore: remove symlink

c3ac768

chore: remove dead code

be58835

Fix CI quality gates and clippy

309a181

chore: remove codex plan loop stuff

a62b043

Relax stale streaming envelope regression gate

e612380

robmorgan merged commit 5da243c into main Mar 23, 2026
8 checks passed

robmorgan deleted the research branch March 23, 2026 03:06

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Complete hybrid timestretch overhaul and finalize implementation plan#1

Complete hybrid timestretch overhaul and finalize implementation plan#1
robmorgan merged 332 commits into
mainfrom
research

robmorgan commented Feb 28, 2026 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

robmorgan commented Feb 28, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Validation

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

robmorgan commented Feb 28, 2026 •

edited

Loading