Skip to content

Handle compaction events in range cache subscriber#7161

Merged
teh-cmc merged 1 commit intomainfrom
cmc/compaction_leak
Aug 13, 2024
Merged

Handle compaction events in range cache subscriber#7161
teh-cmc merged 1 commit intomainfrom
cmc/compaction_leak

Conversation

@teh-cmc
Copy link
Copy Markdown
Contributor

@teh-cmc teh-cmc commented Aug 13, 2024

I completely forgot to handle compaction events in the cache subscriber, which means it was leaking arrow pointers every time compaction happened.

pixi run rs-plot-dashboard --num-plots 10 --num-series-per-plot 5 --num-points-per-series 5000 --freq 1000

Before:
image

After:
image

Checklist

  • I have read and agree to Contributor Guide and the Code of Conduct
  • I've included a screenshot or gif (if applicable)
  • I have tested the web demo (if applicable):
  • The PR title and labels are set such as to maximize their usefulness for the next release's CHANGELOG
  • If applicable, add a new check to the release checklist!
  • If have noted any breaking changes to the log API in CHANGELOG.md and the migration guide

To run all checks from main, comment on the PR with @rerun-bot full-check.

@teh-cmc teh-cmc added 🪳 bug Something isn't working 📉 performance Optimization, memory use, etc exclude from changelog PRs with this won't show up in CHANGELOG.md labels Aug 13, 2024
@Wumpf Wumpf self-requested a review August 13, 2024 10:13
Copy link
Copy Markdown
Member

@Wumpf Wumpf left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

not familiar with this corner, but I think I get it. More events to handle which may cause clearing, yes!

@teh-cmc teh-cmc merged commit 103e5a1 into main Aug 13, 2024
@teh-cmc teh-cmc deleted the cmc/compaction_leak branch August 13, 2024 10:18
teh-cmc added a commit that referenced this pull request Aug 13, 2024
I completely forgot to handle compaction events in the cache subscriber,
which means it was leaking arrow pointers every time compaction
happened.

```
pixi run rs-plot-dashboard --num-plots 10 --num-series-per-plot 5 --num-points-per-series 5000 --freq 1000
```

Before:

![image](https://github.com/user-attachments/assets/acc4baf9-cb89-4ded-8e7d-4ee63dc81f57)


After:

![image](https://github.com/user-attachments/assets/e09bf9ed-1276-4a52-8636-d7d22514c026)
@teh-cmc teh-cmc changed the title Handle compaction events in cache subscriber Handle compaction events in range cache subscriber Aug 14, 2024
Wumpf pushed a commit that referenced this pull request Aug 14, 2024
This is the exact same thing as #7161, except it's for latest-at (and
requires a bit more care, because latest-at is weird).

### Checklist
* [x] I have read and agree to [Contributor
Guide](https://github.com/rerun-io/rerun/blob/main/CONTRIBUTING.md) and
the [Code of
Conduct](https://github.com/rerun-io/rerun/blob/main/CODE_OF_CONDUCT.md)
* [x] I've included a screenshot or gif (if applicable)
* [x] I have tested the web demo (if applicable):
* Using examples from latest `main` build:
[rerun.io/viewer](https://rerun.io/viewer/pr/7161?manifest_url=https://app.rerun.io/version/main/examples_manifest.json)
* Using full set of examples from `nightly` build:
[rerun.io/viewer](https://rerun.io/viewer/pr/7161?manifest_url=https://app.rerun.io/version/nightly/examples_manifest.json)
* [x] The PR title and labels are set such as to maximize their
usefulness for the next release's CHANGELOG
* [x] If applicable, add a new check to the [release
checklist](https://github.com/rerun-io/rerun/blob/main/tests/python/release_checklist)!
* [x] If have noted any breaking changes to the log API in
`CHANGELOG.md` and the migration guide

- [PR Build Summary](https://build.rerun.io/pr/7161)
- [Recent benchmark results](https://build.rerun.io/graphs/crates.html)
- [Wasm size tracking](https://build.rerun.io/graphs/sizes.html)

To run all checks from `main`, comment on the PR with `@rerun-bot
full-check`.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

🪳 bug Something isn't working exclude from changelog PRs with this won't show up in CHANGELOG.md 📉 performance Optimization, memory use, etc

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants