Skip to content

memory-check in "slow" release cycle#87

Merged
j-i-l merged 9 commits intomainfrom
26-tests-tracking-memory-usage-the-slow-pipeline
May 2, 2024
Merged

memory-check in "slow" release cycle#87
j-i-l merged 9 commits intomainfrom
26-tests-tracking-memory-usage-the-slow-pipeline

Conversation

@j-i-l
Copy link
Copy Markdown
Member

@j-i-l j-i-l commented Apr 30, 2024

Closes #26

Decision

Since the memory tracking check will most likely exceed the 6h threshold, we cannot simply rely on the free GH runners and need to establish another option.
For the time being we will simply implement an placeholder job that we can correctly integrate into #81 and set up a more complete memory checking workflow, including also furrer-lab/r-containers#29, afterwards.

@j-i-l j-i-l self-assigned this Apr 30, 2024
@j-i-l j-i-l linked an issue Apr 30, 2024 that may be closed by this pull request
@j-i-l
Copy link
Copy Markdown
Member Author

j-i-l commented Apr 30, 2024

For now these checks run with gctorture and valgrind enabled, however, we might get better results if we use an environment in which R was configured especially for memory checking > see furrer-lab/r-containers#29 (comment)

As far as I understand, we might just switch the container once we have one that is dedicated for memory checking.
I'd handle switching the container in another issue then and focus in this one on the inclusion of the checks suggested in the R docs

@j-i-l
Copy link
Copy Markdown
Member Author

j-i-l commented Apr 30, 2024

https://drmemory.org seems to be an interesting alternative to valgrind.

To use it we would need to compile abn with -g -fno-inline -fno-omit-frame-pointer, have the drmemory binary installed and run

drmemory R CMD check  # or similar

@j-i-l
Copy link
Copy Markdown
Member Author

j-i-l commented Apr 30, 2024

... let's see how long these tests run.

We might want to run them only on single occasions if they run for several hours. It might easily happen that we have several commits on a release branch.

@j-i-l j-i-l mentioned this pull request Apr 30, 2024
26 tasks
@j-i-l
Copy link
Copy Markdown
Member Author

j-i-l commented May 1, 2024

Release Cycle Checks exceeded the 6h limit. ☹️ running with gctorture only now.

@j-i-l
Copy link
Copy Markdown
Member Author

j-i-l commented May 2, 2024

On option might be to run build with the flags, export the .tar.gz as artifact and then run use a matrix strategy for each file in tests/thestthat/, install abn and run devtools::test_file as we do now with the single example.

@j-i-l
Copy link
Copy Markdown
Member Author

j-i-l commented May 2, 2024

Memory checks fail successfully! 👍

@j-i-l j-i-l marked this pull request as ready for review May 2, 2024 15:00
@j-i-l j-i-l merged commit d18b681 into main May 2, 2024
@j-i-l j-i-l deleted the 26-tests-tracking-memory-usage-the-slow-pipeline branch May 2, 2024 15:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Tests tracking memory usage (the slow pipeline)

1 participant