Skip to content

chore(ci): Add CUDA runner for testing device extension#490

Merged
paleolimbot merged 14 commits intomainfrom
ci-add-cuda-runner
Jun 25, 2024
Merged

chore(ci): Add CUDA runner for testing device extension#490
paleolimbot merged 14 commits intomainfrom
ci-add-cuda-runner

Conversation

@paleolimbot
Copy link
Copy Markdown
Member

@paleolimbot paleolimbot commented May 24, 2024

This PR adds the INFRA-provided runner ["self-hosted", "cuda"] so that PRs that modify CUDA code get better CI feedback (before this, the extension pretty much was only ever built on my local setup).

The self-hosted runner is running an older linux than the usual ubuntu-latest, so a few modifications were needed to reflect compiler warning policies. The cache key we were using for Arrow C++ is also no longer sufficient for the device workflow because a cache restore results in an unusable Arrow C++ static library on the self-hosted runner. This shouldn't be necessary for much longer (just until Arrow C++-dependent tests are factored out and run separately).

@lidavidm
Copy link
Copy Markdown
Member

Might need INFRA to enable the CUDA runners on this repo? Not sure who controls that

paleolimbot added a commit that referenced this pull request Jun 4, 2024
…tion to use the driver API (#488)

Closes #246.

This PR doesn't change much about the existing implementation (and I
think there are some things that need to be changed!), it just
eliminates the dependency on the runtime library. The driver API is a
better fit here anyway since we're doing very low-level things!

This isn't tested in CI yet (working on that here:
#490 ).
@paleolimbot paleolimbot force-pushed the ci-add-cuda-runner branch 3 times, most recently from f39bee7 to 4273353 Compare June 24, 2024 14:43
@paleolimbot paleolimbot changed the title chore(ci): Add metal and CUDA runners for testing device extension chore(ci): Add CUDA runner for testing device extension Jun 24, 2024
@paleolimbot paleolimbot marked this pull request as ready for review June 24, 2024 15:48
@paleolimbot paleolimbot merged commit 749349d into main Jun 25, 2024
@paleolimbot paleolimbot deleted the ci-add-cuda-runner branch June 26, 2024 12:56
@paleolimbot paleolimbot added this to the nanoarrow 0.6.0 milestone Sep 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants