Skip to content

[Serve] Deflake test_reconfigure_with_queries#49696

Merged
edoakes merged 6 commits intoray-project:masterfrom
JoshKarpel:deflake-reconfigure-test
Jan 8, 2025
Merged

[Serve] Deflake test_reconfigure_with_queries#49696
edoakes merged 6 commits intoray-project:masterfrom
JoshKarpel:deflake-reconfigure-test

Conversation

@JoshKarpel
Copy link
Copy Markdown
Contributor

Why are these changes needed?

Small isolated PR to (hopefully) fix flakiness issues with python/ray/serve/tests/test_deploy.py::test_reconfigure_with_queries, noticed while working on #48807 and other PRs.

Related issue number

Checks

  • I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR.
  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
    • I've added any new APIs to the API Reference. For example, if I added a
      method in Tune, I've added it in doc/source/tune/api/ under the
      corresponding .rst file.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

Signed-off-by: Josh Karpel <josh.karpel@gmail.com>
@JoshKarpel JoshKarpel marked this pull request as ready for review January 7, 2025 15:59
@jcotant1 jcotant1 added the serve Ray Serve Related Issue label Jan 7, 2025
Signed-off-by: Josh Karpel <josh.karpel@gmail.com>
JoshKarpel and others added 3 commits January 8, 2025 14:52
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
Signed-off-by: Josh Karpel <josh.karpel@gmail.com>
Signed-off-by: Josh Karpel <josh.karpel@gmail.com>
@JoshKarpel
Copy link
Copy Markdown
Contributor Author

@edoakes looks like there's an unrelated problem in CI?


[2025-01-08T21:27:48Z] + cd python/ray/dashboard/client
--
  | [2025-01-08T21:27:48Z] + npm ci
  | [2025-01-08T21:28:15Z] npm ERR! cb() never called!
  | [2025-01-08T21:28:15Z]
  | [2025-01-08T21:28:15Z] npm ERR! This is an error with npm itself. Please report this error at:
  | [2025-01-08T21:28:15Z] npm ERR!     <https://npm.community>
  | [2025-01-08T21:28:15Z]
  | [2025-01-08T21:28:15Z] npm ERR! A complete log of this run can be found in:
  | [2025-01-08T21:28:15Z] npm ERR!     /root/.npm/_logs/2025-01-08T21_28_15_281Z-debug.log


https://buildkite.com/ray-project/microcheck/builds/9567#019447cc-7e4f-47da-8184-3ad36200afb4

@edoakes
Copy link
Copy Markdown
Collaborator

edoakes commented Jan 8, 2025

@edoakes looks like there's an unrelated problem in CI?


[2025-01-08T21:27:48Z] + cd python/ray/dashboard/client
--
  | [2025-01-08T21:27:48Z] + npm ci
  | [2025-01-08T21:28:15Z] npm ERR! cb() never called!
  | [2025-01-08T21:28:15Z]
  | [2025-01-08T21:28:15Z] npm ERR! This is an error with npm itself. Please report this error at:
  | [2025-01-08T21:28:15Z] npm ERR!     <https://npm.community>
  | [2025-01-08T21:28:15Z]
  | [2025-01-08T21:28:15Z] npm ERR! A complete log of this run can be found in:
  | [2025-01-08T21:28:15Z] npm ERR!     /root/.npm/_logs/2025-01-08T21_28_15_281Z-debug.log

https://buildkite.com/ray-project/microcheck/builds/9567#019447cc-7e4f-47da-8184-3ad36200afb4

Yeah have been seeing this today... should get fixed soon. Will just need to re-run once it does.

Copy link
Copy Markdown
Collaborator

@edoakes edoakes left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great, really appreciate you fixing this!

@edoakes edoakes enabled auto-merge (squash) January 8, 2025 22:47
@github-actions github-actions bot added the go add ONLY when ready to merge, run all tests label Jan 8, 2025
@edoakes edoakes merged commit 12e794d into ray-project:master Jan 8, 2025
@JoshKarpel
Copy link
Copy Markdown
Contributor Author

My pleasure! Thanks for reviewing, appreciate the tips on the helper functions!

@JoshKarpel JoshKarpel deleted the deflake-reconfigure-test branch January 9, 2025 00:09
roshankathawate pushed a commit to roshankathawate/ray that referenced this pull request Jan 9, 2025
Small isolated PR to (hopefully) fix flakiness issues with
`python/ray/serve/tests/test_deploy.py::test_reconfigure_with_queries`,
noticed while working on ray-project#48807 and other PRs.

---------

Signed-off-by: Josh Karpel <josh.karpel@gmail.com>
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
Signed-off-by: Roshan Kathawate <roshankathawate@gmail.com>
HYLcool pushed a commit to HYLcool/ray that referenced this pull request Jan 13, 2025
Small isolated PR to (hopefully) fix flakiness issues with
`python/ray/serve/tests/test_deploy.py::test_reconfigure_with_queries`,
noticed while working on ray-project#48807 and other PRs.

---------

Signed-off-by: Josh Karpel <josh.karpel@gmail.com>
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
Signed-off-by: lielin.hyl <lielin.hyl@alibaba-inc.com>
park12sj pushed a commit to park12sj/ray that referenced this pull request Mar 18, 2025
Small isolated PR to (hopefully) fix flakiness issues with
`python/ray/serve/tests/test_deploy.py::test_reconfigure_with_queries`,
noticed while working on ray-project#48807 and other PRs.

---------

Signed-off-by: Josh Karpel <josh.karpel@gmail.com>
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

community-backlog go add ONLY when ready to merge, run all tests serve Ray Serve Related Issue

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants