Skip to content

[Buildkite] Add all Python tests#13566

Merged
simon-mo merged 17 commits intoray-project:masterfrom
simon-mo:buildkite-other-pythons
Jan 26, 2021
Merged

[Buildkite] Add all Python tests#13566
simon-mo merged 17 commits intoray-project:masterfrom
simon-mo:buildkite-other-pythons

Conversation

@simon-mo
Copy link
Copy Markdown
Contributor

@simon-mo simon-mo commented Jan 19, 2021

Why are these changes needed?

This PR adds additional tests to buildkite:

  • Ray Core Python
  • Ray Core Asan
  • Dashboard + Serve
  • RLLib
  • Tune, SGD, Doc
    image

@simon-mo simon-mo changed the title [Buildkite] Add other Core Python tests [Buildkite] Add all Python tests Jan 21, 2021
@simon-mo simon-mo requested a review from ijrsvt January 21, 2021 08:23
--jobs=2
//:all

- label: ":serverless: Dashboard + Serve Tests"
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the smallest nit,
Can we use a different Emoji for this?

head_node_args={
"num_cpus": 10,
"redis_max_memory": 10**7
"redis_max_memory": 10**8
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OOC, why are we upping all of these? Is it because we have more resources per CI box.

Copy link
Copy Markdown
Contributor

@ijrsvt ijrsvt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, should we hold off until asan actually passes on buildkite?

# TODO(maximsmol): we should probably block until the processes actually
# all died somehow
# Wait for the processes to actually stop.
psutil.wait_procs(stopped, timeout=2)
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great fix!!!!
Can we catch this and suggest that the user retries with --force?

- DOC_TESTING=1 ./ci/travis/install-dependencies.sh
- bazel test --config=ci $(./scripts/bazel_export_options) --build_tests_only --test_tag_filters=-tf,-pytorch,-py37 doc/...
- bazel test --config=ci $(./scripts/bazel_export_options) --build_tests_only --test_tag_filters=tf,-pytorch,-py37 doc/...
- bazel test --config=ci $(./scripts/bazel_export_options) --build_tests_only --test_tag_filters=-tf,pytorch,-py37 doc/... No newline at end of file
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

newline?

Copy link
Copy Markdown
Contributor

@ijrsvt ijrsvt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@simon-mo
Copy link
Copy Markdown
Contributor Author

Java was broken for unrelated reason.

@simon-mo simon-mo merged commit 8b8d6b9 into ray-project:master Jan 26, 2021
fishbone pushed a commit to fishbone/ray that referenced this pull request Feb 16, 2021
fishbone added a commit to fishbone/ray that referenced this pull request Feb 16, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants