Skip to content

[ray_client] Integrate with test_basic, test_basic_2 and test_actor#12964

Merged
ericl merged 12 commits intoray-project:masterfrom
barakmich:client_testbasic
Dec 20, 2020
Merged

[ray_client] Integrate with test_basic, test_basic_2 and test_actor#12964
ericl merged 12 commits intoray-project:masterfrom
barakmich:client_testbasic

Conversation

@barakmich
Copy link
Copy Markdown
Contributor

Why are these changes needed?

Brings the client in line with our usual unit tests. Skips tests if the functionality is internal (not exposed in the ray client API), if the functionality has a ticket in this milestone (mostly regarding passing options like num_cpu), grpc message size issues that datastreaming can relatively easily handle (for a future milestone) or on rare occasion, a completely odd reason altogether.

Current stats:
test_basic: 23 pass, 11 skip
test_basic_2: 16 pass, 8 skip
test_actor: 27 pass, 9 skip

Related issue number

Depends on #12818
Closes #12422

Checks

  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

@barakmich barakmich added this to the Ray Client milestone Dec 18, 2020
@barakmich barakmich requested a review from ericl December 18, 2020 06:02
@barakmich barakmich force-pushed the client_testbasic branch 2 times, most recently from dcbd498 to fd7fc02 Compare December 18, 2020 18:55
@ericl ericl added the @author-action-required The PR author is responsible for the next step. Remove tag to send back to the reviewer. label Dec 18, 2020
Copy link
Copy Markdown
Contributor

@ericl ericl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Btw, we should make sure to enable the tests that use _remote later on, it's not really an internal API (it's equivalent to foo.options().remote(), or defining a new @remote function). A lot of the tests are just using _remote since the tests were written a long time ago to save lines of code.

@barakmich
Copy link
Copy Markdown
Contributor Author

Discovered that one of the fixes for test_actor broke test_basic -- and found that there was a bug. Fixed now, but worth another look.

Also, opened #12983 as a result -- marked P3 and added to the milestone but it's ready to happen soon (yay code deletion!)

@barakmich barakmich removed the @author-action-required The PR author is responsible for the next step. Remove tag to send back to the reviewer. label Dec 19, 2020
@ericl
Copy link
Copy Markdown
Contributor

ericl commented Dec 19, 2020

~/build/ray-project/tmp.XLUq6hHlRA
Sat Dec 19 03:12:11 UTC 2020 Flake8....
python/ray/tests/test_actor.py:25:1: E402 module level import not at top of file

@ericl ericl added the @author-action-required The PR author is responsible for the next step. Remove tag to send back to the reviewer. label Dec 19, 2020
Change-Id: I586023573dc3653e816a9329416a75ba127e460d
Change-Id: I0b32cc93abbba0024df52f7f368edaed1a6da9ec
Change-Id: Idb225b9edb121d1b8285ef133f37ee94295133c4
Change-Id: I782f3f92892128ab12126cae876e872b9231b79d
Change-Id: Ic528d587cc29b892e9ee0139cda0222de5e5c730
Change-Id: I7b30456cc50e01023d7164ee6408059227b2f250
Change-Id: I2d2a46a48d060e77c7a2be2b65e3f2b5f3e246c0
Change-Id: I0762b67d335817af42303671c201b6770a24ad35
Change-Id: If5ef594116b83b66f8e506ee63143103ce63b0a4
Change-Id: Ia953d51cec9ed53640445618db8a08b81c833c1f
Change-Id: Ia020aa2ec49a700b9daaf06546d7d6a251599968
Change-Id: Ic4f6723d610de6df6cdb061933309570cac92e55
@barakmich barakmich added tests-ok The tagger certifies test failures are unrelated and assumes personal liability. and removed @author-action-required The PR author is responsible for the next step. Remove tag to send back to the reviewer. labels Dec 19, 2020
@ericl ericl merged commit 7ab9164 into ray-project:master Dec 20, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tests-ok The tagger certifies test failures are unrelated and assumes personal liability.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Get test_basic.py to pass in client mode [10]

2 participants