Skip to content

[RLlib] Fix test_bc.py test case.#11722

Merged
richardliaw merged 3 commits intoray-project:masterfrom
sven1977:fix_test_bc
Oct 31, 2020
Merged

[RLlib] Fix test_bc.py test case.#11722
richardliaw merged 3 commits intoray-project:masterfrom
sven1977:fix_test_bc

Conversation

@sven1977
Copy link
Copy Markdown
Contributor

@sven1977 sven1977 commented Oct 30, 2020

The test_bc.py agent test was broken due to a recent change in the rllib/tests/data/large.json CartPole expert file. The data in there was not "expert" (from the beginning of a PPO run), which made BC not learn.

  • The bc and marwil learning tests were altered to actually fail upon not receiving some reward after some iterations.

Why are these changes needed?

Related issue number

Checks

  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

Copy link
Copy Markdown
Contributor

@richardliaw richardliaw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(approve without context

@richardliaw richardliaw merged commit bfc4f95 into ray-project:master Oct 31, 2020
@sven1977 sven1977 deleted the fix_test_bc branch March 27, 2021 11:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants