Skip to content

[RLLib] MBMPO Fixes#10296

Merged
sven1977 merged 11 commits intoray-project:masterfrom
michaelzhiluo:mbmpo-fix
Sep 9, 2020
Merged

[RLLib] MBMPO Fixes#10296
sven1977 merged 11 commits intoray-project:masterfrom
michaelzhiluo:mbmpo-fix

Conversation

@michaelzhiluo
Copy link
Copy Markdown
Contributor

@michaelzhiluo michaelzhiluo commented Aug 24, 2020

Fixes the Performance Bug for MBMPO; it was a combination of initial random exploration and bug in MBMPO vectorized environment

Why are these changes needed?

Related issue number

Checks

  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/latest/.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failure rates at https://ray-travis-tracker.herokuapp.com/.
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested (please justify below)

@michaelzhiluo michaelzhiluo marked this pull request as ready for review August 24, 2020 23:21
@michaelzhiluo
Copy link
Copy Markdown
Contributor Author

MBMPO Experiments here: https://github.com/ray-project/rl-experiments

Copy link
Copy Markdown
Contributor

@sven1977 sven1977 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great stuff. Just 2 comments, main one being: We need some regression learning test for this.

@ericl ericl removed their assignment Aug 25, 2020
Copy link
Copy Markdown
Contributor

@sven1977 sven1977 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great! Could you remove the print of the loss, though, and pull master again? Then we can merge this.

@sven1977 sven1977 added the @author-action-required The PR author is responsible for the next step. Remove tag to send back to the reviewer. label Aug 28, 2020
@michaelzhiluo
Copy link
Copy Markdown
Contributor Author

@sven1977 Aight, updated to master and deleted comment. I think its good to go!

@michaelzhiluo michaelzhiluo removed the @author-action-required The PR author is responsible for the next step. Remove tag to send back to the reviewer. label Aug 29, 2020
@sven1977 sven1977 merged commit 8e61365 into ray-project:master Sep 9, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants