Skip to content

[rllib] Support batch norm layers#3369

Merged
ericl merged 10 commits intoray-project:masterfrom
ericl:batch-norm
Nov 29, 2018
Merged

[rllib] Support batch norm layers#3369
ericl merged 10 commits intoray-project:masterfrom
ericl:batch-norm

Conversation

@ericl
Copy link
Copy Markdown
Contributor

@ericl ericl commented Nov 21, 2018

What do these changes do?

  • Pass in the right is_training tensor to build_layers_v2
  • Add the right update ops to apply grads automatically
  • Example script in test_batch_norm.py

I don't think this will work for e.g., A3C which applies gradient updates separately, but it should work fine in the other execution modes.

Related issue number

Closes: #2023

Loading
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tests-ok The tagger certifies test failures are unrelated and assumes personal liability.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants