Skip to content

[Example] Fix a NaN bug in the flax mlm example#10796

Closed
merrymercy wants to merge 1 commit intohuggingface:masterfrom
merrymercy:pr-fix-flax
Closed

[Example] Fix a NaN bug in the flax mlm example#10796
merrymercy wants to merge 1 commit intohuggingface:masterfrom
merrymercy:pr-fix-flax

Conversation

@merrymercy
Copy link
Contributor

@merrymercy merrymercy commented Mar 18, 2021

What does this PR do?

Fix a NaN bug in the flax masked language model example. This is a bug introduced in #9133
The min should be max. Otherwise, we will get a NaN.

Who can review?

@TevenLeScao @mfuntowicz

@github-actions
Copy link
Contributor

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

@merrymercy
Copy link
Contributor Author

cc @patrickvonplaten

@patrickvonplaten
Copy link
Contributor

Hey @merrymercy - super sorry, I saw the PR too late and it was actually already fixed.

@merrymercy
Copy link
Contributor Author

Thanks for your effort on Jax integration! @patrickvonplaten
Could you also add some doc for these examples https://github.com/huggingface/transformers/tree/master/examples/flax/language-modeling?

@merrymercy merrymercy closed this Apr 24, 2021
@merrymercy merrymercy deleted the pr-fix-flax branch April 24, 2021 21:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants