Skip to content

Support registering FFN of transformer#2

Merged
jshilong merged 1 commit intojshilong:refactor_tramsformer_basefrom
congee524:transformer
May 18, 2021
Merged

Support registering FFN of transformer#2
jshilong merged 1 commit intojshilong:refactor_tramsformer_basefrom
congee524:transformer

Conversation

@congee524
Copy link
Copy Markdown

No description provided.

@congee524
Copy link
Copy Markdown
Author

@jshilong hey,I have tested it with the original cfg without type and the new cfg with type

@congee524
Copy link
Copy Markdown
Author

And the key of model parameters will not change

@congee524
Copy link
Copy Markdown
Author

kindly ping :p @jshilong

@jshilong jshilong merged commit 8eb66e5 into jshilong:refactor_tramsformer_base May 18, 2021
jshilong pushed a commit that referenced this pull request Dec 9, 2021
* [Docs] Fix the format of return

* replace List with list

* format the documentation of optimizer

* Update ops docstring (#2)

* update ops docstring

* fix typos

Co-authored-by: ChaimZhu <zhuchenming@pjlab.org.cn>

Co-authored-by: ChaimZhu <zhuchenming@pjlab.org.cn>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants