Skip to content

Add DETR model#5922

Draft
xiaohu2015 wants to merge 16 commits intopytorch:mainfrom
xiaohu2015:main
Draft

Add DETR model#5922
xiaohu2015 wants to merge 16 commits intopytorch:mainfrom
xiaohu2015:main

Conversation

@xiaohu2015
Copy link
Copy Markdown
Contributor

@xiaohu2015 xiaohu2015 commented Apr 29, 2022 •
edited
Loading

related to #2707, work with @oke-aditya @triple-mu

  • Backbone: ResNet50
  • Transformer: Encoder + Decoder
  • Position embed
  • Detection head & loss
  • label assignment
  • datapipes

@xiaohu2015 xiaohu2015 marked this pull request as draft April 29, 2022 02:03
@datumbox datumbox mentioned this pull request Apr 29, 2022
Closed
24 tasks
@xiaohu2015 xiaohu2015 mentioned this pull request Apr 29, 2022
Closed
37 tasks
@oke-aditya
Copy link
Copy Markdown
Contributor

oke-aditya commented May 9, 2022

Sorry for an Early poke at the PR, but I would like to know why we are not using nn.TransformerEncoder layer? Although I'm yet to dive into technical details and aspects.

@xiaohu2015
Copy link
Copy Markdown
Contributor Author

xiaohu2015 commented May 10, 2022

Sorry for an Early poke at the PR, but I would like to know why we are not using nn.TransformerEncoder layer? Although I'm yet to dive into technical details and aspects.

For the offical code, they do some modifcation of nn.TransformerEncoder, it maybe affect the performance.

@datumbox datumbox mentioned this pull request Jul 27, 2022
Open
16 tasks
@datumbox
Copy link
Copy Markdown
Contributor

datumbox commented Sep 14, 2022

@xiaohu2015 I hope you are well. It's been a while since this PR has seen any action. I wonder if you plan to continue slowly working on it or you think it's unlikely to do this in H2. No pressure. Thanks! :)

@deepwilson
Copy link
Copy Markdown

deepwilson commented Oct 27, 2022

@datumbox @xiaohu2015 Is there any progress on this?
If not, I would love to help!

@datumbox
Copy link
Copy Markdown
Contributor

datumbox commented Oct 27, 2022

@deepwilson I believe this is up for grabs as @xiaohu2015 doesn't have the time to complete it now. It would be awesome if we can continue the work. :)

@ambujpawar ambujpawar mentioned this pull request Nov 7, 2022
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

cla signed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@xiaohu2015 @oke-aditya @datumbox @deepwilson @facebook-github-bot