Skip to content

Fix dtype casting in OFT module#14546

Merged
AUTOMATIC1111 merged 1 commit intodevfrom
fix-oft-dtype
Jan 6, 2024
Merged

Fix dtype casting in OFT module#14546
AUTOMATIC1111 merged 1 commit intodevfrom
fix-oft-dtype

Conversation

@KohakuBlueleaf
Copy link
Copy Markdown
Collaborator

@KohakuBlueleaf KohakuBlueleaf commented Jan 5, 2024

Description

  • Fix the dtype casting in OFT module to fit how we implement it in other module
  • This changes is needed for FP8 system since pytorch fp8 doesn't support any operation(expect scale_mm in H100 for now)

Checklist:

@AUTOMATIC1111 AUTOMATIC1111 merged commit 8b6848c into dev Jan 6, 2024
@AUTOMATIC1111 AUTOMATIC1111 deleted the fix-oft-dtype branch January 6, 2024 07:50
@w-e-w w-e-w mentioned this pull request Feb 17, 2024
Closed
@pawel665j pawel665j mentioned this pull request Apr 16, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@AUTOMATIC1111 AUTOMATIC1111 AUTOMATIC1111 approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@KohakuBlueleaf @AUTOMATIC1111