Skip to content

Fix DoRA alpha#3922

Closed
ntc-ai wants to merge 1 commit intoComfy-Org:masterfrom
ntc-ai:master
Closed

Fix DoRA alpha#3922
ntc-ai wants to merge 1 commit intoComfy-Org:masterfrom
ntc-ai:master

Conversation

@ntc-ai
Copy link
Copy Markdown

@ntc-ai ntc-ai commented Jul 1, 2024

This change improves the DoRA implementation by moving the alpha application to after the weight_norm.

This aligns with A1111 allowing DoRA authors to target both platforms.

Example DoRA:
extremely_detailed_v2.zip

Base image (no DoRA)
image

Before patch (attached DoRA same seed)
image
(identity changed)

After patch
image
purrfect

@ntc-ai ntc-ai requested a review from comfyanonymous as a code owner July 1, 2024 20:23
@comfyanonymous
Copy link
Copy Markdown
Member

@ntc-ai
Copy link
Copy Markdown
Author

ntc-ai commented Jul 1, 2024

Thanks for the link, I just opened up an issue here: KohakuBlueleaf/LyCORIS#196

I currently use alpha to adjust strength to the -1 / 1 range which makes my DoRAs more usable / more easily merged.

My goal is to create DoRAs that work across all the different platforms as well as LoRAs do.

KohakuBlueleaf added a commit to AUTOMATIC1111/stable-diffusion-webui that referenced this pull request Jul 5, 2024
ruchej pushed a commit to ruchej/stable-diffusion-webui that referenced this pull request Sep 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants