Skip to content

Fix AttributeError in OFT when trying to get MultiheadAttention weight#15260

Merged
AUTOMATIC1111 merged 1 commit intoAUTOMATIC1111:devfrom
v0xie:fix-OFT-MhA-AttributeError
Mar 16, 2024
Merged

Fix AttributeError in OFT when trying to get MultiheadAttention weight#15260
AUTOMATIC1111 merged 1 commit intoAUTOMATIC1111:devfrom
v0xie:fix-OFT-MhA-AttributeError

Conversation

@v0xie
Copy link
Copy Markdown
Contributor

@v0xie v0xie commented Mar 15, 2024

Description

We avoid an AttributeError by changing the condition from if self.rescale is not None: to if self.rescale is not None and not is_other_linear:.

Related: #15190

Screenshots/videos:

Traceback (most recent call last):
  File "F:\stablediffusion\stable-diffusion-webui\extensions-builtin\Lora\networks.py", line 280, in load_networks
    net = load_network(name, network_on_disk)
  File "F:\stablediffusion\stable-diffusion-webui\extensions-builtin\Lora\networks.py", line 219, in load_network
    net_module = nettype.create_module(net, weights)
  File "F:\stablediffusion\stable-diffusion-webui\extensions-builtin\Lora\network_oft.py", line 9, in create_module
    return NetworkModuleOFT(net, weights)
  File "F:\stablediffusion\stable-diffusion-webui\extensions-builtin\Lora\network_oft.py", line 44, in __init__
    self.rescale = self.rescale.reshape(-1, *[1]*(self.org_module[0].weight.dim() - 1))
  File "f:\stablediffusion\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1695, in __getattr__
    raise AttributeError(f"'{type(self).__name__}' object has no attribute '{name}'")
AttributeError: 'MultiheadAttention' object has no attribute 'weight'

Checklist:

@v0xie v0xie requested a review from AUTOMATIC1111 as a code owner March 15, 2024 00:13
@AUTOMATIC1111 AUTOMATIC1111 merged commit 3cb698a into AUTOMATIC1111:dev Mar 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants