Description

For efficiency in lora-block-weight extension. We want to use old lora implementation (the bypass-forward one). But LyCORIS method doesn't support it at all.

Since not all the lyco method can implement efficient forward method. (And some of it is super tricky)
I decide to add general forward at first so at least it will not cause any error and still give out reasonable result.

Method specific implementation (for OFT and LoKr and GLoRA) will in the future PR.

Checklist:

• I have read contributing wiki page
• I have performed a self-review of my own code
• My code follows the style guidelines
• My code passes tests