Gradient masks also kind of work #28
Replies: 4 comments 9 replies
-
|
My bad, it should have been Generated 2 images |
Beta Was this translation helpful? Give feedback.
-
|
yeah; for any future curious types, gotta keep that alpha channel opaque for it to actually do anything :) |
Beta Was this translation helpful? Give feedback.
-
|
y'know i tried gradients when i was being stupid with overmasking and they always gave me a really blatantly visible, well, gradient seam but i honestly don't think i tried it wide enough maybe? certainly something to potentially play with more... and yeah, i sometimes get bonus "windowpaned" images in my outpaints regardless of overmask/blur, legitimately NO clue where to even start with that one lol |
Beta Was this translation helpful? Give feedback.
-
I believe the fix for that is randomness :) Same thing you are already doing when masking the edges with random arcs. Reason it should work is that because gradient is still a straight linear line, SD sees that as an opportunity to draw a new image from somewhere in that spectrum. If its random, SD won't see any straight line and hence no new image. Will have to try again by adding random noise in the gradient. |
Beta Was this translation helpful? Give feedback.
-
|
Using noisy mask does not work well. It makes the image blurry, loosing finer details. |
Beta Was this translation helpful? Give feedback.
-
|
What about noisy gradient masks? |
Beta Was this translation helpful? Give feedback.
-
|
Skewing the gradient is giving much better results e.g. turning it kind logarithmic instead of linear.
EDIT: Overall, the good thing is, gradient mask is not producing any visible seams. EDIT: Realised that making huge changes in large portion of original image will not be desirable in most cases. EDIT: This kind of gradient is effecting the image the way I wanted to, slight changes as a whole, more near the edges |
Beta Was this translation helpful? Give feedback.
-
|
i don't know what your prompt was for this but it's very arrival and i love it |
Beta Was this translation helpful? Give feedback.
-
|
I think it was something like "alien spaceship with glowing lights, award winning". Was trying to see the effect of adding lights on original image. |
Beta Was this translation helpful? Give feedback.
-
|
I have been testing this, and from my tests at least, what gradient does is not really a gradient at all... Seems that it simply does not consider anything blacker than something around #808080 as a mask, and so keeps what is there. Anything over this number seems to generate fully, without regard for the brightness. I suggest you test with fully gray masks instead of a gradient, that should give more of an idea of what different gray tones do... |
Beta Was this translation helpful? Give feedback.
-
|
I did. And that's how I ended up with the last skewed gradient. What happens if you use gray is that what looks like an untouched image on gray mask actually has slightly different color. This leaves a very visible seam. For example in above image using gray mask makes right half of the mountain a slightly different color. I believe that below a certain threshold the changes in images are not structural and so seamless that you won't notice unless you have something to compare. So, gradient below that value does work, just not as we are expecting it to. |
Beta Was this translation helpful? Give feedback.
-
|
Gradients are already supported by automatic1111. That's how I got them working. Or may be I misunderstood what you are saying here about support. |
Beta Was this translation helpful? Give feedback.
-
|
Well, if you say so, it shouldn't be so difficult to implement some gradient editing tools. If that's accurate, some of the features (img2img border masking in particular) could probably greatly benefit from this. I will add a separate branch for gradient editing support and we can see what to do from there. |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
I tried to fade out the mask going towards original image.
This is the initial image I am using.
I test this by outpainting the right half.
It's a liner gradient from
blacktowhite. Simply replacing lines fromopenOutpaint/js/index.js
Line 651 in d1a131a
openOutpaint/js/index.js
Line 670 in d1a131a
with
This is what the mask looks like
Problem is that it only affects half of the original image while making the outpainted portion black.
Idea behind trying this was that any outpaint should also effect original image a little bit depending on whats in the outpainted half of the image.
Beta Was this translation helpful? Give feedback.
All reactions