Ashish Patel 🇮🇳’s Post

𝗗𝗮𝘆-𝟯𝟰𝟳 𝗖𝗼𝗺𝗽𝘂𝘁𝗲𝗿 𝗩𝗶𝘀𝗶𝗼𝗻 𝗟𝗲𝗮𝗿𝗻𝗶𝗻𝗴 𝗔𝗜 𝗿𝗲𝘀𝗲𝗮𝗿𝗰𝗵𝗲𝗿 𝗳𝗿𝗼𝗺 Picsart #AI 𝗥𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝗵𝗮𝘀 𝗽𝘂𝗯𝗹𝗶𝘀𝗵𝗲𝗱 𝗠𝗼𝗿𝗲 𝗖𝗼𝗻𝘁𝗿𝗼𝗹 𝗳𝗼𝗿 𝗙𝗿𝗲𝗲! 𝗜𝗺𝗮𝗴𝗲 𝗦𝘆𝗻𝘁𝗵𝗲𝘀𝗶𝘀 𝘄𝗶𝘁𝗵 𝗦𝗲𝗺𝗮𝗻𝘁𝗶𝗰 𝗗𝗶𝗳𝗳𝘂𝘀𝗶𝗼𝗻 𝗚𝘂𝗶𝗱𝗮𝗻𝗰𝗲 Follow me for a similar post: 🇮🇳 Ashish Patel ------------------------------------------------------------------- 𝗜𝗻𝘁𝗲𝗿𝗲𝘀𝘁𝗶𝗻𝗴 𝗙𝗮𝗰𝘁𝘀 : 🔸 Paper: 𝗠𝗼𝗿𝗲 𝗖𝗼𝗻𝘁𝗿𝗼𝗹 𝗳𝗼𝗿 𝗙𝗿𝗲𝗲! 𝗜𝗺𝗮𝗴𝗲 𝗦𝘆𝗻𝘁𝗵𝗲𝘀𝗶𝘀 𝘄𝗶𝘁𝗵 𝗦𝗲𝗺𝗮𝗻𝘁𝗶𝗰 𝗗𝗶𝗳𝗳𝘂𝘀𝗶𝗼𝗻 𝗚𝘂𝗶𝗱𝗮𝗻𝗰𝗲 🔸 This paper is published in arxiv2021. 🔸 Propose Semantic Diffusion Guidance (SDG), a unified framework for language- and image-guided image synthesis. The semantic diffusion guidance is injected into pretrained diffusion models without extra cost of re-training, and enables fine-grained control over image synthesis with image or language guidance, or both. ------------------------------------------------------------------- 𝗜𝗠𝗣𝗢𝗥𝗧𝗔𝗡𝗖𝗘 🔸 Controllable image synthesis models allow creation of diverse images based on text instructions or guidance from an example image. Recently, denoising diffusion probabilistic models have been shown to generate more realistic imagery than prior methods, and have been successfully demonstrated in unconditional and class-conditional settings.  🔸 We explore fine-grained, continuous control of this model class, and introduce a novel unified framework for semantic diffusion guidance, which allows either language or image guidance, or both. Guidance is injected into a pretrained unconditional diffusion model using the gradient of image-text or image matching scores.  🔸 We explore CLIP-based textual guidance as well as both content and style-based image guidance in a unified form. Our text-guided synthesis approach can be applied to datasets without associated text annotations. We conduct experiments on FFHQ and LSUN datasets, and show results on fine-grained text-guided image synthesis, synthesis of images related to a style or content example image, and examples with both textual and image guidance. ------------------------------------------------------------------- #computervision #artificialintelligence #innovation -------------------------------------------------------------------