Our Framework
Naively compositing the foreground over the background layer (copy-paste: $\mathcal{I}_{\text{over}} =
\mathcal{I}_{\text{fg}} \oplus \mathcal{I}_{\text{bg}}$) produces a video that lacks environmental effects
such as shadows or wakes.
Given such an input composite and an optional binary mask ($\mathcal{M}_{\text{effect}}$) indicating the
target effect regions, our model generates the desired effects within those regions.
Our method is trained on both paired and unpaired data. For unpaired data, we zero out the latent codes of $\mathcal{I}_{\text{over}}$ and $\mathcal{M}_{\text{effect}}$. (Text prompts $\mathcal{T}$ are not shown here for simplicity.)
Our method is trained on both paired and unpaired data. For unpaired data, we zero out the latent codes of $\mathcal{I}_{\text{over}}$ and $\mathcal{M}_{\text{effect}}$. (Text prompts $\mathcal{T}$ are not shown here for simplicity.)
