AMICO: Amodal Instance Composition
Zhuang, Peiye, Huang, Jia-bin, Saraf, Ayush, Rong, Xuejian, Kim, Changil, Demandolx, Denis
–arXiv.org Artificial Intelligence
Image composition aims to blend multiple objects to form a harmonized image. Existing approaches often assume precisely segmented and intact objects. Such assumptions, however, are hard to satisfy in unconstrained scenarios. We present Amodal Instance Composition for compositing imperfect -- potentially incomplete and/or coarsely segmented -- objects onto a target image. We first develop object shape prediction and content completion modules to synthesize the amodal contents. We then propose a neural composition model to blend the objects seamlessly. Our primary technical novelty lies in using separate foreground/background representations and blending mask prediction to alleviate segmentation errors. Our results show state-of-the-art performance on public COCOA and KINS benchmarks and attain favorable visual results across diverse scenes. We demonstrate various image composition applications such as object insertion and de-occlusion.
arXiv.org Artificial Intelligence
Oct-11-2022
- Country:
- North America > United States
- Maryland > Prince George's County
- College Park (0.04)
- Illinois > Champaign County
- Urbana (0.04)
- Maryland > Prince George's County
- Asia > Japan
- Honshū > Chūbu > Toyama Prefecture > Toyama (0.04)
- North America > United States
- Genre:
- Research Report > New Finding (0.68)
- Technology: