cala
CaLa: Complementary Association Learning for Augmenting Composed Image Retrieval
Jiang, Xintong, Wang, Yaxiong, Li, Mengjian, Wu, Yujiao, Hu, Bingwen, Qian, Xueming
Composed Image Retrieval (CIR) involves searching for target images based on an image-text pair query. While current methods treat this as a query-target matching problem, we argue that CIR triplets contain additional associations beyond this primary relation. In our paper, we identify two new relations within triplets, treating each triplet as a graph node. Firstly, we introduce the concept of text-bridged image alignment, where the query text serves as a bridge between the query image and the target image. We propose a hinge-based cross-attention mechanism to incorporate this relation into network learning. Secondly, we explore complementary text reasoning, considering CIR as a form of cross-modal retrieval where two images compose to reason about complementary text. To integrate these perspectives effectively, we design a twin attention-based compositor. By combining these complementary associations with the explicit query pair-target image relation, we establish a comprehensive set of constraints for CIR. Our framework, CaLa (Complementary Association Learning for Augmenting Composed Image Retrieval), leverages these insights. We evaluate CaLa on CIRR and FashionIQ benchmarks with multiple backbones, demonstrating its superiority in composed image retrieval.
- North America > United States > District of Columbia > Washington (0.05)
- Asia > China > Shaanxi Province > Xi'an (0.04)
- Asia > China > Anhui Province > Hefei (0.04)
- (12 more...)
AI-Generated Fashion Is Next Wave of DIY Design G.R. Jenkin & Associat
AI-Generated Fashion Is Next Wave of DIY Design Share Search: Explore by topic FOR THE TECHNOLOGY INSIDER Topics Follow IEEE Spectrum Support IEEE Spectrum IEEE Spectrum is the flagship publication of the IEEE -- the world's largest professional organization devoted to engineering and applied sciences. Our articles, podcasts, and infographics inform our readers about developments in technology, engineering, and science. A not-for-profit organization, IEEE is the world's largest technical professional organization dedicated to advancing technology for the benefit of humanity. IEEE websites place cookies on your device to give you the best user experience. By using our websites, you agree to the placement of these cookies. To learn more, read our Privacy Policy. Enjoy more free content and benefits by creating an account Saving articles to read later requires an IEEE Spectrum account The Institute content is only available for members Downloading full PDF issues is exclusive for IEEE Members Access to Spectrum's Digital Edition is exclusive for IEEE Members Following topics is a feature exclusive for IEEE Members Adding your response to an article requires an IEEE Spectrum account Create an account to access more content and features on IEEE Spectrum, including the ability to save articles to read later, download Spectrum Collections, and participate in conversations with readers and editors. For more exclusive content and features, consider Joining IEEE . Join the world's largest professional organization devoted to engineering and applied sciences and get access to all of Spectrum's articles, archives, PDF downloads, and other benefits.
- North America > United States > Virginia (0.05)
- North America > United States > District of Columbia > Washington (0.04)
- Europe > United Kingdom (0.04)
- (11 more...)
- Government > Regional Government > North America Government > United States Government (1.00)
- Aerospace & Defense (1.00)
- Government > Military > Navy (0.71)
AI Is Designing Clothes Now
When scenes created by the AI image generator DALL-E started circulating online earlier this year, it seemed inevitable that someone would turn the technology to fashion. DALL-E is part of a new crop of AI capable of creating extraordinarily detailed and realistic imagery from a text prompt, making it easy for anyone to use. Artists have quickly begun applying these programs to creating digital art, with one piece conjured up by the program Midjourney even beating out its human-generated competition for a prize. The same power could easily be used to whip up clothing designs. The idea is already becoming reality.
OpenAI offers early look at DALL-E API, showcases text-to-image use case
Did you miss a session from MetaBeat 2022? Head over to the on-demand library for all of our featured sessions here. The DALL-E API won't be officially announced until later this fall, according to OpenAI, but today the company shared details about a customer already leveraging the DALL-E API for a specific enterprise use case. New York City-based Cala, a startup that bills itself as the "world's first operating system for fashion," offers a digital platform (including a mobile app launched in March) that allows creators to design and produce clothing lines, unifying the process from product ideation through order fulfillment. With the addition of DALL-E-powered text-to-image generating tools, users can generate new visual design ideas from natural text descriptions or uploaded reference images – which the company says are first-of-its-kind capabilities for the fashion industry.