Goto

Collaborating Authors

 textmatch



GraphMatch: Fusing Language and Graph Representations in a Dynamic Two-Sided Work Marketplace

arXiv.org Artificial Intelligence

Recommending matches in a text-rich, dynamic two-sided marketplace presents unique challenges due to evolving content and interaction graphs. We introduce GraphMatch, a new large-scale recommendation framework that fuses pre-trained language models with graph neural networks to overcome these challenges. Unlike prior approaches centered on standalone models, GraphMatch is a comprehensive recipe built on powerful text encoders and GNNs working in tandem. It employs adversarial negative sampling alongside point-in-time subgraph training to learn representations that capture both the fine-grained semantics of evolving text and the time-sensitive structure of the graph. We evaluated extensively on interaction data from Upwork, a leading labor marketplace, at large scale, and discuss our approach towards low-latency inference suitable for real-time use. In our experiments, GraphMatch outperforms language-only and graph-only baselines on matching tasks while being efficient at runtime. These results demonstrate that unifying language and graph representations yields a highly effective solution to text-rich, dynamic two-sided recommendations, bridging the gap between powerful pretrained LMs and large-scale graphs in practice.


A Environment Details A.1 Product Scraping We use ScraperAPI [

Neural Information Processing Systems

Attributes such as "dry skin" can fit the The product title refers to y described in 3. 15 Figure 5: The Amazon Mechanical Turk interface for the instruction writing task. Table 7: Two examples of failed human trajectories. Often, the item does not contain the desired options even though the item's title The task instruction is shown at the end of Appendix. Each trajectory is then manually re-scored against a human criteria; the purpose of this is to determine how representative the reward function is of a human's judgment towards Instead of the exact matching approach, points are awarded if (1) the picked product's On the other hand, if cyan is desired as an option for a goal product, but the user picks blue even though cyan is available as a choice, then no points are awarded. Table 8 reflects our observation that our reward function is similar to a human's score, with a This under-scoring is a result of our reward function's exact matching criterion.


TextMatch: Enhancing Image-Text Consistency Through Multimodal Optimization

arXiv.org Artificial Intelligence

Text-to-image generative models excel in creating images from text but struggle with ensuring alignment and consistency between outputs and prompts. This paper introduces TextMatch, a novel framework that leverages multimodal optimization to address image-text discrepancies in text-to-image (T2I) generation and editing. TextMatch employs a scoring strategy powered by large language models (LLMs) and visual question-answering (VQA) models to evaluate semantic consistency between prompts and generated images. By integrating multimodal in-context learning and chain of thought reasoning, our method dynamically refines prompts through iterative optimization. This process ensures that the generated images better capture user intent of, resulting in higher fidelity and relevance. Extensive experiments demonstrate that TextMatch significantly improves text-image consistency across multiple benchmarks, establishing a reliable framework for advancing the capabilities of text-to-image generative models. Our code is available at https://anonymous.4open.science/r/TextMatch-F55C/.