Information Retrieval
Push-pull Feedback Implements Hierarchical Information Retrieval Efficiently
Liu, Xiao, Zou, Xiaolong, Ji, Zilong, Tian, Gengshuo, Mi, Yuanyuan, Huang, Tiejun, Wong, K. Y. Michael, Wu, Si
Experimental data has revealed that in addition to feedforward connections, there exist abundant feedback connections in a neural pathway. Although the importance of feedback in neural information processing has been widely recognized in the field, the detailed mechanism of how it works remains largely unknown. Here, we investigate the role of feedback in hierarchical information retrieval. Specifically, we consider a hierarchical network storing the hierarchical categorical information of objects, and information retrieval goes from rough to fine, aided by dynamical push-pull feedback from higher to lower layers. We elucidate that the push (positive) and pull (negative) feedbacks suppress the interferences due to neural correlations between different and the same categories, respectively, and their joint effect improves retrieval performance significantly.
Drill-down: Interactive Retrieval of Complex Scenes using Natural Language Queries
Tan, Fuwen, Cascante-Bonilla, Paola, Guo, Xiaoxiao, Wu, Hui, Feng, Song, Ordonez, Vicente
This paper explores the task of interactive image retrieval using natural language queries, where a user progressively provides input queries to refine a set of retrieval results. Moreover, our work explores this problem in the context of complex image scenes containing multiple objects. We propose Drill-down, an effective framework for encoding multiple queries with an efficient compact state representation that significantly extends current methods for single-round image retrieval. We show that using multiple rounds of natural language queries as input can be surprisingly effective to find arbitrarily specific images of complex scenes. Furthermore, we find that existing image datasets with textual captions can provide a surprisingly effective form of weak supervision for this task.
Hierarchical Optimal Transport for Document Representation
Yurochkin, Mikhail, Claici, Sebastian, Chien, Edward, Mirzazadeh, Farzaneh, Solomon, Justin M.
The ability to measure similarity between documents enables intelligent summarization and analysis of large corpora. Past distances between documents suffer from either an inability to incorporate semantic similarities between words or from scalability issues. As an alternative, we introduce hierarchical optimal transport as a meta-distance between documents, where documents are modeled as distributions over topics, which themselves are modeled as distributions over words. We then solve an optimal transport problem on the smaller topic space to compute a similarity score. We give conditions on the topics under which this construction defines a distance, and we relate it to the word mover's distance.
5 Strategic Uses for AI in Ecommerce Lionbridge AI
The implementation of AI in ecommerce should come as no surprise. Online businesses have always been quick to adopt new technologies, and this is how the industry thrives; enhancing the customer experience, discovering new markets, and driving further sales. And with the continued development of AI technology like chatbots, visual search, and personalized recommendations, the world of ecommerce is transforming again. But just how effective and useful is AI-powered tech? Where is it being used? In this article, we'll look at the most popular implementations of AI in ecommerce to determine what they do, how they are being used, and first steps for practical application.
Optimizing Revenue while showing Relevant Assortments at Scale
Tulabandhula, Theja, Sinha, Deeksha
Scalable real-time assortment optimization has become essential in e-commerce operations due to the need for personalization and the availability of a large variety of items. While this can be done when there are simplistic assortment choices to be made, imposing constraints on the collection of feasible assortments gives more flexibility to incorporate insights of store-managers and historically well-performing assortments. We design fast and flexible algorithms based on variations of binary search that find the revenue of the (approximately) optimal assortment. In particular, we revisit the problem of large-scale assortment optimization under the multinomial logit choice model without any assumptions on the structure of the feasible assortments. We speed up the comparisons steps using novel vector space embeddings, based on advances in the fields of information retrieval and machine learning. For an arbitrary collection of assortments, our algorithms can find a solution in time that is sub-linear in the number of assortments and for the simpler case of cardinality constraints - linear in the number of items (existing methods are quadratic or worse). Empirical validations using the Billion Prices dataset and several retail transaction datasets show that our algorithms are competitive even when the number of items is $\sim 10^5$ ($100$x larger instances than previously studied).
A Framework for Searching in Graphs in the Presence of Errors
Dereniowski, Dariusz, Tiegel, Stefan, Uznaลski, Przemysลaw, Wolleb-Graf, Daniel
We consider the problem of searching for an unknown target vertex $t$ in a (possibly edge-weighted) graph. Each \emph{vertex-query} points to a vertex $v$ and the response either admits $v$ is the target or provides any neighbor $s\not=v$ that lies on a shortest path from $v$ to $t$. This model has been introduced for trees by Onak and Parys [FOCS 2006] and for general graphs by Emamjomeh-Zadeh et al. [STOC 2016]. In the latter, the authors provide algorithms for the error-less case and for the independent noise model (where each query independently receives an erroneous answer with known probability $p<1/2$ and a correct one with probability $1-p$). We study this problem in both adversarial errors and independent noise models. First, we show an algorithm that needs $\frac{\log_2 n}{1 - H(r)}$ queries against \emph{adversarial} errors, where adversary is bounded with its rate of errors by a known constant $r<1/2$. Our algorithm is in fact a simplification of previous work, and our refinement lies in invoking amortization argument. We then show that our algorithm coupled with Chernoff bound argument leads to an algorithm for independent noise that is simpler and with a query complexity that is both simpler and asymptotically better to one of Emamjomeh-Zadeh et al. [STOC 2016]. Our approach has a wide range of applications. First, it improves and simplifies Robust Interactive Learning framework proposed by Emamjomeh-Zadeh et al. [NIPS 2017]. Secondly, performing analogous analysis for \emph{edge-queries} (where query to edge $e$ returns its endpoint that is closer to target) we actually recover (as a special case) noisy binary search algorithm that is asymptotically optimal, matching the complexity of Feige et al. [SIAM J. Comput. 1994]. Thirdly, we improve and simplify upon existing algorithm for searching of \emph{unbounded} domains due to Aslam and Dhagat [STOC 1991].
Ask a question? AI model provides answers from your web pages! Right from your search box.
SearchAI Answers is an Artificial Intelligence as a Service (AIaaS) service from SearchBlox that offers direct answers to natural language search queries using an AI model built using the customers' content, without the need for any manual tagging or a domain specific taxonomy or creating a knowledge graph. Search Engines as Question Answering (QA) Engines will replace the traditional approach of information retrieval where we are presented with a list of search results links. What is driving the transformation from search to answers? โข New generation of searchers using Siri, Echo & Google Assistant using voice as a primary channel of getting information โข Want to ask direct questions and receive direct answers โข Ask questions in natural language or a conversational manner โข Need concise, relevant and context based domain specific answers SearchAI Answers use explicit and implicit feedback to continually improve the quality of answers using MLOps. What are the business benefits of using SearchAI Answers on your website or portal? Contact us to get started and we will have you running our AI service very quickly.
Using Image Captions and Multitask Learning for Recommending Query Reformulations
Verma, Gaurav, Vinay, Vishwa, Bansal, Sahil, Oberoi, Shashank, Sharma, Makkunda, Gupta, Prakhar
Interactive search sessions often contain multiple queries, where the user submits a reformulated version of the previous query in response to the original results. We aim to enhance the query recommendation experience for a commercial image search engine. Our proposed methodology incorporates current state-of-the-art practices from relevant literature -- the use of generation-based sequence-to-sequence models that capture session context, and a multitask architecture that simultaneously optimizes the ranking of results. We extend this setup by driving the learning of such a model with captions of clicked images as the target, instead of using the subsequent query within the session. Since these captions tend to be linguistically richer, the reformulation mechanism can be seen as assistance to construct more descriptive queries. In addition, via the use of a pairwise loss for the secondary ranking task, we show that the generated reformulations are more diverse.
Regret Minimization in Stochastic Contextual Dueling Bandits
Saha, Aadirupa, Gopalan, Aditya
We consider the problem of stochastic $K$-armed dueling bandit in the contextual setting, where at each round the learner is presented with a context set of $K$ items, each represented by a $d$-dimensional feature vector, and the goal of the learner is to identify the best arm of each context sets. However, unlike the classical contextual bandit setup, our framework only allows the learner to receive item feedback in terms of their (noisy) pariwise preferences--famously studied as dueling bandits which is practical interests in various online decision making scenarios, e.g. recommender systems, information retrieval, tournament ranking, where it is easier to elicit the relative strength of the items instead of their absolute scores. However, to the best of our knowledge this work is the first to consider the problem of regret minimization of contextual dueling bandits for potentially infinite decision spaces and gives provably optimal algorithms along with a matching lower bound analysis. We present two algorithms for the setup with respective regret guarantees $\tilde O(d\sqrt{T})$ and $\tilde O(\sqrt{dT \log K})$. Subsequently we also show that $\Omega(\sqrt {dT})$ is actually the fundamental performance limit for this problem, implying the optimality of our second algorithm. However the analysis of our first algorithm is comparatively simpler, and it is often shown to outperform the former empirically. Finally, we corroborate all the theoretical results with suitable experiments.
Hunt through satellite images of Earth with an AI search engine
Artificial intelligence can now rapidly search through billions of aerial and satellite images to find similar buildings or land features, such as football fields and Arctic ponds. This capability could help researchers classify the amount of land taken up by forests or farms, or could be used by militaries to identify bases or specific weapons used by other countries.