Goto

Collaborating Authors

 selectal


How to Select Which Active Learning Strategy is Best Suited for Y our Specific Problem and Budget Guy Hacohen, Daphna Weinshall School of Computer Science & Engineering

Neural Information Processing Systems

In the traditional supervised learning framework, active learning enables the learner to actively engage in the construction of the labeled training set by selecting a fixed-sized subset of unlabeled examples for labeling by an oracle, where the number of labels requested is referred to as the budget .



How to Select Which Active Learning Strategy is Best Suited for Your Specific Problem and Budget

Hacohen, Guy, Weinshall, Daphna

arXiv.org Artificial Intelligence

In the domain of Active Learning (AL), a learner actively selects which unlabeled examples to seek labels from an oracle, while operating within predefined budget constraints. Importantly, it has been recently shown that distinct query strategies are better suited for different conditions and budgetary constraints. In practice, the determination of the most appropriate AL strategy for a given situation remains an open problem. To tackle this challenge, we propose a practical derivative-based method that dynamically identifies the best strategy for a given budget. Intuitive motivation for our approach is provided by the theoretical analysis of a simplified scenario. We then introduce a method to dynamically select an AL strategy, which takes into account the unique characteristics of the problem and the available budget.