The ActiveCrowdToolkit: An Open-Source Tool for Benchmarking Active Learning Algorithms for Crowdsourcing Research

Figure Crowdsourcing systems are commonly faced with the challenge 1 (a) shows the interface which allows researchers to set of making online decisions by assigning tasks to workers up experiments which run multiple active learning strategies in order to maximise accuracy while also minimising over a single dataset. Using this dialog, the user can construct cost. To aid researchers to reproduce, benchmark and extend an active learning strategy by combining an aggregation state-of-the-art active learning methods for crowdsourcing model, a task selection method and a worker selection systems, we developed the open-source.NET ActiveCrowd-method. The user can also select the number of judgements Toolkit.