Review for NeurIPS paper: Bongard-LOGO: A New Benchmark for Human-Level Concept Learning and Reasoning

Weaknesses: Although I appreciate the benchmark for the "concept learning" aspects that set it apart from most tasks in computer vision, I am skeptical about the type of stimuli used to measure these capabilities. The images are black-and-white drawings with fine lines. This makes the "visual recognition" part require different capabilities than what the state-of-the-art models for computer vision were designed for (natural images). The authors should first assess whether CNNs are suitable at all for this kind of visual input, regardless of the concept learning/reasoning aspects. This could be done by training a recognition task with a large training set of visual stimuli of this type (i.e. in a standard supervised setup).