Deep Learning
Neural Network-Based Collaborative Filtering for Question Sequencing
In the "Method" section, we present a novel approach Abstract-- E-Learning systems (ELS) and Intelligent Tutoring Systems (ITS) play a significant part in today's education Second, It can be adaptively retrained by the user's "Results" section, we present the evaluation results. The NCF got significantly better results than the EduRank with an AP I. INTRODUCTION In the "Discussion" section, we interpret (ITS) play a significant part in today's education A. Recommendation Systems in E-learning resources such as lectures, summaries, exercises, and exams. Their is generating a personalized test for a target learner. Furthermore, they used the tensor factorization algorithm to under a certain context. They applied their algorithms on the KDD difficulty, capabilities, context, learning styles, and habits.
Machine Number Sense: A Dataset of Visual Arithmetic Problems for Abstract and Relational Reasoning
Zhang, Wenhe, Zhang, Chi, Zhu, Yixin, Zhu, Song-Chun
As a comprehensive indicator of mathematical thinking and intelligence, the number sense (Dehaene 2011) bridges the induction of symbolic concepts and the competence of problem-solving. To endow such a crucial cognitive ability to machine intelligence, we propose a dataset, Machine Number Sense (MNS), consisting of visual arithmetic problems automatically generated using a grammar model--And-Or Graph (AOG). These visual arithmetic problems are in the form of geometric figures: each problem has a set of geometric shapes as its context and embedded number symbols. Solving such problems is not trivial; the machine not only has to recognize the number, but also to interpret the number with its contexts, shapes, and relations (e.g., symmetry) together with proper operations. We benchmark the MNS dataset using four predominant neural network models as baselines in this visual reasoning task. Comprehensive experiments show that current neural-network-based models still struggle to understand number concepts and relational operations. We show that a simple brute-force search algorithm could work out some of the problems without context information. Crucially, taking geometric context into account by an additional perception module would provide a sharp performance gain with fewer search steps. Altogether, we call for attention in fusing the classic search-based algorithms with modern neural networks to discover the essential number concepts in future research.
A State Aggregation Approach for Solving Knapsack Problem with Deep Reinforcement Learning
Afshar, Reza Refaei, Zhang, Yingqian, Firat, Murat, Kaymak, Uzay
This paper proposes a Deep Reinforcement Learning (DRL) approach for solving knapsack problem. The proposed method consists of a state aggregation step based on tabular reinforcement learning to extract features and construct states. The state aggregation policy is applied to each problem instance of the knapsack problem, which is used with Advantage Actor Critic (A2C) algorithm to train a policy through which the items are sequentially selected at each time step. The method is a constructive solution approach and the process of selecting items is repeated until the final solution is obtained. The experiments show that our approach provides close to optimal solutions for all tested instances, outperforms the greedy algorithm, and is able to handle larger instances and more flexible than an existing DRL approach. In addition, the results demonstrate that the proposed model with the state aggregation strategy not only gives better solutions but also learns in less timesteps, than the one without state aggregation.
Thinking While Moving: Deep Reinforcement Learning with Concurrent Control
Xiao, Ted, Jang, Eric, Kalashnikov, Dmitry, Levine, Sergey, Ibarz, Julian, Hausman, Karol, Herzog, Alexander
We study reinforcement learning in settings where sampling an action from the policy must be done concurrently with the time evolution of the controlled system, such as when a robot must decide on the next action while still performing the previous action. Much like a person or an animal, the robot must think and move at the same time, deciding on its next action before the previous one has completed. In order to develop an algorithmic framework for such concurrent control problems, we start with a continuous-time formulation of the Bellman equations, and then discretize them in a way that is aware of system delays. We instantiate this new class of approximate dynamic programming methods via a simple architectural extension to existing value-based deep reinforcement learning algorithms. We evaluate our methods on simulated benchmark tasks and a large-scale robotic grasping task where the robot must "think while moving".
PyTorch 1.5 Released: New APIs, Updated C Frontend and More - Synced
The PyTorch Team yesterday announced the release of PyTorch 1.5, along with new and updated libraries. The release features several major new API additions and improvements, including a significant update to the C frontend, Channel Last memory format for computer vision models, and a stable release of the distributed RPC framework used for model-parallel training. The C frontend API is now at parity with Python with appropriate documentation, and features previously tagged as experimental have been moved to stable versions. C optimizers now also behave identically to those in the Python API. The team has also released an experimental Channel Last memory format for computer vision models, which unlocks the ability to use performance efficient convolution algorithms and hardware such as Nvidia's Tensor Cores and FBGEMM.
AI Song Contest
The 2020 Eurovision Song Contest may have been cancelled, but fans of formulaic pop can still get their fill courtesy of the VPRO AI Song Contest. The contestants and their entries were revealed on 10 April and the public have until 10 May to cast their votes. Thirteen teams have entered, with the competition open to anyone residing in a country eligible to take part in the traditional Eurovision extravaganza. The contestants have used a variety of machine learning techniques to help create their songs, with the teams relying on computer input to different degrees. All artists were keen to stress that, rather than pressing a button and letting their trained algorithms create the entire piece, their work is a result of collaboration between AI and humans.
Expanding Sparse Guidance for Stereo Matching
Huang, Yu-Kai, Liu, Yueh-Cheng, Wu, Tsung-Han, Su, Hung-Ting, Hsu, Winston H.
The performance of image based stereo estimation suffers from lighting variations, repetitive patterns and homogeneous appearance. Moreover, to achieve good performance, stereo supervision requires sufficient densely-labeled data, which are hard to obtain. In this work, we leverage small amount of data with very sparse but accurate disparity cues from LiDAR to bridge the gap. We propose a novel sparsity expansion technique to expand the sparse cues concerning RGB images for local feature enhancement. The feature enhancement method can be easily applied to any stereo estimation algorithms with cost volume at the test stage. Extensive experiments on stereo datasets demonstrate the effectiveness and robustness across different backbones on domain adaption and self-supervision scenario. Our sparsity expansion method outperforms previous methods in terms of disparity by more than 2 pixel error on KITTI Stereo 2012 and 3 pixel error on KITTI Stereo 2015. Our approach significantly boosts the existing state-of-the-art stereo algorithms with extremely sparse cues.
Extending and Analyzing Self-Supervised Learning Across Domains
Wallace, Bram, Hariharan, Bharath
Self-supervised representation learning has achieved impressive results in recent years, with experiments primarily coming on ImageNet or other similarly large internet imagery datasets. There has been little to no work with these methods on other smaller domains, such as satellite, textural, or biological imagery. We experiment with several popular methods on an unprecedented variety of domains. We discover, among other findings, that Rotation is by far the most semantically meaningful task, with much of the performance of Jigsaw and Instance Discrimination being attributable to the nature of their induced distribution rather than semantic understanding. Additionally, there are several areas, such as fine-grain classification, where all tasks underperform. We quantitatively and qualitatively diagnose the reasons for these failures and successes via novel experiments studying pretext generalization, random labelings, and implicit dimensionality. Code and models are available at https://github.com/BramSW/Extending_SSRL_Across_Domains/.