Education
Udacity intends to double headcount in India
New Delhi: Silicon Valley-based learning platform Udacity with respect to Monday said it intends to double the headcount at its New Delhi office to help its growth student and enterprise customer base in India. The organization trains laborers on cutting edge abilities, for example, Artificial Intelligence, Machine Learning, robotization, profound learning, information investigation, through its Nanodegree programs. "India is quick ascending as a conspicuous advanced first economy. Because of this quick digitisation crosswise over ventures, there is a flooding interest for new-age experts capable in cutting edge innovations, for example, AI, AI, mechanization, profound learning, information investigation, and so forth.," Udacity CEO Gabriel Dalporto said in an announcement.
Workforce 4.0: The Human Side of Digital Transformation - Chemical Engineering
Chemical process industries (CPI) companies are entering a critical stage in the movement toward digitalization (Industry 4.0), in which the majority of organizations are now initiating pilot projects aimed at improving operations with advanced digital tools. This includes a wide range of technologies, including data analytics, cloud computing, machine learning, artificial intelligence and many others. As the digitalization transformation of the CPI gains momentum, it has become clear that the movement is as much about people as it is about technology. The acceptance and involvement of workers is critical to the successful adoption and expansion of digital tools, as they are asked to adapt to new work practices. He emphasizes: "Companies don't adopt new technologies; people do."
Technology Labs podcast: Episode 4 - Artificial Intelligence Testing
Technology leads podcast is a podcast with three hosts Tom, Daniel, and Rik. Each episode has a guest that will be interviewed. The podcast starts with a couple of interesting tech updates. We question whether these are still podcasts or more leaning towards the audiobook genre. Remote controlling your car with an app is nice, but what if you rent a car and a previous customer can still control it!
Large scale representation learning from triplet comparisons
Haghiri, Siavash, Vankadara, Leena Chennuru, von Luxburg, Ulrike
In this paper, we discuss the fundamental problem of representation learning from a new perspective. It has been observed in many supervised/unsupervised DNNs that the final layer of the network often provides an informative representation for many tasks, even though the network has been trained to perform a particular task. The common ingredient in all previous studies is a low-level feature representation for items, for example, RGB values of images in the image context. In the present work, we assume that no meaningful representation of the items is given. Instead, we are provided with the answers to some triplet comparisons of the following form: Is item A more similar to item B or item C? We provide a fast algorithm based on DNNs that constructs a Euclidean representation for the items, using solely the answers to the above-mentioned triplet comparisons. This problem has been studied in a sub-community of machine learning by the name "Ordinal Embedding". Previous approaches to the problem are painfully slow and cannot scale to larger datasets. We demonstrate that our proposed approach is significantly faster than available methods, and can scale to real-world large datasets. Thereby, we also draw attention to the less explored idea of using neural networks to directly, approximately solve non-convex, NPhard optimization problems that arise naturally in unsupervised learning problems. It has been widely recognized that deep neural networks (DNN) provide a powerful tool for representation learning (Bengio et al., 2013). Representations learned in an unsupervised fashion have been demonstrated to be useful in learning tasks such as classification (Ranzato et al., 2007; 2008; Hinton & Salakhutdinov, 2008; Hinton et al., 2006; Bengio et al., 2007). In the context of supervised learning, representations are typically learned as byproducts in neural networks (Radford et al., 2015). For example in image classification, low level representations of inputs (e.g., rgb values) are fed to a network, together with class label information, the network is trained to perform some supervised classification. As a byproduct it discovers a condensed data representation in the last hidden layers of the network that turns out to be surprisingly successful for other computer vision tasks such as object detection or semantic segmentation (Girshick et al., 2014; K ummerer et al., 2014; Long et al., 2015; Ren et al., 2015).
Continuous Online Learning and New Insights to Online Imitation Learning
Lee, Jonathan, Cheng, Ching-An, Goldberg, Ken, Boots, Byron
Online learning is a powerful tool for analyzing iterative algorithms. However, the classic adversarial setup sometimes fails to capture certain regularity in online problems in practice. Motivated by this, we establish a new setup, called Continuous Online Learning (COL), where the gradient of online loss function changes continuously across rounds with respect to the learner's decisions. We show that COL covers and more appropriately describes many interesting applications, from general equilibrium problems (EPs) to optimization in episodic MDPs. Using this new setup, we revisit the difficulty of achieving sublinear dynamic regret. We prove that there is a fundamental equivalence between achieving sublinear dynamic regret in COL and solving certain EPs, and we present a reduction from dynamic regret to both static regret and convergence rate of the associated EP. At the end, we specialize these new insights into online imitation learning and show improved understanding of its learning stability.
Overcoming Catastrophic Forgetting by Generative Regularization
Chen, Patrick H., Wei, Wei, Cho-jui, null, Hsieh, null, Dai, Bo
In this paper, we propose a new method to overcome catastrophic forgetting by adding generative regularization to Bayesian inference framework. We could construct generative regularization term for all given models by leveraging Energy-based models and Langevin-Dynamic sampling. By combining discriminative and generative loss together, we show that this intuitively provides a better posterior formulation in Bayesian inference. Experimental results show that the proposed method outperforms state of-the-art methods on a variety of tasks, avoiding catastrophic forgetting in continual learning. In particular, the proposed method outperforms previous methos over 10$\%$ in Fashion-MNIST dataset.
A Contextual-Bandit Approach to Online Learning to Rank for Relevance and Diversity
Li, Chang, Feng, Haoyun, de Rijke, Maarten
Online learning to rank (LTR) focuses on learning a policy from user interactions that builds a list of items sorted in decreasing order of the item utility. It is a core area in modern interactive systems, such as search engines, recommender systems, or conversational assistants. Previous online LTR approaches either assume the relevance of an item in the list to be independent of other items in the list or the relevance of an item to be a submodular function of the utility of the list. The former type of approach may result in a list of low diversity that has relevant items covering the same aspects, while the latter approaches may lead to a highly diversified list but with some non-relevant items. In this paper, we study an online LTR problem that considers both item relevance and topical diversity. We assume cascading user behavior, where a user browses the displayed list of items from top to bottom and clicks the first attractive item and stops browsing the rest. We propose a hybrid contextual bandit approach, called CascadeHybrid, for solving this problem. CascadeHybrid models item relevance and topical diversity using two independent functions and simultaneously learns those functions from user click feedback. We derive a gap-free bound on the n-step regret of CascadeHybrid. We conduct experiments to evaluate CascadeHybrid on the MovieLens and Yahoo music datasets. Our experimental results show that CascadeHybrid outperforms the baselines on both datasets.
Ontologies for the Virtual Materials Marketplace
Horsch, Martin Thomas, Chiacchiera, Silvia, Seaton, Michael A., Todorov, Ilian T., Šindelka, Karel, Lísal, Martin, Andreon, Barbara, Kaiser, Esteban Bayro, Mogni, Gabriele, Goldbeck, Gerhard, Kunze, Ralf, Summer, Georg, Fiseni, Andreas, Brüning, Hauke, Schiffels, Peter, Cavalcanti, Welchy Leite
The Virtual Materials Marketplace (VIMMP) project, which develops an open platform for providing and accessing services related to materials modelling, is presented with a focus on its ontology development and data technology aspects. Within VIMMP, a system of marketplace-level ontologies is developed to characterize services, models, and interactions between users; the European Materials and Modelling Ontology (EMMO), which is based on mereotopology following Varzi and semiotics following Peirce, is employed as a top-level ontology. The ontologies are used to annotate data that are stored in the ZONTAL Space component of VIMMP and to support the ingest and retrieval of data and metadata at the VIMMP marketplace frontend.
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks
Shridhar, Mohit, Thomason, Jesse, Gordon, Daniel, Bisk, Yonatan, Han, Winson, Mottaghi, Roozbeh, Zettlemoyer, Luke, Fox, Dieter
We present ALFRED (Action Learning From Realistic Environments and Directives), a benchmark for learning a mapping from natural language instructions and egocentric vision to sequences of actions for household tasks. Long composition rollouts with non-reversible state changes are among the phenomena we include to shrink the gap between research benchmarks and real-world applications. ALFRED consists of expert demonstrations in interactive visual environments for 25k natural language directives. These directives contain both high-level goals like "Rinse off a mug and place it in the coffee maker." and low-level language instructions like "Walk to the coffee maker on the right." ALFRED tasks are more complex in terms of sequence length, action space, and language than existing vision-and-language task datasets. We show that a baseline model designed for recent embodied vision-and-language tasks performs poorly on ALFRED, suggesting that there is significant room for developing innovative grounded visual language understanding models with this benchmark.
Towards an Integrative Educational Recommender for Lifelong Learners
Bulathwela, Sahan, Perez-Ortiz, Maria, Yilmaz, Emine, Shawe-Taylor, John
One of the most ambitious use cases of computer-assisted learning is to build a recommendation system for lifelong learning. Most recommender algorithms exploit similarities between content and users, overseeing the necessity to leverage sensible learning trajectories for the learner. Lifelong learning thus presents unique challenges, requiring scalable and transparent models that can account for learner knowledge and content novelty simultaneously, while also retaining accurate learners representations for long periods of time. We attempt to build a novel educational recommender, that relies on an integrative approach combining multiple drivers of learners engagement. Our first step towards this goal is TrueLearn, which models content novelty and background knowledge of learners and achieves promising performance while retaining a human interpretable learner model.