Education
Podcasts: Opening our eyes - CN&CO
Over the last few weeks, I have taken a deep dive into the world of Artificial Intelligence (AI). It's a space that requires continuous learning and the blogs that I have written are just a pin prick in the vast opportunities that this space presents. In thinking about intelligence and our future, my mind starts to work through the different models that surround us โ from business models; to educational systems; and to seeing how natural systems are changing and adapting. Google defines intelligence as "the ability to acquire and apply knowledge and skills". A broad definition and I am sure it will be challenged on a few levels.
A.I. and the Future of Cheating
No matter whether you were a straight-A student at university or more a student of beer pong, it's extremely unlikely that your positive memories of college took place in an examination hall. Beyond being generally miserable, exams exacerbate anxiety and other mental health issues, and do a poor job of assessing skills like critical thinking and creativity. Time-pressured tests are used as the key filter for several prestigious professions and universities and, some argue, for no apparent good reason. Given this sad state of affairs, it should be positive to see supervised exams and tests fall slowly out of vogue. Headmasters and professors have urged that more flexible, less time-pressured assessments like essays and written assignments should replace exams.
Global Deep Learning Software Market 2019 Artelnics, Bright Computing, BAIR, Intel, Cognex, IBM, Keras โ Industry News Room
The report on the Global Deep Learning Software Market offers complete data on the Deep Learning Software market. Components, for example, main players, analysis, size, situation of the business, SWOT analysis, and best patterns in the market are included in the report. In addition to this, the report sports numbers, tables, and charts that offer a clear viewpoint of the Deep Learning Software market. The top Players/Vendors Artelnics, Bright Computing, BAIR, Intel, Cognex, IBM, Keras, Microsoft, VLFeat, NIVIDA, PaddlePaddle, Torch, SignalBox, Wolfram of the global Deep Learning Software market are further covered in the report. The latest data has been presented in the study on the revenue numbers, product details, and sales of the major firms.
Artificial intelligence is watching China's students but how well can it really see?
Almost every second of Betty Li's school life is monitored. The 22-year-old student at a university in northwestern China must get through face scanners to enter her dormitory and register attendance, while cameras above the blackboards in her classrooms keep an eye on the students' attentiveness. Like many other educational institutions across the country, the university in Xian, Shaanxi province, deployed AI-powered gates and facial recognition cameras several years ago as a part of the "smart campuses" campaign promoted by the Ministry of Education. Some schools are even exploring ways to use artificial intelligence to analyse the behaviour of teachers and students. The universities are at the forefront of a national effort to lead the world in emerging technologies and move China's economy up the value chain.
This AI can pass a 12th-grade standardized science test
Last week, researchers at the Allen Institute for Artificial Intelligence demonstrated in a new paper that an AI they'd designed could ace an eighth-grade multiple-choice science test with more than 90 percent correct answers -- and do quite well on a 12th-grade science test, too, with more than 80 percent correct answers. The system, called Aristo, took the New York Regents Science Exam (a standardized test for students across New York State), with a few limitations: it didn't have to solve the problems that involved looking at diagrams. Nonetheless, the researchers tested the program on different versions of the test as well as on tests from different years and found that its performance was pretty consistent: It's an A student. Aristo demonstrates how quickly AI is advancing. As recently as 2016, the paper's authors note, no one in the field could manage to score as well as 60 percent on a similar eighth-grade science exam.
Hierarchic Neighbors Embedding
Liu, Shenglan, Yu, Yang, Liu, Yang, Qiao, Hong, Feng, Lin, Feng, Jiashi
Manifold learning now plays a very important role in machine learning and many relevant applications. Although its superior performance in dealing with nonlinear data distribution, data sparsity is always a thorny knot. There are few researches to well handle it in manifold learning. In this paper, we propose Hierarchic Neighbors Embedding (HNE), which enhance local connection by the hierarchic combination of neighbors. After further analyzing topological connection and reconstruction performance, three different versions of HNE are given. The experimental results show that our methods work well on both synthetic data and high-dimensional real-world tasks. HNE develops the outstanding advantages in dealing with general data. Furthermore, comparing with other popular manifold learning methods, the performance on sparse samples and weak-connected manifolds is better for HNE.
AdaBoost-assisted Extreme Learning Machine for Efficient Online Sequential Classification
Chen, Yi-Ta, Chuang, Yu-Chuan, An-Yeu, null, Wu, null
In this paper, we propose an AdaBoost - assisted extreme learning machine for efficient online sequential classification (AOS - ELM) . In order to achieve better accuracy in online sequential learning scenarios, we utilize the cost - sensitive algorithm - AdaBoost, which diversifying the weak classifiers, and addin g the forgetting mechanism, which stabilizing the performance during the training procedure . Hence, AOS - ELM adapt s bet ter to sequentially arrived data compared with other voting based methods. The experim ent results show AOS - ELM can achieve 9 4.41 % accuracy on MNIST dataset, which is the theoretical accuracy bound performed by original batch learning algorithm, AdaBoost - EL M. Moreover, with the forgetting mechanism, the standard deviation of accuracy during the online sequential learning process is reduced to 8.26x.
Transfer Learning with Dynamic Distribution Adaptation
Wang, Jindong, Chen, Yiqiang, Feng, Wenjie, Yu, Han, Huang, Meiyu, Yang, Qiang
Transfer learning aims to learn robust classifiers for the target domain by leveraging knowledge from a source domain. Since the source and the target domains are usually from different distributions, existing methods mainly focus on adapting the cross-domain marginal or conditional distributions. However, in real applications, the marginal and conditional distributions usually have different contributions to the domain discrepancy. Existing methods fail to quantitatively evaluate the different importance of these two distributions, which will result in unsatisfactory transfer performance. In this paper, we propose a novel concept called Dynamic Distribution Adaptation (DDA), which is capable of quantitatively evaluating the relative importance of each distribution. DDA can be easily incorporated into the framework of structural risk minimization to solve transfer learning problems. On the basis of DDA, we propose two novel learning algorithms: (1) Manifold Dynamic Distribution Adaptation (MDDA) for traditional transfer learning, and (2) Dynamic Distribution Adaptation Network (DDAN) for deep transfer learning. Extensive experiments demonstrate that MDDA and DDAN significantly improve the transfer learning performance and setup a strong baseline over the latest deep and adversarial methods on digits recognition, sentiment analysis, and image classification. More importantly, it is shown that marginal and conditional distributions have different contributions to the domain divergence, and our DDA is able to provide good quantitative evaluation of their relative importance which leads to better performance. We believe this observation can be helpful for future research in transfer learning.
Emergent Tool Use From Multi-Agent Autocurricula
Baker, Bowen, Kanitscheider, Ingmar, Markov, Todor, Wu, Yi, Powell, Glenn, McGrew, Bob, Mordatch, Igor
Through multi-agent competition, the simple objective of hide-and-seek, and standard reinforcement learning algorithms at scale, we find that agents create a self-supervised autocurriculum inducing multiple distinct rounds of emergent strategy, many of which require sophisticated tool use and coordination. We find clear evidence of six emergent phases in agent strategy in our environment, each of which creates a new pressure for the opposing team to adapt; for instance, agents learn to build multi-object shelters using moveable boxes which in turn leads to agents discovering that they can overcome obstacles using ramps. We further provide evidence that multi-agent competition may scale better with increasing environment complexity and leads to behavior that centers around far more human-relevant skills than other self-supervised reinforcement learning methods such as intrinsic motivation. Finally, we propose transfer and fine-tuning as a way to quantitatively evaluate targeted capabilities, and we compare hide-and-seek agents to both intrinsic motivation and random initialization baselines in a suite of domain-specific intelligence tests.
Leveraging human Domain Knowledge to model an empirical Reward function for a Reinforcement Learning problem
Traditional Reinforcement Learning (RL) problems depend on an exhaustive simulation environment that models real-world physics of the problem and trains the RL agent by observing this environment. In this paper, we present a novel approach to creating an environment by modeling the reward function based on empirical rules extracted from human domain knowledge of the system under study. Using this empirical rewards function, we will build an environment and train the agent. We will first create an environment that emulates the effect of setting cabin temperature through thermostat. This is typically done in RL problems by creating an exhaustive model of the system with detailed thermodynamic study. Instead, we propose an empirical approach to model the reward function based on human domain knowledge. We will document some rules of thumb that we usually exercise as humans while setting thermostat temperature and try and model these into our reward function. This modeling of empirical human domain rules into a reward function for RL is the unique aspect of this paper. This is a continuous action space problem and using deep deterministic policy gradient (DDPG) method, we will solve for maximizing the reward function. We will create a policy network that predicts optimal temperature setpoint given external temperature and humidity.