Education
Learning definable hypotheses on trees
Grienenberger, Emilie, Ritzert, Martin
We study the problem of learning properties of nodes in tree structures. Those properties are specified by logical formulas, such as formulas from first-order or monadic second-order logic. We think of the tree as a database encoding a large dataset and therefore aim for learning algorithms which depend at most sublinearly on the size of the tree. We present a learning algorithm for quantifier-free formulas where the running time only depends polynomially on the number of training examples, but not on the size of the background structure. By a previous result on strings we know that for general first-order or monadic second-order (MSO) formulas a sublinear running time cannot be achieved. However, we show that by building an index on the tree in a linear time preprocessing phase, we can achieve a learning algorithm for MSO formulas with a logarithmic learning phase.
Software architecture for YOLO, a creativity-stimulating robot
Alves-Oliveira, Patrícia, Gomes, Samuel, Chandak, Ankita, Arriaga, Patrícia, Hoffman, Guy, Paiva, Ana
YOLO is a social robot designed and developed to stimulate creativity in children through storytelling activities. Children use it as a character in their stories. This article details the artificial intelligence software developed for YOLO. The implemented software schedules through several Creativity Behaviors to find the ones that stimulate creativity more effectively. YOLO can choose between convergent and divergent thinking techniques, two important processes of creative thought. These techniques were developed based on the psychological theories of creativity development and on research from creativity experts who work with children. Additionally, this software allows the creation of Social Behaviors that enable the robot to behave as a believable character. On top of our framework, we built 3 main social behavior parameters: Exuberant, Aloof, and Harmonious. These behaviors are meant to ease immersive play and the process of character creation. The 3 social behaviors were based on psychological theories of personality and developed using children's input during co-design studies. Overall, this work presents an attempt to design, develop, and deploy social robots that nurture intrinsic human abilities, such as the ability to be creative.
FEED: Feature-level Ensemble for Knowledge Distillation
Knowledge Distillation (KD) aims to transfer knowledge in a teacher-student framework, by providing the predictions of the teacher network to the student network in the training stage to help the student network generalize better. It can use either a teacher with high capacity or {an} ensemble of multiple teachers. However, the latter is not convenient when one wants to use feature-map-based distillation methods. For a solution, this paper proposes a versatile and powerful training algorithm named FEature-level Ensemble for knowledge Distillation (FEED), which aims to transfer the ensemble knowledge using multiple teacher networks. We introduce a couple of training algorithms that transfer ensemble knowledge to the student at the feature map level. Among the feature-map-based distillation methods, using several non-linear transformations in parallel for transferring the knowledge of the multiple teacher{s} helps the student find more generalized solutions. We name this method as parallel FEED, andexperimental results on CIFAR-100 and ImageNet show that our method has clear performance enhancements, without introducing any additional parameters or computations at test time. We also show the experimental results of sequentially feeding teacher's information to the student, hence the name sequential FEED, and discuss the lessons obtained. Additionally, the empirical results on measuring the reconstruction errors at the feature map give hints for the enhancements.
TinyBERT: Distilling BERT for Natural Language Understanding
Jiao, Xiaoqi, Yin, Yichun, Shang, Lifeng, Jiang, Xin, Chen, Xiao, Li, Linlin, Wang, Fang, Liu, Qun
Language model pre-training, such as BERT, has significantly improved the performances of many natural language processing tasks. However, pre-trained language models are usually computationally expensive and memory intensive, so it is difficult to effectively execute them on some resource-restricted devices. To accelerate inference and reduce model size while maintaining accuracy, we firstly propose a novel transformer distillation method that is a specially designed knowledge distillation (KD) method for transformer-based models. By leveraging this new KD method, the plenty of knowledge encoded in a large teacher BERT can be well transferred to a small student TinyBERT. Moreover, we introduce a new two-stage learning framework for TinyBERT, which performs transformer distillation at both the pre-training and task-specific learning stages. This framework ensures that TinyBERT can capture both the general-domain and task-specific knowledge of the teacher BERT. TinyBERT is empirically effective and achieves comparable results with BERT in GLUE datasets, while being 7.5x smaller and 9.4x faster on inference. TinyBERT is also significantly better than state-of-the-art baselines, even with only about 28% parameters and 31% inference time of baselines.
Guide to AI: How Artificial Intelligence is Changing The Business World - Calendar
Despite its role in early 20th-century fiction, AI has been part of the professional conversation for barely 70 years. AI was first studied at a Dartmouth College conference in 1956. The 1960's saw gains in machine translation and analysis. But AI underwent a "winter" from the 1970s through the early '90s. Researchers shelved their work largely because of the problem of "combinatorial explosion." A U.K. professor who first described the AI concept worried that too many variables would make it useless outside of lab settings. In the early '70s, groups like the U.S. Defense Advanced Research Projects Agency pulled funding. Research failures had become the norm. Interest in AI grew during the 1990s and early 2000's. Processing power and data volumes increased. At the same time, data sets grew massively. Algorithms gained more "meat" on which to train. Advances in game theory and data modeling led to new approaches. Today, best-in-class infrastructures can support 100,000 or more computers. Two-and-a-half quintillion bytes of data are now generated every day. Globally, private firms are spending tens of billions of dollars per year researching and improving AI initiatives. In fact, 2018's investment amount is more than 50 percent larger than last year's alone. Add it all up, and AI seems ready for a leap forward unlike any seen in its history. But, after slow decades followed by speedy discoveries, few outside the field feel they truly understand it. A recent Dell Technologies report found that 67 percent of leaders said their companies were struggling to implement AI. A similar two out of three consumers don't even realize they're using it, according to a HubSpot survey. "By far the greatest danger of artificial intelligence is that people conclude too early that they understand it."
12 Deep Learning Researchers and Leaders
Having first appeared on the scene of machine learning in 1986 and artificial neural networks in 2000, the study of deep learning continues to explode with new research, advanced techniques, higher benchmarks, and broader applications. Keeping pace in such an active field with an average of 30 new deep learning papers uploaded to arXiv per day over the previous month is daunting, to say the least. While there are many key deep learning scientists and engineers active today, the following list of 12 researchers and innovators in the field are among the most important – and they so happen to actively share on social media, making their progress and insights much easier to keep up with. So, start paying attention to these 12 top deep learning individuals, and be prepared to expand your understanding and awareness of the incredible advancements deep learning is bringing to science, industry, and society. While it in no way correlates to everyone's contribution to the field, the list is sorted by the number of Twitter followers so you can see who appears to have the most reach today.
Top Countries Shaken Up, Fearing AI Will Snatch Away Their Jobs
Recently, a study indicated UK workers fearing artificial intelligence to eliminate their jobs. Is AI going to steal away our jobs or is it all a hype? We're undergoing a technology revolution experiencing breathless stories about how artificial intelligence is going to replace our jobs. Are these signs of artificial intelligence apocalypse? Is there anything at all that reveals the AI phenomenon or is it just an image of a boogeyman trying to scare us into line?
Coursera Cofounder Daphne Koller Melds AI And Biology In Drug Startup Insitro
Renowned machine learning expert Daphne Koller is the founder and CEO of drug discovery company Insitro. Daphne Koller talks fast, punctuating her words with gesticular flourishes as she shows off lab equipment through big glass windows in her South San Francisco offices. Along with a standard DNA sequencer, there's a high-powered microscope with automatic imaging and a machine that replaces manual pipetting by using ultrasonic acoustic energy to transfer fluids. The fancy gear is part of a robo-lab that provides the foundation for Koller's startup, Insitro. The ex-Stanford University computer science professor, MacArthur Fellow and cofounder of online education unicorn Coursera created Insitro to completely rethink the expensive, time-intensive drug discovery process.
City's Artificial Intelligence Research Centre and Institute for Cyber Security to lead Doctoral Training Programs
Supported by the European digital innovation and entrepreneurial education organization EIT Digital, City, University of London's Artificial Intelligence Research Centre (CitAI) and Institute for Cyber Security (ICS) will lead two new Doctoral Training Programs (DTPs). Starting in the 2019-2020 academic year will be a DTP in Artificial Intelligence (AI). This will enable the commercial deployment of AI technology in Europe and other regions by developing critical interdisciplinary capabilities in AI technology, particularly, though not exclusively in machine (deep) learning and explainable AI, with applications for solving real-life industrial problems. Dr Eduardo Alonso, Director of City's Artificial Intelligence Research Centre (CitAI) and lead for City's Master's programme in AI, will oversee this DTP. This program will be carried out in partnership with founding partners Delta Capital Ltd, Telefónica Innovación Alpha SL and Bosch AA-AS.
Elearning, LMS, Online courses & tutorials in Abuja Nigeria
Every student success is dependent on an accommodating, secure, challenging and academically robust learning environment. Life Learners E-Store is one the leading online store for the latest ICT Gadgets. At Life Learners, our Training program and courses are aimed at increasing knowledge in various ICT fields so as to develop a community of certified professionals. Life Learners eLearning platform offers up-to-date practice tests on UTME, NECO & WAEC as well as professional job interviews.