Europe
Deep Learning Architectures and Applications Udemy
This video course presents deep learning architectures coded in Python using Keras, a modular neural network library that runs on top of either Google's TensorFlow or Lisa Lab's Theano backends. This video course introduces Generative Adversarial Networks (GANs) that are used to reproduce synthetic data that looks like data generated by humans, and then teach how to forge the MNIST and CIFAR-10 dataset with the help of Keras Adversarial GANs. Practical applications include code for predicting the surrounding words given the current word, sentiment analysis, and synthetic generation of texts. We will learn about a specific form of word embedding word2vec. This embedding has proven more effective and has been widely adopted in the deep learning and NLP communities.
futuretext - Data Science for Internet of Things(IoT) - Research, Teaching and Certification
Created by industry thought leader Ajit Jaokar in 1999, our research is based on two courses conducted by Ajit: Big Data for Telecoms at Oxford University and the newly launched citysciences program program at UPM ( Technical University of Madrid) which apply machine learning techniques to IoT and Smart cities applications. "Great course with many interactions, either group or one to one that helps in the learning. In addition, tailored curriculum to the need of each student and interaction with companies involved in this field makes it even more impactful. As for myself, it allowed me to go into topics of interests that help me in reshaping my career. "This DSIOT course is a great way to get up-to-speed.
Getting Started with NLP and Deep Learning with Python
As the amount of data continues to grow at an almost incomprehensible rate, being able to understand and process data is becoming a key differentiator for competitive organizations. Machine Learning applications are everywhere, from self-driving cars to spam detection, document search, and trading strategies, to speech recognition. This makes machine learning well-suited to the present-day era of Big Data and Data Science. The main challenge is how to transform data into actionable knowledge. In this course, you'll be introduced to the Natural Processing Language and Recommendation Systems, which help you run multiple algorithms simultaneously. Also, you'll learn about Deep learning and TensorFlow.
Cognition in Dynamical Systems, Second Edition
Cognition is the process of knowing. As carried out by a dynamical system, it is the process by which the system absorbs information into its state. A complex network of agents cognizes knowledge about its environment, internal dynamics and initial state by forming emergent, macro-level patterns. Such patterns require each agent to find its place while partially aware of the whole pattern. Such partial awareness can be achieved by separating the system dynamics into two parts by timescale: the propagation dynamics and the pattern dynamics. The fast propagation dynamics describe the spread of signals across the network. If they converge to a fixed point for any quasi-static state of the slow pattern dynamics, that fixed point represents an aggregate of macro-level information. On longer timescales, agents coordinate via positive feedback to form patterns, which are defined using closed walks in the graph of agents. Patterns can be coherent, in that every part of the pattern depends on every other part for context. Coherent patterns are acausal, in that (a) they cannot be predicted and (b) no part of the stored knowledge can be mapped to any part of the pattern, or vice versa. A cognitive network's knowledge is encoded or embodied by the selection of patterns which emerge. The theory of cognition summarized here can model autocatalytic reaction-diffusion systems, artificial neural networks, market economies and ant colony optimization, among many other real and virtual systems. This theory suggests a new understanding of complexity as a lattice of contexts rather than a single measure.
Building Function Approximators on top of Haar Scattering Networks
The field of artificial neural networks has exploded during the 1980s due to its universal approximation capabilities, as can be seen in [1], but the lack of understanding of the underlying statistical and geometric features extracted from the analyzed signal discouraged significantly its usage among scientists and researchers, as can be seen in [2-3]. Since then, most of its usage has been relegated to applications where such understanding can be neglected, such as computer vision, nonlinear statespace estimators and other tasks related to control where exact algorithmic approaches are unknown or too difficult to implement, according to [3]. More recently, aiming to enlightening these black-boxes, several approaches have been under heavy development, such as variables contributions in the feed forward structure [4], visualization using saliency maps [5], generation of skeletal structures [6], fuzzy rule based evaluation of all permutations [3], extraction of functional relations using sensitivity analysis of input data [7], as many others. In a parallel way, other researchers have been successfully developing new kinds of feed-forward neural architectures that behave much more like a transparent box, where the extracted features can be directly evaluated and understood. Convolutional Neural Networks are a great example of such achievements, as can be seen in [8-10]. Despite its several layers, they can be employed on different types of tasks, including text classification, natural language processing, computer vision and so on, with a good understanding of what is happening behind the curtains. Manuscript received January 15, 2018. This work was supported in part by the FIPE (Institute of Economic Research Foundation) by means of a postdoctoral scholarship.
Human-Guided Data Exploration
Henelius, Andreas, Oikarinen, Emilia, Puolamäki, Kai
The outcome of the explorative data analysis (EDA) phase is vital for successful data analysis. EDA is more effective when the user interacts with the system used to carry out the exploration. In the recently proposed paradigm of iterative data mining the user controls the exploration by inputting knowledge in the form of patterns observed during the process. The system then shows the user views of the data that are maximally informative given the user's current knowledge. Although this scheme is good at showing surprising views of the data to the user, there is a clear shortcoming: the user cannot steer the process. In many real cases we want to focus on investigating specific questions concerning the data. This paper presents the Human Guided Data Exploration framework, generalising previous research. This framework allows the user to incorporate existing knowledge into the exploration process, focus on exploring a subset of the data, and compare different complex hypotheses concerning relations in the data. The framework utilises a computationally efficient constrained randomisation scheme. To showcase the framework, we developed a free open-source tool, using which the empirical evaluation on real-world datasets was carried out. Our evaluation shows that the ability to focus on particular subsets and being able to compare hypotheses are important additions to the interactive iterative data mining process.
Frank-Wolfe Splitting via Augmented Lagrangian Method
Gidel, Gauthier, Pedregosa, Fabian, Lacoste-Julien, Simon
Minimizing a function over an intersection of convex sets is an important task in optimization that is often much more challenging than minimizing it over each individual constraint set. While traditional methods such as Frank-Wolfe (FW) or proximal gradient descent assume access to a linear or quadratic oracle on the intersection, splitting techniques take advantage of the structure of each sets, and only require access to the oracle on the individual constraints. In this work, we develop and analyze the Frank-Wolfe Augmented Lagrangian (FW-AL) algorithm, a method for minimizing a smooth function over convex compact sets related by a "linear consistency" constraint that only requires access to a linear minimization oracle over the individual constraints. It is based on the Augmented Lagrangian Method (ALM), also known as Method of Multipliers, but unlike most existing splitting methods, it only requires access to linear (instead of quadratic) minimization oracles. We use recent advances in the analysis of Frank-Wolfe and the alternating direction method of multipliers algorithms to prove a sublinear convergence rate for FW-AL over general convex compact sets and a linear convergence rate over polytopes.
Learning at the Ends: From Hand to Tool Affordances in Humanoid Robots
Saponaro, Giovanni, Vicente, Pedro, Dehban, Atabak, Jamone, Lorenzo, Bernardino, Alexandre, Santos-Victor, José
One of the open challenges in designing robots that operate successfully in the unpredictable human environment is how to make them able to predict what actions they can perform on objects, and what their effects will be, i.e., the ability to perceive object affordances. Since modeling all the possible world interactions is unfeasible, learning from experience is required, posing the challenge of collecting a large amount of experiences (i.e., training data). Typically, a manipulative robot operates on external objects by using its own hands (or similar end-effectors), but in some cases the use of tools may be desirable, nevertheless, it is reasonable to assume that while a robot can collect many sensorimotor experiences using its own hands, this cannot happen for all possible human-made tools. Therefore, in this paper we investigate the developmental transition from hand to tool affordances: what sensorimotor skills that a robot has acquired with its bare hands can be employed for tool use? By employing a visual and motor imagination mechanism to represent different hand postures compactly, we propose a probabilistic model to learn hand affordances, and we show how this model can generalize to estimate the affordances of previously unseen tools, ultimately supporting planning, decision-making and tool selection tasks in humanoid robots. We present experimental results with the iCub humanoid robot, and we publicly release the collected sensorimotor data in the form of a hand posture affordances dataset.
Sample-Derived Disjunctive Rules for Secure Power System Operation
Cremer, Jochen L., Konstantelos, Ioannis, Tindemans, Simon H., Strbac, Goran
Machine learning techniques have been used in the past using Monte Carlo samples to construct predictors of the dynamic stability of power systems. In this paper we move beyond the task of prediction and propose a comprehensive approach to use predictors, such as Decision Trees (DT), within a standard optimization framework for pre- and post-fault control purposes. In particular, we present a generalizable method for embedding rules derived from DTs in an operation decision-making model. We begin by pointing out the specific challenges entailed when moving from a prediction to a control framework. We proceed with introducing the solution strategy based on generalized disjunctive programming (GDP) as well as a two-step search method for identifying optimal hyper-parameters for balancing cost and control accuracy. We showcase how the proposed approach constructs security proxies that cover multiple contingencies while facing high-dimensional uncertainty with respect to operating conditions with the use of a case study on the IEEE 39-bus system. The method is shown to achieve efficient system control at a marginal increase in system price compared to an oracle model.
Three clear customer benefits in a world of artificial intelligence (AI)
Time is probably the scarcest resource of any customer group. Companies like Amazon and Booking.com are obsesses with saving time of their customers. Question is: how focussed is your company on saving time of your customers. The paradox is: the more time you save from your customers, the more time (and money) they will spend with you. In a world driven by Artificial Intelligence, companies have new and more opportunities than in the past to focus on this opportunity. There are three clear benefits to help customers, to save them time and to boost the overal customer experience.