One of the main reasons why RL has worked so well in these applications is that we are able simulate millions of interactions with the environment in a relatively short period of time, allowing the agent to experience a large number of different situations in the environment and learn the consequences of its actions. In many real world applications, however, where the agent interacts with the physical world, it might not be easy to generate such a large number of interactions. The time and cost associated with training such systems could render RL an unfeasible approach for training in large scale. As a concrete example, consider training a large number of humanoid robots (agents) to move quickly, as in the Robocup competition [ Farchy et al., 2013 ] . Although the agents have similar dynamics, subtle variations mean that a single policy shared across all agents would not be an effective solution.

Cameras with artificial intelligence (AI) software that the South Korean government claims can detect the likelihood of crime will be installed in Seoul within the year. The Seocho District of South Korea's capital and Electronics and Telecommunications Research Institute (ERTI), a national research institute, said they will install 3,000 cameras at the district by July. The cameras will use AI software that processes the location, time, and behaviour patterns of passersby to measure the likelihood of a crime taking place. The cameras will automatically measure whether somebody is walking normally or tailing someone. It will also detect what passersby are wearing -- such as hats, masks, or glasses -- and what they are carrying with them such as bags or dangerous objects that have a strong possibility of being used to commit a crime.

Music and dance are so deeply embedded in the human experience that we almost take them for granted. They're distinct from one another, but intimately related: Music -- arrangements of sound over time -- causes us to move our bodies in space. Without knowing it, we track pulse, tempo and rhythm, and we move in response. But only recently have scientists developed the tools, and the inclination, to quantitatively study the human response to music in its many forms. It's a research program that relies on a wide array of approaches, employing techniques from the study of perception and cognition to those of neurobiology and neuroimaging, with additional insights from psychophysics, evolutionary psychology and animal studies.

Sundar Pichai, the chief executive of Google, has been put in charge of its parent company Alphabet, after co-founders Larry Page and Sergey Brin announced they were stepping down. The 47-year-old said the pair had set up a "strong foundation" on which he would "continue to build". Pichai's life story is remarkable, and his rise to the top of Google is an endorsement of India's standing in the global technology industry - and equally, a reassuring reminder of the so-called "American Dream". Pichai was born and schooled in Chennai, India. He captained his school's cricket team, leading it to win regional competitions.

Sundar Pichai, the chief executive of Google, has been put in charge of its parent company Alphabet, after co-founders Larry Page and Sergey Brin announced they were stepping down. The 47-year-old said the pair had set up a "strong foundation" on which he would "continue to build". Pichai's life story is remarkable, and his rise to the top of Google is an endorsement of India's standing in the global technology industry - and equally, a reassuring reminder of the so-called "American Dream". Pichai was born and schooled in Chennai, India. He captained his school's cricket team, leading it to win regional competitions.

Cyclists, whether they be food delivery riders or MAMILs, are infamous for doing everything they can to conserve their hard-won speed, even if it means running a red light or careering into the way of pedestrians on the footpath. But new work from IBM Research Australia and RMIT's Exertion Games Lab, however, is looking to avoid tiresome stops or dangerous behaviour by using artificial intelligence (AI) to catch the'green wave' of traffic signals. It's well known many cyclists jump traffic signals or make legally questionable deviations to maintain momentum getting from A to B. If you're an underpaid international student under Dickensian food delivery conditions, there's simply no other way. That could be about to change. In a project dubbed'Ari the e-bike,' the researchers used traffic data and'green wave' modelling from VicRoads and internet of things (IoT) technologies to help the rider regulate their speed to match cycles of green traffic lights.

Attributed network embedding has attracted plenty of interests in recent years. It aims to learn task-independent, low-dimension, and continuous vectors for nodes preserving both topology and attribute information. Most existing methods, such as GCN and its variations, mainly focus on the local information, i.e., the attributes of the neighbors. Thus, they have been well studied for assortative networks but ignored disassortative networks, which are common in real scenes. To address this issue, we propose a block-based generative model for attributed network embedding on a probability perspective inspired by the stochastic block model (SBM). Specifically, the nodes are assigned to several blocks wherein the nodes in the same block share the similar link patterns. These patterns can define assortative networks containing communities or disassortative networks with the multipartite, hub, or any hybrid structures. Concerning the attribute information, we assume that each node has a hidden embedding related to its assigned block, and then we use a neural network to characterize the nonlinearity between the node embedding and its attribute. We perform extensive experiments on real-world and synthetic attributed networks, and the experimental results show that our proposed method remarkably outperforms state-of-the-art embedding methods for both clustering and classification tasks, especially on disassortative networks.

Trajectory owner prediction is the basis for many applications such as personalized recommendation, urban planning. Although much effort has been put on this topic, the results archived are still not good enough. Existing methods mainly employ RNNs to model trajectories semantically due to the inherent sequential attribute of trajectories. However, these approaches are weak at Point of Interest (POI) representation learning and trajectory feature detection. Thus, the performance of existing solutions is far from the requirements of practical applications. In this paper, we propose a novel CNN-based Trajectory Owner Prediction (CNNTOP) method. Firstly, we connect all POI according to trajectories from all users. The result is a connected graph that can be used to generate more informative POI sequences than other approaches. Secondly, we employ the Node2Vec algorithm to encode each POI into a low-dimensional real value vector. Then, we transform each trajectory into a fixed-dimensional matrix, which is similar to an image. Finally, a CNN is designed to detect features and predict the owner of a given trajectory. The CNN can extract informative features from the matrix representations of trajectories by convolutional operations, Batch normalization, and $K$-max pooling operations. Extensive experiments on real datasets demonstrate that CNNTOP substantially outperforms existing solutions in terms of macro-Precision, macro-Recall, macro-F1, and accuracy.

Top accomplishments include release of Akida intellectual property for licensing to ASIC suppliers, the development of a neural network converter for CNN to event-based CNN and native SNN translation, and an agreement with Socionext, formerly known as the Fujitsu Semiconductor business, for Akida development and manufacturing. In November 2019, BrainChip was granted a U.S. patent for its dynamic neural networks which are a valuable feature of its Akida AI processing chip used to power biometric and AI applications on devices at the network edge. Unlike other solutions, Akida does not need a host processor, external memory and a math accelerator device. It will be available in a Flip-Chip Ball Grid Array (FCBGA324) that is 15mm x 15mm. In 2019, the Akida logic and layout designs have been finalized.

A deep neural network (DNN) with piecewise linear activatio ns can partition the input space into numerous small linear regions, where diffe rent linear functions are fitted. It is believed that the number of these regions rep resents the expressivity of the DNN. This paper provides a novel and meticulous perspe ctive to look into DNNs: Instead of just counting the number of the linear regio ns, we study their local properties, such as the inspheres, the directions of t he corresponding hyper-planes, the decision boundaries, and the relevance of the su rrounding regions. W e empirically observed that different optimization techniq ues lead to completely different linear regions, even though they result in similar cl assification accuracies. W e hope our study can inspire the design of novel optimizatio n techniques, and help discover and analyze the behaviors of DNNs. In the past few decades, deep neural networks (DNNs) have ach ieved remarkable success in various difficult tasks of machine learning (Krizhevsky et al., 2012; Graves et al., 2013; Goodfellow et al., 2014; He et al., 2016; Silver et al., 2017; Devlin et al., 2019). Albeit the great progress DNNs have made, there are still many problems which have not been thoro ughly studied, such as the expressivity and optimization of DNNs. High expressivity is believed to be one of the most important reasons for the success of DNNs. It is well known that a standard deep feedforward network with pie cewise linear activations can partition the input space into many linear regions, where different li near functions are fitted (Pascanu et al., 2014; Montufar et al., 2014). More specifically, the activat ion states are in one-to-one correspondence with the linear regions, i.e., all points in the same li near region activate the same nodes of the DNN, and hence the hidden layers serve as a series of affine transformations of these points.