Training neural networks with batch normalization and weight decay has become a common practice in recent years. In this work, we show that their combined use may result in a surprising periodic behavior of optimization dynamics: the training process regularly exhibits destabilizations that, however, do not lead to complete divergence but cause a new period of training. We rigorously investigate the mechanism underlying the discovered periodic behavior from both empirical and theoretical points of view and analyze the conditions in which it occurs in practice. We also demonstrate that periodic behavior can be regarded as a generalization of two previously opposing perspectives on training with batch normalization and weight decay, namely the equilibrium presumption and the instability presumption.

A master face is a face image that passes face-based identity authentication for a high percentage of the population. These faces can be used to impersonate, with a high probability of success, any user, without having access to any user information. We optimize these faces for 2D and 3D face verification models, by using an evolutionary algorithm in the latent embedding space of the StyleGAN face generator. For 2D face verification, multiple evolutionary strategies are compared, and we propose a novel approach that employs a neural network to direct the search toward promising samples, without adding fitness evaluations. The results we present demonstrate that it is possible to obtain a considerable coverage of the identities in the LFW or RFW datasets with less than 10 master faces, for six leading deep face recognition systems. In 3D, we generate faces using the 2D StyleGAN2 generator and predict a 3D structure using a deep 3D face reconstruction network. When employing two different 3D face recognition systems, we are able to obtain a coverage of 40%-50%. Additionally, we present the generation of paired 2D RGB and 3D master faces, which simultaneously match 2D and 3D models with high impersonation rates.

Summary: Findings provide a better understanding of how natural genetic variations impact brain development and give rise to the spectrum of autism-associated behaviors. Research in humans and animal models points to potential biological and genetic mechanisms contributing to the diversity of behaviors seen in autism. The findings were presented at Neuroscience 2022, the annual meeting of the Society for Neuroscience and the world's largest source of emerging news about brain science and health. Autism, also referred to as autism spectrum disorder, constitutes a diverse group of conditions related to brain development. According to the Centers for Disease Control and Prevention, approximately 1 in 44 children in the U.S. is diagnosed with an autism spectrum disorder, with the diagnosis being four times more common in boys than girls.

Graph AI carries immense potential for us to explore, connect the dots and build intelligent applications using the Internet of Behaviors (IoB). Many Graph Neural Networks achieved state-of-the-art results on both node and graph classification tasks. However, despite GNNs revolutionizing graph representation learning, there is limited understanding of their area to the students. The purpose of this course is to unfold the basics to the cutting-edge concepts and technologies in this realm. Graphs are all around us; real-world objects are often defined in terms of their connections to other things.

Researchers have created a machine-learning system that efficiently predicts the future trajectories of multiple road users, like drivers, cyclists, and pedestrians, which could enable an autonomous vehicle to more safely navigate city streets. If a robot is going to navigate a vehicle safely through downtown Boston, it must be able to predict what nearby drivers, cyclists, and pedestrians are going to do next. A new machine-learning system may someday help driverless cars predict the next moves of nearby drivers, pedestrians, and cyclists in real-time. Humans may be one of the biggest roadblocks to fully autonomous vehicles operating on city streets. If a robot is going to navigate a vehicle safely through downtown Boston, it must be able to predict what nearby drivers, pedestrians, and cyclists are going to do next.

Artificial intelligence (AI) adoption has been largely accepted in the legal community, as many have realized the value of technology that can detect relevant content and produce better outcomes. Incorporating AI into document review workflows or using insights to inform case strategy is transformative and drives better results. From government requests to civil litigation and internal investigations, high profile and fast-moving matters require efficient processes. Deploying technology strategically will help teams to identity key documents and themes early in the case and manage the assessment and review of data efficiently. The continued evolution of AI tools, such as the ability to detect conduct and behavior through sentiment analysis and pattern processing, will further assist with investigatory compliance but can also be used proactively.

Lawyers were quick to refute the possibility that machine learning and classification of documents could potentially offer a defensible solution …

Not long after the invention of computers in the 1940s, expectations were high. Many believed that computers would soon achieve or surpass human-level intelligence. Herbert Simon, a pioneer of artificial intelligence (AI), famously predicted in 1965 that "machines will be capable, within twenty years, of doing any work a man can do"--to achieve general AI. Of course, these predictions turned out to be wildly off the mark. In the tech world today, optimism is high again.

Deep neural networks are representation learning techniques. During training, a deep net is capable of generating a descriptive language of unprecedented size and detail in machine learning. Extracting the descriptive language coded within a trained CNN model (in the case of image data), and reusing it for other purposes is a field of interest, as it provides access to the visual descriptors previously learnt by the CNN after processing millions of images, without requiring an expensive training phase. Contributions to this field (commonly known as feature representation transfer or transfer learning) have been purely empirical so far, extracting all CNN features from a single layer close to the output and testing their performance by feeding them to a classifier. This approach has provided consistent results, although its relevance is limited to classification tasks. In a completely different approach, in this paper we statistically measure the discriminative power of every single feature found within a deep CNN, when used for characterizing every class of 11 datasets. We seek to provide new insights into the behavior of CNN features, particularly the ones from convolutional layers, as this can be relevant for their application to knowledge representation and reasoning. Our results confirm that low and middle level features may behave differently to high level features, but only under certain conditions. We find that all CNN features can be used for knowledge representation purposes both by their presence or by their absence, doubling the information a single CNN feature may provide. We also study how much noise these features may include, and propose a thresholding approach to discard most of it. All these insights have a direct application to the generation of CNN embedding spaces.

Since the 2013 Target breach, it's been clear that companies need to respond better to security alerts even as volumes have gone up. With this year's fast-spreading ransomware attacks and ever-tightening compliance requirements, response must be much faster. Adding staff is tough with the cybersecurity hiring crunch, so companies are turning to machine learning and artificial intelligence (AI) to automate tasks and better detect bad behavior. In a cybersecurity context, AI is software that perceives its environment well enough to identify events and take action against a predefined purpose. AI is particularly good at recognizing patterns and anomalies within them, which makes it an excellent tool to detect threats.