Goto

Collaborating Authors

 Technology


Convolutional Normalization: Improving Deep Convolutional Network Robustness and Training

Neural Information Processing Systems

Normalization techniques have become a basic component in modern convolutional neural networks (ConvNets). In particular, many recent works demonstrate that promoting the orthogonality of the weights helps train deep models and improve robustness. For ConvNets, most existing methods are based on penalizing or normalizing weight matrices derived from concatenating or flattening the convolutional kernels. These methods often destroy or ignore the benign convolutional structure of the kernels; therefore, they are often expensive or impractical for deep ConvNets. In contrast, we introduce a simple and efficient "Convolutional Normalization" (ConvNorm) method that can fully exploit the convolutional structure in the Fourier domain and serve as a simple plug-and-play module to be conveniently incorporated into any ConvNets. Our method is inspired by recent work on preconditioning methods for convolutional sparse coding and can effectively promote each layer's channel-wise isometry. Furthermore, we show that our ConvNorm can reduce the layerwise spectral norm of the weight matrices and hence improve the Lipschitzness of the network, leading to easier training and improved robustness for deep ConvNets. Applied to classification under noise corruptions and generative adversarial network (GAN), we show that the ConvNorm improves the robustness of common ConvNets such as ResNet and the performance of GAN. We verify our findings via numerical experiments on CIFAR and ImageNet.


Images of Samsung's rumored smart glasses have leaked

Engadget

Images of Samsung's rumored smart glasses have leaked They are codenamed Jinju and could retail for somewhere between $380 and $500. Images and details about Samsung's upcoming smart glasses have leaked, . We knew these were, but we now have what could be actual photos and they look pretty nifty. The glasses are reportedly being developed under the codename Jinju and could cost anywhere from $380 to $500. These are the first smart glasses from Samsung and look to offer a similar feature set to stuff like and the forthcoming . Samsung's specs will run on the and will likely feature heavy integration with the Google Gemini chatbot.



Jackie and Shadow's chicks getting new feathers

Popular Science

Pin feathers, tucking, and more signs that these bald eagles babies won't be chicks forever. More information Adding us as a Preferred Source in Google by using this link indicates that you would like to see more of our content in Google News results. The eaglets still rely on mom and dad for food, but not for long. Breakthroughs, discoveries, and DIY tips sent six days a week. The newest residents of the internet's favorite eagle nest are rapidly growing right before our eyes.



On Path Integration of Grid Cells: Group Representation and Isotropic Scaling

Neural Information Processing Systems

Understanding how grid cells perform path integration calculations remains a fundamental problem. In this paper, we conduct theoretical analysis of a general representation model of path integration by grid cells, where the 2D self-position is encoded as a higher dimensional vector, and the 2D self-motion is represented by a general transformation of the vector. We identify two conditions on the transformation. One is a group representation condition that is necessary for path integration. The other is an isotropic scaling condition that ensures locally conformal embedding, so that the error in the vector representation translates conformally to the error in the 2D self-position. Then we investigate the simplest transformation, i.e., the linear transformation, uncover its explicit algebraic and geometric structure as matrix Lie group of rotation, and explore the connection between the isotropic scaling condition and a special class of hexagon grid patterns. Finally, with our optimization-based approach, we manage to learn hexagon grid patterns that share similar properties of the grid cells in the rodent brain. The learned model is capable of accurate long distance path integration.


ChimpACT: ALongitudinal Dataset for Understanding Chimpanzee Behaviors

Neural Information Processing Systems

Understanding the behavior of non-human primates is crucial for improving animal welfare, modeling social behavior, and gaining insights into distinctively human and phylogenetically shared behaviors. However, the lack of datasets on non-human primate behavior hinders in-depth exploration of primate social interactions, posing challenges to research on our closest living relatives. To address these limitations, we present ChimpACT, a comprehensive dataset for quantifying the longitudinal behavior and social relations of chimpanzees within a social group. Spanning from 2015 to 2018, ChimpACT features videos of a group of over 20 chimpanzees residing at the Leipzig Zoo, Germany, with a particular focus on documenting the developmental trajectory of one young male, Azibo.


Quantifying Modeling Interactions An Information Decomposition Framework

Neural Information Processing Systems

The recent explosion of interest in multimodal applications has resulted in a wide selection of datasets and methods for representing and integrating information from different modalities. Despite these empirical advances, there remain fundamental research questions: How can we quantify the interactions that are necessary to solve a multimodal task? Subsequently, what are the most suitable multimodal models to capture these interactions? To answer these questions, we propose an information-theoretic approach to quantify the degree of redundancy, uniqueness, and synergy relating input modalities with an output task. We term these three measures as the PID statistics of a multimodal distribution (or PID for short), and introduce two new estimators for these PID statistics that scale to high-dimensional distributions. To validate PID estimation, we conduct extensive experiments on both synthetic datasets where the PID is known and on large-scale multimodal benchmarks where PID estimations are compared with human annotations. Finally, we demonstrate their usefulness in (1) quantifying interactions within multimodal datasets, (2) quantifying interactions captured by multimodal models, (3) principled approaches for model selection, and (4) three real-world case studies engaging with domain experts in pathology, mood prediction, and robotic perception where our framework helps to recommend strong multimodal models for each application.


How to avoid the horror of walking through a spiderweb, according to the National Park Service

Popular Science

Hiking sticks, hats, and other simple tricks can keep your hike web-free. More information Adding us as a Preferred Source in Google by using this link indicates that you would like to see more of our content in Google News results. Breakthroughs, discoveries, and DIY tips sent six days a week. You're striding confidently down what seems to be a clear, open path, and then you feel it. The more you try to backtrack and flail your way out of it the more you feel like Frodo wrapped in Shelob the spider's deadly web, your luckier friends snickering like orcs ready to take you back to Mordor .


Taylor Swift files to trademark voice and image after AI concerns

BBC News

Taylor Swift has applied to trademark her voice and appearance in an apparent attempt to protect herself from artificial intelligence impersonations. The pop superstar has lodged three trademark applications in the US - one using a photo of herself on stage during her Eras Tour, and the other two being audio clips of her introducing herself while promoting her last album. AI-generated versions of Swift have cropped up in various ways in recent years - from explicit images to a fake election ad in which she appeared to urge people to vote for Donald Trump. The move comes after actor Matthew McConaughey became the first celebrity to use trademark rules to attempt to protect his voice and image from AI misuse earlier this year . Trademark applications are a relatively new way for celebrities to combat the growing issue of AI rip-offs.