takeuchi
Statistical Inference for Autoencoder-based Anomaly Detection after Representation Learning-based Domain Adaptation
Kiet, Tran Tuan, Loi, Nguyen Thang, Duy, Vo Nguyen Le
Anomaly detection (AD) plays a vital role across a wide range of domains, but its performance might deteriorate when applied to target domains with limited data. Domain Adaptation (DA) offers a solution by transferring knowledge from a related source domain with abundant data. However, this adaptation process can introduce additional uncertainty, making it difficult to draw statistically valid conclusions from AD results. In this paper, we propose STAND-DA -- a novel framework for statistically rigorous Autoencoder-based AD after Representation Learning-based DA. Built on the Selective Inference (SI) framework, STAND-DA computes valid $p$-values for detected anomalies and rigorously controls the false positive rate below a pre-specified level $α$ (e.g., 0.05). To address the computational challenges of applying SI to deep learning models, we develop the GPU-accelerated SI implementation, significantly enhancing both scalability and runtime performance. This advancement makes SI practically feasible for modern, large-scale deep architectures. Extensive experiments on synthetic and real-world datasets validate the theoretical results and computational efficiency of the proposed STAND-DA method.
- Asia > Japan > Honshū > Kantō > Tokyo Metropolis Prefecture > Tokyo (0.14)
- North America > United States > Wisconsin (0.04)
- Asia > Vietnam > Hồ Chí Minh City > Hồ Chí Minh City (0.04)
- Research Report > Experimental Study (0.49)
- Research Report > New Finding (0.46)
Neural Tangent Kernels and Fisher Information Matrices for Simple ReLU Networks with Random Hidden Weights
Takeuchi, Jun'ichi, Takeishi, Yoshinari, Murata, Noboru, Mimura, Kazushi, Ho, Ka Long Keith, Nagaoka, Hiroshi
Fisher information matrices and neural tangent kernels (NTK) for 2-layer ReLU networks with random hidden weight are argued. We discuss the relation between both notions as a linear transformation and show that spectral decomposition of NTK with concrete forms of eigenfunctions with major eigenvalues. We also obtain an approximation formula of the functions presented by the 2-layer neural networks.
- Asia > Japan > Kyūshū & Okinawa > Kyūshū > Fukuoka Prefecture > Fukuoka (0.05)
- Asia > Japan > Honshū > Chūgoku > Hiroshima Prefecture > Hiroshima (0.05)
- Asia > Japan > Honshū > Kantō > Tokyo Metropolis Prefecture > Tokyo (0.04)
Statistical Inference for Clustering-based Anomaly Detection
Phu, Nguyen Thi Minh, Loc, Duong Tan, Duy, Vo Nguyen Le
Unsupervised anomaly detection (AD) is a fundamental problem in machine learning and statistics. A popular approach to unsupervised AD is clustering-based detection. However, this method lacks the ability to guarantee the reliability of the detected anomalies. In this paper, we propose SI-CLAD (Statistical Inference for CLustering-based Anomaly Detection), a novel statistical framework for testing the clustering-based AD results. The key strength of SI-CLAD lies in its ability to rigorously control the probability of falsely identifying anomalies, maintaining it below a pre-specified significance level $\alpha$ (e.g., $\alpha = 0.05$). By analyzing the selection mechanism inherent in clustering-based AD and leveraging the Selective Inference (SI) framework, we prove that false detection control is attainable. Moreover, we introduce a strategy to boost the true detection rate, enhancing the overall performance of SI-CLAD. Extensive experiments on synthetic and real-world datasets provide strong empirical support for our theoretical findings, showcasing the superior performance of the proposed method.
- North America > United States > Wisconsin (0.04)
- Asia > Vietnam > Hồ Chí Minh City > Hồ Chí Minh City (0.04)
- Asia > Middle East > UAE > Dubai Emirate > Dubai (0.04)
- Asia > Japan (0.04)
Time Series Anomaly Detection in the Frequency Domain with Statistical Reliability
Yamada, Akifumi, Shiraishi, Tomohiro, Nishino, Shuichi, Katsuoka, Teruyuki, Taji, Kouichi, Takeuchi, Ichiro
Effective anomaly detection in complex systems requires identifying change points (CPs) in the frequency domain, as abnormalities often arise across multiple frequencies. This paper extends recent advancements in statistically significant CP detection, based on Selective Inference (SI), to the frequency domain. The proposed SI method quantifies the statistical significance of detected CPs in the frequency domain using $p$-values, ensuring that the detected changes reflect genuine structural shifts in the target system. We address two major technical challenges to achieve this. First, we extend the existing SI framework to the frequency domain by appropriately utilizing the properties of discrete Fourier transform (DFT). Second, we develop an SI method that provides valid $p$-values for CPs where changes occur across multiple frequencies. Experimental results demonstrate that the proposed method reliably identifies genuine CPs with strong statistical guarantees, enabling more accurate root-cause analysis in the frequency domain of complex systems.
- North America > United States (0.46)
- Europe > France (0.04)
- Research Report > New Finding (0.66)
- Research Report > Experimental Study (0.53)
Murine AI excels at cats and cheese: Structural differences between human and mouse neurons and their implementation in generative AIs
Saiga, Rino, Shiga, Kaede, Maruta, Yo, Inomoto, Chie, Kajiwara, Hiroshi, Nakamura, Naoya, Kakimoto, Yu, Yamamoto, Yoshiro, Yasutake, Masahiro, Uesugi, Masayuki, Takeuchi, Akihisa, Uesugi, Kentaro, Terada, Yasuko, Suzuki, Yoshio, Nikitin, Viktor, De Andrade, Vincent, De Carlo, Francesco, Yamashita, Yuichi, Itokawa, Masanari, Ide, Soichiro, Ikeda, Kazutaka, Mizutani, Ryuta
Mouse and human brains have different functions that depend on their neuronal networks. In this study, we analyzed nanometer-scale three-dimensional structures of brain tissues of the mouse medial prefrontal cortex and compared them with structures of the human anterior cingulate cortex. The obtained results indicated that mouse neuronal somata are smaller and neurites are thinner than those of human neurons. These structural features allow mouse neurons to be integrated in the limited space of the brain, though thin neurites should suppress distal connections according to cable theory. We implemented this mouse-mimetic constraint in convolutional layers of a generative adversarial network (GAN) and a denoising diffusion implicit model (DDIM), which were then subjected to image generation tasks using photo datasets of cat faces, cheese, human faces, and birds. The mouse-mimetic GAN outperformed a standard GAN in the image generation task using the cat faces and cheese photo datasets, but underperformed for human faces and birds. The mouse-mimetic DDIM gave similar results, suggesting that the nature of the datasets affected the results. Analyses of the four datasets indicated differences in their image entropy, which should influence the number of parameters required for image generation. The preferences of the mouse-mimetic AIs coincided with the impressions commonly associated with mice. The relationship between the neuronal network and brain function should be investigated by implementing other biological findings in artificial neural networks.
- Asia > Japan > Honshū > Kantō > Tokyo Metropolis Prefecture > Tokyo (0.05)
- Asia > Japan > Honshū > Kantō > Kanagawa Prefecture (0.04)
- Europe > United Kingdom > Wales > Caerphilly (0.04)
- (13 more...)
- Research Report > New Finding (1.00)
- Research Report > Experimental Study (1.00)
- Health & Medicine > Therapeutic Area > Psychiatry/Psychology (1.00)
- Health & Medicine > Therapeutic Area > Neurology (1.00)
Controllable RANSAC-based Anomaly Detection via Hypothesis Testing
Phong, Le Hong, Luat, Ho Ngoc, Duy, Vo Nguyen Le
Detecting the presence of anomalies in regression models is a crucial task in machine learning, as anomalies can significantly impact the accuracy and reliability of predictions. Random Sample Consensus (RANSAC) is one of the most popular robust regression methods for addressing this challenge. However, this method lacks the capability to guarantee the reliability of the anomaly detection (AD) results. In this paper, we propose a novel statistical method for testing the AD results obtained by RANSAC, named CTRL-RANSAC (controllable RANSAC). The key strength of the proposed method lies in its ability to control the probability of misidentifying anomalies below a pre-specified level $\alpha$ (e.g., $\alpha = 0.05$). By examining the selection strategy of RANSAC and leveraging the Selective Inference (SI) framework, we prove that achieving controllable RANSAC is indeed feasible. Furthermore, we introduce a more strategic and computationally efficient approach to enhance the true detection rate and overall performance of the CTRL-RANSAC. Experiments conducted on synthetic and real-world datasets robustly support our theoretical results, showcasing the superior performance of the proposed method.
- Information Technology > Data Science > Data Mining > Anomaly Detection (1.00)
- Information Technology > Artificial Intelligence > Representation & Reasoning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Statistical Learning > Regression (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Performance Analysis > Accuracy (0.70)
Japanese scientists graft living skin onto 'smiling' robot
Tokyo, Japan – Japanese scientists have developed a technique to attach self-healing, living skin to a robot face and make it "smile". The scientists, led by professor Shoji Takeuchi at the University of Tokyo's Biohybrid Systems Laboratory, connected cultured skin tissue in the likeness of a human face to an actuator – an external mechanical device – using "anchors" that mimic skin ligaments. In a video released by the team, the scientists can be seen manipulating the skin into a smile without causing the tissue to bunch, tear or get stuck in place. Previous efforts to attach tissue made from human cells to a solid surface would result in the skin being damaged when in motion. While Takeuchi's fleshy pink blob bears greater resemblance to a children's animated character than a human face, researchers hope the breakthrough will pave the way to realistic humanoids in the future.
- Asia > Japan > Honshū > Kantō > Tokyo Metropolis Prefecture > Tokyo (0.78)
- North America > United States (0.75)
- Europe > United Kingdom (0.05)
Say cheese: Japanese scientists make robot face 'smile' with living skin
Japanese scientists have devised a way to attach living skin tissue to robotic faces and make them "smile," in a breakthrough that holds out promise of applications in cosmetics and medicine. Researchers at the University of Tokyo grew human skin cells in the shape of a face and pulled it into a wide grin, using embedded ligament-like attachments. The result, though eerie, is an important step toward building more life-like robots, said lead researcher Shoji Takeuchi. "By attaching these actuators and anchors, it became possible to manipulate living skin for the first time," he added. The smiling robot, featured in a study published online last month by Cell Reports Physical Science, is the fruit of a decade of research by Takeuchi and his lab on how best to combine biological and artificial machines.
Statistical Test for Generated Hypotheses by Diffusion Models
Katsuoka, Teruyuki, Shiraishi, Tomohiro, Miwa, Daiki, Duy, Vo Nguyen Le, Takeuchi, Ichiro
The enhanced performance of AI has accelerated its integration into scientific research. In particular, the use of generative AI to create scientific hypotheses is promising and is increasingly being applied across various fields. However, when employing AI-generated hypotheses for critical decisions, such as medical diagnoses, verifying their reliability is crucial. In this study, we consider a medical diagnostic task using generated images by diffusion models, and propose a statistical test to quantify its reliability. The basic idea behind the proposed statistical test is to employ a selective inference framework, where we consider a statistical test conditional on the fact that the generated images are produced by a trained diffusion model. Using the proposed method, the statistical reliability of medical image diagnostic results can be quantified in the form of a p-value, allowing for decision-making with a controlled error rate. We show the theoretical validity of the proposed statistical test and its effectiveness through numerical experiments on synthetic and brain image datasets.
- Europe > Switzerland (0.04)
- Asia > Vietnam > Hồ Chí Minh City > Hồ Chí Minh City (0.04)
- Europe > Slovenia > Drava > Municipality of Benedikt > Benedikt (0.04)
- Research Report > Experimental Study (0.37)
- Research Report > New Finding (0.35)
Watch a robot with living muscles walk through water
A tiny, bipedal robot that combines muscle tissue with artificial materials can walk and turn by contracting its muscles. While biohybrid robots that crawl and swim have been built before with lab-grown muscle, this is the first such bipedal robot that can pivot and make sharp turns. It does this by applying electricity to one of its legs to make the muscle contract, while the other leg remains anchored. The muscle acts as a biological actuator – a component that converts electrical energy into mechanical force. At the moment, the robot, which is only 3 centimetres tall, cannot support itself in air and has a foam buoy to help it stand up in a water tank.
- Asia > Japan > Honshū > Kantō > Tokyo Metropolis Prefecture > Tokyo (0.20)
- North America > United States > Pennsylvania (0.06)