frp
Free Random Projection for In-Context Reinforcement Learning
Hayase, Tomohiro, Collins, Benoît, Inoue, Nakamasa
Hierarchical inductive biases are hypothesized to promote generalizable policies in reinforcement learning, as demonstrated by explicit hyperbolic latent representations and architectures. Therefore, a more flexible approach is to have these biases emerge naturally from the algorithm. We introduce Free Random Projection, an input mapping grounded in free probability theory that constructs random orthogonal matrices where hierarchical structure arises inherently. The free random projection integrates seamlessly into existing in-context reinforcement learning frameworks by encoding hierarchical organization within the input space without requiring explicit architectural modifications. Empirical results on multi-environment benchmarks show that free random projection consistently outperforms the standard random projection, leading to improvements in generalization. Furthermore, analyses within linearly solvable Markov decision processes and investigations of the spectrum of kernel random matrices reveal the theoretical underpinnings of free random projection's enhanced performance, highlighting its capacity for effective adaptation in hierarchically structured state spaces.
Application of ASV for Voice Identification after VC and Duration Predictor Improvement in TTS Models
Nikolayevich, Borodin Kirill, Dmitrievich, Kudryavtsev Vasiliy, Maratovich, Mkrtchian Grach, Genadievich, Gorodnichev Mikhail, Sergeevich, Korzh Dmitrii
One of the most crucial components in the field of biometric security is the automatic speaker verification system, which is based on the speaker's voice. It is possible to utilise ASVs in isolation or in conjunction with other AI models. In the contemporary era, the quality and quantity of neural networks are increasing exponentially. Concurrently, there is a growing number of systems that aim to manipulate data through the use of voice conversion and text-to-speech models. The field of voice biometrics forgery is aided by a number of challenges, including SSTC, ASVSpoof, and SingFake. This paper presents a system for automatic speaker verification. The primary objective of our model is the extraction of embeddings from the target speaker's audio in order to obtain information about important characteristics of his voice, such as pitch, energy, and the duration of phonemes. This information is used in our multivoice TTS pipeline, which is currently under development. However, this model was employed within the SSTC challenge to verify users whose voice had undergone voice conversion, where it demonstrated an EER of 20.669.
Feature Necessity & Relevancy in ML Classifier Explanations
Huang, Xuanxiang, Cooper, Martin C., Morgado, Antonio, Planes, Jordi, Marques-Silva, Joao
Given a machine learning (ML) model and a prediction, explanations can be defined as sets of features which are sufficient for the prediction. In some applications, and besides asking for an explanation, it is also critical to understand whether sensitive features can occur in some explanation, or whether a non-interesting feature must occur in all explanations. This paper starts by relating such queries respectively with the problems of relevancy and necessity in logic-based abduction. The paper then proves membership and hardness results for several families of ML classifiers. Afterwards the paper proposes concrete algorithms for two classes of classifiers. The experimental results confirm the scalability of the proposed algorithms.
Revisiting Facial-Recognition Payment: Old Problems Still Lingering
China is a world leader in adopting innovative payment methods. Most Chinese today use their mobile phones to make payments and many people don't carry a physical wallet. Now facial-recognition payment (FRP, 刷脸支付) is gaining traction in China as well. To use FRP, users must first register their face and upload bank-card information to a mobile app. Then, they can complete payments by simply glancing at cameras positioned at the checkout in stores. FRP has become a popular payment method, used mostly in convenience stores, vending machines, and supermarkets.
A First-Occupancy Representation for Reinforcement Learning
Moskovitz, Ted, Wilson, Spencer R., Sahani, Maneesh
Both animals and artificial agents benefit from state representations that support rapid transfer of learning across tasks and which enable them to efficiently traverse their environments to reach rewarding states. The successor representation (SR), which measures the expected cumulative, discounted state occupancy under a fixed policy, enables efficient transfer to different reward structures in an otherwise constant Markovian environment and has been hypothesized to underlie aspects of biological behavior and neural activity. However, in the real world, rewards may move or only be available for consumption once, may shift location, or agents may simply aim to reach goal states as rapidly as possible without the constraint of artificially imposed task horizons. In such cases, the most behaviorally-relevant representation would carry information about when the agent was likely to first reach states of interest, rather than how often it should expect to visit them over a potentially infinite time span. To reflect such demands, we introduce the first-occupancy representation (FR), which measures the expected temporal discount to the first time a state is accessed. We demonstrate that the FR facilitates exploration, the selection of efficient paths to desired states, allows the agent, under certain conditions, to plan provably optimal trajectories defined by a sequence of subgoals, and induces similar behavior to animals avoiding threatening stimuli.
AI technology to predict deadly heart attacks
Scientists at the University of Oxford used AI to develop a new biomarker, or'fingerprint' called fat radiomic profile (FRP). The technology could identify people at high risk of a fatal heart attack at least five years before it strikes by detecting biological red flags in the perivascular space lining blood vessels which supply blood to the heart, Tech Explorist reports. Currently, there are no methods routinely by specialists that can spot the majority of the fundamental warnings for a future heart attack. For this study, scientists primarily used fat biopsies from 167 people undergoing cardiac surgery. They then analyzed the expression of genes related with inflammation, scarring, and new blood vessel formation, and matched these to the CCTA scan images to figure out which highlights best demonstrate changes to the fat encompassing the heart vessels, called perivascular fat.