Goto

Collaborating Authors

 errw


Cost-SensitiveSelf-TrainingforOptimizing Non-DecomposableMetrics

Neural Information Processing Systems

However, the majority of work on self-training has focused on the objective of improving accuracy whereas practical machine learning systems can havecomplex goals (e.g.


On Statistical Estimation of Edge-Reinforced Random Walks

Qinghua, null, Ding, null, Anantharam, Venkat

arXiv.org Machine Learning

Reinforced random walks (RRWs), including vertex-reinforced random walks (VRRWs) and edge-reinforced random walks (ERRWs), model random walks where the transition probabilities evolve based on prior visitation history~\cite{mgr, fmk, tarres, volkov}. These models have found applications in various areas, such as network representation learning~\cite{xzzs}, reinforced PageRank~\cite{gly}, and modeling animal behaviors~\cite{smouse}, among others. However, statistical estimation of the parameters governing RRWs remains underexplored. This work focuses on estimating the initial edge weights of ERRWs using observed trajectory data. Leveraging the connections between an ERRW and a random walk in a random environment (RWRE)~\cite{mr, mr2}, as given by the so-called "magic formula", we propose an estimator based on the generalized method of moments. To analyze the sample complexity of our estimator, we exploit the hyperbolic Gaussian structure embedded in the random environment to bound the fluctuations of the underlying random edge conductances.