Goto

Collaborating Authors

 Deep Learning


Utilizing Image Transforms and Diffusion Models for Generative Modeling of Short and Long Time Series Ilan Naiman Nimrod Berman

Neural Information Processing Systems

Lately, there has been a surge in interest surrounding generative modeling of time series data. Most existing approaches are designed either to process short sequences or to handle long-range sequences. This dichotomy can be attributed to gradient issues with recurrent networks, computational costs associated with transformers, and limited expressiveness of state space models. Towards a unified generative model for varying-length time series, we propose in this work to transform sequences into images.







Provably Efficient Interaction-Grounded Learning with Personalized Reward

Neural Information Processing Systems

Interaction-Grounded Learning (IGL) [Xie et al., 2021] is a powerful framework in To deal with personalized rewards that are ubiquitous in applications such as recommendation systems, Maghakian et al. [2022] study a version of IGL with context-dependent feedback, but their algorithm does not come with theoretical guarantees. Building on this estimator, we propose two algorithms, one based on explore-then-exploit and the other based on inverse-gap weighting.


PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models

Neural Information Processing Systems

Gemma-7B fine-tuned with PiSSA achieves an accuracy of 77.7%, surpassing LoRA's 74.53% by 3.25%. Due to the same architecture, PiSSA is also compatible with quantization to further reduce the memory requirement of fine-tuning.