Appendix for Linear Dynamics-embedded Neural Network for Long-Sequence Modeling
–arXiv.org Artificial Intelligence
This appendix provides all necessary materials for the paper'Linear Dynamics-embedded Neural Network for Long-Sequence Modeling', including model details, experimental configurations, and PyTorch implementation. Here, we introduce the convolutional view of continuous SSMs [1]. B, we obtain the convolutional SSMs (3) according to the definition of convolution. B.2.1 Zero-order Hold Method The state transition function is an ordinary differential equation (ODE). We can obtain its analytical solution as follows.
arXiv.org Artificial Intelligence
Jun-2-2024