Separation and Bias of Deep Equilibrium Models on Expressivity and Learning Dynamics

This novel model directly finds the fixed points of such a forward process as features for prediction. Despite empirical evidence showcasing its efficacy compared to feedforward neural networks, a theoretical understanding for its separation and bias is still limited.