Implicit Bias of (Stochastic) Gradient Descent for Rank-1 Linear Neural Network

Unfortunately, even for standard linear networks in regression setting, a comprehensive characterization of the implicit bias is still an open problem.