[P] Attempted implementation of Solomonoff induction • r/MachineLearning

Solomonoff induction and its use of the Kolmogorov complexity has fascinated me, to me it's way to overcoming overfitting which happens when we apply more and more complex models to explain the data. I wanted to use it as a way to objectively determine when to switch from a simple model to a more complicated one. An actual implementation of Solomonoff induction is computationally prohibitive. I wanted to try out a reduced version of the induction to see how well it would work. I'm not claiming that I actually implemented Solomonoff's theory, this is an attempt at a practical approximation of it.