Thoughts: Sutton's The Bitter Lesson

It states that general learning methods that can scale with computation are ultimately the most effective. The two methods that can seemingly scale endlessly are search and learning, and they have bore their fruit. Sutton lists out their successes in chess, go, speech recognition, computer vision, etc, etc. This is in contrast to the human-knowledge approach, where our knowledge of a specific domain is built into the algorithms that are trying to "solve" or "work-out", so to speak, that domain. In speech recognition, this was with the hand crafting of phonemes, words, etc; in games like chess/go this was through crafting for features of the game; and the list goes on and on.