Selfridge, Oliver G.

Pandemonium: A Paradigm for Learning


First hill climbing technique: pick vectors at random (points in the space), score them, and select the one that scores highest. Second hill--climbing technique: pick vectors until one of them (Number 4) outscores the previous ones. Fran this point take small random steps in all directions (that is, add small random vectors) until you find a direction that improves your score. In general, one may hope that in spaces of very high dimensionality the interdependence of the components and the score is so great as to make very unlikely the existence of false peaks completely isolated from the main or true peak.