Wedosobyintroducing apairofoperators: gather,which efficiently aggregates feature responses from a large spatial extent, and excite, which redistributes the pooled information to local features.
Haussler et al. [1994], Ryabko [2006] researched the online learning problem with a mix of both restrictions. There are also substantial amount of papers investigating online learnability with all measurable functions but restricted data processes.