SWAP: Softmax-Weighted Average Pooling

Blake Elias is a Researcher at the New England Complex Systems Institute. Shawn Jain is an AI Resident at Microsoft Research. Our method, softmax-weighted average pooling (SWAP), applies average-pooling, but re-weights the inputs by the softmax of each window. We present a pooling method for convolutional neural networks as an alternative to max-pooling or average pooling. Our method, softmax-weighted average pooling (SWAP), applies average-pooling, but re-weights the inputs by the softmax of each window.