How important are specialized transforms in Neural Operators?