Exploring Structural Nonlinearity in Binary Polariton-Based Neuromorphic Architectures