Fusion Encoder Networks