Neuromorphic photonic networks using silicon photonic weight banks