SOLAR: Scalable Optimization of Large-scale Architecture for Reasoning