Optimization and Regularization Under Arbitrary Objectives