An Analysis of Regularized Approaches for Constrained Machine Learning

Regularization-based approaches for injecting constraints in Machine Learning (ML) were introduced (see e.g. Given the recent interest in ethical and trustworthy AI, however, several works are resorting to these approaches for enforcing desired properties over a ML model (e.g. The regularization function C denotes a vector of (nonnegative) constraint violation indices for m constraints, while λ 0 is a vector of weights (or multipliers). As an example, in a regression problem we may desire a specific output ordering for two input vectors in the training set. If n is even, the term is 0 for perfectly balanced classifications.