shadow price
Noisy Dual Mirror Descent: A Near Optimal Algorithm for Jointly-DP Convex Resource Allocation
We study convex resource allocation problems with $m$ hard constraints under $(\varepsilon,\delta)$-joint differential privacy (Joint-DP or JDP) in an offline setting. To approximately solve the problem, we propose a generic algorithm called Noisy Dual Mirror Descent. The algorithm applies noisy Mirror Descent to a dual problem from relaxing the hard constraints for private shadow prices, and then uses the shadow prices to coordinate allocations in the primal problem.
A Neural Network Framework for Discovering Closed-form Solutions to Quadratic Programs with Linear Constraints
Beylunioglu, Fuat Can, Duimering, P. Robert, Pirnia, Mehrdad
Deep neural networks (DNNs) have been used to model complex optimization problems in many applications, yet have difficulty guaranteeing solution optimality and feasibility, despite training on large datasets. Training a NN as a surrogate optimization solver amounts to estimating a global solution function that maps varying problem input parameters to the corresponding optimal solutions. Work in multiparametric programming (mp) has shown that solutions to quadratic programs (QP) are piece-wise linear functions of the parameters, and researchers have suggested leveraging this property to model mp-QP using NN with ReLU activation functions, which also exhibit piecewise linear behaviour. This paper proposes a NN modeling approach and learning algorithm that discovers the exact closed-form solution to QP with linear constraints, by analytically deriving NN model parameters directly from the problem coefficients without training. Whereas generic DNN cannot guarantee accuracy outside the training distribution, the closed-form NN model produces exact solutions for every discovered critical region of the solution function. To evaluate the closed-form NN model, it was applied to DC optimal power flow problems in electricity management. In terms of Karush-Kuhn-Tucker (KKT) optimality and feasibility of solutions, it outperformed a classically trained DNN and was competitive with, or outperformed, a commercial analytic solver (Gurobi) at far less computational cost. For a long-range energy planning problem, it was able to produce optimal and feasible solutions for millions of input parameters within seconds.
Noisy Dual Mirror Descent: A Near Optimal Algorithm for Jointly-DP Convex Resource Allocation
We study convex resource allocation problems with m hard constraints under (\varepsilon,\delta) -joint differential privacy (Joint-DP or JDP) in an offline setting. To approximately solve the problem, we propose a generic algorithm called Noisy Dual Mirror Descent. The algorithm applies noisy Mirror Descent to a dual problem from relaxing the hard constraints for private shadow prices, and then uses the shadow prices to coordinate allocations in the primal problem. When strong duality holds, both preceding results can be improved to \widetilde{\mathcal{O}}(\frac{\sqrt{\ln(1/\delta)}}{\varepsilon}) by better utilizing the geometric structure of the dual space, which is neglected by existing works. To complement our results under strong duality, we derive a minimax lower bound \Omega(\frac{m}{\varepsilon}) for any JDP algorithm outputting feasible allocations.
Navigation with shadow prices to optimize multi-commodity flow rates
Boero, Ignacio, Spasojevic, Igor, del Castillo, Mariana, Pappas, George, Kumar, Vijay, Ribeiro, Alejandro
We propose a method for providing communication network infrastructure in autonomous multi-agent teams. In particular, we consider a set of communication agents that are placed alongside regular agents from the system in order to improve the rate of information transfer between the latter. In order to find the optimal positions to place such agents, we define a flexible performance function that adapts to network requirements for different systems. We provide an algorithm based on shadow prices of a related convex optimization problem in order to drive the configuration of the complete system towards a local maximum. We apply our method to three different performance functions associated with three practical scenarios in which we show both the performance of the algorithm and the flexibility it allows for optimizing different network requirements.
Logarithmic Regret in Multisecretary and Online Linear Programs with Continuous Valuations
I study how the shadow prices of a linear program that allocates an endowment of $n\beta \in \mathbb{R}^{m}$ resources to $n$ customers behave as $n \rightarrow \infty$. I show the shadow prices (i) adhere to a concentration of measure, (ii) converge to a multivariate normal under central-limit-theorem scaling, and (iii) have a variance that decreases like $\Theta(1/n)$. I use these results to prove that the expected regret in \cites{Li2019b} online linear program is $\Theta(\log n)$, both when the customer variable distribution is known upfront and must be learned on the fly. I thus tighten \citeauthors{Li2019b} upper bound from $O(\log n \log \log n)$ to $O(\log n)$, and extend \cites{Lueker1995} $\Omega(\log n)$ lower bound to the multi-dimensional setting. I illustrate my new techniques with a simple analysis of \cites{Arlotto2019} multisecretary problem.
Matching While Learning
Johari, Ramesh, Kamble, Vijay, Kanoria, Yash
We consider the problem faced by a service platform that needs to match supply with demand, but also to learn attributes of new arrivals in order to match them better in the future. We introduce a benchmark model with heterogeneous workers and jobs that arrive over time. Job types are known to the platform, but worker types are unknown and must be learned by observing match outcomes. Workers depart after performing a certain number of jobs. The payoff from a match depends on the pair of types and the goal is to maximize the steady-state rate of accumulation of payoff. Our main contribution is a complete characterization of the structure of the optimal policy in the limit that each worker performs many jobs. The platform faces a trade-off for each worker between myopically maximizing payoffs (exploitation) and learning the type of the worker (\emph{exploration}). This creates a multitude of multi-armed bandit problems, one for each worker, coupled together by the constraint on the availability of jobs of different types (capacity constraints). We find that the platform should estimate a shadow price for each job type, and use the payoffs adjusted by these prices, first, to determine its learning goals and then, for each worker, (i) to balance learning with payoffs during the "exploration phase", and (ii) to myopically match after it has achieved its learning goals during the "exploitation phase."
Formulating LUTI Calibration as an Optimisation Problem: Estimation of Tranus Shadow Price and Substitution Parameters
Capelle, Thomas (Inria and Université Grenoble Alpes) | Sturm, Peter (Inria and Université Grenoble Alpes) | Vidard, Arthur (Inria and Université Grenoble Alpes) | Morton, Brian (University of North Carolina at Chapel Hill)
Cities and their employment catchment areas are focus points of economic activity, transportation, and social interactions. The need for land use and transport inte- grated modelling (LUTI modelling) as a decision aid tool in urban planning, has become apparent. Instanti- ating such models on cities, requires a substantial data collection, model structuring and parameter estimation effort; for conciseness, the latter is referred to here as calibration. This work is a partial effort towards the integrated calibration of LUTI models. It considers one of the most widely used LUTI models and softwares, Tranus. The usual calibration approach for Tranus is briefly reviewed. It is then reformulated as an optimisa- tion problem, in order to make it amenable to the sys- tematic incorporation of constraints on parameters and additional data and to form a clear basis for future fully integrated calibration. The problem at hand concerns a dynamic system; an approach is shown how to “elimi- nate” parts of the dynamics in order to ease the param- eter optimisation. We also discuss how to validate cali- bration results and propose to use synthetic data gener- ated from real world problems in order to assess conver- gence properties and accuracy of calibration methods.