scalarization
Mixture-Model Preference Learning for Many-Objective Bayesian Optimization
Dubey, Manisha, De Peuter, Sebastiaan, Wang, Wanrong, Kaski, Samuel
Preference-based many-objective optimization faces two obstacles: an expanding space of trade-offs and heterogeneous, context-dependent human value structures. Towards this, we propose a Bayesian framework that learns a small set of latent preference archetypes rather than assuming a single fixed utility function, modelling them as components of a Dirichlet-process mixture with uncertainty over both archetypes and their weights. To query efficiently, we designing hybrid queries that target information about (i) mode identity and (ii) within-mode trade-offs. Under mild assumptions, we provide a simple regret guarantee for the resulting mixture-aware Bayesian optimization procedure. Empirically, our method outperforms standard baselines on synthetic and real-world many-objective benchmarks, and mixture-aware diagnostics reveal structure that regret alone fails to capture.
- Europe > United Kingdom > Scotland (0.04)
- Europe > United Kingdom > England > Greater Manchester > Manchester (0.04)
- Europe > Netherlands > North Holland > Amsterdam (0.04)
- (2 more...)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Uncertainty > Bayesian Inference (0.34)
- Information Technology > Artificial Intelligence > Machine Learning > Learning Graphical Models > Directed Networks > Bayesian Learning (0.34)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Optimization (0.34)
- North America > Canada > Ontario > Toronto (0.04)
- Asia (0.04)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- Information Technology > Artificial Intelligence > Natural Language > Machine Translation (0.73)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.69)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (0.68)
- South America > Chile > Santiago Metropolitan Region > Santiago Province > Santiago (0.04)
- North America > United States > Texas > Brazos County > College Station (0.04)
- Asia > China > Guangxi Province > Nanning (0.04)
- Overview (0.92)
- Research Report (0.67)
- Energy (0.46)
- Health & Medicine > Pharmaceuticals & Biotechnology (0.46)
- South America > Chile > Santiago Metropolitan Region > Santiago Province > Santiago (0.04)
- North America > United States > Texas > Brazos County > College Station (0.04)
- Asia > China > Guangxi Province > Nanning (0.04)
- Overview (0.92)
- Research Report (0.67)
- Energy (0.46)
- Health & Medicine > Pharmaceuticals & Biotechnology (0.46)
- North America > United States > Illinois > Champaign County > Urbana (0.04)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- Asia > Middle East > Jordan (0.04)
- North America > United States (0.04)
- North America > Canada > British Columbia > Metro Vancouver Regional District > Vancouver (0.04)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- North America > United States > Massachusetts > Middlesex County > Cambridge (0.04)
- North America > United States > California > Santa Clara County > Mountain View (0.05)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
InDefenseoftheUnitaryScalarization forDeepMulti-TaskLearning
While some workshowsthatmulti-task networkstrained viaunitary scalarization exhibit superior performance to independent per-task models [29, 35], others suggest the opposite [30, 54, 58]. However, SMTOs usually require access to per-task gradients either with respect to the shared parameters, or to the shared representation.
- North America > Puerto Rico > San Juan > San Juan (0.04)
- North America > United States > Hawaii > Honolulu County > Honolulu (0.04)
- North America > Canada > Quebec > Montreal (0.04)
- (5 more...)