pluralistic alignment dataset
LIVS: A Pluralistic Alignment Dataset for Inclusive Public Spaces
Mushkani, Rashid, Nayak, Shravan, Berard, Hugo, Cohen, Allison, Koseki, Shin, Bertrand, Hadrien
We introduce the Local Intersectional Visual Spaces (LIVS) dataset, a benchmark for multi-criteria alignment of text-to-image (T2I) models in inclusive urban planning. Developed through a two-year participatory process with 30 community organizations, LIVS encodes diverse spatial preferences across 634 initial concepts, consolidated into six core criteria: Accessibility, Safety, Comfort, Invitingness, Inclusivity, and Diversity, through 37,710 pairwise comparisons. Using Direct Preference Optimization (DPO) to fine-tune Stable Diffusion XL, we observed a measurable increase in alignment with community preferences, though a significant proportion of neutral ratings highlights the complexity of modeling intersectional needs. Additionally, as annotation volume increases, accuracy shifts further toward the DPO-tuned model, suggesting that larger-scale preference data enhances fine-tuning effectiveness. LIVS underscores the necessity of integrating context-specific, stakeholder-driven criteria into generative modeling and provides a resource for evaluating AI alignment methodologies across diverse socio-spatial contexts.
- North America > Canada > Quebec > Montreal (0.06)
- South America > Brazil > Rio de Janeiro > Rio de Janeiro (0.04)
- North America > United States > Oregon > Multnomah County > Portland (0.04)
- (7 more...)