Aligning LLM Agents by Learning Latent Preference from User Edits Ge Gao Alexey T aymanov Eduardo Salinas Paul Mineiro Dipendra Misra Department of Computer Science, Cornell University