People have theirownhabits;fromhowtheyorganizetheirworkspace, over which mug they reach for in the morning, to how they prepare for cooking. Such preferences are context-dependent, dynamic, and often difficult to articulate. As embodied AI agents, such as robots, enter personal spaces, effective interaction requires under standing these implicit and evolving preferences; otherwise, such systems risk being more hindering than helpful. We propose an architecture that learns user preferences from real-world behavioral observation without requiring explicit instruction or feedback. We introduce a factor-graph-based user model that captures preferences across spatial arrangement, tool selection, and workflow, and continuously adapts as tasks and contexts change. The model expands with new observations, enabling open-ended, in situ learning of user-specific preference patterns. Our evaluation shows accurate, calibrated predictions across domains and robust adaptation over time. We demonstrate personalized robot assistance scenarios illustrating seamless and context-aware human–agent interaction.
Publication
Violet Yinuo Han, Alexandra Ion. 2026. Priors of U: Dynamic Preference Learning for Embodied Interaction. In Proceedings of UIST ’26. Detroit, MI, USA. November 2-5, 2026. DOI: https://doi.org/10.1145/3830398.3830688