Human-Centered Physical AI

The world around us is inherently physical, yet adaptive interfaces focus mostly on adapting digital contents. Users, on the other hand, have many physical tasks and interact with physical objects all the time. To support users with physical tasks, AI needs an embodiment.

Augmenting humans > automating tasks

We research adaptive systems for physical interaction that are ubiquitous and unobtrusive. Intelligence should be integrated into our familiar objects and environments, therefore blending into the background while dynamically adapting to our needs.

We investigate interactive structures and physical AI, designing computational methods and innovative materials that seamlessly blend computation, fabrication, and robotics. Our research advances the creation of responsive materials and intelligent structures that sense, react, adapt, and communicate with users and the environment. By embedding intelligence directly within physical forms, from flexible robotic actuators to wearable technologies and metamaterials, we create intuitive interfaces, enhance human interaction, and foster novel, unobtrusive integrations of technology into everyday life.

At the Interactive Structures Lab, we bridge the gap between understanding user needs and adapting to them by developing full-stack research prototypes, incl. software systems and physical interfaces.

The Interactive Structures lab is led by Prof. Alexandra Ion at CMU HCII.
Reach out to join the team. CMU students, see current research opportunities.

selected publications

See all publications.

Towards Unobtrusive Physical AI: Augmenting Everyday Objects with Intelligence and Robotic Movement for Proactive Assistance

Violet Yinuo Han, Jesse T. Gonzalez, Christina Yang, Zhiruo Wang, Scott E. Hudson, Alexandra Ion.

In Proceedings of UIST ’25. Busan, Republic of Korea. Sept. 28 - Oct. 01, 2025

 paper  doi video project page 

Personalized Bistable Orthoses for Rehabilitation of Finger Joints

Yuyu Lin, Dian Zhu, Anoushka Naidu, Kenneth Yu, Deon Harper, Eni Halilaj, Douglas Weber, Deborah Ellen Kenney, Adam J. Popchak, Mark Baratz, Alexandra Ion.

In Proceedings of UIST ’25. Busan, Republic of Korea. Sept. 28 - Oct. 01, 2025

 paper  doi video project page 
code

Constraint-Driven Robotic Surfaces, at Human-Scale

Jesse T. Gonzalez, Juhi Kedia, Sapna Tayal, Sonia Prashant, Alexandra Ion, Scott E. Hudson.

In Proceedings of UIST ’23. San Francisco, CA. Oct. 29 – Nov. 1, 2023

Best Demo Award at UIST'23 (Jury's choice)

 paper  doi video project page 

Developable Metamaterials: Mass-fabricable Metamaterials by Laser-Cutting Elastic Structures

Madlaina Signer, Alexandra Ion, Olga Sorkine-Hornung.

In Proceedings of CHI ’21. Virtual conference (formerly Yokohama, Japan). May 8 – 13, 2021

 paper  doi video project page 
source code

Metamaterial Mechanisms

Alexandra Ion, Johannes Frohnhofen, Ludwig Wall, Robert Kovacs, Mirela Alistar, Jack Lindsay, Pedro Lopes, Hsiang-Ting Chen, Patrick Baudisch.

In Proceedings of UIST'16. Tokyo, Japan, October 16 – 19, 2016

Best Paper Honorable Mention (top 2%)

 paper  doi video project page 
source code try our editor 3D models talk press images (113 MB)