Researchers at the University of Texas at Dallas have developed a new interface system called PropType, which overlays a virtual keyboard onto everyday physical objects, such as water bottles, books, or mugs, to enable typing in augmented reality (AR) contexts. Traditional AR text-input methods (floating keyboards, mid-air typing) suffer from slow performance and physical strain (often called “gorilla arm”). The PropType system aims to improve on that by leveraging tactile feedback from the real object’s surface, while adapting the keyboard layout to accommodate curved or irregular shapes.
The key innovation lies in adapting the keyboard overlay to both the geometry of the object and the user’s grasping posture. The researchers studied 16 participants interacting with various props, tracking how they held items and typed. Based on that data, they developed custom keyboard layouts for different objects and an editing tool allowing users to tailor layouts and visual effects. Because users are typing on a physical object they already hold, the setup improves key confirmation via tactile cues and can reduce reliance on purely visual feedback. As the system doesn’t force users to hold their arms aloft, it promises greater comfort in mobile or hands-free AR use cases.
The technology is still in the prototype stage. The team behind PropType, led by Jin Ryong Kim at the Jonsson School of Engineering and Computer Science, presented the work at major HCI conferences and received a Best Paper Honorable Mention at the Association for Computing Machinery CHI conference and a demonstration award at the Institute of Electrical and Electronics Engineers Haptics Symposium.
PropType signals a meaningful step: rather than simply floating virtual keyboards, the future of AR input may rest on smartly combining physical props, haptic feedback, and surface-aware interaction to deliver more intuitive, comfortable text entry.