Physical hypermedia: Augmenting physical material with hypermedia structures

This paper introduces the notion of physical hypermedia, addressing the problem of organizing material in mixed digital and physical environments. Based on empirical studies, we propose concepts for collectional actions and meta-data actions, and present prototypes combining principles from augmented reality and hypermedia to support organization of mixtures of digital and physical materials. Our prototype of a physical hypermedia system is running on an augmented architect's desk and digital walls utilizing Radio Frequency Identifier (RFID) tags as well as visual tags tracked by cameras. It allows users to tag physical materials, and have these tracked by readers (antennas) that may become pervasive in our work environments. In the physical hypermedia system, we work with three categories of RFID tags: simple object tags, collectional tags, and tooltags invoking operations such as grouping and linking of physical material. In addition, we utilize visual ARToolKit tags for linking and navigating 3D models on a physical desk. Our primary application domain is architecture and design, and so we discuss the use of augmented collectional artifacts primarily for this domain.