笔式用户界面开发工具研究

笔式用户界面提供给用户更为自然的交互方式,然而,笔式用户界面的构造是一项非常困难的工作,一个可用的笔式用户界面系统往往需要多领域、多学科的知识.系统地论述了一个支持笔式用户界面开发的工具系统Penbuilder的设计实现.它基于笔交互的特性以及无处不在的计算环境的要求而设计,为笔式用户界面的开发提供高级的支持.基于Penbuilder的支持,设计开发了一批典型的笔式用户界面原型系统.该研究为笔式用户界面的构造与快速原型提供了有力的支持.     

An exploration of pen tail gestures for interactions

In this paper, we performed an exploration on the design and evaluation of pen tail gesture, an interaction method that allows the use of pen tail movement to initiate interactions. Based on our interviews with some designers and researchers who regularly used pen-based tools, we conducted three experiments to establish baseline criteria to distinguish intentional pen tail gestures from incidental pen tail movements, and to understand the basic movement behaviors in pen tail gestures. We developed designs and recognition methods of pen gestures, and implemented three application prototypes based on them. Our research can inspire some new designs of pen-based tools and enrich the design repertoire of pen-based user interfaces.     

Evaluating the benefits of multimodal interface design for CoMPASS—a mobile GIS

The context of mobility raises many issues for geospatial applications providing location-based services. Mobile device limitations, such as small user interface footprint and pen input whilst in motion, result in information overload on such devices and interfaces which are difficult to navigate and interact with. This has become a major issue as mobile GIS applications are now being used by a wide group of users, including novice users such as tourists, for whom it is essential to provide easy-to-use applications. Despite this, comparatively little research has been conducted to address the mobility problem. We are particularly concerned with the limited interaction techniques available to users of mobile GIS which play a primary role in contributing to the complexity of using such an application whilst mobile. As such, our research focuses on multimodal interfaces as a means to present users with a wider choice of modalities for interacting with mobile GIS applications. Multimodal interaction is particularly advantageous in a mobile context, enabling users of location-based applications to choose the mode of input that best suits their current task and location. The focus of this article concerns a comprehensive user study which demonstrates the benefits of multimodal interfaces for mobile geospatial applications.     

一种新的笔式交互范式的可用性评估

笔式用户界面是Post—WIMP界面的一种重要形态,具有自然、和谐的交互特性。尽管笔式用户界面广泛应用于无处不在计算环境中,但很少专门对它的可用性进行评估。针对笔式用户界面的特征,提出了一种新的笔式用户界面范式,基于此范式设计并实现了一个面向教学的笔式交互系统(PenOffice),利用此系统对范式从易学性、效率、出错率和用户满意度这几个方面进行了可用性评估,从中分析了笔式用户界面以及这种新的界面范式的优点和不足。     

协作笔式用户界面开发工具研究

笔式用户界面是一种重要的Post-WIMP(window icon menu pointer)界面,它给用户提供了自然的交互方式.然而,当前的笔式用户界面工具箱大多是面向单用户任务的,不能很好地支持协作应用场景.通过对笔式交互特征和协作环境功能需求的分析,设计并实现了一个工具箱CoPen Toolkit,用于支持协作笔式用户界面的开发.它提供了灵活的架构和可扩展的组件,支持笔迹描述、事件处理和网络协作等功能.基于CoPen Toolkit,构造了多个原型系统,实践表明,它能够很好地支持协作笔式用户界面的开发.     

基于场景的笔式界面设计工具的设计和实现*

设计实现了一个基于数字笔的用户界面设计工具,该工具以面向笔式界面领域,基于场景的设计思想来设计系统中的界面场景组织关系以及场景之间的动态切换方式,设计者与工具间的交互自然流畅、快捷高效。通过手势识别技术,该工具可以将场景的设计结果转换为内部的界面描述语言,并通过相应的解释最终构造生成笔式用户界面。该工具可以快速生成界面原型,从而有效地提高了笔式交互系统的设计和开发效率。     

A portable toolkit for supporting end-user personalization and control in context-aware applications

A context-aware application in the pervasive computing environment provides intuitive user centric services using implicit context cues. Personalization and control are important issues for this class of application as they enable end-users to understand and configure the behavior of an application. However most development efforts for building context-aware applications focus on the sensor fusion and machine learning algorithms to generate and distribute context cues that drive the application with little emphasis on user-centric issues. We argue that, to elevate user experiences with context-aware applications, it is very important to address these personalization and control issues at the system interface level in parallel to context centric design. Towards this direction, we present Persona, a toolkit that provides support for extending context-aware applications with end-user personalization and control features. Specifically, Persona exposes a few application programming interfaces that abstract end-user customization and control mechanisms and enables developers to integrate these user-centric aspects with rest of the application seamlessly. There are two primary advantages of Persona. First, it can be used with various existing middlewares as a ready-to-use plug-in to build customizable and controllable context-aware applications. Second, existing context-aware applications can easily be augmented to provide end-user personalization and control support. In this paper, we discuss the design and implementation of Persona and demonstrate its usefulness through the development and augmentation of a range of common context-aware applications.     

Bringing context-aware access to the web through spoken interaction

The web has become the largest repository of multimedia information and its convergence with telecommunications is now bringing the benefits of web technology to hand-held devices. To optimize data access using these devices and provide services which meet the user needs through intelligent information retrieval, the system must sense and interpret the user environment and the communication context. In addition, natural spoken conversation with handheld devices makes possible the use of these applications in environments in which the use of GUI interfaces is not effective, provides a more natural human-computer interaction, and facilitates access to the web for people with visual or motor disabilities, allowing their integration and the elimination of barriers to Internet access. In this paper, we present an architecture for the design of context-aware systems that use speech to access web services. Our contribution focuses specifically on the use of context information to improve the effectiveness of providing web services by using a spoken dialog system for the user-system interaction. We also describe an application of our proposal to develop a context-aware railway information system, and provide a detailed evaluation of the influence of the context information in the quality of the services that are supplied.     

面向协作交互任务的资源模型

提出一种面向协作交互任务的资源模型.首先分析了现有协作任务分析方法和资源模型;然后在总结典型协作交互任务的基础上,提出了基于分布式认知的协作资源模型,描述了模型的组成结构和交互策略;最后给出了模型的使用模式和一个基于此模型的笔式协作概念图实例.分析表明,该模型能有效地支持协作交互,建立符合认知特点的协作用户界面.     

Designing audio-enhanced paper photos for older adult emotional wellbeing in communication therapy

This article introduces audio-enhanced paper photos enabled by digital pen technology as an interaction paradigm for supporting and understanding emotional wellbeing in late adulthood, particularly in the context of communication therapy activities and related social interactions. We describe the development of a multimodal pen-based system that enables creation of audio-enhanced paper photos and the application of this technology to two domains: older adults with aphasia working to regain expressive and receptive language after a stroke, and older adults wanting to interact with a family member of advanced age with memory loss. Our pen-based authoring software enables caregivers, both therapists and family members, to create audio-enhanced paper photos to encourage meaningful and emotionally appropriate interaction with the older adults they support. We examine the ways in which emotional information is embedded in audio-enhanced photos and how this approach addresses various aspects of emotional wellbeing in late adulthood.     

一种新的人机界面—PUIs

长期以来 ,图形用户界面 (GUIs)一直是人机交互 (HCI)的主流平台。GUI风格的交互让用户使用计算机时更为方便 ,尤其对于办公自动化应用。然而 ,随着人们使用计算机方式的变化以及计算任务种类和数量的大量增加 ,GUIs已经很难实现满足用户需求所必需的所有交互形式。为了适应更多更广的情况 ,人们需要一种更自然、更直观、能自适应、更易为人们接受的界面形式。于是 ,感知用户界面 (PUIs—PerceptualUserInterfaces)成为人机界面中的新热点 ,其主要目的是使人机交互更像人与人之间的交互以及人与世界的交互。本文介绍了蓬勃发展的PUI领域 ,然后简要介绍了三个基于视觉技术的实际系统     

自适应笔式用户界面开发的概念框架

提出了一个指导自适应笔式用户界面开发的概念框架CFAPUI(a conceptual framework for developing adaptive pen-based user interface).该框架详细描述了自适应笔式用户界面的软件体系结构,阐述了自适应笔式用户界面的软件体系结构中的各组成模块及其相互间的关系.同时,在体系结构的基础上提出自适应笔式用户界面开发时的具体过程步骤和方法,并通过一个笔式表单应用来说明该开发框架在指导自适应笔式用户界面开发中的具体应用.     

基于混合输入的场景设计工具

笔式用户界面作为Post-WIMP界面中的一种，以触控技术为依托，摒弃了物理键盘和鼠标，在一定程度上改变了人机交互的方式.草图绘制和识别软件不断涌现，但是却一直没有成熟的笔式界面设计开发工具.基于PGIS交互范式，利用场景设计方法，开发了基于笔式交互原语的图形和草图混合输入的场景设计工具SDT.首先，基于软件工程领域的高内聚低耦合原则提出了"分离-融合"设计方法，并据此提出了系统的总体架构；其次，从界面形式化描述、笔式交互原语和单字符、混合输入这3个方面介绍了关键技术；再次，通过一个完整示例对该工具进行了更具体的展示，同时佐证了该系统的可用性和可行性；最后，通过两个评估实验，验证了该工具的先进性和有效性.     

基于场景树的笔式用户界面设计

从增加笔式用户界面的可用性和提供自然、方便的交互操作的角度，提出一种使用场景树的界面设计方法，并将该方法用于管理会议系统相关环节，包括会议过程、查询和阅读会议文档、记录等．     

Providing user context for mobile and social networking applications

The processing capabilities of mobile devices coupled with portable and wearable sensors provide the basis for new context-aware services and applications tailored to the user environment and daily activities. In this article, we describe the approach developed within the UPCASE project, which makes use of sensors available in the mobile device as well as sensors externally connected via Bluetooth to provide user contexts. We describe the system architecture from sensor data acquisition to feature extraction, context inference and the publication of context information in web-centered servers that support well-known social networking services. In the current prototype, context inference is based on decision trees to learn and to identify contexts dynamically at run-time, but the middleware allows the integration of different inference engines if necessary. Experimental results in a real-world setting suggest that the proposed solution is a promising approach to provide user context to local mobile applications as well as to network-level applications such as social networking services.     

An innovative framework to support multimodal interaction with Smart Environments

Interaction with future coming Smart Environments requires research on methods for the design of a new generation of human-environment interfaces. The paper outlines an original approach to the design of multimodal applications that, while valid for the integration on today’s devices, aims also to be sufficiently flexible so as to remain consistent in view of the transition to future Smart Environments, which will likely be structured in a more complex manner, requiring that interaction with services offered by the environment is made available through the integration of multimodal/unimodal interfaces provided through objects of everyday use. In line with the most recent research tendencies, the approach is centred not only on the user interface part of a system, but on the design of a comprehensive solution, including a dialogue model which is meant to provide a robust support layer on which multimodal interaction builds upon. Specific characteristics of the approach and of a sample application being developed to validate it are discussed in the paper, along with some implementation details.     

Pen-to-mime: Pen-based interactive control of a human figure

In this paper a pen-based intuitive interface is presented, that controls a virtual human figure interactively. Recent commercial pen devices can detect not only the pen positions but also the pressure and tilt of the pen. We utilize such information to make a human figure perform various types of motions in response to the pen movements manipulated by the user. The figure walks, runs, turns and steps along the trajectory and speed of the pen. The figure also bends, stretches and tilts in response to the tilt of the pen. Moreover, it ducks and jumps in response to the pen pressure. Using our interface, the user controls a virtual human figure intuitively as if he or she were holding a virtual puppet and playing with it.

In addition to the interface design and implementation, this paper describes a motion generation engine to produce various motion based on varying parameters that are given by the pen interface. We take a motion blending approach and construct motion blending modules with a set of small number of motion capture data for each type of motions. Finally, we present the results from user experiments and comparison with a transitional gamepad-based interface.     

Integrating adaptation rules for people with special needs in model-based UI development process

The adaptation of user interfaces for people with special needs is a promising approach in order to enable their access to digital services. Model-based user interfaces provide a useful approach for this purpose since they allow tailoring final user interfaces with a high degree of flexibility. This paper describes a system called Adaptation Integration System aimed at providing Cameleon Reference Framework model-based tools with a mechanism to integrate adaptation rules in the development process. Thus, more accessible user-tailored interfaces can be automatically generated. The services provided by the system can be applied at both design time and runtime. At design time, a user interface can be tailored at any abstraction level in the development process. At runtime, changes in the context of use trigger the adaptation process. Adaptation rules are stored in a repository tagged with meta-information useful for the adaptation process, such as the granularity of the adaptations and the abstraction level. As case studies, two applications have been developed using the services provided by the system. One of them exploits the benefits at design time, whereas the other application is devoted to describe the adaptation process at runtime. The results obtained in these two scenarios demonstrate the viability and potential of the adaption integration system since even inexperienced designers may efficiently produce accessible user interfaces.     

笔式界面软件资源管理模型及其实现*

针对目前文档管理模式和WIMP界面交互范式对笔式交互的不足,提出了笔式界面软件文档资源管理的统一模型,能够有效地管理笔式界面软件所产生的文档数据,并且根据此模型实现了笔式界面的文档资源管理系统,采用了PIBG交互范式和实物界面.评估结果表明,根据此模型设计的系统,能够提高用户工作效率,降低用户的认知负担.