vCOM: Electronic commerce in a collaborative virtual world

Existing e-commerce applications on the web provide the users a relatively simple, browser-based interface to access available products. Customers are not provided with the same shopping experience as they would in an actual store or mall. This experience, however, can be achieved by the creation of a virtual shopping mall environment, simulating most of the actual shopping user interactions. The virtual mall brings together the services and products of various vendors. Users can navigate through the virtual shopping malls, adding items of interest into a virtual shopping cart, and perform searches assisted by ‘intelligent agents’. A Collaborative Virtual Environment (CVE) can realize a sophisticated virtual shopping application. In such a CVE, a large number of potential users may interact with each other. In this paper, vCOM, a VRML and Java3D-based prototype is presented, which permits users to navigate around virtual e-commerce worlds and perform collaborative shopping and intelligent searches with the assistance of software agents, in order to find the products and services of interest to them. They can then negotiate with sales agents to bargain for the best possible price and then make a secure buying transaction. The virtual mall prototype also allows the user to communicate with an ‘intelligent shopping assistant’ using simple voice commands. This assistant interacts with the shopper using voice synthesis and helps him/her use the interface to efficiently navigate in the mall. Real-time interactions between the entities in this shared environment are implemented over the High Level Architecture (HLA), an IEEE standard for distributed simulations and modeling. The paper focuses on user interface design, collaborative e-commerce through HLA and multi-agent architecture.     

Navigational tools for desktop virtual environment interfaces

Desktop systems typically rely on a two-dimensional (2D) software interface and general purpose hardware (mouse, keyboard) for interaction with a three-dimensional (3D) virtual environment. These interfaces must provide all the functionality required to navigate through and interact with the virtual environment, yet research into the usability aspects of the tools presented on these software interfaces indicates that the majority of users experience some degree of frustration when using them to perform even relatively simple tasks. This paper begins with a study of usability issues for interfaces to virtual environments on desktop systems, and details a series of experiments performed to evaluate the usability of a number of navigational tools. Participants were tested on the time taken to complete a number of navigational tasks with a series of interfaces presenting different navigational tools. The tools presented were a speed control function, a you-are-here (YAH) map, a function enabling the user to mark and teleport to any location within the presented environment, and an undo function. Results indicate that the visual presentation of navigational aids improves navigation performance, in terms of the time taken to complete tasks, and also improves user satisfaction with the desktop system.     

Aurally aided visual search in three-dimensional space

We conducted an experiment to evaluate the effectiveness of spatial audio displays on target acquisition performance. Participants performed a visual search task with and without the aid of a spatial audio display. Potential target locations ranged between plus and minus 180 degrees in azimuth and from -70 degrees to +90 degrees in elevation. Independent variables included the number of visual distractors present (1, 5, 10, 25, 50) and the spatial audio condition (no spatial audio, free-field spatial audio, virtual spatial audio). Results indicated that both free-field and virtual audio cues engendered a significant decrease in search times. Potential applications of this research include the design of spatial audio displays for aircraft cockpits and ground combat vehicles.     

Multimedia Clip Generation From Documents for Browsing on Mobile Devices

Small displays on mobile handheld devices, such as personal digital assistants (PDAs) and cellular phones, are the bottlenecks for usability of most content browsing applications. Generally, conventional content such as documents and Web pages need to be modified for effective presentation on mobile devices. This paper proposes a novel visualization for documents, called multimedia thumbnails, which consists of text and image content converted into playable multimedia clips. A multimedia thumbnail utilizes visual and audio channels of small portable devices as well as both spatial and time dimensions to communicate text and image information of a single document. The proposed algorithm for generating multimedia thumbnails includes 1) a semantic document analysis step, where salient content from a source document is extracted; 2) an optimization step, where a subset of this extracted content is selected based on time, display, and application constraints; and 3) a composition step, where the selected visual and audible document content is combined into a multimedia thumbnail. Scalability of MMNails that allows generation of multimedia clips of various lengths is also described. A user study is presented that evaluates the effectiveness of the proposed multimedia thumbnail visualization.     

Auditory display design for exploration in mobile audio-augmented reality

In this paper, we compare four different auditory displays in a mobile audio-augmented reality environment (a sound garden). The auditory displays varied in the use of non-speech audio, Earcons, as auditory landmarks and 3D audio spatialization, and the goal was to test the user experience of discovery in a purely exploratory environment that included multiple simultaneous sound sources. We present quantitative and qualitative results from an initial user study conducted in the Municipal Gardens of Funchal, Madeira. Results show that spatial audio together with Earcons allowed users to explore multiple simultaneous sources and had the added benefit of increasing the level of immersion in the experience. In addition, spatial audio encouraged a more exploratory and playful response to the environment. An analysis of the participants’ logged data suggested that the level of immersion can be related to increased instances of stopping and scanning the environment, which can be quantified in terms of walking speed and head movement.     

基于ATMEGA16语音录放系统的设计与实现

介绍了具有较强通用性的语音告警系统。系统通过单片机ATMEGA16控制语音芯片ISD1790,实现了在不同情况下提供不同的语音提示告警,且提示语音可以自行录入。最后通过D类音频功率放大器TPA3101D2,实现了高音质大音量语音输出。     

虚拟现实全景流体绘画系统的可用性研究

虚拟现实环境给三维空间场景应用带来更强的真实感和身临其境的体验。在虚拟现实场景中经 常需要使用 360全景图像生成沉浸式环境背景,其中全景流体动力学绘画系统提供了一个新的全景图绘制方 法。在调研虚拟现实技术在流体绘画领域应用的适用性测试中,本文综合运用用户测试法、操作日志分析法、 事后问卷调查法和访谈法,对基于虚拟现实的全景式流体绘画创作系统进行可用性评估,并创意性地使用可视 化方法辅助日志分析。所有的受试者均认为系统的可用性不低于一般水平,利用该系统完成流体绘画的创作工 作不需要受试者具有专业绘画经验。受试者对系统的功能效果持积极肯定的意见,并期待尝试用其他交互形式 代替手柄类交互方式以促进艺术创作的表达。其研究方法和结果将为同类系统的开发和评估提供参考。     

Effects of design features of train electronic guidance interface on visual search,behavior, and usability

In urban rail trains, traditional printed guide information interfaces are being replaced by digital interfaces. An electronic guide screen is an important device for passengers to obtain information about the ride because the train is running underground. In particular, when the train is crowded, passengers must obtain information in advance and make appropriate decisions. Therefore, it is important to efficiently search for guidance interfaces. In this study, use scenarios of the guidance interface were simulated. The typical information layout and display mode in the current electronic guidance interface were the experimental variables. Through eye tracking and subjective evaluation, the effects of design features on user search performance, visual behavior, and usability satisfaction were discussed. The experimental results showed that the information layout and display mode of the guidance interface had an interactive effect on the task completion time, fixation counts, and usability score; they also had a significant effect on the recall accuracy and saccade ratio. Task completion time had a strong positive correlation with usability satisfaction and was correlated with visual behavior. The study confirmed that the split-screen display mode combined with interlaced layout could improve search performance and subjective satisfaction.Relevance to industryPrinted guide signs in subway cars are being replaced by electronic guide screens of different styles. Passengers must search for the required information within a limited period. In this study, the effects of different interface layouts and display modes on search performance, visual behavior, and usability were studied. This had a positive significance in improving user experience.     

Virtual Reality: How Much Immersion Is Enough?

Solid evidence of virtual reality's benefits has graduated from impressive visual demonstrations to producing results in practical applications. Further, a realistic experience is no longer immersion's sole asset. Empirical studies show that various components of immersion provide other benefits - full immersion is not always necessary. The goal of immersive virtual environments (VEs) was to let the user experience a computer-generated world as if it were real - producing a sense of presence, or "being there," in the user's mind.     

VDub: Modifying Face Video of Actors for Plausible Visual Alignment to a Dubbed Audio Track

In many countries, foreign movies and TV productions are dubbed, i.e., the original voice of an actor is replaced with a translation that is spoken by a dubbing actor in the country's own language. Dubbing is a complex process that requires specific translations and accurately timed recitations such that the new audio at least coarsely adheres to the mouth motion in the video. However, since the sequence of phonemes and visemes in the original and the dubbing language are different, the video‐to‐audio match is never perfect, which is a major source of visual discomfort. In this paper, we propose a system to alter the mouth motion of an actor in a video, so that it matches the new audio track. Our paper builds on high‐quality monocular capture of 3D facial performance, lighting and albedo of the dubbing and target actors, and uses audio analysis in combination with a space‐time retrieval method to synthesize a new photo‐realistically rendered and highly detailed 3D shape model of the mouth region to replace the target performance. We demonstrate plausible visual quality of our results compared to footage that has been professionally dubbed in the traditional way, both qualitatively and through a user study.     

Understanding the Relation Between Network Quality of Service and the Usability of Distributed Multimedia Documents

Network quality of service, as manifest in the delays users experience, effects both user perceptions and performance. Unfortunately, existing research on the usability of network-based documents and applications does not always adequately address the issue of network delays. In this article, we assert that researchers must document, and should consider manipulating, the delays users experience during studies exploring the usability of network-based computing systems. This article provides an overview of the factors that contribute to the delays users experience and the issues involved in modeling these delays. It also provides advice on how delays should be documented and discusses the advantages and disadvantages of the various techniques available for integrating delays into usability studies and controlled experiments. The existing literature reports numerous inconsistent results, which may be due to different experimental designs, participants, tasks, independent variables, and dependent variables. Therefore, this article concludes by outlining the experimental design considerations that must be considered as the relation between network quality of service and the usability of network-based computing systems is investigated. The result is a framework that will guide future research and allow more effective comparisons of the results of that research.     

Robot-enabled tangible virtual assembly with coordinated midair object placement

The assembly in Virtual Reality (VR) enables users to fit virtual parts into existing 3D models immersively. However, users cannot physically feel the haptic feedback when connecting the parts with the virtual model. This work presents a robot-enabled tangible interface that dynamically moves a physical structure with a robotic arm to provide physical feedback for holding a handheld proxy in VR. This enables the system to provide force feedback during virtual assembly. The cooperation between the physical support and the handheld proxy produces realistic physical force feedback, providing a tangible experience for various virtual parts in virtual assembly scenarios. We developed a prototype system that allowed the operator to place a virtual part onto other models in VR by placing the proxy onto the matched structure attached to a robotic arm. We conducted a user evaluation to explore user performance and system usability in a virtual assembly task. The results indicated that the robot-enabled tangible support increased the task completion time but significantly improved the system usability and sense of presence with a more realistic haptic experience.     

带电作业绝缘斗臂车虚拟仿真系统的设计与开发

将带电作业中的绝缘斗臂车操作训练与虚拟现实技术相结合,以Quest3D4.0和VC++ 6.0等软件为开发平台,在完成整体设计的基础上实现了绝缘斗臂车虚拟仿真系统。系统通过建立视景仿真和绝缘斗臂车模拟控制系统,受训者可在虚拟操作环境中真实体验在现实世界中的工况,有力地保障了仿真培训的效果,为电力系统的带电作业培训提供了一种新的思维方式。     

3D sound interactive environments for blind children problem solving skills

Audio-based virtual environments have been increasingly used to foster cognitive and learning skills. A number of studies have also highlighted that the use of technology can help learners to develop effective skills such as motivation and self-esteem. This study presents the design and usability of 3D interactive environments for children with visual disabilities to help them solve problems in Chilean geography and culture. We introduce AudioChile, a virtual environment that can be navigated through 3D sound to enhance spatiality and immersion throughout the environment. 3D sound is used to orientate, avoid obstacles, and identify the positions of various characters and objects within the environment. We have found during the usability evaluation that sound can be fundamental for attention and motivation purposes during interaction. Learners identified and clearly discriminated environmental sounds to solve everyday problems, spatial orientation, and laterality.     

RoleVR: Multi-experience in immersive virtual reality between co-located HMD and non-HMD users

In this study, we present RoleVR, which can provide a similar high level of presence and multi experience for co-located head-mounted display (HMD) and Non-HMD users in an asymmetric virtual reality (VR) environment. The core of RoleVR is distinguishing the difference between the asymmetric environments (in terms of the system and the experience) of HMD and Non-HMD users to design optimized roles for these users. Here, we assign HMD user with spatial role that maximizes the sense of space based on three-dimensional visual information, and we assign Non-HMD user with temporal role in which they take control of communication and action, and understand the overall situation according to the flow of time. We also design an interaction for walking and a hand interface to enhance presence. This is achieved by understanding the user’s role, thereby improving the immersion. Finally, we created an asymmetric VR application that considers the interaction between roles and performed survey-based experiments to verify the basic presence and multi-experience of users in RoleVR. Through this process, we confirmed that RoleVR provides satisfactory presence for co-located HMD and Non-HMD users, and a variety of experiences specialized for each role.

     

Piles across space: Breaking the real-estate barrier on small-display devices

We describe an implementation that has users ‘flick’ notes, images, audio, and video files onto virtual, imaginary piles beyond the display of small-screen devices. Multiple sets of piles can be maintained in persistent workspaces. Two user studies yielded the following: Participants developed mental schemes to remember virtual pile locations, and they successfully reinstated pile locations after several days, while situated in varying environments. Alignment of visual cues on screen with surrounding physical cues in situ accelerated a sorting task when compared to other, non-aligned visual cues. The latter, however, yielded better long-term retention.     

A Review of Online Advertising Effects on the User Experience

This article reviews empirical research conducted in the last decade on the subject of how online display advertising affects the usability and quality of user experience of websites. In particular, from an in-depth analysis of research questions, methods, and findings of the reviewed studies, the following is discussed: (a) which conceptual and theoretical background knowledge, based on psychological explanations of user cognition, affection and behavior, can best support the design and investigation of online advertising, and (b) which specific adverts features and properties are key to understand and favor certain types of effects on users. By capitalizing on this benchmark knowledge on benefits of adverts and their hidden costs, web researchers and practitioners are encouraged to approach online advertising from a deeper and more comprehensive perspective, which is centered on qualities of web interaction that go beyond traditional usability factors. It is speculated that many of the theories and models developed for advertising effectiveness, and variables used to measure it, could and should be applied also when assessing the quality of the user experience when using websites in general, regardless of whether they contain adverts.     

Creation and evaluation of a multi-sensory virtual assembly environment

The multi-modal information presentation, integrated into the virtual environment （VE）, has potential for stimulating different senses, improving the user＇s impression of immersion, and increasing the amount of information that is accepted and processed by the user＇s perception system. The increase of the useful feedback information may reduce the user＇s cognitive load, thus enhancing the user＇s efficiency and performance while interacting with VEs. This paper presents our creation of a multi-sensory virtual assembly environment （VAE） and the evaluation of the effects of multi-sensory feedback on the usability. The VAE brings together complex technologies such as constraint-based assembly simulation, optical motion tracking technology, and real-time 3D sound generation technology around a virtual reality workbench and a common software platform. The usability evaluation is in terms of its three attributes： efficiency of use, user satisfaction, and reliability. These are addressed by using task completion times （TCTs）, questionnaires, and human performance error rates （HPERs）, respectively. Two assembly tasks have been used to perform the experiments, using sixteen participants. The outcomes showed that the multi-sensory feedback could improve the usability. They also indicated that the integrated feedback offered better usability than either feedback used in isolation. Most participants preferred the integrated feedback to either feedback （visual or auditory） or no feedback. The participants＇ comments demonstrated that nonrealistic or inappropriate feedback had negative effects on the usability, and easily made them feel frustrated. The possible reasons behind the outcomes are also analysed by using a unifying human computer interaction framework. The implications, concluded from the outcomes of this work, can serve as useful guidelines for improving VE system design and implementation.     

Smartphone Guide Technology in Cultural Spaces: Measuring Visitor Experience with an iPhone Multimedia Guide in Shakespeare’s Church

Smartphone technologies are now used to deploy audio and multimedia guides in cultural spaces, including historic churches. It is important to measure what effect the use of such technologies has on visitor experience of the cultural space and the usability and user experience of the guide. An “in the wild” study was conducted to investigate visitor experience in a historic church, with two versions of a multimedia iPhone Guide and with a traditional paper guide. The Church Experience Scale (CES) and the Multimedia Guide Scale (MMGS) were used to measure the experience of 59 visitors to Holy Trinity Church, Stratford-upon-Avon, known as Shakespeare’s church. A total of 40 visitors used an iPhone guide, 21 a free choice version and 19 a guided tour version, and 19 visitors used a paper guide. Results showed that participants with a smartphone guide had a significantly more positive visitor experience and spent significantly longer on their visit to the church. There was a significant correlation between length of visit and the Enjoyment, Intellectual Stimulation, and Curiosity factor of the CES, but further work is needed to understand the direction of causality in this relationship. The usability and user experience of the multimedia guide conditions did not differ from each other, but the results of the MMGS showed that both guides could be improved in terms of general usability and quality of interaction. Challenges of conducting a study “in the wild” of a smartphone app in a cultural space are discussed.     

增强现实技术综述

增强现实技术是将计算机渲染生成的虚拟场景与真实世界中的场景无缝融合起来的一种技术,它通过视频显示设备将虚实融合的场景呈现给用户,使人们与计算机之间的交互更加的自然,同时具有广泛的应用前景,因此成为近年来的一个研究热点。随着跟踪注册技术的进步、计算机性能的飞速发展、深度摄像机的普及,以及Light Field投影技术在增强现实中的应用,增强现实技术逐渐成为下一代人机交互的发展方向。该文章首先概述了增强现实的主要研究内容和发展情况,并详细介绍了增强现实的关键技术、开发工具,然后分类概述了增强现实应用案例。