Using Distributable User Interfaces in CSCL In-Situ Classrooms

Distributable user interfaces enable users to distribute user interface interaction objects (i.e. panels, buttons, input fields, checkboxes, etc.) across different displays using a set of distribution primitives to manipulate them in real time. This work presents how this kind of user interfaces facilitates the computer supported collaborative learning in modern classrooms. These classrooms provide teachers and students with display ecosystems consisting of stationary displays, such as smart projectors and smart TVs as well as mobile displays owned by teachers and students, such as smartphones, tablets, and laptops. The distribution of user interface interaction objects enables teachers to modify the user interface interaction objects that are available to students in real time to control and promote the collaboration and participation among them during learning activities. We propose the development of this type of applications using an extension of the CAMELEON reference framework that supports the definition of UI distribution models. The Essay exercise is presented as a case of study where teachers control the collaboration among students by distributing user interface interaction objects.     

Customizing User Interaction in Smart Phones

Emerging input modalities could facilitate more efficient user interactions with mobile devices. An end-user customization tool based on user-defined context-action rules lets users specify personal, multimodal interaction with smart phones and external appliances. The tool's input modalities include sensor-based, user-trainable free-form gestures; pointing with radio frequency tags; and implicit inputs based on such things as sensors, the Bluetooth environment, and phone platform events. The tool enables user-defined functionality through a blackboard-based context framework enhanced to manage the rule-based application control. Test results on a prototype implemented on a smart phone with real context sources show that rule-based customization helps end users efficiently customize their smart phones and use novel input modalities.     

An integrated framework of user experience-oriented smart service requirement analysis for smart product service system development

The rapid deployment of digital technologies drives the conventional product service system (PSS) to shift into a new paradigm known as smart PSS. Empowered with smart capabilities, smart PSS has great potential in creating positive user experience (UX). The requirements analysis is an essential task for successful development of smart PSS with strong UX. Nevertheless, there is still a lack of research on the requirement analysis of smart PSS by incorporating smart-enabled UX perspective. Hence, this paper proposes a framework of user experience-oriented smart service requirement (UXO-SSR) analysis for smart PSS development. At first, the relevant factors (e.g., user personas and activity journey) are integrated to conceptualize the UX in smart PSS context. Second, a four-phase model is proposed for identifying UXO-SSR, which can provide an effective tool for acquiring UX requirements of smart PSS from holistic perspective. Third, a novel asymmetric trapezium cloud-based uncertain linguistic BWM approach is developed to evaluate the priority of the identified UXO-SSRs. The approach can appropriately handle the hybrid uncertainties (i.e., hesitancy, fuzziness and randomness) of linguistic evaluation information, thereby improving the accuracy of evaluation results. Finally, a case study of smart sleep service system is presented to demonstrate the feasibility and reliability of the proposed framework.     

Human interaction with IoT-based smart environments

This paper describes concepts, design, implementation, and performance evaluation of a 3D-based user interface for accessing IoT-based Smart Environments (IoT-SE). The generic interaction model of the described work addresses some major challenges of Human-IoT-SE-Interaction such as cognitive overload associated with manual device selection in complex IoT-SE, loss of user control, missing system image or over-automation. To address these challenges we propose a 3D-based mobile interface for mixed-initiative interaction in IoT-SE. The 3D visualization and 3D UI, acting as the central feature of the system, create a logical link between physical devices and their virtual representation on the end user’s mobile devices. By so doing, the user can easily identify a device within the environment based on its position, orientation, and form, and access the identified devices through the 3D interface for direct manipulation within the scene. This overcomes the problem of manual device selection. In addition, the 3D visualization provides a system image for the IoT-SE, which supports users in understanding the ambience and things going on in it. Furthermore, the mobile interface allows users to control the amount and the way the IoT-SE automates the environment. For example, users can stop or postpone system triggered automatic actions, if they don’t like or want them. Users also can remove a rule forever. By so doing, users can delete smart behaviors of their IoT-SE. This helps to overcome the automation challenges. In this paper, we present the design, implementation and evaluation of the proposed interaction system. We chose smart meeting rooms as the context for prototyping and evaluating our interaction concepts. However, the presented concepts and methods are generic and could be adapted to similar environments such as smart homes. We conducted a subjective usability evaluation (ISO-Norm 9241/110) with 16 users. All in one the study results indicate that the proposed 3D-User Interface achieved a good high score according to the ISO-Norm scores.     

Exploring educational immersive videogames: an empirical study with a 3D multimodal interaction prototype

ABSTRACT

Gestural interaction devices emerged and originated various studies on multimodal human–computer interaction to improve user experience (UX). However, there is a knowledge gap regarding the use of these devices to enhance learning. We present an exploratory study which analysed the UX with a multimodal immersive videogame prototype, based on a Portuguese historical/cultural episode. Evaluation tests took place in high school environments and public videogaming events. Two users would be present simultaneously in the same virtual reality (VR) environment: one as the helmsman aboard Vasco da Gama’s fifteenth-century Portuguese ship and the other as the mythical Adamastor stone giant at the Cape of Good Hope. The helmsman player wore a VR headset to explore the environment, whereas the giant player used body motion to control the giant, and observed results on a screen, with no headset. This allowed a preliminary characterisation of UX, identifying challenges and potential use of these devices in multi-user virtual learning contexts. We also discuss the combined use of such devices, towards future development of similar systems, and its implications on learning improvement through multimodal human–computer interaction.     

User interfaces for mobile content

The UI must be designed to facilitate the widespread and increased use of mobile content. Current UI approaches in the computing domain - such as windows, icons, menus, and pointing (WIMP) - are inadequate and inappropriate for mobile applications. Mobile device constraints pose several UI design challenges. UIs for emerging mobile devices consist of hardware and software combinations such as additional buttons for text input and special functional keys, touch-sensitive screens, audio/visual interfaces, and haptic interfaces to provide virtual-reality (VR) experiences. Analysts expect that third-generation mobile phones and beyond will be conduits for enormous amounts of multimedia content. Several major issues along a variety of dimensions must be addressed in the design and provision of content to these mobile devices. Because they are crucial for enhancing the user experience and enabling the effective consumption of mobile content, UIs are therefore among the major issues that need further study and work.     

Development of a virtual aquarium system interacting with a smart device

New applications of smart devices interacting with other computing devices are recently providing interesting and feasible solutions in ubiquitous computing environments. In this study, we propose an interactive virtual aquarium system that interacts with a smart device as a user interface. We developed a virtual aquarium graphic system and a remote interaction application of a smart device for building an interactive virtual aquarium system. We performed an experiment that demonstrates the feasibility and the effectiveness of the proposed system as an example of a new type of interactive application of a smart display, where a smart device serves as a remote user interface.     

The value of handhelds in smart environments

The severe resource restrictions of computer-augmented everyday artifacts imply substantial problems for the design of applications in smart environments. Some of these problems can be overcome by exploiting the resources, I/O interfaces, and computing capabilities of nearby mobile devices in an ad-hoc fashion. We identify the means by which smart objects can make use of handheld devices such as PDAs and mobile phones, and derive the following major roles of handhelds in smart environments: (1) mobile infrastructure access point; (2) user interface; (3) remote sensor; (4) mobile storage medium; (5) remote resource provider; and (6) weak user identifier. We present concrete applications that illustrate these roles, and describe how handhelds can serve as mobile mediators between computer-augmented everyday artifacts, their users, and background infrastructure services. The presented applications include a remote interaction scenario, a smart medicine cabinet, and an inventory monitoring application.     

User experience-a research agenda

Over the last decade, 'user experience' (UX) became a buzzword in the field of human - computer interaction (HCI) and interaction design. As technology matured, interactive products became not only more useful and usable, but also fashionable, fascinating things to desire. Driven by the impression that a narrow focus on interactive products as tools does not capture the variety and emerging aspects of technology use, practitioners and researchers alike, seem to readily embrace the notion of UX as a viable alternative to traditional HCI. And, indeed, the term promises change and a fresh look, without being too specific about its definite meaning. The present introduction to the special issue on 'Empirical studies of the user experience' attempts to give a provisional answer to the question of what is meant by 'the user experience'. It provides a cursory sketch of UX and how we think UX research will look like in the future. It is not so much meant as a forecast of the future, but as a proposal - a stimulus for further UX research.     

A novel mobile device user interface with integrated social networking services

Modern mobile devices support accessing Web-based social networking services from the user interface (UI) of Web browsers, applications, and mobile widgets. While effectively accessing these services, people may find it tedious to switch between multiple user interfaces in order to be aware of the latest content. Aiming for an improved user experience, we experimented with integration of these services into mobile devices' main user interface. The integrated content is presented beyond application silos and automatically filtered to highlight the relevant elements. A mobile system called LinkedUI was developed and deployed in one lab test and one field study. Three findings emerge from these studies. Firstly, it is feasible to construct an alternative device UI that supports integration of Web content across applications and services via hyperlinking. Time, publisher (e.g., contacts), content types, and geographical locations are key dimensions for association of content. Secondly, the alternative device UI enables better usability of accessing social networking services than accessing them from individual Web sites on mobile devices. It helps people to be aware of the latest content during microbreaks. Thirdly, automatic filtering, on the basis of one user's data, is one promising approach to identifying relevant content. Given filtered content, most people using the automatic filtering approved the functionality and experienced a better sense of control that is arguably due to the reduced information volume.     

Who will buy smart glasses? Empirical results of two pre-market-entry studies on the role of personality in individual awareness and intended adoption of Google Glass wearables

Recent market studies reveal that augmented reality (AR) devices, such as smart glasses, will substantially influence the media landscape. Yet, little is known about the intended adoption of smart glasses, particularly: Who are the early adopters of such wearables? We contribute to the growing body of research that investigates the role of personality in predicting media usage by analyzing smart glasses, such as Google Glass or Microsoft Hololens. First, we integrate AR devices into the current evolution of media and technologies. Then, we draw on the Big Five Model of human personality and present the results from two studies that investigate the direct and moderating effects of human personality on the awareness and innovation adoption of smart glasses. Our results show that open and emotionally stable consumers tend to be more aware of Google Glass. Consumers who perceive the potential for high functional benefits and social conformity of smart glasses are more likely to adopt such wearables. The strength of these effects is moderated by consumers’ individual personality, particularly by their levels of openness to experience, extraversion and neuroticism. This article concludes with a discussion of theoretical and managerial implications for research on technology adoption, and with suggestions for avenues for future research.     

Design and implementation of a smart system for personalization and accurate selection of mobile services

Wireless mobile services are computing applications that run on handheld wireless devices. Such applications must work within the daunting constraints of the devices, which include memory, processing power, input capabilities, and size of display. It is therefore important that mobile services take into account the user’s context, optimize resource usage, and minimize input effort imposed on the user. In this paper, we present the design and implementation of a smart agent-enabled system for personalizing wireless mobile services and advertisements for Java 2 Micro Edition (J2ME) or Java ME, and Wireless Application Protocol (WAP) enabled devices. We use software agents for context filtering because such autonomous software entities have characteristics that can benefit mobile devices and the wireless environment, and the Composite Capability/Preference Profiles (CC/PP) standard for defining profiles for user preferences and device capabilities. The system incorporates the use of artificial neural networks to adaptively and iteratively learn to select the best available service based on contextual information. The system is evaluated using practical operating scenarios, as well as empirical data and results show an 87% success rate in the selection of the best available service.     

Reality-based interaction affecting mental workload in virtual reality mental arithmetic training

ABSTRACT

The concept of digital game-based learning (DGBL) evolves rapidly together with technological enhancements of virtual reality (VR) and smart phones. However, the mental workload (MWL) that VR-training applications demand and motivational qualities originating from user experience (UX) should be identified in order to create effective and enjoyable training/learning challenges that fit with individual users’ capabilities. This study examined the effects of reality-based interaction (RBI) and VR on measures of student motivation and MWL, in a mental arithmetic game for secondary school pupils. In a randomised controlled trial with sixty school children, a mental arithmetic game was tested with three different interaction and two different presentation methods – VR RBI, VR head-mounted-display tapping and tablet flick-gesture. Results found a significant effect of RBI on MWL but no differences in enjoyment of training were found between VR-experience and tablet training-experience. In fact, adding the gaming-context to the mental arithmetic task created an enjoyable, motivating experience regardless of presentation or interaction-style.     

Ubiquitous WiFi and Acoustic Sensing: Principles,Technologies, and Applications

Journal of Computer Science and Technology - With the increasing pervasiveness of mobile devices such as smartphones, smart TVs, and wearables, smart sensing, transforming the physical world into...     

Evaluating the benefits of multimodal interface design for CoMPASS—a mobile GIS

The context of mobility raises many issues for geospatial applications providing location-based services. Mobile device limitations, such as small user interface footprint and pen input whilst in motion, result in information overload on such devices and interfaces which are difficult to navigate and interact with. This has become a major issue as mobile GIS applications are now being used by a wide group of users, including novice users such as tourists, for whom it is essential to provide easy-to-use applications. Despite this, comparatively little research has been conducted to address the mobility problem. We are particularly concerned with the limited interaction techniques available to users of mobile GIS which play a primary role in contributing to the complexity of using such an application whilst mobile. As such, our research focuses on multimodal interfaces as a means to present users with a wider choice of modalities for interacting with mobile GIS applications. Multimodal interaction is particularly advantageous in a mobile context, enabling users of location-based applications to choose the mode of input that best suits their current task and location. The focus of this article concerns a comprehensive user study which demonstrates the benefits of multimodal interfaces for mobile geospatial applications.     

基于事件的虚拟现实用户体验评估方法研究

近年来,随着虚拟现实(Virtual Reality,VR)技术的逐渐成熟,我国VR产业处于高速增长的态势。虽然VR的发展为内容设计提供了许多新的可能性,但由于VR应用的设计不成熟,VR行业的从业者们仍面临着严峻的挑战,VR中的设计仍需要通过用户使用来验证是否可行。因此,用户体验(User Experience,UX)研究对于成功设计VR软件至关重要。同时,随着用户对内容质量要求的提高,VR内容是否有足够的吸引力将在很大程度上影响用户体验,决定了用户是否会进行更进一步的VR体验。因此,如何评估VR用户体验并找到影响用户体验的内容对于提高用户体验和用户黏性至关重要。目前,对VR的研究集中在硬件和软件的改善上,对内容设计的关注较少,对用户体验的评价也没有统一且明确的标准。文中尝试找出用户体验和用户特性以及VR内容之间的关联。首先,定义了4种类型的VR交互事件,并设计了一份问卷来收集测试者的用户特性及其主观评价。其次,将80名测试者分成两组,在固定的时间内体验两种类型的VR产品,在实验过程中,测试者的客观生理数据与参与实验的整个过程都被记录下来。最后,采用统计学方法和改进的Prism算法,找出了用户特性、游戏交互事件类型与用户体验之间的相关性。文中对VR用户体验规范化评估进行了初步尝试,实验结果可以为VR内容设计人员和开发人员提供参考。     

Interactive multi-frame reconstruction for mobile devices

The small size of handheld devices, their video capabilities and multiple cameras are under-exploited assets. Properly combined, the features can be used for creating novel applications that are ideal for pocket-sized devices, but may not be useful in laptop computers, such as interactively capturing and analyzing images on the fly. In this paper we consider building mosaic images of printed documents and natural scenes from low resolution video frames. High interactivity is provided by giving a real-time feedback on the video quality, while simultaneously guiding the user’s actions. In our contribution, we analyze and compare means to reach interactivity and performance with sensor signal processing and GPU assistance. The viability of the concept is demonstrated on a mobile phone. The achieved usability benefits suggest that combining interactive imaging and energy efficient high performance computing could enable new mobile applications and user interactions.     

Touchable area: An empirical study on design approach considering perception size and touch input behavior

As the use of mobile touch devices continues to increase, distinctive user experiences can be provided through a direct manipulation. Therefore, the characteristics of touch interfaces should be considered regarding their controllability. This study aims to provide a design approach for touch-based user interfaces. A derivation procedure for the touchable area is proposed as a design guideline based on input behavior. To these ends, two empirical tests were conducted through a smart phone interface. Fifty-five participants were asked to perform a series of input tasks on a screen. As results, touchable area with a desirable hit rate of 90% could be yielded depending on the icon design. To improve the applicability of the touchable area, user error was analyzed based on omission-commission classification. The most suitable design had a hit rate of 95% compared to 90 and 99%. This study contributes practical implications for user interaction design with finger-based controls.Relevance to industryThis research describes a distinctive design approach that guarantees the desired touch accuracy for effective use of mobile touch devices. Therefore, the results will encourage interface designers to take into account the input behavior of fingers from a user-centered perspective.     

The evaluation of user experience of a human walking and a driving simulation in the virtual reality

Virtual reality (VR) has been implemented in various applications such as gaming, e-learning, rehabilitation, etc. Although many studies have been conducted to evaluate the user experiences (UX) of various applications in VR, there are few studies evaluating the UX of VR in a holistic view. Since user experience means holistic feelings caused by attributes like efficiency, effectiveness, pleasure, and attractiveness, it is necessary to evaluate user experience in many respects, including presence, usability, and workload. Therefore, this study aims to evaluate the UX of VR in four various metrics: presence, workload, usability, and flow. In this study, the user experience factor was confirmed through the previous studies comparing visual display terminals (VDT) and head-mounted displays (HMD). In addition, the UX difference between VDT and HMD in two different situations, walking and driving, is analyzed. The data of 26 participants were analyzed and found that there were significant differences in the four studied metrics related to UX. In the driving situation, the usability value was higher in VDT, whereas they were higher in HMD for walking. Comparing the two contexts in HMD, walking was significantly higher in three metrics: presence, usability, and flow. The results show that HMD is better in terms of user experience than VDT, and HMD is more suitable for walking situations than for driving situations. Through this study, in terms of user experience, it is suitable to replace walking tasks with VR when the experiment in a real-world environment is impossible.     

Identification of UX dimensions for incident reporting systems with mobile applications in urban contexts: a longitudinal study

Incident reporting systems enable end-users to report problems that they have experienced in their working activities to authorities. Such applications are sought to sense the quality of the environment, thus enabling authorities to promote safety and well-being among citizens. Many governments are now promoting the use of mobile applications allowing citizens to report incidents in their neighbourhood to the administration. Nonetheless, it is not clear which user experience dimensions affect the adoption of incident reporting systems, and to what extent anticipated use of the system (anticipated UX) is a determinant for predicting the user experience with the final application. In order to understand how citizens perceive incident reporting systems and which factors affect the user experience (UX), we have performed empirical studies including interviews in early phases of the development process and empirical user testing of advanced prototypes. In this paper, we present the results of a longitudinal study on the evolution of the perception of UX dimensions along the development process, from interviews to running prototypes. Hereafter, we describe the method that has been used for coding the findings of these empirical studies according to six UX dimensions (including visual and aesthetic experience, emotions, stimulation, identification, meaning & value and social relatedness/co-experience). Moreover, we describe how the findings have been associated with users’ tasks. The findings from interviews and user testing indicate that whilst the perceived importance of some UX dimensions (such as identification and meaning & value) remains similar over time, other dimensions such as stimulation and emotions do evolve. Beyond the practical implications of this study for the design of incident reporting systems, this work presents an approach that allows comparing the results of UX assessments in different phases of the process.