Context-aware recommendations through context and activity recognition in a mobile environment

The mobile Internet introduces new opportunities to gain insight in the user’s environment, behavior, and activity. This contextual information can be used as an additional information source to improve traditional recommendation algorithms. This paper describes a framework to detect the current context and activity of the user by analyzing data retrieved from different sensors available on mobile devices. The framework can easily be extended to detect custom activities and is built in a generic way to ensure easy integration with other applications. On top of this framework, a recommender system is built to provide users a personalized content offer, consisting of relevant information such as points-of-interest, train schedules, and touristic info, based on the user’s current context. An evaluation of the recommender system and the underlying context recognition framework shows that power consumption and data traffic is still within an acceptable range. Users who tested the recommender system via the mobile application confirmed the usability and liked to use it. The recommendations are assessed as effective and help them to discover new places and interesting information.     

基于用户行为周期的移动设备异常检测方法

本文提出了一种分布式的移动设备异常检测系统,该系统采用客户端-服务器架构,客户端程序在移动设备上持续提取特征并传送给服务器,服务器使用异常检测算法分析特征。根据人类日常活动的规律性以及用户使用移动设备的周期性,我们还提出了一种基于用户行为周期的异常检测方法,通过比较待检测特征向量和以往周期相近时间段的特征向量集的距离即可判定该特征向量是否异常,向量比较时采用不受特征间关联以及特征取值范围影响的马氏距离作为距离衡量的标准。实验证明我们采用的移动设备异常检测系统框架和检测方法能够有效提高对移动设备恶意程序的检测率。     

Positioning device for outdoor mobile robots using optical sensors and lasers

We propose a novel method for positioning a mobile robot in an outdoor environment using lasers and optical sensors. Position estimation via a noncontact optical method is useful because the information from the wheel odometer and the global positioning system in a mobile robot is unreliable in some situations. Contact optical sensors such as computer mouse are designed to be in contact with a surface and do not function well in strong ambient light conditions. To mitigate the challenges of an outdoor environment, we developed an optical device with a bandpass filter and a pipe to restrict solar light and to detect translation. The use of two devices enables sensing of the mobile robot’s position, including posture. Furthermore, employing a collimated laser beam allows measurements against a surface to be invariable with the distance to the surface. In this paper, we describe motion estimation, device configurations, and several tests for performance evaluation. We also present the experimental positioning results from a vehicle equipped with our optical device on an outdoor path. Finally, we discuss an improvement in postural accuracy by combining an optical device with precise gyroscopes.     

An adaptive rule-based approach for managing situation-awareness

Situation awareness is a powerful paradigm that can efficiently exploit the increasing capabilities of handheld devices, such as smart phones and PDAs. Indeed, accurate understanding of the current situation can allow the device to proactively provide information and propose services to users in mobility. Of course, to recognize the situation is a challenging task, due to such factors as the variety of possible situations, uncertain and imprecise data, and different user’s preferences and behavior.In this framework, we propose a robust and general rule-based approach to manage situation awareness. We adopt Semantic Web reasoning, fuzzy logic modeling, and genetic algorithms to handle, respectively, situational/contextual inference, uncertain input processing, and adaptation to the user’s behavior. We exploit an agent-oriented architecture so as to provide both functional and structural interoperability in an open environment. The system is evaluated by means of a real-world case study concerning resource recommendation. Experimental results show the effectiveness of the proposed approach.     

Hybrid indoor and outdoor location services for new generation mobile terminals

In the last years, an increasing interest in location services characterized the market of mobile ubiquitous devices (smartphones, handhelds, etc.). Several technologies and solutions have been developed to determine the position of mobile devices in their operating space, each with its specific degree of precision and accuracy. In this scenario, the ideal location service should be able of tracking the mobile terminal in any place it moves to, both indoors and outdoors. However, while outdoor location services have already achieved a satisfactory degree of technological maturity and effectiveness, a really ubiquitous location service that works satisfactorily in both indoor and outdoor scenarios is not yet available. In order to cope with the above challenge, this work proposes a hybrid location approach designed to choose and switch among multiple positioning technologies supported by the mobile device and available in the surrounding environment, in a dynamic and transparent way during the user movement. It combines signal strength–based fingerprinting techniques for indoor positioning together with traditional GPS-based positioning for the outdoor localization and performs opportunistic technology switching according to a count-and-threshold mechanism. The resulting solution is able to leverage the different features of the wireless networks and of the global positioning technologies, in order to provide ubiquitous location services across indoor and outdoor scenarios, as well as to minimize power consumption of the mobile device.     

Understanding user intent on the web through interaction mining

Predicting the goals of internet users can be extremely useful in e-commerce, online entertainment, and many other internet-based applications. One of the crucial steps to achieve this is to classify internet queries based on available features, such as contextual information, keywords and their semantic relationships. Beyond these methods, in this paper we propose to mine user interaction activities to predict the intent of the user during a navigation session. However, since in practice it is necessary to use a suitable mix of all such methods, it is important to exploit all the mentioned features in order to properly classify users based on their common intents. To this end, we have performed several experiments aiming to empirically derive a suitable classifier based on the mentioned features.     

Multimodal extraction of events and of information about the recording activity in user generated videos

In this work we propose methods that exploit context sensor data modalities for the task of detecting interesting events and extracting high-level contextual information about the recording activity in user generated videos. Indeed, most camera-enabled electronic devices contain various auxiliary sensors such as accelerometers, compasses, GPS receivers, etc. Data captured by these sensors during the media acquisition have already been used to limit camera degradations such as shake and also to provide some basic tagging information such as the location. However, exploiting the sensor-recordings modality for subsequent higher-level information extraction such as interesting events has been a subject of rather limited research, further constrained to specialized acquisition setups. In this work, we show how these sensor modalities allow inferring information (camera movements, content degradations) about each individual video recording. In addition, we consider a multi-camera scenario, where multiple user generated recordings of a common scene (e.g., music concerts) are available. For this kind of scenarios we jointly analyze these multiple video recordings and their associated sensor modalities in order to extract higher-level semantics of the recorded media: based on the orientation of cameras we identify the region of interest of the recorded scene, by exploiting correlation in the motion of different cameras we detect generic interesting events and estimate their relative position. Furthermore, by analyzing also the audio content captured by multiple users we detect more specific interesting events. We show that the proposed multimodal analysis methods perform well on various recordings obtained in real live music performances.     

An unsupervised approach to modeling personalized contexts of mobile users

Mobile context modeling is a process of recognizing and reasoning about contexts and situations in a mobile environment, which is critical for the success of context-aware mobile services. While there are prior works on mobile context modeling, the use of unsupervised learning techniques for mobile context modeling is still under-explored. Indeed, unsupervised techniques have the ability to learn personalized contexts, which are difficult to be predefined. To that end, in this paper, we propose an unsupervised approach to modeling personalized contexts of mobile users. Along this line, we first segment the raw context data sequences of mobile users into context sessions where a context session contains a group of adjacent context records which are mutually similar and usually reflect the similar contexts. Then, we exploit two methods for mining personalized contexts from context sessions. The first method is to cluster context sessions and then to extract the frequent contextual feature-value pairs from context session clusters as contexts. The second method leverages topic models to learn personalized contexts in the form of probabilistic distributions of raw context data from the context sessions. Finally, experimental results on real-world data show that the proposed approach is efficient and effective for mining personalized contexts of mobile users.     

Delay tolerant lazy release consistency for distributed shared memory in opportunistic networks

Opportunistic networks (ONs) allow mobile wireless devices to interact with one another through a series of opportunistic contacts. While ONs exploit mobility of devices to route messages and distribute information, the intermittent connections among devices make many traditional computer collaboration paradigms, such as distributed shared memory (DSM), very difficult to realize. DSM systems, developed for traditional networks, rely on relatively stable, consistent connections among participating nodes to function properly.We propose a novel delay tolerant lazy release consistency (DTLRC) mechanism for implementing distributed shared memory in opportunistic networks. DTLRC permits mobile devices to remain independently productive while separated, and provides a mechanism for nodes to regain coherence of shared memory if and when they meet again. DTLRC allows applications to utilize the most coherent data available, even in the challenged environments typical to opportunistic networks. Simulations demonstrate that DTLRC is a viable concept for enhancing cooperation among mobile wireless devices in opportunistic networking environment.     

Towards the semantic and context-aware management of mobile multimedia

Users of mobile devices can nowadays easily create large quantities of mobile multimedia documents tracing significant events attended, places visited or, simply, moments of their everyday life. However, they face the challenge of organizing these documents in order to facilitate searching through them at a later time and sharing them with other users. We propose using context awareness and semantic technologies in order to improve and facilitate the organization, annotation, retrieval and sharing of personal mobile multimedia documents. Our approach combines metadata extracted and enriched automatically from the users’ context with annotations provided manually by the users and with annotations inferred by applying user-defined rules to context features. These new contextual metadata are integrated into the processes of annotation, sharing and keyword-based retrieval.     

Context-aware mobile service for routing the fastest subway path

The rapid growth of the IT industry during the last few decades has increased demands on mobile devices such as PDAs, cellular phones, and GPS navigation systems. With emerging concepts of context-aware computing, the mobile devices can provide mobile users with timely information by using not only common knowledge but also environmental context such as current time and location. Lately, the context-aware applications have been actively investigated and have been contributed to numerous application areas such as real-time electronic catalogues and navigation systems for tourists. In this paper, we propose a new context-aware application for finding the fastest subway route. We have developed the proposed application as an implemented system named Optimize Your Time System (OYT System, for short). A terminal device of the OYT System is equipped with a GPS receiver and the system’s server contains a timetable of all trains in a target subway system. On perceiving users’ context such as current time and location automatically from GPS, the OYT System can display the optimal route which takes the shortest time for the user to reach the specified destination. In this paper, we present details of the OYT System and some experimental examples.     

基于电信数据的室外定位技术研究

越来越多的移动计算依赖位置信息提供基于位置的服务,移动设备的室外定位技术至关重要。目前广为采用的方式是GPS,但移动设备端的GPS位置信息依赖移动设备如手机的GPS传感器获取,电信运营商虽然为用户提供通话和数据服务,却无法获得用户的精确GPS位置。针对这种情况,提出利用手机端和电信基站之间的连接信号数据(简称电信数据),实现移动设备的定位服务。考虑到电信运营商积累了海量的电信数据,因此通过研究基于电信数据的室外定位技术,使得运营商获取用户位置成为可能。提取电信特征数据、以手机所在GPS位置作为标签数据,研究了五种基于机器学习模型的室外定位算法,实现了从基站信号数据到GPS坐标点的预测,通过大量的实验对比了这些方法的定位精度和运行时间、不同数据收集模式的定位精度、不同特征的定位精度以及探索了后处理对定位精度的提升效果。最终通过实验可知,基于栅格化的随机森林分类模型是效果最好的方法,能够达到15~20m的平均误差和10m的中位误差,比前期回归算法在2G和4G数据分别实现了39.46%和54.28%的精度提升,取得与GPS定位接近的定位精度。     

Context Aware Terrain Visualization for Wayfinding and Navigation

To assist wayfinding and navigation, the display of maps and driving directions on mobile devices is nowadays commonplace. While existing system can naturally exploit GPS information to facilitate orientation, the inherently limited screen space is often perceived as a drawback compared to traditional street maps as it constrains the perception of contextual information. Moreover, occlusion issues add to this problem if the environment is shown from the popular egocentric perspective. In this paper we describe an interactive visualization system that addresses these problems by reallocating the available screen space. At the heart of our system are three novel visualization techniques: First, we propose a non‐standard perspective that allows to blend between the familiar pedestrian perspective and a standard map depiction with reduced occlusion. Second, we derive an efficient deformation technique that allows an interactive allocation of screen space to areas of interest like e.g. nearby touristic attractions. Finally, a path adaptive isometric perspective is proposed that reveals otherwise hidden facades in top‐down views. We describe efficient implementations of all techniques and exemplify our interactive system on real world urban models.     

ML-SOR: Message routing using multi-layer social networks in opportunistic communications

Opportunistic networks are a generalization of DTNs in which disconnections are frequent and encounter patterns between mobile devices are unpredictable. In such scenarios, message routing is a fundamental issue. Social-based routing protocols usually exploit the social information extracted from the history of encounters between mobile devices to find an appropriate message relay. Protocols based on encounter history, however, take time to build up a knowledge database from which to take routing decisions. While contact information changes constantly and it takes time to identify strong social ties, other types of ties remain rather stable and could be exploited to augment available partial contact information. In this paper, we start defining a multi-layer social network model combining the social network detected through encounters with other social networks and investigate the relationship between these social network layers in terms of node centrality, community structure, tie strength and link prediction. The purpose of this analysis is to better understand user behavior in a multi-layered complex network combining online and offline social relationships. Then, we propose a novel opportunistic routing approach ML-SOR (Multi-layer Social Network based Routing) which extracts social network information from such a model to perform routing decisions. To select an effective forwarding node, ML-SOR measures the forwarding capability of a node when compared to an encountered node in terms of node centrality, tie strength and link prediction. Trace driven simulations show that a routing metric combining social information extracted from multiple social network layers allows users to achieve good routing performance with low overhead cost.     

A web-based pervasive recommendation system for mobile tourist guides

Mobile tourist guides have attracted considerable research interest during the past decade, resulting in numerous standalone and web-based mobile applications. Particular emphasis has been given to personalization of services, typically based on travel recommender systems used to assist tourists in choosing places to visit; these systems address an important aspect of personalization and hence reduce the information burden for the user. However, existing systems fail to exploit information, behaviours, evaluations or ratings of other tourists with similar interests, which would potentially provide ground for the cooperative production of improved tourist content and travel recommendations. In this paper, we extend this notion of travel recommender systems utilizing collaborative filtering techniques while also taking into account contextual information (such as the current user’s location, time, weather conditions and places already visited by the user) for deriving improved recommendations in pervasive environments. We also propose the use of wireless sensor network (WSN) installations around tourist sites for enabling precise localization and also providing mobile users convenient and inexpensive means for uploading tourist information and ratings about points of interest (POI) via their mobile devices. We also introduce the concept of ‘context-aware rating’, whereby user ratings uploaded through WSN infrastructures are weighted higher to differentiate among users that rate POIs using the mobile tourist guide application while onsite and others using the Internet away from the POI.     

Distributed user interfaces in public spaces using RFID-based panels

The combination and integration of services between mobile computing and context-aware applications responds to the use of mobile devices defining a wide range of distributed user interfaces to support social activities. In this paper, we propose a novel solution that combines social software with context awareness to improve users' interaction in public spaces. This approach is based on the concept of collaborative interactive panels where users share their opinions and ideas about environmental issues by performing natural gestures. And so, taking advantage of physical resources already available in public spaces combined with the use of well-known technologies, such as mobile devices and RFID, we extend the concept of social software from the Web to physical public scenarios, such as bus stations, squares, etc. As an example, we present a case of study that encourage citizens' participation in decisions related to the community environmental issues reducing the gap between the social software and users.     

Indoor scene recognition by a mobile robot through adaptive object detection

Mobile robotics has achieved notable progress, however, to increase the complexity of the tasks that mobile robots can perform in natural environments, we need to provide them with a greater semantic understanding of their surrounding. In particular, identifying indoor scenes, such as an Office or a Kitchen, is a highly valuable perceptual ability for an indoor mobile robot, and in this paper we propose a new technique to achieve this goal. As a distinguishing feature, we use common objects, such as Doors or furniture, as a key intermediate representation to recognize indoor scenes. We frame our method as a generative probabilistic hierarchical model, where we use object category classifiers to associate low-level visual features to objects, and contextual relations to associate objects to scenes. The inherent semantic interpretation of common objects allows us to use rich sources of online data to populate the probabilistic terms of our model. In contrast to alternative computer vision based methods, we boost performance by exploiting the embedded and dynamic nature of a mobile robot. In particular, we increase detection accuracy and efficiency by using a 3D range sensor that allows us to implement a focus of attention mechanism based on geometric and structural information. Furthermore, we use concepts from information theory to propose an adaptive scheme that limits computational load by selectively guiding the search for informative objects. The operation of this scheme is facilitated by the dynamic nature of a mobile robot that is constantly changing its field of view. We test our approach using real data captured by a mobile robot navigating in Office and home environments. Our results indicate that the proposed approach outperforms several state-of-the-art techniques for scene recognition.     

Mobility at work: A typology of mobile communities of practice and contextual ambidexterity

Innovations in mobile technology shape how mobile workers share knowledge and collaborate on the go. We introduce mobile communities of practice (MCOPs) as a lens for understanding how these workers self-organize, and present three MCOP case studies. Working from contextual ambidexterity, we develop a typology of bureaucratic, anarchic, idiosyncratic and adhocratic MCOPs. We discuss how variations in the degree of organizational alignment and individual discretion shape the extent to which these types explore and exploit mobile work practices and approach organizational ambidexterity. This article concludes with important strategic implications for managing mobile work and practical considerations for identifying, creating, and supporting MCOPs.     

Inferring contextual preferences using deep encoder-decoder learners

ABSTRACT

Context-aware systems enable the sensing and analysis of user context in order to provide personalised services. Our study is part of growing research efforts examining how high-dimensional data collected from mobile devices can be utilised to infer users’ dynamic preferences that are learned over time. We suggest novel methods for inferring the category of the item liked in a specific contextual situation, by applying encoder-decoder learners (long short-term memory networks and auto encoders) on mobile sensor data. In these approaches, the encoder-decoder learners reduce the dimensionality of the contextual features to a latent representation which is learned over time. Given new contextual sensor data from a user, the latent patterns discovered from each deep learner is used to predict the liked item’s category in the given context. This can greatly enhance a variety of services, such as mobile online advertising and context-aware recommender systems. We demonstrate our contribution with a point of interest (POI) recommender system in which we label contextual situations with the items’ categories. Empirical results utilising a real world data set of contextual situations derived from mobile phones sensors log show a significant improvement (up to 73% improvement) in prediction accuracy compared with state of the art classification methods.     

Realtime training on mobile devices for face recognition applications

Due to the increases in processing power and storage capacity of mobile devices over the years, an incorporation of realtime face recognition to mobile devices is no longer unattainable. However, the possibility of the realtime learning of a large number of samples within mobile devices must be established. In this paper, we attempt to establish this possibility by presenting a realtime training algorithm in mobile devices for face recognition related applications. This is differentiated from those traditional algorithms which focused on realtime classification. In order to solve the challenging realtime issue in mobile devices, we extract local face features using some local random bases and then a sequential neural network is trained incrementally with these features. We demonstrate the effectiveness of the proposed algorithm and the feasibility of its application in mobile devices through empirical experiments. Our results show that the proposed algorithm significantly outperforms several popular face recognition methods with a dramatic reduction in computational speed. Moreover, only the proposed method shows the ability to train additional samples incrementally in realtime without memory failure and accuracy degradation using a recent mobile phone model.