Research and trends in the field of e-learning from 2001 to 2005: A content analysis of cognitive studies in selected journals

This paper provided a content analysis of studies in the field of cognition in e-learning that were published in five Social Sciences Citation Index (SSCI) journals (i.e. Computers and Education, British Journal of Educational Technology, Innovations in Education and Teaching International, Educational Technology Research & Development, and Journal of Computer Assisted Learning) from 2001 to 2005. Among the 1027 articles published in these journals from 2001 to 2005, 444 articles were identified as being related to the topic of cognition in e-learning. These articles were cross analyzed by published years, journal, research topic, and citation count. Furthermore, 16 highly-cited articles across different topics were chosen for further analysis according to their research settings, participants, research design types, and research methods. It was found from the analysis of the 444 articles that “Instructional Approaches,” “Learning Environment,” and “Metacognition” were the three most popular research topics, but the analysis of the citation counts suggested that the studies related to “Instructional Approaches,” “Information Processing” and “Motivation” might have a greater impact on subsequent research. Although the use of questionnaires might still be the main method of gathering research data in e-learning cognitive studies, a clear trend was observed that more and more studies were utilizing learners’ log files or online messages as data sources for analysis. The results of the analysis provided insights for educators and researchers into research trends and patterns of cognition in e-learning.     

Exploiting the wisdom of social connections to make personalized recommendations on scholarly articles

Existing scholarly publication recommenders were designed to aid researchers, as well as ordinary users, in discovering pertinent literature in diverse academic fields. These recommenders, however, often (i) depend on the availability of users’ historical data in the form of ratings or access patterns, (ii) generate recommendations pertaining to users’ (articles included in their) profiles, as oppose to their current research interests, or (iii) fail to analyze valuable user-generated data at social sites that can enhance their performance. To address these design issues, we propose PReSA, a personalized recommender on scholarly articles. PReSA recommends articles bookmarked by the connections of a user U on a social bookmarking site that are not only similar in content to a target publication P currently of interest to U but are also popular among U’s connections. PReSA (i) relies on the content-similarity measure to identify potential academic publications to be recommended and (ii) uses only information readily available on popular social bookmarking sites to make recommendations. Empirical studies conducted using data from CiteULike have verified the efficiency and effectiveness of (the recommendation and ranking strategies of) PReSA, which outperforms a number of existing (scholarly publication) recommenders.     

Electronic supply chains: Status & perspective

The area of e-commerce based supply chains (or e-supply chains) has received significant attention in the last two decades. Despite the high level of activity, the most recent reviews on this topic date back to the beginning of this century. In this paper, we analyzed the state of e-supply chain research published during January 2000–January 2015 AD, covering 165 articles from 47 ISI indexed journals. The analysis is performed using a five-dimensional framework comprising Topic-of-Study, Unit-of-Analysis, Research Perspective, Industry Type, and Research Method. Within these dimensions, Topic-of-Study plays a pivotal role, whereas the other four dimensions are analyzed around its sub-classification scheme. Our main objective is to establish a broader interdisciplinary understanding of the e-supply chain research domain, and to identify trends and gaps in contemporary e-supply chain theory and practice. The findings indicate that problems are addressed from different perspectives with varying levels of interest from researchers belonging to several academic disciplines including business, economics, engineering and social sciences. Our analysis also identified two distinct periods (2000–2006 and 2007 onwards) with different foci of research attention. The problems that received significant attention in the earlier period include innovation, adoption and barriers, and supply chain integration; while in the latter period, the focus seemed to have shifted towards supply chain integration and collaboration issues. Problems that received minimum interest across the two periods include customer relationship, economic and environmental impact.     

Community building and knowledge sharing by individuals with disabilities using social media

The use of social media to share information, enhance learning, and connect with an online community has grown rapidly over the past 10 years. As social media becomes a more common tool in both formal and informal education, it is imperative to understand how it is used by individuals with disabilities. Through a systematic study of the literature, 215 articles on social media used by individuals with disabilities were selected and 29 selected for in-depth thematic analysis. Six major themes were identified: community, cyberbullying, self-esteem, self-determination, access to technology, and accessibility. To confirm these six categories, we expanded our search, yielding an additional 30 articles, for a total 59 articles reviewed in-depth. Interactions between individuals with disabilities within online communities often had the goal of acquiring knowledge or learning new information. A communities of practice theoretical framework is used to discuss interactions among the elements of social media design, learning, and the building of community by individuals with disabilities.     

Graphical user interface (GUI) testing: Systematic mapping and repository

ContextGUI testing is system testing of a software that has a graphical-user interface (GUI) front-end. Because system testing entails that the entire software system, including the user interface, be tested as a whole, during GUI testing, test cases—modeled as sequences of user input events—are developed and executed on the software by exercising the GUI’s widgets (e.g., text boxes and clickable buttons). More than 230 articles have appeared in the area of GUI testing since 1991.ObjectiveIn this paper, we study this existing body of knowledge using a systematic mapping (SM).MethodThe SM is conducted using the guidelines proposed by Petersen et al. We pose three sets of research questions. We define selection and exclusion criteria. From the initial pool of 230 articles, published in years 1991–2011, our final pool consisted of 136 articles. We systematically develop a classification scheme and map the selected articles to this scheme.ResultsWe present two types of results. First, we report the demographics and bibliometrics trends in this domain, including: top-cited articles, active researchers, top venues, and active countries in this research area. Moreover, we derive the trends, for instance, in terms of types of articles, sources of information to derive test cases, types of evaluations used in articles, etc. Our second major result is a publicly-accessible repository that contains all our mapping data. We plan to update this repository on a regular basis, making it a “live” resource for all researchers.ConclusionOur SM provides an overview of existing GUI testing approaches and helps spot areas in the field that require more attention from the research community. For example, much work is needed to connect academic model-based techniques with commercially available tools. To this end, studies are needed to compare the state-of-the-art in GUI testing in academic techniques and industrial tools.     

Mining LMS data to develop an “early warning system” for educators: A proof of concept

Earlier studies have suggested that higher education institutions could harness the predictive power of Learning Management System (LMS) data to develop reporting tools that identify at-risk students and allow for more timely pedagogical interventions. This paper confirms and extends this proposition by providing data from an international research project investigating which student online activities accurately predict academic achievement. Analysis of LMS tracking data from a Blackboard Vista-supported course identified 15 variables demonstrating a significant simple correlation with student final grade. Regression modelling generated a best-fit predictive model for this course which incorporates key variables such as total number of discussion messages posted, total number of mail messages sent, and total number of assessments completed and which explains more than 30% of the variation in student final grade. Logistic modelling demonstrated the predictive power of this model, which correctly identified 81% of students who achieved a failing grade. Moreover, network analysis of course discussion forums afforded insight into the development of the student learning community by identifying disconnected students, patterns of student-to-student communication, and instructor positioning within the network. This study affirms that pedagogically meaningful information can be extracted from LMS-generated student tracking data, and discusses how these findings are informing the development of a customizable dashboard-like reporting tool for educators that will extract and visualize real-time data on student engagement and likelihood of success.     

Interplay between User Experience (UX) evaluation and system development

User Experience (UX) is a maturing research area pertaining to as well as extending beyond the traditional usability. Issues in the realm of usability may be amplified in UX because of its larger scope. Four key non-orthogonal issues are definition, modeling, method selection, and interplay between evaluation and development. Leveraging the legacy of a series of related research activities, this Special Issue (SI) aims to develop a deeper understanding of how evaluation feedback shapes software development, especially when experiential qualities such as fun, trust, esthetic values are concerned. Three articles addressing this specific topic from different perspectives and with different approaches are included in this SI.     

Re-examining the causal structure of information technology impact research

About 20 years ago, Markus and Robey noted that most research on IT impacts had been guided by deterministic perspectives and had neglected to use an emergent perspective, which could account for contradictory findings. They further observed that most research in this area had been carried out using variance theories at the expense of process theories. Finally, they suggested that more emphasis on multilevel theory building would likely improve empirical reliability. In this paper, we reiterate the observations and suggestions made by Markus and Robey on the causal structure of IT impact theories and carry out an analysis of empirical research published in four major IS journals, Management Information Systems Quarterly (MISQ), Information Systems Research (ISR), the European Journal of Information Systems (EJIS), and Information and Organization (I&O), to assess compliance with those recommendations. Our final sample consisted of 161 theory-driven articles, accounting for approximately 21% of all the empirical articles published in these journals. Our results first reveal that 91% of the studies in MISQ, ISR, and EJIS focused on deterministic theories, while 63% of those in I&O adopted an emergent perspective. Furthermore, 91% of the articles in MISQ, ISR, and EJIS adopted a variance model; this compares with 71% from I&O that applied a process model. Lastly, mixed levels of analysis were found in 14% of all the surveyed articles. Implications of these findings for future research are discussed.     

Wiki Scaffolding: Aligning wikis with the corporate strategy

Wikis are main exponents of collaborative development by user communities. This community may be created around the wiki itself (e.g., community of contributors in Wikipedia) or already exist (e.g., company employees in corporate wikis). In the latter case, the wiki is not created in a vacuum but as part of the information ecosystem of the hosting organization. As any other Information System resource, wiki success highly depends on the interplay of technology, work practice and the organization. Thus, wiki contributions should be framed along the concerns already in use in the hosting organization in terms of glossaries, schedules, policies, organigrams and the like. The question is then, how can corporate strategies permeate wiki construction while preserving wiki openness and accessibility? We advocate for the use of “Wiki Scaffoldings”, i.e., a wiki installation that is provided at the onset to mimic these corporate concerns: categories, users, templates, articles initialized with boilerplate text, are all introduced in the wiki before any contribution is made. To retain wikis' friendliness and engage layman participation, we propose scaffoldings to be described as mind maps. Mind maps are next “exported” as wiki installations. We show the feasibility of the approach introducing a Wiki Scaffolding Language (WSL). WSL is realized as a plugin for FreeMind, a popular tool for mind mapping. Finally, we validate the expressiveness of WSL in four case studies. WSL is available for download.     

On the Anatomy of Human Hacking

ABSTRACT

Human hacking is a nontechnical kind of intrusion that relies heavily on human manipulation. Its impact is continuously giving serious concern in the Information technology arena which has often been undermined due to the ease with which this technique is widely used to infiltrate networks through unsuspecting individuals that are undeniably considered the “weakest link” in the security circle. Security awareness that brings about behavioral change, reduces employees' vulnerability, and protects against threats exploiting employees' vulnerability having a positive impact overall on risks related to information assets. Strategies for developing and implementing a successful information security awareness program are presented in this article, which also provides an introduction to the subject of human hacking while discussing the various counter-measures available to minimize the likelihood of such occurrences and their financial, reputation, psychological, and legal ramifications.     

De-coding Our Scholarship: The State of Research in Computers and Writing from 2003–2008

Since its inception, the field of computers and writing has responded to rapid technological advancements that affect the research, practice, and teaching of writing. A potential consequence of addressing these advancements in teaching and practice, however, may be a reduced focus on foundational, empirical research. To examine the state of research in the field of computers and writing, we assessed the types of research published in four journals (Computers and Composition print, Computers and Composition Online, Kairos, and College Composition and Communication (CCC)) from late 2003/early 2004 to the end of 2008. We explored the state of research by investigating research approaches, design, and modes of inquiry over time. Within this context, we considered author gender, collaboration, and employment of interdisciplinary and mixed methods. We applied criteria from MacNealy (1998) to classify 26% of the computers and writing articles we analyzed as rigorous empirical research. We found a preference for qualitative research designs (56% of articles were qualitative) and, to a lesser degree, mixed methods (29%). While providing a sense of the state of the field as it matures, we conclude by presenting discussion questions on the role of research, research drivers, and ways to increase the quality of research and research reporting. We urge the field to consider the kinds of research we do, teach, and value.     

A systematic review of research on open source software in commercial software product development

Context

The popularity of the open source software development in the last decade, has brought about an increased interest from the industry on how to use open source components, participate in the open source community, build business models around this type of software development, and learn more about open source development methodologies. There is a need to understand the results of research in this area.

Objective

Since there is a need to understand conducted research, the aim of this study is to summarize the findings of research that has ben carried out on usage of open source components and development methodologies by the industry, as well as companies’ participation in the open source community.

Method

Systematic review through searches in library databases and manual identification of articles from the open source conference. The search was first carried out in May 2009 and then once again in May 2010.

Results

In 2009, 237 articles were first found, from which 19 were selected based on content and quality, and in 2010, 76 new articles were found from which four were selected. Twenty three articles were identified in total.

Conclusions

The articles could be divided into four categories: open source as part of component based software engineering, business models with open source in commercial organization, company participation in open source development communities, and usage of open source processes within a company.     

SDMSim: A manufacturing service supply–demand matching simulator under cloud environment

Nowadays, with the introduction and application of new information technologies in manufacturing, various advanced manufacturing modes and national strategies have been put forward and paid more and more attention, such as Industry 4.0, Industrial Internet, Cyber-Physical System or Cyber Manufacturing, Made in China 2025, Internet Plus Manufacturing, Cloud Manufacturing, etc. For these modes and strategies, how to realize the effective and intelligent supply–demand matching (SDM) of various manufacturing resources and capabilities (MR&C) in the form of service is one of the common issues and aims. In order to provide a uniformed research platform for related researchers both in academic and industry, the concept of manufacturing service SDM simulator (SDMSim) is proposed in this paper. A hypernetwork based architecture for the simulator is designed, as well as its seven key functions and subsystems, including manufacturing service management, manufacturing task management, manufacturing service SDM hypernetwork, manufacturing service SDM problem formulation and configuration, matching and scheduling algorithms/strategies selection and design, statistical analysis, and visualization. It illustrates that SDMSim has the potential to serve the users of manufacturing service provider, manufacturing service consumer, manufacturing service operator in the field of SoM, as well as the related researchers.     

Effects of a collaborative annotation method on students’ learning and learning-related motivation and affect

Two studies tested the effectiveness of a web-based collaborative annotation system (Hy-Lighter) for learning comprehension, and learning-related affect and motivation. In an undergraduate course setting, students (N = 27) in study 1, (1) highlighted and annotated selected articles, and (2) highlighted and annotated selected articles and reviewed peer highlights and annotations. In a graduate course setting, students (N = 40) in study 2, (1) highlighted and annotated selected articles, and (2) highlighted and annotated selected articles and reviewed peer highlights and annotations. Control groups in both studies read a hard copy of the articles -without using HyLighter and engaging in its associated annotation practices. The main dependent variables included: (a) performance on quizzes, and (b) a number of affective and motivational variables related to reading assignments and academic success. Although not statistically significant, summative assessment scores were higher for students using HyLigther relative to the ones exposed to conventional instruction. HyLighter use also seemed to be associated with more positive affect in undergraduate students relative to their graduate counterparts. Somewhat equivocal findings between the two studies were attributed to the differential implementation of the software in and outside of the classroom. Recommendations for optimal use and desired outcomes were advanced.     

Explaining authors’ contribution to pivotal artifacts during mass collaboration in the Wikipedia’s knowledge base

This article discusses the relevance of large-scale mass collaboration for computer-supported collaborative learning (CSCL) research, adhering to a theoretical perspective that views collective knowledge both as substance and as participatory activity. In an empirical study using the German Wikipedia as a data source, we explored collective knowledge as manifested in the structure of artifacts that were created through the collaborative activity of authors with different levels of contribution experience. Wikipedia’s interconnected articles were considered at the macro level as a network and analyzed using a network analysis approach. The focus of this investigation was the relation between the authors’ experience and their contribution to two types of articles: central pivotal articles within the artifact network of a single knowledge domain and boundary-crossing pivotal articles within the artifact network of two adjacent knowledge domains. Both types of pivotal articles were identified by measuring the network position of artifacts based on network analysis indices of topological centrality. The results showed that authors with specialized contribution experience in one domain predominantly contributed to central pivotal articles within that domain. Authors with generalized contribution experience in two domains predominantly contributed to boundary-crossing pivotal articles between the knowledge domains. Moreover, article experience (i.e., the number of articles in both domains an author had contributed to) was positively related to the contribution to both types of pivotal articles, regardless of whether an author had specialized or generalized domain experience. We discuss the implications of our findings for future studies in the field of CSCL.     

A computational literature review of football performance analysis through probabilistic topic modeling

This research aims to illustrate the potential use of concepts, techniques, and mining process tools to improve the systematic review process. Thus, a review was performed on two online databases (Scopus and ISI Web of Science) from 2012 to 2019. A total of 9649 studies were identified, which were analyzed using probabilistic topic modeling procedures within a machine learning approach. The Latent Dirichlet Allocation method, chosen for modeling, required the following stages: 1) data cleansing, and 2) data modeling into topics for coherence and perplexity analysis. All research was conducted according to the standards of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses in a fully computerized way. The computational literature review is an integral part of a broader literature review process. The results presented met three criteria: (1) literature review for a research area, (2) analysis and classification of journals, and (3) analysis and classification of academic and individual research teams. The contribution of the article is to demonstrate how the publication network is formed in this particular field of research, and how the content of abstracts can be automatically analyzed to provide a set of research topics for quick understanding and application in future projects.

     

MIS research strategies

Different strategies for conducting empirical research in the Management Information Systems (MIS) field are discussed. Strategies employed in 532 MIS articles published in 15 journals during the 1970–1979 time period are analyzed. The trends are analyzed over the ten year period with respect to the differences between articles authored by practitioners and academic, differences between articles that are cited frequently versus infrequently, and the relationship with the type of research conducted.The analysis points out that more than two thirds of published MIS research by either academicians or practitioners had utilized non-empirical approaches and focused on a single variable. Case studies are the most commonly employed empirical strategy and most studies do not measure the impact of independent variables on the process of using developing, or operating information systems. The analysis suggests that MIS journal articles employing empirical research strategies are cited more frequently than nonempirical ones.     

Agent mediated retailing in the connected local community

This paper reports on and discusses recent research into software agent mediated retailing and considers how it may act as a catalyst to the formation of local electronic retail communities. Each member of the e-retail community has their own software agent that acts on their behalf. Their software agent acts as an electronic personal sales assistant (ePSA), interacting with the person and assisting with the selection and purchase of products. We consider issues that arise when each person can express their likes and dislikes for various aspects of the product range to their software agent, both in terms of the software agent's ability to serve them better, and how such preferences may be shared with others in the larger community to help them—and others in the community—make better and more informed choices. The investigations reported use the multimedia access through personal persistent agents (MAPPA) system, an experimental kiosk based e-retail system. MAPPA integrates a software agent based architecture, a novel form of product display and the use of an animated character agent to enhance the user's sense of personalisation.We report on user evaluation studies of the MAPPA system to investigate the effectiveness of the character agent as an interface to the e-retail system using both conventional usability evaluation techniques and eye-tracking technology. We also describe a simulation program that allows us to investigate the dynamics of e-retail community cohesion when a number of different parameters are considered, including the characteristics of the individual community members and the algorithms employed by the software agents to share information. Lastly, we develop and discuss notions of loyalty, trust, reputation and preference, four issues critical to the development and maintenance of the relationships between individual people, their personal software agents, businesses and the larger e-retail connected community. We propose these issues as ‘supra-functional’ criteria for human–computer interaction design in this area.     

One-handed carrying among elderly and obese individuals: a systematic review to identify research gaps

Abstract

A systematic review of the literature regarding one-handed load carrying was conducted to identify research gaps for future load carrying studies. Twenty-six articles that may be relevant to elderly and obese people were included. Only two studies evaluated the effect of age as an independent variable during one-handed carrying. Obesity was not included as an independent variable in any of the articles. In general, the results suggested that one-handed carrying is more physically demanding than other methods of load carrying. In many cases, physiological responses to carrying a load in one hand were similar to carrying twice the load equally distributed between two hands. Some studies recommended a one-handed carrying weight limit of approximately 9–10?kg for men and 6–7?kg for women. However, more research on the effects of age and obesity during one-handed carrying is needed to determine if these results hold for elderly and obese people.

Practitioner Summary: A systematic review of the scientific literature since 1966 regarding one-handed carrying that may pertain to elderly and/or obese people was performed. Few studies were identified that included aging and none included obesity as independent variables. Areas for future research are identified and discussed.     

Immersive virtual reality in the age of the Metaverse: A hybrid-narrative review based on the technology affordance perspective

Immersive virtual reality (VR) that utilizes head-mounted displays (HMD) is one of the key emerging technologies of the 21st century and has drawn keen attention from consumers, practitioners, and scholars in various disciplines. Nevertheless, the information systems (IS) discipline has neglected immersive VR, given that only a handful of studies have been published in mainstream IS journals. However, the recent advancements in immersive VR technology provide new opportunities for organizations and IS researchers. In light of these points, we reviewed the immersive VR literature to provide a holistic view of opportunities and challenges for organizations and future research directions for the IS field. By examining the technical capabilities of immersive VR and the previous literature, we identified five affordances: embodiment, interactivity, navigability, sense-ability, and create-ability. Our review of the 151 studies from the IS and related fields synthesized how these affordances were utilized in various research domains. Guided by the affordance-actualization theory, we also identified the strategic opportunities and challenges that come with implementing VR. The actualization of immersive VR affordances in organizations is indeed a fruitful area for IS scholars as there are various venues to move the IS field as well as the VR research in the organizational context forward.