Workshop Report: Software Quality Assurance Standards Under Development

Definitions and processes related to software quality must be standardized, according to most participants in the recent ACM Software Quality Assurance Workshop. The need for such standards will become even more apparent over the next five to eight years, since the Department of Defense is expected to require their use for software acquisition.     

Plan Recognition and Evaluation for On-line Critiquing

The Traum-AID system is a tool for assisting physicians during the management of patients with severe injuries. Originally, Traum-AID was conceived as a rule-based expert system combined with a planner. After this architecture had been implemented, we began to face the issue of how Traum-AID could communicate its plans to physicians in order to influence their behavior and have a positive effect on patient outcome. This paper describes Trauma-TIQ – the critiquing interface for Traum-AID – which examines the actions the physician intends to carry out and produces a critique in response to those intentions. Trauma-TIQ's two main components are a plan recognizer that uses the context of the case to disambiguate plans, and a plan evaluator that identifies errors and calculates their significance in order to determine an appropriate response. Unlike previously developed reminder systems, Trauma-TIQ evaluates the physician's proposed plan and attempts to intervene before problems occur. And unlike previous critiquing systems, it is able to provide ongoing decision support during the planning and delivery of care. In the context of time-critical patient management it is, therefore, a more appropriate means of interaction.     

Interactive Critiquing forCatalog Navigation in E-Commerce

E-commerce sites can have large, essentiallyunbounded, catalogs. With large catalogs comesincreasing difficulty for buyers in making useof standard search and browsing facilities.Particularly in the case of casual oroccasional buyers and in the case of complexproducts, the gap between a product'sspecifications and the buyer's understanding ofneed can be hard to bridge. An effectivee-commerce catalog must map user needs toproducts that can fulfill them. This paperdescribes an interactive, incremental,case-based, critiquing approach to solving thisproblem. The approach is interactive andincremental, so it does not require that theuser have a completely specified need at thestart. The system is case-based in that itemphasizes products over features orconstraints, and uses case-based reasoningtechniques for its product retrieval. Finally,the approach is based on the critiquing ofpresented examples, each critique redirectingthe search to home in on appropriate products.     

Interaction design guidelines on critiquing-based recommender systems

A critiquing-based recommender system acts like an artificial salesperson. It engages users in a conversational dialog where users can provide feedback in the form of critiques to the sample items that were shown to them. The feedback, in turn, enables the system to refine its understanding of the user’s preferences and prediction of what the user truly wants. The system is then able to recommend products that may better stimulate the user’s interest in the next interaction cycle. In this paper, we report our extensive investigation of comparing various approaches in devising critiquing opportunities designed in these recommender systems. More specifically, we have investigated two major design elements which are necessary for a critiquing-based recommender system: critiquing coverage—one vs. multiple items that are returned during each recommendation cycle to be critiqued; and critiquing aid—system-suggested critiques (i.e., a set of critique suggestions for users to select) vs. user-initiated critiquing facility (i.e., facilitating users to create critiques on their own). Through a series of three user trials, we have measured how real-users reacted to systems with varied setups of the two elements. In particular, it was found that giving users the choice of critiquing one of multiple items (as opposed to just one) has significantly positive impacts on increasing users’ decision accuracy (particularly in the first recommendation cycle) and saving their objective effort (in the later critiquing cycles). As for critiquing aids, the hybrid design with both system-suggested critiques and user-initiated critiquing support exhibits the best performance in inspiring users’ decision confidence and increasing their intention to return, in comparison with the uncombined exclusive approaches. Therefore, the results from our studies shed light on the design guidelines for determining the sweetspot balancing user initiative and system support in the development of an effective and user-centric critiquing-based recommender system.

A model for critiquing based on automated medical records

We describe the design of a critiquing system, HyperCritic, that relies on automated medical records for its data input. The purpose of the system is to advise general practitioners who are treating patients who have hypertension. HyperCritic has access to the data stored in a primary-care information system that supports a fully automated medical record. Hyper-Critic relies on data in the automated medical record to critique the management of hypertensive patients, avoiding a consultation-style interaction with the user. The first step in the critiquing process involves the interpretation of the medical record in an attempt to discover the physician's actions and decisions. After detecting the relevant events in the medical record, HyperCritic views the task of critiquing as the assignment of critiquing statements to these patient-specific events. Critiquing statements are defined as recommendations involving one or more suggestions for possible modifications in the actions of the physician. The core of the model underlying HyperCritic is that the process of generating the critiquing statements is viewed as the application of a limited set of abstract critiquing tasks. We distinguish four categories of critiquing tasks: preparation tasks, selection tasks, monitoring tasks, and responding tasks. The execution of these critiquing tasks requires specific medical factual knowledge. This factual knowledge is separated from the critiquing tasks and is stored in a medical fact base. The principal advantage demonstrated by HyperCritic is the adaption of a domain-independent critiquing structure. We show how this domain-independent critiquing structure can be used to facilitate knowledge acquisition and maintenance of the system.     

从软件质量控制到软件质量保证

本文阐述了在嵌入式系统和在其他执行关键任务的软件中由传统的软件质量控制技术到前涉的质量保证方案的转化：软件在每一个产品和每一个组织中所发挥的作用日益重要。近年来,执行关键任务的应用系统的数量以指数速度增长。这些系统要么失败后损失巨大（空中交换管制系统和其他生命支持产品）。要么纠正费用高（便携式电话和其他用户产品）。为嵌入式系统设计的软件在更多的时候属于“执行关键任务”的范畴,而对嵌入式系统的需求也在继续升温,因此对前涉的质量保证的需求要高于以往任何时候。本文把质量控制到质量保证的转化分为两个阶段：1质量评估（第一阶段）：在开发周期的早期,即在软件到达用户之前,甚至在测试之前识别和排除软件故障,同时提供客观定量的质量评估。2质量保证（第二阶段）：在作更改的时候,通过精确的影响分析,采用强制执行编码标准和防止新错误出现的方法来防止错误进入代码基数。     

Incremental critiquing

Conversational recommender systems guide users through a product space, alternatively making concrete product suggestions and eliciting the user's feedback. Critiquing is a common form of user feedback, where users provide limited feedback at the feature-level by constraining a feature's value-space. For example, a user may request a cheaper product, thus critiquing the price feature. Usually, when critiquing is used in conversational recommender systems, there is little or no attempt to monitor successive critiques within a given recommendation session. In our experience this can lead to inefficiencies on the part of the recommender system, and confusion on the part of the user. In this paper we describe an approach to critiquing that attempts to consider a user's critiquing history, as well as their current critique, when making new recommendations. We provide experimental evidence to show that this has the potential to significantly improve recommendation efficiency.     

Information based, dynamic quality information system for non-hierarchic regional production networks

Within the scope of the Special Research Programme No. 457 “Non-Hierarchic Regional Production Networks” that is promoted by the German Foundation for Research (DFG) the Institute for Production Measuring Technology and Quality Assurance develops a computer aided Quality Information System (QIS). This QIS controls the quality related information flow between the Units of Competence (UoC) that are temporarily combined in a production network. As the number of UoC increases, the number of interfaces may create the risk of information loss within the system. This requires the set-up of a QIS that handles the data gathering, processing, storage and distribution of any number of UoC.     

Software Quality Perspectives

Abstract

Software Quality have multidimensional perspectives. Information Security, Reliability are the Integral Characteristics of it. Audit, Inspection & Testing are the methodological process to reach this goal. The meaning of Software Quality cannot be completed without including Security, Reliability, Inspection and Audit. That is the ultimate perspective of this article. This article defines the meaning and Characteristics of Software Quality and its scope and integral relationship with other entities as it is pre-requisite Quality Assurance. This article also identifies the methodological and procedural perspectives of Software Quality Assurance. Discussing a parallel evaluation on Control Objectives for Information and related Technology (COBIT) and Capability Maturity Model Integration (CMMI).

COBIT is designed to meet multiple requirements it allows an organization to assess the business risks and assign control objectives to a common set of IT functions. And CMMI has defined the quality and process.

As integral part of Software Quality Assurance, this article also briefly discusses important parts of Testing, different type and level of testing what to be tested and what not to be tested. Different types of Reviews, Audit, Incident management, Defect management, Risk vulnerability and Threat Management, and Information Security issues.     

教育系统模型与过程模型的研究及应用

为有效地建立教育质量保证体系,本文从系统与过程的视角对教育进行了深入研究。在借鉴全面质量管理思想以及软件质量保证理论与技术的基础上,本文提出了教育系统模型用于指导教育体系建设和教育过程模型用于指导教育过程建设的观点,并就教育质量保证体系建设的内容、任务与过程进行了阐述。实践表明,上述结果从理论上能够很好地指导教育质量保证体系的建设,理论实际应用效果显著。     

Critiquing the process of radiologic differential diagnosis

ICON is a developmental expert system designed to critique the process of radiologic differential diagnosis. To use ICON, a physician outlines (1) findings observed in a chest radiograph, (2) a small amount of clinical information describing the patient, and (3) a proposed diagnosis. ICON critiques the appropriateness of that diagnosis in detail, analyzing why and how well the findings serve to confirm it, or to rule it out. ICON may also suggest further information to look for. ICON explores the design issues involved in critiquing the process of differential diagnosis, and is currently implemented in a limited domain: the radiographic diagnosis of a lung mass in a patient with Hodgkin's disease.     

On-line scheduling for adaptive control machine tools in FMS

Adaptive control is available to adjust the operating speed of machine tools in FMS according to the condition of production, but it changes the time of each operation and disturbs the previously determined schedule. In this paper, on-line scheduling which changes the schedule according to the change of operating times is proposed. It is verified by computer simulation that on-line scheduling using SLACK, EDD, or the Look Ahead heuristic rule is available. The Look Ahead rule is the best for decreasing the lateness of due dates. Algorithms to change the adaptive control mode between optimization for cost performance and that for productivity according to the condition of the schedule are proposed, and their validity is verified by computer simulation.     

Using hypermedia in computer-aided instruction

The previous article in this issue (see ibid., 1996) described the Discover distributed interactive visualization system, which has been running at National Cheng-Kung University Hospital since 1993. Shortly after Discover was implemented, we observed that physicians were having trouble understanding and navigating through Discover processes for image analysis and generation. To address this problem, we developed a computer aided instruction mechanism based on hypermedia technology-multimedia with hypertext navigation. Hints (Hypermedia Information Network System) is built around the concept of hypercontrol-the use of a multimedia document to control hardware or software systems. It is currently being used with Discover at the university hospital. Physicians use this hypermedia network system to learn the processes of the discover visualization system and to help them standardize the way they examine images     

CMM实践中的分布式软件工程管理框架

分布式计算机体系结构的进展,使得客户/服务器软件工程被分布式软件工程所代替。CMM(CapabilityMaturityModel)已被软件组织所认识和重视,CMM实践中的软件工程的管理机制是软件质量保障的关键因素。该文介绍一种符合CMM思想、支持CSCW、适合分布式系统结构的管理框架,通过CMM角色定义、过程定义、过程流与文档流的管理以及对CMM角色行为的协同控制,帮助软件企业有效地控制软件过程、增强开发效率、改进软件产品质量。     

Assessing Software Quality Using the Markov Decision Processes

Quality of software is one of the most critical concerns in software system development, and many products fail to meet the quality objectives when constructed initially. Software quality is highly affected by the development process's actual dynamics. This article proposes the use of the Markov decision process (MDP) for the assessment of software quality because MDP is a useful technique to abstract the model of dynamics of the development process and to test its impact on quality. Additionally, the MDP modeling of the dynamics leads to early prediction of the quality, from the design phases all the way through the different stages of development. The proposed approach is based on the stochastic nature of the software development process, including project architecture, construction strategy of Software Quality Assurance system, its qualification actions, and team assignment strategy. It accepts these factors as inputs, generating a relative quality degree as an output. The proposed approach has been demonstrated for the design phase with a case study taken from the literature. The results prove its robustness and capability to identify appropriate policies in terms of quality, cost, and time. © 2011 Wiley Periodicals, Inc.     

Telemedicine as a tool for intensive management of diabetes: the DIABTel experience

This paper presents the current features of the DIABTel telemedicine system and the evaluation outcomes of its use in clinical routine. This telemedicine system is designed to complement the daily care and intensive management of diabetic patients through telemonitoring and telecare services. The system comprises a patient unit (PU) used by patients in their day-to-day activities and a Medical Workstation used by physicians and nurses at hospitals. Both applications offer tools to collect, manage, view and interpret data and to exchange data and messages. The system was evaluated for usability, telemedical protocols, metabolic control and quality of life. This evaluation consisted in a 6-month cross-over pilot study with ten Type I diabetic patients. The results of the evaluation allowed assessment of the telemedicine protocols in terms of the number of communications/patient (21.6+/-7.7); days between communications (5.4+/-2.66); messages sent by physicians (118 text messages); and data and messages transmitted by patients (3524 blood glucose readings, 1649 day-to-day insulin adjustments, 24 exercise reports, ten diet modifications and 63 text messages). Physicians performed more therapeutic changes during the DIABTel period than in the control period. There was a trend towards HbA1c improvement during DIABTel use with no incidence in the number of hypoglycaemias. This pilot study demonstrates the feasibility of the DIABTel system in clinical routine use and its potential benefits for diabetes care: improving the availability of information necessary for therapy adjustments; offering new physician-patient communication tools; increasing patient empowerment and education; and showing a positive trend towards improving the metabolic control of patients. Further studies are needed to validate these findings and to promote telemedicine as an opportunity to better diabetes care.     

Project evaluation using the SEI method

The SEI Process Evaluation Method can be adapted for individual projects. This paper shows how the projects in a Systems House were assessed, over an extensive period, using a modified form of the method. The use of a spreadsheet to store and process the information is described and recommended; a form of reporting results is presented; the problems encountered are described and the solutions delineated; the advantages of applying the method to projects are evaluated; and practical recommendations are given to those who might wish to adopt the revised method.The paper maintains that the SEI Maturity Level is a concept of little use to projects; however, the answers to the SEI questionnaire can be otherwise evaluated to produce action lists for the removal of project deficiencies, to the great advantage of projects.Dr Mike Gilchrist is a Quality Consultant, specializing in Software Process evaluation. He advises on ISO 9000, assisting companies to produce Quality Systems suitable for registration. He has a particular research interest in the causes of software management errors. A Registered Assessor of Quality Systems (IQA), also accredited on Lloyds Register of Quality Management Assessors, he is a member of the Institute of Quality Assurance, and of the British Computer Society.     

New Applications

A small computer has joined the artists and craftsmen at Michael Machet Associates to help meet the growing demand for Tiffany-inspired stained glass lampshades and panels. "Our sales jumped 40 percent last year," said Michael W. Machet, company president. "By installing the IBM System/3 Model 10, we have been able to meet the increased demand for our products by processing orders faster and planning production better."     

Applications of group technology in distributed manufacturing

This paper discusses the systematic use of group technology (GT) to support important activities of distributed manufacturing including design indexing and retrieval, variant design, variant process planning, and design critiquing. We introduce an Object-Oriented Group Technology (OOGT) scheme, which captures design data critical to the product's manufacture. Our approach uses a STEP-based product information model to generate the OOGT data automatically. The latter are then used to conduct an efficient search for similar products manufactured by selected companies and to retrieve and use information about the manufacturing processes and performance of these similar products.