Similarity of business process models: Metrics and evaluation

It is common for large organizations to maintain repositories of business process models in order to document and to continuously improve their operations. Given such a repository, this paper deals with the problem of retrieving those models in the repository that most closely resemble a given process model or fragment thereof. Up to now, there is a notable research gap on comparing different approaches to this problem and on evaluating them in the same setting. Therefore, this paper presents three similarity metrics that can be used to answer queries on process repositories: (i) node matching similarity that compares the labels and attributes attached to process model elements; (ii) structural similarity that compares element labels as well as the topology of process models; and (iii) behavioral similarity that compares element labels as well as causal relations captured in the process model. These metrics are experimentally evaluated in terms of precision and recall. The results show that all three metrics yield comparable results, with structural similarity slightly outperforming the other two metrics. Also, all three metrics outperform text-based search engines when it comes to searching through a repository for similar business process models.     

Integration of heterogeneous repositories based on ontologies for EC applications development

Recently, due to the significance of Web applications in the business field, it has become important how quickly an application can be developed from a business idea. This paper proposes a method that rebuilds heterogeneous repositories required for business applications development into a multi-grain-size repository based on ontologies. The proposed repository consists of component libraries and their use patterns from a level on a high abstraction such as enterprise activities to the concreteness level of software. Our repository supports the whole process of business application development including modeling enterprises and business activities and deploying models as software with components. Finally, we devise a development methodology of on-line business such as Web shopping with the framework and software component based on free and commercial application servers.     

Mining version histories for change impact analysis in business process model repositories

In order to remain competitive and sustainable in today's ever-changing business environments, organizations need to frequently make changes to their business activities and the corresponding business process models. One of the critical issues that an organization faces is change impact analysis: estimating the potential effects of changing a business process to other processes in the organization's business process repository. In this paper, we propose an approach to change impact analysis which mines a version history of a business process model repository. Our approach then identifies business process models that have been co-changed in the past and uses this knowledge to predict the impact of future changes. An empirical validation on a real business process model repository has showed the effectiveness of our approach in predicting impact of a change.     

Business process model repositories - Framework and survey

Context

Large organizations often run hundreds or even thousands of different business processes. Managing such large collections of business process models is a challenging task. Software can assist in performing that task, by supporting common management functions such as storage, search and version management of models. It can also provide advanced functions that are specific for managing collections of process models, such as managing the consistency of public and private processes. Software that supports the management of large collections of business process models is called: business process model repository software.

Objective

This paper contributes to the development of business process model repositories, by analyzing the state of the art.

Method

To perform the analysis a literature survey and a comparison of existing (business process model) repository technology is performed.

Result

The results of the state of the art analysis are twofold. First, a framework for business process model repositories is presented, which consists of a management model and a reference architecture. The management model lists the functionality that can be provided and the reference architecture presents the components that provide that functionality. Second, an analysis is presented of the extent to which existing business process model repositories implement the functionality from the framework.

Conclusion

The results presented in the paper are valuable as a comprehensive overview of business process model repository functionality. In addition they form a basis for a future research agenda. We conclude that existing repositories focus on traditional functionality rather than exploiting the full potential of information management tools, thus we show that there is a strong basis for further research.     

Software defect prediction using Bayesian networks

There are lots of different software metrics discovered and used for defect prediction in the literature. Instead of dealing with so many metrics, it would be practical and easy if we could determine the set of metrics that are most important and focus on them more to predict defectiveness. We use Bayesian networks to determine the probabilistic influential relationships among software metrics and defect proneness. In addition to the metrics used in Promise data repository, we define two more metrics, i.e. NOD for the number of developers and LOCQ for the source code quality. We extract these metrics by inspecting the source code repositories of the selected Promise data repository data sets. At the end of our modeling, we learn the marginal defect proneness probability of the whole software system, the set of most effective metrics, and the influential relationships among metrics and defectiveness. Our experiments on nine open source Promise data repository data sets show that response for class (RFC), lines of code (LOC), and lack of coding quality (LOCQ) are the most effective metrics whereas coupling between objects (CBO), weighted method per class (WMC), and lack of cohesion of methods (LCOM) are less effective metrics on defect proneness. Furthermore, number of children (NOC) and depth of inheritance tree (DIT) have very limited effect and are untrustworthy. On the other hand, based on the experiments on Poi, Tomcat, and Xalan data sets, we observe that there is a positive correlation between the number of developers (NOD) and the level of defectiveness. However, further investigation involving a greater number of projects is needed to confirm our findings.     

Qualit?tsmerkmale, -metriken und -messverfahren für Gesch?ftsprozessmodelle

The availability of high-quality business process models is a central prerequisite for a successful process management. Nevertheless, in practice process models exhibit a large number of quality deficits, among them grammatical, content-related, and stylistic defects. In addition, there exist only very few approaches to determine the quality of business process models. In this paper, we present the 3QM-Framework, an analytical approach to systematically determine the quality of business process models. The 3QM-Framework makes three contributions: it provides quality marks, metrics, and measurement procedures to quantify the quality level as elements of a theoretically justified quality model. The applicability of the 3QM-Framework has been empirically evaluated in case studies. The results of a survey that was conducted among experts moreover attest its practical relevance.     

基于熵的信息系统业务模型复杂性度量

业务模型的复杂度决定企业信息系统的复杂度，也对信息系统的重构性能具有很大程度的影响。目前研究多侧重于代码级软件的复杂度度量，而对业务模型的复杂度则关注较少。本文首先给出了企业业务模型的分层体系结构，依据模型实体之间的依赖关系与分解关系将业务模型分解为一组基本模型单元。然后重点提出一种基于熵的模型复杂性度量方法，使用信息熵来描述业务模型的复杂性，通过计算基本模型单元的复杂度递归得到各模型实体、依赖关系的复杂性，进而综合得到模型的复杂性。最后通过实际案例验证了此方法的可行性。该方法为信息系统的设计与构造过程提供了有效的参考与决策依据。     

基于面向对象系统的质量度量模型PMMSQ的设计和实现

本文首先从软件质量度量的角度出发,阐述了软件质量度量的理论与方法,介绍了ISO9126模型;针对已有软件质量度量模型中存在的问题,提出了一个适合于软件质量度量实践的实用软件质量度量模型（PMMSQ）,并详细介绍了面向对象系统软件质量度量的步骤;最后,根据PMMSQ模型完成了软件度量活动的核心工作--对象特征集存储库的设
计和实现。     

Defining and validating metrics for assessing the understandability of entity–relationship diagrams

Database and data model evolution cause significant problems in the highly dynamic business environment that we experience these days. To support the rapidly changing data requirements of agile companies, conceptual data models, which constitute the foundation of database design, should be sufficiently flexible to be able to incorporate changes easily and smoothly. In order to understand what factors drive the maintainability of conceptual data models and to improve conceptual modelling processes, we need to be able to assess conceptual data model properties and qualities in an objective and cost-efficient manner. The scarcity of early available and thoroughly validated maintainability measurement instruments motivated us to define a set of metrics for Entity–Relationship (ER) diagrams. In this paper we show that these easily calculated and objective metrics, measuring structural properties of ER diagrams, can be used as indicators of the understandability of the diagrams. Understandability is a key factor in determining maintainability as model modifications must be preceded by a thorough understanding of the model. The validation of the metrics as early understandability indicators opens up the way for an in-depth study of how structural properties determine conceptual data model understandability. It also allows building maintenance-related prediction models that can be used in conceptual data modelling practice.     

Prozessgetriebenes Datenqualitätsmanagement durch Integration von Datenqualität in bestehende Prozessmodelle

The importance of high data quality and the need to consider data quality in the context of business processes are well acknowledged. Process modeling is mandatory for process-driven data quality management, which seeks to improve and sustain data quality by redesigning processes that create or modify data. A variety of process modeling languages exist, which organizations heterogeneously apply. The purpose of this article is to present a context-independent approach to integrate data quality into the variety of existing process models. The authors aim to improve communication of data quality issues across stakeholders while considering process model complexity. They build on a keyword-based literature review in 74 IS journals and three conferences, reviewing 1,555 articles from 1995 onwards. 26 articles, including 46 process models, were examined in detail. The literature review reveals the need for a context-independent and visible integration of data quality into process models. First, the authors derive the within-model integration, that is, enhancement of existing process models with data quality characteristics. Second, they derive the across-model integration, that is, integration of a data-quality-centric process model with existing process models. Since process models are mainly used for communicating processes, they consider the impact of integrating data quality and the application of patterns for complexity reduction on the models’ complexity metrics. There is need for further research on complexity metrics to improve applicability of complexity reduction patterns. Missing knowledge about interdependency between metrics and missing complexity metrics impede assessment and prediction of process model complexity and thus understandability. Finally, our context-independent approach can be used complementarily to data quality integration focusing on specific process modeling languages.     

Metrics for data warehouse conceptual models understandability

Due to the principal role of Data warehouses (DW) in making strategy decisions, data warehouse quality is crucial for organizations. Therefore, we should use methods, models, techniques and tools to help us in designing and maintaining high quality DWs. In the last years, there have been several approaches to design DWs from the conceptual, logical and physical perspectives. However, from our point of view, none of them provides a set of empirically validated metrics (objective indicators) to help the designer in accomplishing an outstanding model that guarantees the quality of the DW. In this paper, we firstly summarise the set of metrics we have defined to measure the understandability (a quality subcharacteristic) of conceptual models for DWs, and present their theoretical validation to assure their correct definition. Then, we focus on deeply describing the empirical validation process we have carried out through a family of experiments performed by students, professionals and experts in DWs. This family of experiments is a very important aspect in the process of validating metrics as it is widely accepted that only after performing a family of experiments, it is possible to build up the cumulative knowledge to extract useful measurement conclusions to be applied in practice. Our whole empirical process showed us that several of the proposed metrics seems to be practical indicators of the understandability of conceptual models for DWs.     

Structuredness and its significance for correctness of process models

Recent research has shown that business process models from practice suffer from several quality problems. In particular, the correctness of control flow has been analyzed for industry-scale collections of process models revealing that error ratios are surprisingly high. In the past the structuredness property has been discussed as a guideline to avoid errors, first in research on programming, and later also in business process modeling. In this paper we investigate the importance of structuredness for process model correctness from an empirical perspective. We introduce definitions of two metrics that quantify the (un)structuredness of a process model, the degree of structuredness and the unmatched connector count. Then, we use the event-driven process chain models of the SAP reference model for validating the capability of these metrics to predict error probability. Our findings clearly support the importance of structuredness as a design principle for achieving correctness in process models.     

经营过程绩效模型库软件的检索与重用机制

探讨了企业战略和外部环境对经营过程绩效体系的影响，在此基础上提出了经营过程绩效模型检索及参考模型生成方法，并以该检索与生成机制为核心构建了经营过程绩效模型库管理软件，以支持绩效模型的重用。最后，结合实际案例介绍了该模型库管理软件的应用。     

A practical approach to software metrics

Metrics programs that create meaningful change in software practice must start with business goals in mind. Software metrics are quantitative standards of measurement for various aspects of software projects. A well-designed metrics program will support decision making by management and enhance return on the IT investment. There are many aspects of software projects that can be measured, but not all aspects are worth measuring. Starting a new metrics program or improving a current program consists of five steps: identify business goals; select metrics; gather historical data; automate measurement procedures; and use metrics in decision making     

用户体验质量(QoE)的模型与评价方法综述

随着信息时代的到来,新的多样性的信息服务大量涌现,人们对信息服务的要求也越来越高.为了获得用户对服务的认可,服务提供商必须确保良好的用户体验质量.因此,用户体验质量不仅成为学术界重要的研究课题之一,而且也成为工业界关键的服务评价指标之一.文中综述了用户体验质量的模型与评价方法等方面的工作.介绍了该领域的研究现状与进展,总结归纳了用户体验质量的影响因素、量化方法及三类评价方法学,重点讨论了几种具体的基于不同学科的用户体验质量的模型和评价方法.基于这些讨论,该文以视频流媒体服务为背景,提出了基于隐马尔可夫的用户体验质量模型,建立了基于随机模型的评价方法,对未来的研究方向进行了展望.     

The business model portfolio as a strategic tool for value creation and business performance

The number of organisations that operate multiple business models continues to increase. However, operating multiple business models can be complex, as they often need to be harmonised within a broader portfolio due to their interdependencies. This complexity is exacerbated by the increasing role of digital technology and data – enabling new opportunities but also coming with related paradoxes. This paper examines the growing body of literature on business model portfolios revealing that they are evolving into a strategic tool for value creation and business performance. While there are concomitant value opportunities arising from complementarities and synergies, there are also paradoxes emerging from tensions that need to be considered. Employing a developmental literature review, we present a synthesis of recent empirical case studies to gain insight into the management of business model portfolios. Firstly, we identify different strategic intents: diversifying, sensing, and complementing. Secondly, we distil different themes for value opportunities and paradoxes and categorise them according to a business model framework. Thirdly, we identify and discuss the role of digital technologies and data for business model portfolios. Overall, we contribute to an emerging stream of studies on multiple business models in relation to strategy, innovation and technology. By adopting a holistic perspective on the management of business model portfolios, we explore strategic intent, value opportunities and paradoxes, and discuss how portfolios can play a role in strategic management and planning.     

Presentation and exchange of business models with CIMOSA-XML

In the modern competitive business world there is a frequent need for enterprises to modify their structure of business processes to become more effective in the market place. The solution to this management demand is an improved business integration which is only successful when it is supported by effective IT systems. The Esprit project PRIMA aims to create a competitive advantage for European companies in the process sector by providing a route to ‘smarter' IT investments that are effective across the whole enterprise. A process repository which will store business process models in suitable formats would provide users with appropriate views of the models, focusing only on their information needs. However, the existence of many incompatible modelling methodologies and tools makes it impossible to unify the modelling approach. Therefore it would be desirable to have a high level common modelling language. The PRIMA project has identified CIMOSA as the basis for common semantics of the business model language and the XML format, as a suitable format for the transfer of the model structure and content. The PRIMA working group, in an effort to elaborate these concepts, has developed the Document Type Definition concept (DTD) of the CIMOSA-XML meta-model, which can be used to build the partial enterprise models related to the Business Functional Requirements (BFR) of the PRIMA Process Methodology.     

Complexity metrics for Workflow nets

Process modeling languages such as EPCs, BPMN, flow charts, UML activity diagrams, Petri nets, etc., are used to model business processes and to configure process-aware information systems. It is known that users have problems understanding these diagrams. In fact, even process engineers and system analysts have difficulties in grasping the dynamics implied by a process model. Recent empirical studies show that people make numerous errors when modeling complex business processes, e.g., about 20% of the EPCs in the SAP reference model have design flaws resulting in potential deadlocks, livelocks, etc. It seems obvious that the complexity of the model contributes to design errors and a lack of understanding. It is not easy to measure complexity, however. This paper presents three complexity metrics that have been implemented in the process analysis tool ProM. The metrics are defined for a subclass of Petri nets named Workflow nets, but the results can easily be applied to other languages. To demonstrate the applicability of these metrics, we have applied our approach and tool to 262 relatively complex Protos models made in the context of various student projects. This allows us to validate and compare the different metrics. It turns out that our new metric focusing on the structuredness outperforms existing metrics.     

B2B集成技术的体系结构

介绍了B2B集成技术的体系结构和概念上的模型，用来支持统一概念集成模型中并发的A2A和B2B集成。概念集成模型通过设计时仓库完成，集成模型作为元数据存储在设计时仓库。B2B集成技术的执行时范例完成实际的应用和贸易伙伴商务交易遵循编译的方法，根据存储在设计时仓库中的集成模型，执行器完成实际的集成实例。     

Querying business process model repositories

Business process management technology is becoming increasingly popular, resulting in more and more business process models being created. Hence, there is a need for these business process models to be managed effectively. For effective business process model management, being able to efficiently query large amount of business process models is essential. For example, it is preferable to find a similar or related model to customize, rather than building a new one from scratch. This would not only save time, but would also be less error-prone and more coherent with the existing models of the enterprise. Querying large amounts of business process models efficiently is also vital during company amalgamation, in which business process models from multiple companies need to be examined and integrated. This paper provides: an overview of the field of querying business process models; a summary of its literature; and a list of challenges (and some potential solutions) that have yet to be addressed. In particular, we aim to compare the differences between querying business process models and general graph querying. We also discuss literature work from graph querying research that can be used when querying business process models.