|Intelligent Automation & Soft Computing |
Workflow Models to Establish Software Baselines in SSMEs
1Department of Computer Science, COMSATS University Islamabad, Wah, Pakistan
2Department of IT and Computer Science, PAF-lnstitute of Applied Sciences and Technology, Haripur, Pakistan
3College of Computer Science and Information Technology, Al Baha University, Al Baha, Saudi Arabia
4Department of Information Technology, Faculty of Computer Science and Information Technology, University of Jeddah, Jeddah, Suadi Arabia
5Department of Information and Computer Science, King Fahd University of Petroleum and Minerals, Dhahran, 31261, Saudi Arabia
6Department of Information and Communication Engineering, Yeungnam University, Gyeongsan, 38541, Korea
*Correspondence: Muhammad Shafiq. Email: firstname.lastname@example.org
Received: 31 December 2020; Accepted: 21 February 2021
Abstract: Capability Maturity Model Integration (CMMI) is used for Software Process Improvement (SPI) worldwide. Research reveals that CMMI adoption needs a lot of resources in terms of training, funds, and professional workers. Software Small & Medium Enterprises (SSMEs) cannot, however, reserve resources for the purpose. One of the challenges of CMMI adoption is that CMMI identifies “What-to-Do” as a requirement to fulfill and leaves “How-To-Do” to implementers. Implementation of Configuration Management Process Area (CM-PA), being one of the umbrella activities, presents more obstacles generally to the software industry and particularly to SSMEs as compared to other PAs. Establish software baselines is the first Specific Goal (SG-1) needed by CMMI for the effective implementation of CM-PA. Workflow Models (WFMs), an identified set of activities performed in a logical sequence to accomplish a specific practice with probable actors and potential work products, were designed for implementation of its three contributing Specific Practices (SPs). The proposed WFMs were evaluated through the Expert Panel Review (EPR) process. Additionally, a case study was conducted to validate the proposed models. The results of the EPR/Case Study showed that the proposed WFMs are useful, easy to use, supportive in the achievement of SG-1, and applicable to SSMEs. It is important to mention that this research work adds to the empirical software engineering body of knowledge as well as contribute to the implementation of CM-PA.
Keywords: SPI; CMMI; CM-PA; SSMEs
There is no global definition of SSMEs. However, the software enterprises having employees from 6 ~ 250 are considered as SSMEs. The success or failure of SSMEs depends upon the quality of their products or services. Clients expect high-quality software that runs flawlessly and never crashes. One way to improve quality is to improve software development processes. Continual software process improvement and periodic appraisal for effectiveness are bound to pave the way towards high-quality software. It cannot be denied that the CMMI model helps the software industry to take the quality of its software development process to higher levels. However, no significant number of SSMEs decide to adopt it. Xu et al.  believe that CMMI offers software enterprises only guidelines and does not provide clear workflow models.
CMMI Level-II  comprises seven PAs, including CM-PA. A wide range of research has been carried out for the implementation of PAs at Level-II. However, no workflow model was found for establishing a baseline to help SSME, as shown in Tab. 1. Consequently, there is an urgent need to develop configurable workflow models for this purpose.
This study aims to achieve SG-1 of CM-PA by designing WFMs for the implementation of its three SPs. Research questions, as shown in Tab. 2, have been formulated to achieve the specified research objectives.
2 Research Methodology
Research methodology has always been considered to have a profound impact on the study, so it was very meticulously designed. The phases involved in the designing of the WFMs are illustrated in Fig. 1.
Identification of the criterion is the first phase of this research methodology. The criterion, because of its similar nature, was derived from the work of Keshta [3–6], and Niazi et al.  respectively, as briefed in Tab. 3. The rest of the phases, being self-explanatory, need not be further elaborated.
3 Related Work
A variety of related research was explored. However, for brevity, only very close research, i.e., WFMs designed for implementation of PAs at CMMI Level-II is presented. Keshta  devised a WFM for implementation of SPs 1.3 of PP-PA and defined phases for a project life cycle keeping in view the SSMEs. The model comprises four stages: “Plan”, “Design”, “Review”, and “Update / Rework”. Keshta et al.  further developed WFMs for all SPs of PPQA-PA from the perspective of SSMEs. Two of the SPs, (SP - 1.1 and SP - 1.2) of PPQA comprise four stages i.e., “Plan”, “Prepare”, “Audit” & “Report”. The models were validated using EPR. Besides, Keshta et al.  designed WFMs for four SPs of REQM-PA to support SSMEs to implement the best practices. The five phases of the WFM for SP 1.1 are: “Request”, “Understand”, “Evaluate”, “Accept” and “Finalize”. SP 1.2 also include five stages: “Assess”, “Report”, “Negotiate”, “Record”, and “Commit”. The WFMs  for SP 1.3 has six stages: “Initiate”, “Validate”, “Implement”, “Verify”, “Update” and “Release” whereas WFM for SP 1.4 also constitutes six stages: “Request”, “Maintain”, “Validate”, “Allocate”, “Verify” and “Release”. The EPR process was used to validate the WFMs using the specified criteria. The applicability of models to SSMEs was evaluated in Saudi Arabian software industry.
Other researchers have also done similar work. Tariq et al.  proposed that an additional SP be included in REQM-PA for Software as a Services (SAAS) and carried out validation through a case study “Allwebid”. Similarly, Batti et al.  proposed a six-phase methodology to deal with changing requirements i.e., “Initiate”, “Receipt”, “Approve/Disapprove”, “Evaluate”, “Implement” and “Configure” with CCB to act as a central player and process owner. In the same manner, Niazi et al.  developed the CMMI-compliant Requirements Change Management (RCM) Model with five stages: “Request”, “Validate”, “Implement”, “Verify” & “Update” which was evaluated through the EPR process. Consequently, Vivatanavorasin et al.  proposed a three-layer WFM for SAM-PA containing “Contextual layer,” “Elaboration layer”, and “Description layer”. A tool was also developed for Supplier Agreement Management as a proof-of-concept prototype.
After a thorough literature review, it was found that no WFM is available. However, there is an acute need to design WFMs to support the implementation of SG-1 in SSMEs.
4 Proposed Workflow Models
The first SG of CM-PA “Establish Baselines” is achieved through three SPs.
4.1 Identify Configuration Items
WFM for the first SP has five stages namely: “Planning”, “Identification”, “Assignment”, “Documentation” and “Sharing” as illustrated in Fig. 2. Supportive pieces of evidence are shown in Tab. 4 and a pertinent process guide is given in Tab. 5.
4.2 Establish Configuration Management System
Few among the findings supportive of the proposed WFM are given in table Tab. 6. The proposed WFM is divided into five stages i.e., “Planning”, “Establishment”, “Maintenance”, “Preservation” and “Improvement” and is illustrated in Fig. 3 followed by the pertinent process guide in Tab. 7.
4.3 Create or Release Baselines
Proposed WFM for creating/releasing baselines is divided into four stages i.e., “Initiation”, “Authorization”, “Creation” and “Release” and is illustrated in Fig. 4. Only two of the supportive findings from literature are given in Tab. 8 and the pertinent process guide in Tab. 9.
5 Proposed WFMs Validation
5.1 EPR Process Validation.
An EPR process was carried out to validate the proposed WFMs, where opinions on the models based on the specified criteria were collected from 10 experts with experience in the fields of SPI, Project Management, Configuration Management, and Software Development as shown in Tab. 10.
According to Khan et al. , researchers are free to establish their criteria. Experts were divided into 3 groups based on their experience/knowledge. Experts with less than 15 years of experience were classified as Junior, with more than 17 years of experience as Senior, and the rest were classified as Intermediate. According to this criterion, the panel consisted of 4 senior, 2 junior, and 4 intermediate experts. The questionnaire was formulated based on the work of Keshta [3–6], and Niazi et al.  specifically to obtain the panel's opinion on the proposed WFMs. A summary of the experts' responses based on the 5-point Likert scale is presented in Tabs. 11–13. The Q-8 was an open-ended question that was used to collect feedback to improve the models.
According to the ERP results, experts believe that the models are easy to learn, effective in implementing the SPs, supportive in achieving SG-1, cover the sub-practices, improve the process, are very useful for industry software, contribute to the quality of the software produced, and applicable in SSMEs. However, as with other things, there is room for improvement in the proposed WFMs.
5.2 Case Studies Validation
To build trust, a case study was conducted in two Pakistani SSMEs that were willing to implement the WFMs. For reasons of confidentiality, cover names are being used. Briefs of the SSMEs are tabulated in Tab. 14.
The above-mentioned SSMEs were assessed by a CMMI expert as a readiness review of the three SPs of CM-PA and were found not ready. Two SSMEs agreed to participate in these case studies. A brief presentation covering the objectives of the study was given at the opening session for both the SSMEs. To assess the effectiveness of the proposed WFMs after implementation, the lead auditor in both SMEs performed SCAMPI type “C” and type “B” assessments for these SPs. The result of the assessments was encouraging. All three SEs (SP 1.1, SP 1.2, and SP 1.3) were considered “Fully Implemented” and their contribution to the satisfactory achievement of the said SG-1, i.e., “Establish Baselines” in both SSMEs. According to the lead auditor's statement, both SSMEs will easily produce a "Fully Implemented" score in SCAMPI type “A”. Feedback from participating professionals was also collected in the closing session.
5.3 Mitigation Actions
First, the closed-ended questions in the questionnaire may not have captured the true respondent’s feelings. An open-ended question was included to reduce the impact and capture the opinions freely. This added to the veracity of the response. Second, panel members may have interpreted the questions / WFM differently and answer accordingly. Due to the close connection, the questionnaire was taken from Keshta’s work [3–6]. This has been further refined by adding framework coverage at the sub-practice level and reviewed by another academician Third, the responses could be limited to the respondents' knowledge and experience. As part of building trust, experts with extensive industry experience participated in this research. The presence of world-renowned experts on the panel contributed to the effectiveness of the review process. Fourth, there may be a difference between the responses from Senior, Intermediate, and Junior experts. The P of Chi-Square (X2) test was found > 0.05 for ∞ = 0.05 and degree of freedom = 2 against the responses. It shows ignorable variation among the responses provided by the aforementioned three categories of experts. Fifth, the possibility that the usual literature review process may not have discerned relevant research work. As stated by Hossain et al. , this cannot be treated as a systemic omission. Finally, the results and conclusions may not be applicable in varied or typical environments. In addition to the EPR, case studies were conducted in the Pakistani SSME. Hence, the results can be generalized to the Pakistani SSME, however, more case studies should be carried out for external validity.
6 Proposed WFMs Novelty
The novelty of the models is tabulated in Tab. 15 as under.
The development of a workflow model to achieve the SG-1 “Establish Baselines” of CM-PA at CMMI maturity level-II and its validation was the main objective of this study. For this purpose, five research questions (RQ-A ~ RQ-E) were formulated. Further WFMs were devised for all the three SPs contributing towards the establishment of baselines. The experts’ responses met the criteria listed. The results were further confirmed by conducting case studies. It is worth mentioning that the case studies have shown the ability of the Pakistani SSME to adopt the proposed models with slight changes to adapt to their contexts. Satisfactory comments from the participating organizations and experts speak well of WFMs and increase confidence in the evaluation results. During face-to-face discussions with participating professionals, it was found that they had no problem understanding / using models with related templates, forms, checklists, and process guides as supporting tools. WFM has been refined after several rounds of improvement taking into account the suggestions of scientists, specialists, and finally feedback from case study participants. This work should be continued to develop WFMs for other PAs for which the workflow models have still not been developed. Models should also be reviewed for external validity and future CMMI versions.
Funding Statement: The authors received no specific funding for this study.
Conflicts of Interest: The authors declare that they have no conflicts of interest to report regarding the present study.
|This work is licensed under a Creative Commons Attribution 4.0 International License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.|