Ambiguity Detection and Improvement for Malay Requirements Specification: A Systematic Review

Mohd Firdaus Zahrin, Mohd Hafeez Osman, Sa'adah Hassan, Azlena Haron, Alfian Abdul Halin

Abstract


Malaysian public sectors have invested billions in digitizing systems. Electronic government efforts created much software. Our informal interview taught us that many software projects encountered delays, and several failed. One of the main contributions of software failure is ambiguity in requirements specification (RS). Ambiguity is a familiar requirement smell that causes misinterpretation. Thus, we seek to devise a technique for detecting and improving ambiguous RS in the Malaysian public sector. One of our challenges is that the Malaysian public sector RS is developed in Malay, and most available techniques support English and other major languages. Hence, this paper investigates the automated and semi-automated techniques to detect and improve ambiguous RS. Following the standard guidelines for systematic mapping, review, snowballing, and quality assessment, we studied works from 2010 to 2022 on ambiguity detection and improvement techniques. We chose 42 articles as primary studies from 2,549. As a result, Natural Language Processing (NLP) and machine learning (ML) are the most promising techniques for automated and semi-automated ambiguous detection models. Furthermore, the ambiguous improvement technique began using deep learning (DL) in 2019. However, most proposed tools are still in the validation phase and are not widely employed, implying that tool development and validation research are progressing slowly. Apart from the generic linguistic context of RS, some research focuses on industrial domain-based RS. Our study shows that additional strategies have been developed to overcome RS-related issues.

Keywords


Ambiguity; requirement smells; requirements specification; systematic review

Full Text:

PDF

References


A. Spillner and T. Linz, Software Testing Foundations: A Study Guide for the Certified Tester Exam- Foundation Level- ISTQB® Compliant. dpunkt.verlag, 2021.

A. Belfadel, J. Laval, C. Bonner Cherifi, and N. Moalla, "Requirements engineering and enterprise architecture-based software discovery and reuse," Innov. Syst. Softw. Eng., vol. 18, no. 1, pp. 39–60, 2022, doi: 10.1007/s11334-021-00423-5.

M. A. Jubair et al., "A multi-agent K-means with case-based reasoning for an automated quality assessment of software requirement specification," IET Commun., 2022, doi: 10.1049/cmu2.12555.

S. F. Alshareef, A. M. Maatuk, T. M. Abdelaziz, and M. Hagal, "Validation framework for aspectual requirements engineering (ValFAR)," 2020, doi: 10.1145/3410352.3410777.

L. Montgomery, D. Fucci, A. Bouraffa, L. Scholz, and W. Maalej, "Empirical research on requirements quality: a systematic mapping study," Requir. Eng., vol. 27, no. 2, pp. 183–209, 2022, doi: 10.1007/s00766-021-00367-z.

M. A. Akbar, A. Alsanad, S. Mahmood, A. A. Alsanad, and A. Gumaei, "A Systematic Study to Improve the Requirements Engineering Process in the Domain of Global Software Development," IEEE Access, vol. 8, pp. 53374–53393, 2020, doi: 10.1109/ACCESS.2020.2979468.

E. D. Canedo and B. C. Mendes, "Software requirements classification using machine learning algorithms," Entropy, vol. 22, no. 9, Sep. 2020, doi: 10.3390/E22091057.

I. García, C. Pacheco, A. León, and J. A. Calvo-Manzano, "A serious game for teaching the fundamentals of ISO/IEC/IEEE 29148 systems and software engineering – Lifecycle processes – Requirements engineering at undergraduate level," Comput. Stand. Interfaces, vol. 67, p. 103377, 2020, doi: https://doi.org/10.1016/j.csi.2019.103377.

I. K. Raharjana, D. Siahaan, and C. Fatichah, "User Stories and Natural Language Processing: A Systematic Literature Review," IEEE Access, vol. 9, pp. 53811–53826, 2021, doi: 10.1109/ACCESS.2021.3070606.

L. Zhao et al., "Natural Language Processing for Requirements Engineering," ACM Comput. Surv., vol. 54, no. 3, Apr. 2021, doi: 10.1145/3444689.

M. Osama, A. Zaki-Ismail, M. Abdelrazek, J. Grundy, and A. Ibrahim, "A Comprehensive Requirement Capturing Model Enabling the Automated Formalisation of NL Requirements," SN Comput. Sci., vol. 4, no. 1, p. 57, 2022, doi: 10.1007/s42979-022-01449-7.

A. Yadav, A. Patel, and M. Shah, "A comprehensive review on resolving ambiguities in natural language processing," AI Open, vol. 2, pp. 85–92, 2021, doi: 10.1016/j.aiopen.2021.05.001.

A. Hussain, H. Ahmed, A. Khamaj, and M. N. M. Nawi, "a Model of Consequences of Ambiguous Requirements," J. Southwest Jiaotong Univ., vol. 56, no. 6, pp. 599–609, 2021, doi: 10.35741/issn.0258-2724.56.6.52.

C. Ribeiro and D. Berry, "The prevalence and severity of persistent ambiguity in software requirements specifications: Is a special effort needed to find them?," Sci. Comput. Program., vol. 195, p. 102472, 2020, doi: 10.1016/j.scico.2020.102472.

A. Fantechi, S. Gnesi, and L. Semini, "VIBE: Looking for Variability In ambiguous requirements," J. Syst. Softw., vol. 195, p. 111540, 2023, doi: 10.1016/j.jss.2022.111540.

J. Iqbal, R. B. Ahmad, M. Khan, M. H. Nizam, and A. Akhunzada, "Model to Cope with Requirements Engineering Issues for Software Development Outsourcing," IEEE Access, vol. 10, pp. 63199–63229, 2022, doi: 10.1109/ACCESS.2022.3182393.

M. R. Asadabadi, E. Chang, O. Zwikael, M. Saberi, and K. Sharpe, "Hidden fuzzy information: Requirement specification and measurement of project provider performance using the best worst method," Fuzzy Sets Syst., vol. 383, pp. 127–145, 2020, doi: 10.1016/j.fss.2019.06.017.

K. H. Oo, "Comparing Accuracy Between SVM, Random Forest, K-NN Text Classifier Algorithms for Detecting Syntactic Ambiguity in Software Requirements," in Lecture Notes in Networks and Systems, 2023, vol. 550 LNNS, pp. 43–58, doi: 10.1007/978-3-031-16865-9_4.

A. Griva, S. Byrne, D. Dennehy, and K. Conboy, "Software Requirements Quality: Using Analytics to Challenge Assumptions at Intel," IEEE Softw., vol. 39, no. 2, pp. 80–88, 2022, doi: 10.1109/MS.2020.3043868.

S. Ezzini, S. Abualhaija, C. Arora, and M. Sabetzadeh, "Automated Handling of Anaphoric Ambiguity in Requirements: A Multi-Solution Study," in Proceedings of the 44th International Conference on Software Engineering, 2022, pp. 187–199, doi: 10.1145/3510003.3510157.

F. Dalpiaz, I. van der Schalk, S. Brinkkemper, F. B. Aydemir, and G. Lucassen, "Detecting terminological ambiguity in user stories: Tool and experimentation," Inf. Softw. Technol., vol. 110, pp. 3–16, 2019, doi: 10.1016/j.infsof.2018.12.007.

S. Ezzini, S. Abualhaija, C. Arora, M. Sabetzadeh, and L. C. Briand, "Using domain-specific corpora for improved handling of ambiguity in requirements," in Proceedings - International Conference on Software Engineering, May 2021, pp. 1485–1497, doi: 10.1109/ICSE43902.2021.00133.

M. F. Zahrin, M. H. Osman, A. A. Halin, S. Hassan, and A. Haron, "Issues in Requirements Specification in Malaysia" s Public Sector: An Evidence from a Semi-Structured Survey and a Static Analysis," Int. J. Adv. Comput. Sci. Appl., vol. 13, no. 11, pp. 284–292, 2022, doi: 10.14569/IJACSA.2022.0131132.

F. Ashfaq and I. S. Bajwa, "Natural language ambiguity resolution by intelligent semantic annotation of software requirements," Autom. Softw. Eng., vol. 28, no. 2, Nov. 2021, doi: 10.1007/s10515-021-00291-0.

M. Tukur, S. Umar, and J. Hassine, "Requirement Engineering Challenges: A Systematic Mapping Study on the Academic and the Industrial Perspective," Arab. J. Sci. Eng., vol. 46, no. 4, pp. 3723–3748, 2021, doi: 10.1007/s13369-020-05159-1.

O. M. H. Et.al, "Ambi Detect: An Ambiguous Software Requirements Specification Detection Tool," 2021. doi: 10.17762/turcomat.v12i3.1066.

J. Medeiros, A. Vasconcelos, C. Silva, and M. Goulão, "Requirements specification for developers in agile projects: Evaluation by two industrial case studies," Inf. Softw. Technol., vol. 117, p. 106194, Jan. 2020, doi: 10.1016/j.infsof.2019.106194.

D. Budgen and P. Brereton, "Performing systematic literature reviews in software engineering," Proc. - Int. Conf. Softw. Eng., vol. 2006, pp. 1051–1052, Aug. 2006, doi: 10.1145/1134285.1134500.

P. Jamshidi, A. Ahmad, and C. Pahl, "Cloud Migration Research: A Systematic Review," IEEE Trans. Cloud Comput., vol. 1, no. 2, pp. 142–157, 2013, doi: 10.1109/TCC.2013.10.

A. R. Amna and G. Poels, "Ambiguity in user stories: A systematic literature review," Inf. Softw. Technol., vol. 145, p. 106824, 2022, doi: 10.1016/j.infsof.2022.106824.

K. Kaur, P. Singh, and P. Kaur, "A review of artificial intelligence techniques for requirement engineering," in Advances in Intelligent Systems and Computing, 2021, vol. 1257, pp. 259–278, doi: 10.1007/978-981-15-7907-3_20.

K. Ahmad, M. Abdelrazek, C. Arora, M. Bano, and J. Grundy, "Requirements engineering for artificial intelligence systems: A systematic mapping study," Inf. Softw. Technol., vol. 158, 2023, doi: 10.1016/j.infsof.2023.107176.

M. Q. Riaz, W. H. Butt, and S. Rehman, "Automatic Detection of Ambiguous Software Requirements: An Insight," in 5th International Conference on Information Management, ICIM 2019, 2019, pp. 1–6, doi: 10.1109/INFOMAN.2019.8714682.

K. Petersen, R. Feldt, S. Mujtaba, and M. Mattsson, "Systematic mapping studies in software engineering," 2008, doi: 10.14236/ewic/ease2008.8.

A. Ferrari and A. Esuli, "An NLP approach for cross-domain ambiguity detection in requirements engineering," Autom. Softw. Eng., 2019, doi: 10.1007/s10515-019-00261-7.

A. Ferrari et al., "Detecting requirements defects with NLP patterns: an industrial experience in the railway domain," Empir. Softw. Eng., vol. 23, no. 6, pp. 3684–3733, 2018, doi: 10.1007/s10664-018-9596-7.

L. Reynolds and K. McDonell, "Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm," 2021, doi: 10.1145/3411763.3451760.

X. V. Lin et al., "Few-shot Learning with Multilingual Generative Language Models," in Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, Dec. 2022, pp. 9019–9052, doi: 10.18653/v1/2022.emnlp-main.616.




DOI: http://dx.doi.org/10.18517/ijaseit.13.6.18535

Refbacks

  • There are currently no refbacks.


Published by INSIGHT - Indonesian Society for Knowledge and Human Development