Specifying and Analyzing a Software Testing Ontology at the Top-Domain Ontological Level


  • Guido Tebes Facultad de Ingeniería, UNLPam
  • Luis Olsina GIDIS_Web, School of Engineering, UNLPam
  • Denis Peppino GIDIS_Web, School of Engineering, UNLPam
  • Pablo Becker GIDIS_Web, School of Engineering, UNLPam




ontologies, software testing, terminologies, top-domain ontological level, vocabularies


One of the Software Engineering areas that supports quality assurance is testing. Given that specific processes, artefacts, methods and ultimately strategies for software testing involve a large number of domain concepts, it is valuable to have a robust conceptual base, that is, a software testing ontology that defines the terms, properties, relationships and axioms explicitly and unambiguously. Ontologies for instance foster a clearer terminological understanding of process and method specifications for strategies, among many other benefits. After analyzing both the results of a conducted Systematic Literature Review of primary studies on conceptualized software testing ontologies and the state-of-the-art of testing-related standards, we decided to develop a software testing top-domain ontology named TestTDO that fits our goals. Therefore, this article specifices development, verification and validation aspects of the TestTDO, which was built following the Design Science Research approach.


Download data is not yet available.

Author Biography

Guido Tebes, Facultad de Ingeniería, UNLPam



L. Olsina and P. Becker, “Family of strategies for different evaluation purposes,” in CIbSE 2017 - XX Ibero-American Conference on Software Engineering, 2017, pp. 221–234.

P. Becker, G. Tebes, D. Peppino, and L. Olsina, “Applying an Improving Strategy that embeds Functional and Non-Functional Requirements Concepts,” Journal of Computer Science and Technology, vol. 19, no. 2, pp. 153–175, 2019, doi: 10.24215/16666038.19.e15.

P. Becker, F. Papa, and L. Olsina, “Process Ontology Specification for Enhancing the Process Compliance of a Measurement and Evaluation Strategy,” CLEI electronic journal, vol. 18, no. 1, pp. 1–26, 2015, doi: 10.19153/cleiej.18.1.2.

ISO, “ISO/IEC/IEEE 29119-1, Software and systems engineering - Software Testing – Part 1: Concepts and definitions.” 2013.

ISTQB, “International Software Testing Qualifications Board, Standard Glossary of Terms used in Software Testing, Version 3.2.” 2019, [Online]. Available: https://www.istqb.org/.

A. R. Hevner, S. T. March, J. Park, and S. Ram, “Design science in information systems research,” MIS Quarterly: Management Information Systems, vol. 28, no. 1, pp. 75–105, 2004, [Online]. Available: https://doi.org/10.2307/25148625.

G. Tebes, B. Rivera, P. Becker, M. F. Papa, D. Peppino, and L. Olsina, “Specifying the design science research process: an applied case of building a software testing ontology,” in XXIII CIbSE’ 20, 2020, pp. 1–14, Published by Curran Associates, ISBN: 9781713818533.

G. Tebes, D. Peppino, P. Becker, G. Matturro, M. Solari, and L. Olsina, “Analyzing and documenting the systematic review results of software testing ontologies,” Information and Software Technology, vol. 123, 2020, doi: 10.1016/j.infsof.2020.106298.

M. D’Aquin and A. Gangemi, “Is There Beauty in Ontologies?,” Applied Ontology, vol. 6, no. 3, pp. 165–175, 2011.

L. Olsina, “Analyzing the Usefulness of ThingFO as a Foundational Ontology for Sciences,” in proceedings of ASSE’20, Argentine Symposium on Software Engineering, 49 JAIIO, 2020, pp. 1–20.

G. Tebes, L. Olsina, D. Peppino, and P. Becker, “TestTDO: A Top-Domain Software Testing Ontology,” in XXIII CIbSE’ 20, 2020, pp. 1–14, Published by Curran Associates, ISBN: 9781713818533.

É. F. De Souza, R. De Almeida Falbo, and N. L. Vijaykumar, “ROoST: Reference ontology on software testing,” Applied Ontology, vol. 12, no. 1, pp. 59–90, 2017.

G. Guizzardi, “Ontological foundations for structural conceptual models, Ph.D. Thesis, Netherlands, Universal Press.” 2005.

A. Asman and R. M. Srikanth, “A Top Domain Ontology For Software Testing, Master Thesis,” Jönköping University, 2015.

H. de S. Campos Junior, C. A. de Paiva, R. Braga, M. A. P. Araújo, J. M. N. David, and F. Campos, “Regression Tests Provenance Data in the Continuous Software Engineering Context,” 2017, doi: 10.1145/3128473.3128483.

S. Vasanthapriyan, J. Tian, D. Zhao, S. Xiong, and J. Xiang, “An Ontology-Based Knowledge Sharing Portal for Software Testing,” in Proceedings - 2017 IEEE International Conference on Software Quality, Reliability and Security Companion, QRS-C 2017, 2017, pp. 472–479, doi: 10.1109/QRS-C.2017.82.

S. Vasanthapriyan, J. Tian, and J. Xiang, “An ontology-based knowledge framework for software testing,” Communications in Computer and Information Science, vol. 780, pp. 212–226, 2017, doi: 10.1007/978-981-10-6989-5_18.

A. Freitas and R. Vieira, “An ontology for guiding performance testing,” in Proceedings - 2014 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology - Workshops, WI-IAT 2014, 2014, vol. 1, pp. 25–36, doi: 10.1109/WI-IAT.2014.62.

G. Arnicans, D. Romans, and U. Straujums, “Semi-automatic generation of a software testing lightweight ontology from a glossary based on the ONTO6 methodology,” Frontiers in Artificial Intelligence and Applications, vol. 249, pp. 263–276, 2013.

P. G. Sapna and H. Mohanty, “An Ontology Based Approach for Test Scenario Management,” in Information Intelligence, Systems, Technology and Management, 2011, pp. 91–100, doi: 10.1007/978-3-642-19423-8_10.

L. Cai, W. Tong, Z. Liu, and J. Zhang, “Test Case Reuse Based on Ontology,” in 2009 15th IEEE Pacific Rim International Symposium on Dependable Computing, Nov. 2009, pp. 103–108, doi: 10.1109/PRDC.2009.25.

X. Bai, S. Lee, W. T. Tsai, and Y. Chen, “Ontology-based test modeling and partition testing of web services,” in Proceedings of the IEEE International Conference on Web Services, ICWS 2008, 2008, pp. 465–472, doi: 10.1109/ICWS.2008.111.

E. F. Barbosa, E. Y. Nakagawa, A. C. Riekstin, and J. C. Maldonado, “Ontology-based development of testing related tools,” in 20th International Conference on Software Engineering and Knowledge Engineering, SEKE 2008, 2008, pp. 697–702.

H. Zhu and Q. Huo, “Developing Software Testing Ontology in UML for a Software Growth Environment of Web-Based Applications,” in Software Evolution with UML and XML, IGI Global, 2005, pp. 263–295.

S. Fleetwood, “The Ontology of Things, Properties and Powers,” Journal of Critical Realism, vol. 8, no. 3, pp. 343–366, 2009, doi: 10.1558/jocr.v8i3.343.

R. A. Zwaan, “Situation Model: Psychological,” in International Encyclopedia of the Social & Behavioral Sciences, N. J. Smelser and P. B. B. T.-I. E. of the S. & B. S. Baltes, Eds. Oxford: Pergamon, 2001, pp. 14137–14141.

M. Fernandez, A. Gómez-Pérez, and N. Juristo, “Methontology: from ontological art towards ontological engineering,” in Proceedings of the AAAI97 Spring Symposium Series on Ontological Engineering, 1997, pp. 33–40.

L. Olsina, G. Tebes, D. Peppino, and P. Becker, “Approaches used to Verify and Validate a Software Testing Ontology as an Artifact,” in IEEE ARGENCON, 2020, pp. 1–8.

M. H. L. Vo and Q. Hoang, “Transformation of UML class diagram into OWL Ontology,” Journal of Information and Telecommunication, vol. 4, no. 1, pp. 1–16, Jan. 2019, doi: 10.1080/24751839.2019.1686681.

R. E. Y. Haasjes, “Metamodel transformations between UML and OWL, Master Thesis,” University of Twente, 2019.

D. Vrandečić and A. Gängemi, “Unit tests for ontologies,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Oct. 2006, vol. 4278 LNCS, pp. 1012–1020, doi: 10.1007/11915072_2.

J. Brank, M. Grobelnik, and D. Mladenic, “A survey of ontology evaluation techniques,” in In Proceedings of the Conference on Data Mining and Data Warehouses (SiKDD 2005), 2005, pp. 166–169.

A. Lozano-Tello and A. Gómez-Pérez, “ONTOMETRIC: A Method to Choose the Appropriate Ontology,” Journal of Database Management, vol. 15, no. 2, pp. 1–18, 2004, doi: 10.4018/jdm.2004040101.

A. Duque-Ramos, J. T. Fernández-Breis, R. Stevens, and N. Aussenac-Gilles, “OQuaRE: A square-based approach for evaluating the quality of ontologies,” Journal of Research and Practice in Information Technology, vol. 43, no. 2, pp. 159–176, 2011.




How to Cite

Tebes, G., Olsina, L., Peppino, D., & Becker, P. (2021). Specifying and Analyzing a Software Testing Ontology at the Top-Domain Ontological Level. Journal of Computer Science and Technology, 21(2), e12. https://doi.org/10.24215/16666038.21.e12



Original Articles