An Adaptive Approach to Optimize Probabilistic Distributed Testing

  • Mohammed Amine Tajioue Faculty of Science, Ibn Tofail University
  • Oussama Maakoul
  • Fatima Zahra Moutai
  • Sara Hsaini
  • Salma Azzouzi
  • My El Hassan Charaf
Keywords: Probabilistic automata, Synchronization, Control, Observability, Optimization, Markov Decision Processes

Abstract

Typically, conformance testing consists of placing a set of parallel testers at each port of an implementation to ensure its conformance to the specifification. However, a number of common fault detections occur if no coordination is made between these parallel testers and the implementation under test (IUT). Therefore, the test process must support mechanisms of coordination between these distributed components, particularly for implementation with stochastic behaviour. To this end, as well as to analyse the stochastic behaviour of the implementation under test, we propose in this paper an algorithm to generate for each tester a probabilistic local test sequence (PLTS) aiming to avoid both synchronization and observation issues. Finally, we suggest a new architecture based on Markov decision processes with an adaptive controller to control and optimize the whole testing process.

References

K. C. Tai, and Y. C. Young, Synchronizable test sequences of finite state machines, Computer Networks, vol. 30, pp. 1111–1134, 1998.

R. M. Hierons, Testing a distributed system: generating minimal synchronised test sequences that detect output-shifting faults, Information and Software Technology, vol. 43, no. 9, pp. 551–560, 2001.

H. Ural, and D. Whittier, Distributed testing without encountering controllability and observability problems, Information Processing Letters, vol. 88, pp. 133-141, 2003.

O. Rafiq, and L. Cacciari, Coordination algorithm for distributed testing, The Journal of Supercomputing, vol. 24, pp. 203-211, 2003.

S. Azzouzi, M. Benattou, and M. E. H. Charaf, A temporal agent-based approach for testing open distributed systems Computer Standards & Interfaces, vol. 40, pp. 23– 33, 2015.

A. Khoumsi, A new method for testing real time systems Proceedings Seventh International Conference on Real-Time Computing Systems and Applications, pp. 441-450, 2000.

R. M. Hierons, and M. N´u˜nez, Implementation relations and probabilistic schedulers in the distributed test architecture, Journal of Systems and Software, vol. 132, pp. 319–335, 2017.

G. Luo, R. Dssouli, G. v Bochmann, P. Venkataram, and A. Ghedamsi, Test generation with respect to distributed interfaces, Computer Standards & Interfaces, vol. 16, no. 2, pp. 119–132, 1994.

J. Chen, R. M. Hierons, and K. Ural, Conditions for resolving observability problems in distributed testing, Lecture Notes Computer Science (including Subseries Lecture Notes Artificial Intelligence Lecture Notes Bioinformatics), vol. 3235, pp. 229–242, 2004.

W. Y. Liu, H. W. Zeng, and H. K. Miao, Multiple UIO-based test sequence generation for distributed systems, Journal of Shanghai University, vol. 12, no. 5, pp. 438–443, 2008.

M. Gerhold, A. Hartmanns, and M. Stoelinga, Model-based testing of stochastically timed systems, Innovations in Systems and Software Engineering, vol. 15, no. 3-4, pp. 207–233, 2019.

F.-Z. Moutai, S. Hsaini, S. Azzouzi, and M. E. H. Charaf, Testing Distributed Cloud: A Case Study, 2019 International Symposium on Advanced Electrical and Communication Technologies (ISAECT), pp. 1–5, 2019.

F.-Z. Moutai, S. Hsaini, S. Azzouzi, and M. E. H. Charaf, Security Testing Approach for IaaS Infrastructure, Proceedings of the 2nd International Conference on Networking, Information Systems & Security (NISS19), pp. 1–5, 2019.

K. G. Larsen, and A. Skou, Bisimulation through Probabilistic Testing (Preliminary Report), in Proceedings of the 16th ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, (New York, NY, USA), pp. 344–352, Association for Computing Machinery, 1989.

L. Cheung, M. Stoelinga, and F. Vaandrager, A testing scenario for probabilistic processes, Journal of the ACM, vol. 54, no. 6, pp. 29–29, 2007.

R. M. Hierons, and M. G. Merayo, Mutation testing from probabilistic and stochastic finite state machines, Journal of Systems and Software, vol. 82, no. 11, pp. 1804– 1818, 2009.

H. Bohnenkamp, and A. Belinfante, Timed testing with TorX, Lecture Notes Computer Science, vol. 3582, pp. 173–188, 2005.

G. H. Walton, J. H. Poore, and C. J. Trammell, Statistical testing of software based on a usage model, Software: Practice and Experience, vol. 25, no. 1, pp. 97–108, 1995.

J. A. Whittaker, K. Rekab, and M. G. Thomason, A Markov chain model for predicting the reliability of multi-build software, Information and Software Technology, vol. 42, no. 12, pp. 889–894, 2000.

S. J. Prowell, Computations for Markov Chain Usage Models, Computer Science Technical Report UT-CS-03- 505, pp. 03-505, 2003.

M. Gerhold, and M. Stoelinga, Model-based testing of probabilistic systems, Formal Aspects of Computing, vol. 30, no. 1, pp. 77–106, 2018.

M. E. H. Charaf, M. Benattou, and A. S. A. Jess, AGENT based architecture for testing distributed systems, Journal of Information Science and Engineering, vol. 30, no. 5, pp. 1619–1634, 2014.

S. Hsaini, S. Azzouzi, and M. E. H. Charaf, Testing Rules for Mapreduce Fameworks, Colloquium in Information Science and Technology, 2018.

S. Azzouzi, S. Hsaini, and M. E. H. Charaf, A Synchronized Test Control Execution Model of Distributed Systems, International Journal of Grid and High Performance Computing, vol. 12, no. 1, pp. 1–17, 2020.

M. E. H. Charaf, and S. Azzouzi, A colored petri-net model for control execution of distributed systems, 4th International Conference on Control Decision and Information Technologies (CoDIT’17), pp. 277–282, 2017.

M. A. Tajioue, O. Maakoul, S. Hsaini, S. Azzouzi, and M. E. H. Charaf, Towards Overcoming Issues of Testing Probabilistic Distributed systems, 2020 7th International Conference on Control Decision and Information Technologies (CoDIT’20), vol. 1, pp. 903–907, 2021.

O. Maakoul, M. A. Tajioue, S. Hsaini, S. Azzouzi, and M. E. H. Charaf, Testing Access Control List Policies in a Hadoop

Environment, 2020 7th International Conference on Control Decision and Information Technologies (CoDIT’20), vol. 1, pp. 831–836, 2021.

R. Bellman, Dynamic Programming and Lagrange Multipliers, Proceedings of the National Academy of Sciences, vol. 42, no. 10, pp. 767–769, 1956.

Published
2022-02-08
How to Cite
Tajioue, M. A., Maakoul, O., Moutai, F. Z., Hsaini, S., Azzouzi, S., & Charaf, M. E. H. (2022). An Adaptive Approach to Optimize Probabilistic Distributed Testing. Statistics, Optimization & Information Computing, 10(1), 147-159. https://doi.org/10.19139/soic-2310-5070-1205
Section
Research Articles