ISSN 0021-3454 (print version)
ISSN 2500-0381 (online version)
Menu

4
Issue
vol 67 / April, 2024
Article

DOI 10.17586/0021-3454-2021-64-6-444-451

UDC 51.77

MODELING THE PROCESS OF INTERACTION IN AN INFORMATION AND COMPUTING NETWORK AS A SYSTEM WITH MARKOV PROCESSES

O. A. Malafeyev
St. Petersburg State University, Department of Modeling of Socio-economic Systems; Head of the Department;


I. V. Zaitseva
Russian State Hydrometeorological University, Department of Higher Mathematics and Theoretical Mechanics; Head of the Department


D. V. Shlaev
Stavropol State Agrarian University, Department of Information Systems;


S. G. Shmatko
PhD, Associate Professor; Stavropol State Agrarian University, Department of Information Systems; Head of the Department;


N. A. Breider
Russian State Hydrometeorological University, Educational and Methodical Management; Head of the Department;


Read the full article 

Abstract. A mathematical model of an enterprise information-computing network functioning with the choice of the optimal policy for the work of the information technology department is presented. The task of the research is to find the optimal strategy for the work of the information technology department to improve the information and computer network performance. The information-computer network of an enterprise is considered as an example of Markov network of mass service. The choice of the best strategy to maximize the mathematical expectation of a payoff is mathematically substantiated. The methods of probability theory, the mathematical apparatus of the theory of mass service and the theory of controlled Markov random processes are used as a theoretical apparatus for studying the system under consideration. Howard's iterative algorithm is used for finding the optimal policy.
Keywords: modeling, functioning, information and computing network, information technology department, Markov decision-making process

References:
  1. Bellman R.E., Dreyfus S.E. Applied Dynamic Programming, Princeton University Press, 1962.
  2. Yushkevich A.A., Dynkin E.B. Upravlyayemyye markovskiye protsessy i ikh prilozheniya (Guided Markov Processes and Their Applications), Moscow, 1975, 338 р. (in Russ.)
  3. Bellman R.E. Dynamic programming, Princeton, 1957, 365 р.
  4. Kaufmann A. Graphs, dynamic programming, and finite games, NY, London, Academic press, 1967, 484 р.
  5. Kolokoltsov V.N., Malafeev O.A. Matematicheskoye modelirovaniye mnogoagentnykh sistem konkurentsii i kooperatsii (Teoriya igr dlya vsekh) (Mathematical Modeling of Multi-Agent Systems of Competition and Cooperation (Game Theory for All)), St. Petersburg, 2012, 624 р. (in Russ.)
  6. Kaufmann A., Henry-Labordere A. Methodes et modeles de la recherché operationnelle: programmation en nombres entiers, 1974.
  7. Malafeev O.A., Zubova A.F. Matematicheskoye i komp'yuternoye modelirovaniye sotsial'no-ekonomicheskikh sistem na urovne mnogoagentnogo vzaimodeystviya (Vvedeniye v problemy ravnovesiya, ustoychivosti i nadezhnosti) (Mathematical and Computer Modeling of Socio-Economic Systems at the Level of Multi-Agent Interaction (Introduction to the Problems of Equilibrium, Stability and Reliability)), St. Petersburg, 2006, 1006 р. (in Russ.)
  8. Kutuzov O.I., Tatarnikova T.M. Proceedings of 2019 22nd International Conference on Soft Computing and Measurements, SCM 2019, 2019, pp. 45–47.
  9. Tatarnikova T.M., Elizarov М.А. Scientific and Technical Journal of Information Technologies, Mechanics and Optics, 2016, no. 6(16), pp. 1120–1127. (in Russ.)
  10. Sikarev I.A., Sakharov V.V., Chertkov A.A. Vestnik Gosudarstvennogo universiteta morskogo i rechnogo flota imeni admirala S.O. Makarova, 2018, no. 3(49), pp. 647–657. (in Russ.)
  11. Sikarev I.A., Shakhnov S.F. Automatic Control and Computer Sciences, 2017, no. 8(51), pp. 921–927.
  12. Zaitseva I. AIP Conference Proceedings, 2019, vol. 2116, рр. 450057.
  13. Malafeyev O., Zaitseva I., Onishenko V., Zubov A., Bondarenko L, Orlov V., Petrova V., Kirjanen A. AIP Conference Proceedings, 2019, vol. 2116, рр. 450058.