Method for control of technical objects operation process with the use of semi - Markov decision processes

In this article there is presented a description of a method for control of the operation process in a complex operation system of technical objects operation where semi-Markov decision processes are used for control. The study has been based on the operation process of a real bus municipal transportation system. For complex systems of technical objects operation, it is possible to achieve the set goal – appropriate accomplishment of the assigned task (tasks) with required efficiency - only when the control decisions, made by the system decision-makers, are rational. In systems where the complex operation process of technical objects is carried out, the choice of rational control decisions (from possible variants) is an issue of great importance and difficulty. In real complex operation systems of technical objects operation, the process of making control decisions should be carried out using mathematical procedures and methods, rather than according to the system decision makers' intuition or experience. Use of appropriate mathematical methods for control of the operation process facilitates the choice of rational control decisions providing correct and efficient accomplishment of the assigned tasks. The presented method involves elaborating a mathematical operation model (semi-Markov model) and choosing the best control strategy (from possible decision variants), according to the accepted criterion (criteria) of technical objects operation system assessment.