Optimal Control of Service Systems with Heterogeneous Servers and Priority Customers

We study service systems with parallel servers and random customer arrivals and focus on the waiting cost of customers. Using a Markov decision process (MDP) modeling approach, we analytically characterize the structures of the optimal dynamic server assignment policies for two important systems, one consisting of multiple homogeneous servers and two classes of customers and the other consisting of two heterogeneous servers and multiple classes of customers. Based on the obtained results, we propose a threshold-type heuristic policy for the generalized system consisting of multiple heterogeneous servers and multiple classes of customers. To design such a heuristic policy, we first develop techniques for the performance evaluation of general threshold-type policies with any given threshold values. We then construct a path to search for the optimal threshold values. We compare the performance of the best threshold-type heuristic policy with that of the optimal policy and show that our proposed heuristic policy is computationally efficient yet generates great performance. To derive additional managerial insights, we compare the system under our threshold-type dynamic server assignment policy with other commonly seen and simple systems, such as the dedicated system and the work-conserving flexible priority system. The clear performance advantage observed from extensive numerical experiments demonstrates the importance and usefulness of dynamic server assignment control for systems serving multiple classes of customer arrivals. Finally, we extend our analysis to incorporate customer-dependent service rates and sojourn-time minimization performance metrics. This paper was accepted by Chung Piaw Teo, optimization. Funding: This work was supported by the Hong Kong Research Grants Council [16500921, 16505819] and the National Natural Science Foundation of China [72201233, 72301222]. Supplemental Material: The online appendix and data files are available at https://doi.org/10.1287/mnsc.2023.01228 .