Optimal control of assignment of jobs to processors under heavy traffic

The paper is concerned with the optimal control of the assignment of jobs from several arriving random streams to one of a bank of processors. Owing to the difficulty of the general problem, a heavy traffic approach is used. The required work depends on the processor to which it is assigned. The information that the assignment can be based on is quite flexible, and several information structures (data on which the control is based) are considered. The assignment can be made on arrival or when the job is to be processed. There can be bursty arrivals (the bursts depending on randomly varying environmental factors), rather general nonlinear cost functions and other complications. It is shown, under reasonably general conditions, that the optimal costs for the physical systems converge to the optimal cost for the heavy traffic limit problem, as the heavy traffic parameter goes to its limit. Numerical data is presented to illustrate some of the potential uses of the limit process for obtaining optimal contros, or controls satisfying optimal tradeoffs among competing criteria. The methods of proof are quite powerful tools for such optimal control problems

[1]  J. Doob Stochastic processes , 1953 .

[2]  P. Billingsley,et al.  Convergence of Probability Measures , 1969 .

[3]  G. J. Foschini,et al.  A Basic Dynamic Routing Problem and Diffusion , 1978, IEEE Trans. Commun..

[4]  P. R. Kumar,et al.  Optimal control of a queueing system with two heterogeneous servers , 1984 .

[5]  Harold J. Kushner,et al.  Approximation and Weak Convergence Methods for Random Processes , 1984 .

[6]  Bruce E. Hajek,et al.  Review of 'Approximation and Weak Convergence Methods for Random Processes, with Applications to Stochastic Systems Theory' (Kushner, H.J.; 1984) , 1985, IEEE Transactions on Information Theory.

[7]  T. Kurtz Approximation of Population Processes , 1987 .

[8]  Jean Walrand An introduction to queuing networks , 1988 .

[9]  H. Kushner,et al.  Optimal and approximately optimal control policies for queues in heavy traffic , 1989 .

[10]  J. Sztrik An introduction to queuing networks , 1990 .

[11]  Lawrence M. Wein,et al.  Scheduling Networks of Queues: Heavy Traffic Analysis of a Two-Station Network with Controllable Inputs , 1990, Oper. Res..

[12]  Lawrence M. Wein,et al.  Optimal Control of a Two-Station Brownian Network , 2015, Math. Oper. Res..

[13]  J. Michael Harrison,et al.  The QNET method for two-moment analysis of open queueing networks , 1990, Queueing Syst. Theory Appl..

[14]  L. F. Martins,et al.  Routing and singular control for queueing networks in heavy traffic , 1990 .

[15]  L. F. Martins,et al.  Numerical Methods for Stochastic Singular Control Problems , 1991 .

[16]  Lawrence M. Wein,et al.  Scheduling Networks of Queues: Heavy Traffic Analysis of a Multistation Network with Controllable Inputs , 2011, Oper. Res..

[17]  F. P. Kelly,et al.  Dynamic routing in open queueing networks: Brownian models, cut constraints and resource pooling , 1993, Queueing Syst. Theory Appl..

[18]  Hong Chen,et al.  Diffusion approximations for open queueing networks with service interruptions , 1993, Queueing Syst. Theory Appl..

[19]  J. Quadrat Numerical methods for stochastic control problems in continuous time , 1994 .

[20]  Harold J. Kushner,et al.  Controlled and optimally controlled multiplexing systems: A numerical exploration , 1995, Queueing Syst. Theory Appl..

[21]  Harold J. Kushner,et al.  Codes for Optimal Stochastic Control: Documentation and Users Guide , 1996 .

[22]  J. Harrison Heavy traffic analysis of a system with parallel servers: asymptotic optimality of discrete-review policies , 1998 .

[23]  S. Ethier,et al.  Markov Processes: Characterization and Convergence , 2005 .