A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms

[1]  L. Platzman Optimal Infinite-Horizon Undiscounted Control of Finite Probabilistic Systems , 2006 .

[2]  Peter W. Glynn,et al.  Optimization of stochastic systems , 1986, WSC '86.

[3]  Daniel P. Heyman,et al.  Stochastic models in operations research , 1982 .

[4]  B. L. Miller Countable-state average-cost regenerative stopping problems , 1981, Journal of Applied Probability.

[5]  George E. Monahan,et al.  Optimal Stopping in a Partially Observable Markov Process with Costly Information , 1980, Oper. Res..

[6]  S. Marcus,et al.  Decentralized control of finite state Markov processes , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[7]  C. White Monotone control laws for noisy, countable-state Markov chains , 1980 .

[8]  P. Whittle Bayesian control of Markov chains, mathematical centre tracts 95: K.M. van HEE Mathematisch Centrum, Amsterdam, 1978, vii + 190 pages, Dfl. 23,00 , 1979 .

[9]  S. Christian Albright,et al.  Structural Results for Partially Observable Markov Decision Processes , 1979, Oper. Res..

[10]  C. White Bounds on optimal cost for a replacement problem with partial observations , 1979 .

[11]  B. L. Miller,et al.  Optimal Investigation as a Regenerative Stopping Problem. , 1979 .

[12]  C. White Optimal control-limit strategies for a partially observed replacement problem† , 1979 .

[13]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over the Infinite Horizon: Discounted Costs , 1978, Oper. Res..

[14]  C. White Optimal Inspection and Repair of a Production Process Subject to Deterioration , 1978 .

[15]  Robert F. Anderson,et al.  Optimal Inspections in a Stochastic Control Problem with Costly Observations, II , 1977, Math. Oper. Res..

[16]  K. M. vanHee,et al.  Bayesian control of Markov chains , 1978 .

[17]  K. Sawaki,et al.  OPTIMAL CONTROL FOR PARTIALLY OBSERVABLE MARKOV DECISION PROCESSES OVER AN INFINITE HORIZON , 1978 .

[18]  D. Bertsekas,et al.  Dynamic Programming and Stochastic Control , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[19]  Chelsea C. White,et al.  A Markov Quality Control Process Subject to Partial Observation , 1977 .

[20]  Loren K. Platzman,et al.  Finite memory estimation and control of finite probabilistic systems , 1977 .

[21]  Robert C. Wang Computing optimal quality control policies — two actions , 1976, Journal of Applied Probability.

[22]  William P. Pierskalla,et al.  A survey of maintenance models: The control and surveillance of deteriorating systems , 1976 .

[23]  Donald B. Rosenfield,et al.  MARKOVIAN DETERIORATION WITH UNCERTAIN INFORMATION — A MORE GENERAL MODEL , 1976 .

[24]  Andrew Vazsonyi,et al.  Information Systems in Management Science---The Use of Mathematics for Management Information Systems. II , 1976 .

[25]  Adrian Segall,et al.  Dynamic file assignment in a computer network , 1976 .

[26]  Donald B. Rosenfield,et al.  Markovian Deterioration with Uncertain Information , 1976, Oper. Res..

[27]  S. Ehrenfeld,et al.  On a sequential Markovian decision procedure with incomplete information , 1976, Comput. Oper. Res..

[28]  Chelsea C. White,et al.  Cost Equality and Inequality Results for a Partially Observed Stochastic Optimization Problem , 1975, IEEE Transactions on Systems, Man, and Cybernetics.

[29]  Evan L. Porteus On the Optimality of Structured Policies in Countable Stage Decision Processes , 1975 .

[30]  Charlotte Striebel,et al.  Optimal Control of Discrete Time Stochastic Systems , 1975 .

[31]  Thomas Kaijser A Limit Theorem for Partially Observed Markov Chains , 1975 .

[32]  U. Rieder Bayesian dynamic programming , 1975, Advances in Applied Probability.

[33]  L. Stone Theory of Optimal Search , 1975 .

[34]  Leonard Kleinrock,et al.  Packet Switching in a Multiaccess Broadcast Channel: Dynamic Control Procedures , 1975, IEEE Trans. Commun..

[35]  Leonard Kleinrock,et al.  Packet Switching in a Multiaccess Broadcast Channel: Performance Evaluation , 1975, IEEE Trans. Commun..

[36]  D. Rhenius Incomplete Information in Markovian Decision Models , 1974 .

[37]  M. Rudemo State estimation for partially observed Markov chains , 1973 .

[38]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over a Finite Horizon , 1973, Oper. Res..

[39]  J. Satia,et al.  Markovian Decision Processes with Probabilistic Observation of States , 1973 .

[40]  J. K. Satia,et al.  Markovian Decision Processes with Uncertain Transition Probabilities , 1973, Oper. Res..

[41]  Edward J. Sondik,et al.  Toward an Integrated Methodology for the Analysis of Health-Care Systems , 1971, Oper. Res..

[42]  S. Ross Quality Control under Markovian Deterioration , 1971 .

[43]  Edward J. Sondik,et al.  The optimal control of par-tially observable Markov processes , 1971 .

[44]  Azaria Paz,et al.  Introduction to Probabilistic Automata , 1971 .

[45]  Stephen M. Pollock,et al.  A Simple Model of Search for a Moving Target , 1970, Oper. Res..

[46]  K. Hinderer,et al.  Foundations of Non-stationary Dynamic Programming with Discrete Time Parameter , 1970 .

[47]  M. Degroot Optimal Statistical Decisions , 1970 .

[48]  T. Yoshikawa,et al.  Discrete-Time Markovian Decision Processes with Incomplete State Observation , 1970 .

[49]  R. Kaplan Optimal Investigation Strategies with Imperfect Information , 1969 .

[50]  James E. Eckles,et al.  Optimum Maintenance with Incomplete Information , 1968, Oper. Res..

[51]  N. Furukawa A BAYES CONTROLLED PROCESS , 1967 .

[52]  M. Aoki Optimal control of partially observable Markovian systems , 1965 .

[53]  H. M. Taylor Markovian sequential replacement processes , 1965 .

[54]  E. Dynkin Controlled Random Sequences , 1965 .

[55]  Karl Johan Åström,et al.  Optimal control of Markov processes with incomplete state information , 1965 .

[56]  D. Iglehart Optimality of (s, S) Policies in the Infinite Horizon Dynamic Inventory Problem , 1963 .

[57]  M. Klein Inspection—Maintenance—Replacement Schedules Under Markovian Deterioration , 1962 .

[58]  R. Howard Dynamic Programming and Markov Processes , 1960 .

[59]  M. A. Girshick,et al.  A BAYES APPROACH TO A QUALITY CONTROL MODEL , 1952 .