Actas de congresos
On The Existence Of Stationary Optimal Policies For The Average Cost Control Problem Of Linear Systems With Abstract State-feedback
Registro en:
9781424431243
Proceedings Of The Ieee Conference On Decision And Control. , v. , n. , p. 3682 - 3687, 2008.
1912216
10.1109/CDC.2008.4738991
2-s2.0-62949164738
Autor
Vargas A.N.
Do Val J.B.R.
Institución
Resumen
This paper establishes conditions for the existence of optimal stationary policies for a class of long-run average cost control problems. The discretetime system is assumed to be linear with respect to the state but the controls take an abstract statefeedback structure. The derived approach may be used to represent systems where the state is observed by the controller only through some specially structures output (no history is employed). It is shown that, if there exists an optimal-abstract policy for the discounted-cost problem, and such a policy generates an autonomous system with uniform exponential decay, then there exists an optimal stationary policy for the average cost problem. Notions of controllability and observability of linear time-varying systems are imposed. © 2008 IEEE.
3682 3687 Sandell, N.R., Athans, M., Varaiya, P., Safonov, M.G., Survey of decentralized control methods for large scale systems (1978) IEEE Trans. Automat. Control, 23 (2), pp. 108-128 Syrmos, V., Abdallah, C., Dorato, P., Grigoriadis, K., Static output feedback-a survey (1997) Automatica, 33, pp. 125-137 Anderson, B.D.O., Moore, J.B., Time-varying feedback laws for decentralized control (1981) IEEE Trans. Automatic Control, 26 (5), pp. 1133-1138 Geromel, J.C., de Souza, C.C., Skelton, R.E., Static output feedback controllers: Stability and convexity (1998) IEEE Trans. Automatic Control, 43 (1), pp. 120-125 Anderson, B.D.O., Moore, J.B., (1979) Optimal Filtering, , Prentice-Hall, Englewood Cliffs, N.J Davis, M.H.A., Vinter, R.B., (1985) Stochastic Modelling and Control, , Chapman and Hall, London Blondel, V., Tsitsiklis, J.N., NP-hardness of some linear control design problems (1997) SIAM J. Control Optim, 35 (6), pp. 2118-2127 Henrion, D., Lasserre, J.B., Convergent relaxations of polynomial matrix inequalities and static output feedback (2006) IEEE Trans. Automatic Control, 51 (2), pp. 192-202 Hernández-Lerma, O., Lasserre, J.B., (1996) Discrete-Time Markov Control Processes: Basic Optimality Criteria, , Springer-Verlag, New York Hernández-Lerma, O., Lasserre, J.B., (1999) Further Topics in Discrete Time Markov Control Processes, , Springer-Verlag, New York Hernández-Lerma, O., Romera, R., Limiting discountedcost control of partially observable stochastic systems (2001) SIAM J. Control Optim, 40 (2), pp. 348-369 Arapostathis, A., Borkar, V.S., Fernández-Gaucherand, E., Ghosh, M.K., Marcus, S.I., Discrete-time controlled Markov processes with average cost criterion: A survey (1993) SIAM J. Control Optim, 31 (2), pp. 282-344 Schal, M., Average optimality in dynamic programming with general state space (1993) Math. of Operations Res, 18, pp. 163-172 Meyn, S.P., The policy iteration algorithm for average reward Markov decision processes with general state space (1997) IEEE Trans. Automat. Control, 42 (12), pp. 1663-1680 Feinberg, E.A., Lewis, M.E., Optimality inequalities for average cost Markov decision processes and the stochastic cash balance problem (2007) Math. Oper. Res, 32 (4), pp. 769-783 Bertsekas, D.P., Shreve, S.E., (1978) Stochastic Optimal Control: The Discrete Time Case, , Academic Press Hernández-Lerma, O., Lasserre, J.B., Average cost optimal policies for Markov control processes with Borel state space and unbounded costs (1990) Systems Control Lett, 15, pp. 349-356 Kalman, R.E., Contribution to the theory of optimal control (1960) Bol. Soc. Mat. Mexicana, 5 (2), pp. 102-119 Silverman, L.M., Anderson, B.D.O., Controllability, observability and stability of linear systems (1968) SIAM J. Control Optim, 6 (1), pp. 121-130 Anderson, B.D.O., Moore, J.B., New results in linear system stability (1969) SIAM J. Control, 7 (3), pp. 398-414 Vargas, A.N., do Val, J.B.R., Average cost and stability of time-varying linear systems Preprint