Opening book details…
Can I read Discrete-Time Markov Control Processes : Basic Optimality Criteria on EtoBox?
Discrete-Time Markov Control Processes : Basic Optimality Criteria by Onésimo Hernández-Lerma, Jean Bernard Lasserre (auth.) is a nonfiction available to read on EtoBox.
What is Discrete-Time Markov Control Processes : Basic Optimality Criteria about?
This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control (or action) spaces, and possibly unbounded costs and noncompact control constraint sets. MCPs are a class of stochastic control problems, also known as Markov decision processes, controlled Markov processes, or stochastic dynamic pro grams; sometimes, particularly when the state space is a countable set, they are also called Markov decision (or controlled Markov) chains. Regardless of the name used, MCPs appear in many fields, for example, engineering, economics, operations research, statistics, renewable and nonrenewable re source management, (control of) epidemics, etc. However, most of the lit erature (say, at least 90%) is concentrated on MCPs for which (a) the state space is a countable set, and/or (b) the costs-per-stage are bounded, and/or (c) the control constraint sets are compact. But curiously enough, the most widely used control model in engineering and economics--namely the LQ (Linear system/Quadratic cost) model-sat
Who reads Discrete-Time Markov Control Processes : Basic Optimality Criteria?
It is typically read by self-directed learners exploring a subject in depth.
Common subject areas: history, science, philosophy, social sciences.
- Author
- Onésimo Hernández-Lerma, Jean Bernard Lasserre (auth.)
- Publisher
- Springer-Verlag New York
- Published
- 1996
- Language
- EN
- ISBN
- 9780387945798
- Category
- nonfiction
- Subjects
- Mathematics, Engineering, Computer Science
Other editions & translations
More by Onésimo Hernández-Lerma, Jean Bernard Lasserre (auth.)
Browse all works by Onésimo Hernández-Lerma, Jean Bernard Lasserre (auth.)
Similar books
- Discrete-Time Markov Control Processes — Hernández-Lerma, Onésimo; Lasserre, Jean Bernard (1996)
- Further Topics on Discrete-Time Markov Control Processes — Onésimo Hernández-Lerma, Jean Bernard Lasserre (auth.) (1999)
- Discrete Time Markov Jump Linear Systems — O.L.V. Costa, M.D. Fragoso, R.P. Marques, Oswaldo Luiz do Valle (2005)
- Stationary Processes and Discrete Parameter Markov Processes — Rabi Bhattacharya; Edward C. Waymire (2022)
- Zero-Sum Discrete-Time Markov Games with Unknown Disturbance Distribution: Discounted and Average Criteria (SpringerBriefs in Probability and Mathematical Statistics) — J. Adolfo Minjárez-Sosa (2020)
- Continuous Average Control of Piecewise Deterministic Markov Processes (SpringerBriefs in Mathematics) — Oswaldo Luiz do Valle Costa, Francois Dufour (auth.) (2013)
