Skip to content

Opening book details…

Can I read Discrete-Time Markov Control Processes : Basic Optimality Criteria on EtoBox?

Discrete-Time Markov Control Processes : Basic Optimality Criteria by Onésimo Hernández-Lerma, Jean Bernard Lasserre (auth.) is a nonfiction available to read on EtoBox.

What is Discrete-Time Markov Control Processes : Basic Optimality Criteria about?

This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control (or action) spaces, and possibly unbounded costs and noncompact control constraint sets. MCPs are a class of stochastic control problems, also known as Markov decision processes, controlled Markov processes, or stochastic dynamic pro grams; sometimes, particularly when the state space is a countable set, they are also called Markov decision (or controlled Markov) chains. Regardless of the name used, MCPs appear in many fields, for example, engineering, economics, operations research, statistics, renewable and nonrenewable re source management, (control of) epidemics, etc. However, most of the lit erature (say, at least 90%) is concentrated on MCPs for which (a) the state space is a countable set, and/or (b) the costs-per-stage are bounded, and/or (c) the control constraint sets are compact. But curiously enough, the most widely used control model in engineering and economics--namely the LQ (Linear system/Quadratic cost) model-sat

Who reads Discrete-Time Markov Control Processes : Basic Optimality Criteria?

It is typically read by self-directed learners exploring a subject in depth.

Common subject areas: history, science, philosophy, social sciences.

Author
Onésimo Hernández-Lerma, Jean Bernard Lasserre (auth.)
Publisher
Springer-Verlag New York
Published
1996
Language
EN
ISBN
9780387945798
Category
nonfiction
Subjects
Mathematics, Engineering, Computer Science

Other editions & translations

More by Onésimo Hernández-Lerma, Jean Bernard Lasserre (auth.)

Browse all works by Onésimo Hernández-Lerma, Jean Bernard Lasserre (auth.)

Similar books