Opening book details…
Can I read The Apparent Conflict Between Estimation and Control—a Survey of the Two-armed Bandit Problem on EtoBox?
The Apparent Conflict Between Estimation and Control—a Survey of the Two-armed Bandit Problem by Ian H. Witten is a Engineering article available to read on EtoBox.
What is The Apparent Conflict Between Estimation and Control—a Survey of the Two-armed Bandit Problem about?
The two-armed bandit is one of the simplest possible non-deterministic control environments which are not trivial. And yet it is astonishingly diffkult to control. For the finite-time problem, dynamic programming methods provide optimal controllers. Optimal control strategies also exist for the infinite-time problem, but their implementation requires inJinite storage. Storage can be restricted by allowing only the results of the last r tosses to be recorded: the finite-memory problem-or by considering fcnite state controllers: the f&testate problem. This paper surveys approaches to the two-armed bandit problem. After introducing the problem and discussing examples of systems where it appears, progress on the three abovementioned variants is reviewed in turn. Later, Sworder (4) emphasized the difficulty of the problem by showing that, even for a simple linear system, the optimum identification technique coupled to the optimal control algorithm does not lead to the optimal controller. This demonstrates the dangers of attempting to avoid the problem by developing separate identification and control theories. However, the problem is one of system theory rather than control engineering.
Who reads The Apparent Conflict Between Estimation and Control—a Survey of the Two-armed Bandit Problem?
It is typically read by researchers, students, and practitioners in Engineering.
- Author
- Ian H. Witten
- Publisher
- Elsevier Science; Elsevier ; Elsevier Ltd.; Elsevier BV (ISSN 0016-0032)
- Published
- 1976
- Language
- EN
- Field
- Engineering (Physical Sciences)