Whittle Index for Partially Observed Binary Markov Decision Processes

Vivek S. Borkar

首页> 外文期刊>Automatic Control, IEEE Transactions on >Whittle Index for Partially Observed Binary Markov Decision Processes

【24h】

Whittle Index for Partially Observed Binary Markov Decision Processes

机译：部分观测的二进制Markov决策过程的Whittle指数

获取原文

获取原文并翻译 | 示例

掌桥外文数据库（机构版） >>

开具论文收录证明 >>

文献代查 >>

页面导航

摘要
著录项
相似文献
相关主题

摘要

We consider the problem of dynamically scheduling M out of N binary Markov chains when only noisy observations of state are available, with ergodic (equivalently, long run average) reward. By passing on to the equivalent problem of controlling the conditional distribution of state given observations and controls, it is cast as a restless bandit problem and its Whittle indexability is established.

机译：当只有状态的嘈杂观测值可用时，我们考虑动态调度N个二元马尔可夫链中的M个问题，并获得遍历（等效于长期平均）奖励。通过将给定的观测和控制转移到控制状态的条件分布的等效问题，将其转换为不安定的土匪问题，并建立了其Whittle可分性。

著录项

来源
《Automatic Control, IEEE Transactions on》 |2017年第12期|6614-6618|共5页
作者
Vivek S. Borkar;
展开▼
作者单位

展开▼
收录信息
原文格式 PDF
正文语种 eng
中图分类
关键词
Markov processes; Process control; Dynamic programming; Aerospace electronics; Dynamic scheduling;

机译：马尔可夫过程;过程控制;动态规划;航空航天电子学;动态调度;

相似文献

外文文献
中文文献
专利

1. Information Relaxation Bounds for Partially Observed Markov Decision Processes [J] . Haugh Martin B., Lacedelli Octavio Ruiz IEEE Transactions on Automatic Control . 2020,第8期

机译：部分观察到的Markov决策过程的信息放松界限
2. Asymptotic Optimality of Finite Model Approximations for Partially Observed Markov Decision Processes With Discounted Cost [J] . Saldi Naci, Yuksel Serdar, Linder Tamas IEEE Transactions on Automatic Control . 2020,第1期

机译：有限模型近似的渐近最优折扣折扣判决过程的有限模型近似
3. MILP based value backups in partially observed Markov decision processes (POMDPs) with very large or continuous action and observation spaces [J] . Rakshita Agrawal, Matthew J. Realff, Jay H. Lee Computers & Chemical Engineering . 2013,第sepa13期

机译：在具有较大或连续动作和观察空间的部分观察到的马尔可夫决策过程（POMDP）中基于MILP的价值备份
4. On the adaptive control of a class of partially observed Markov decision processes [C] . Shun-Pin Hsu, Dong-Ming Chuang, Arapostathis, A. American Control Conference;ACC '09 . 2009

机译：一类局部观测的马尔可夫决策过程的自适应控制
5. Discrete-time partially observed Markov decision processes: Ergodic, adaptive, and safety control. [D] . Hsu, Shun-Pin. 2002

机译：离散时间部分观察到的马尔可夫决策过程：遍历，自适应和安全控制。
6. Decision Making Under Uncertainty: A Neural Model Based on Partially Observable Markov Decision Processes [O] . Rajesh P. N. Rao 2010

机译：不确定性下的决策：基于部分可观察的马尔可夫决策过程的神经模型
7. Experimental design for Partially Observed Markov Decision Processes [O] . Thorbergsson, Leifur, Hooker, Giles 2017

机译：部分观测马尔可夫决策过程的实验设计

Whittle Index for Partially Observed Binary Markov Decision Processes

摘要

著录项

相似文献

相关主题

期刊订阅