Formal Synthesis of Control Policies for Continuous Time Markov Processes From Time-Bounded Temporal Logic Specifications

Medina Ayala A.; Andersson S.B.; Belta C.

首页> 外文期刊>Automatic Control, IEEE Transactions on >Formal Synthesis of Control Policies for Continuous Time Markov Processes From Time-Bounded Temporal Logic Specifications

【24h】

Formal Synthesis of Control Policies for Continuous Time Markov Processes From Time-Bounded Temporal Logic Specifications

机译：时限时间逻辑规范对连续时间马尔可夫过程控制策略的形式综合

获取原文

获取原文并翻译 | 示例

掌桥外文数据库（机构版） >>

开具论文收录证明 >>

文献代查 >>

页面导航

摘要
著录项
相似文献
相关主题

摘要

We consider the control synthesis problem for continuous-time Markov decision processes (CTMDPs), whose expected behaviors are measured by the satisfaction of Continuous Stochastic Logic (CSL) formulas. We present an extension of the CSL for CTMDPs involving sequential task specifications with continuous time constraints on the execution of those tasks. We then exploit model checking and time-bounded reachability algorithms to solve the CSL control synthesis problem. To illustrate the feasibility and effectiveness of our approach, we apply our methods to generate the optimal rate constants of a coupled set of biochemical reactions.

机译：我们考虑连续时间马尔可夫决策过程（CTMDP）的控制综合问题，其预期行为通过连续随机逻辑（CSL）公式的满意程度来衡量。我们介绍了CTMDP的CSL扩展，其中涉及顺序任务规范，并且在执行这些任务时有连续的时间限制。然后，我们利用模型检查和时限可达性算法来解决CSL控制综合问题。为了说明该方法的可行性和有效性，我们应用我们的方法来生成一组耦合的生化反应的最佳速率常数。

著录项

来源
《Automatic Control, IEEE Transactions on》 |2014年第9期|2568-2573|共6页
作者
Medina Ayala A.; Andersson S.B.; Belta C.;
展开▼
作者单位

展开▼
收录信息
原文格式 PDF
正文语种 eng
中图分类
关键词
Biological system modeling; Computational modeling; Markov processes; Model checking; Optimal control; Probabilistic logic; Decision Making; Decision making; Formal Verification; Markov Processes; Markov processes; Stochastic Systems; formal verification; stochastic systems;

机译：生物系统建模;计算建模;马尔可夫过程;模型检查;最佳控制;概率逻辑;做决定;做决定;正式验证;马尔可夫过程;马尔可夫过程;随机系统;正式验证;随机系统;

相似文献

外文文献
中文文献
专利

1. Control of noisy differential-drive vehicles from time-bounded temporal logic specifications [J] . Igor Cizelj, Calin Belta The International journal of robotics research . 2014,第8期

机译：从有时间限制的时间逻辑规范中控制嘈杂的差速驱动车辆
2. Efficient computation of time-bounded reachability probabilities in uniform continuous-time Markov decision processes [J] . Christel Baier, Holger Hermanns, Joost-Pieter Katoen, Theoretical computer science . 2005,第1期

机译：统一连续时间马尔可夫决策过程中有界可及性概率的高效计算
3. Finite optimal control for time-bounded reachability in CTMDPs and continuous-time Markov games [J] . Markus N. Rabe, Sven Schewe Acta Informatica . 2011,第5a6期

机译：CTMDP和连续时间Markov游戏中有限可达性的有限最优控制
4. Policy Learning for Time-Bounded Reachability in Continuous-Time Markov Decision Processes via Doubly-Stochastic Gradient Ascent [C] . Ezio Bartocci, Luca Bortolussi, Tomas Brazdil, International conference on quantitative evaluation of systems . 2016

机译：基于双随机梯度上升的连续时间马尔可夫决策过程中时间可及性的策略学习
5. Scalable Control Synthesis for Multi-Robot Systems Under Temporal Logic Specifications [D] . Luo, Xusheng. 2020

机译：时间逻辑规范下的多机器人系统可扩展控制合成
6. Space–time-bounded quantum fields for detection processes [O] . Fernando J. Aguayo, George Jaroszkiewicz -1

机译：时空界的量子场用于检测过程
7. Policy learning for time-bounded reachability in continuous-time Markov decision processes via doubly-stochastic gradient ascent [O] . Bartocci Ezio, Bortolussi Luca, Brázdil Tomǎš, 2016

机译：通过双随机梯度上升进行连续时间马尔可夫决策过程中时间可及性的策略学习
8. Learning Based Approach to Control Synthesis of Markov Decision Processes for Linear Temporal Logic Specifications. [R] . Sadigh, D., Kim, E., Coogan, S., 2014

机译：基于学习的线性时序逻辑规范马尔可夫决策过程综合控制方法。

Formal Synthesis of Control Policies for Continuous Time Markov Processes From Time-Bounded Temporal Logic Specifications

摘要

著录项

相似文献

相关主题

期刊订阅