• 主题
高级搜索  >
历史搜索 清空历史
首页> 外文期刊>Future generation computer systems >Keeping track of user steering actions in dynamic workflows
【24h】

Keeping track of user steering actions in dynamic workflows

机译：在动态工作流程中跟踪用户指导操作

获取原文
获取原文并翻译 | 示例
           
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

In long-lasting scientific workflow executions in HPC machines, computational scientists (the users in this work) often need to fine-tune several workflow parameters. These tunings are done through user steering actions that may significantly improve performance (e.g, reduce execution time) or improve the overall results. However, in executions that last for weeks, users can lose track of what has been adapted if the tunings are not properly registered. In this work, we build on provenance data management to address the problem of tracking online parameter fine-tuning in dynamic workflows steered by users. We propose a lightweight solution to capture and manage provenance of the steering actions online with negligible overhead. The resulting provenance database relates tuning data with data for domain, dataflow provenance, execution, and performance, and is available for analysis at runtime. We show how users may get a detailed view of the execution, providing insights to determine when and how to tune. We discuss the applicability of our solution in different domains and validate its ability to allow for online capture and analyses of parameter fine-tunings in a real workflow in the Oil and Gas industry. In this experiment, the user could determine which tuned parameters influenced simulation accuracy and performance. The observed overhead for keeping track of user steering actions at runtime is less than 1% of total execution time. (C) 2019 Elsevier B.V. All rights reserved.
机译：在HPC机器中执行持久的科学工作流时，计算科学家（本工作的用户）通常需要微调几个工作流参数。这些调整是通过用户指导操作完成的，这些操作可以显着提高性能（例如，减少执行时间）或改善总体结果。但是，在持续数周的执行过程中，如果未正确注册调音，则用户可能无法跟踪已改编的内容。在这项工作中，我们基于出处数据管理来解决在用户指导的动态工作流程中跟踪在线参数微调的问题。我们提出了一种轻量级的解决方案，以很少的开销捕获和管理在线转向操作的出处。生成的来源数据库将调整数据与域，数据流来源，执行和性能的数据相关联，并且可在运行时进行分析。我们展示了用户如何获得执行的详细视图，并提供洞察力以确定何时以及如何进行调整。我们讨论了我们的解决方案在不同领域中的适用性，并验证了其在石油和天然气行业的实际工作流程中允许在线捕获和分析参数微调的能力。在该实验中，用户可以确定哪些调整参数影响了仿真的准确性和性能。在运行时跟踪用户引导动作的观察到的开销小于总执行时间的1％。 （C）2019 Elsevier B.V.保留所有权利。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号