PY-PITS: A Scalable Python Runtime System for the Computation of Partially Idempotent Tasks

机译：PY-PITS：可扩展的Python运行时系统，用于计算部分幂等任务

获取原文

页面导航

摘要
著录项
相似文献
相关主题

摘要

The popularization of multi-core architectures and cloud services has allowed users access to high performance computing infrastructures. However, programming for these systems might be cumbersome due to challenges involving system failures, load balancing, and task scheduling. Aiming at solving these problems, we previously introduced SPITS, a programming model and reference architecture for executing bag-of-task applications. In this work, we discuss how this programming model allowed us to design and implement PY-PITS, a simple and effective open source runtime system that is scalable, tolerates faults and allows dynamic provisioning of resources during computation of tasks. We also discuss how PY-PITS can be used to improve utilization of multi-user computational clusters equipped with queues to submit jobs and propose a performance model to aid users to understand when the performance of PY-PITS scales with the number of Workers.

机译：多核架构和云服务的普及使用户可以访问高性能计算基础架构。但是，由于涉及系统故障，负载平衡和任务调度的挑战，这些系统的编程可能很麻烦。为了解决这些问题，我们先前介绍了SPITS，这是一种用于执行任务袋应用程序的编程模型和参考体系结构。在这项工作中，我们将讨论该编程模型如何使我们能够设计和实现PY-PITS，PY-PITS是一种简单有效的开源运行时系统，具有可伸缩性，容错性并允许在任务计算过程中动态配置资源。我们还将讨论如何使用PY-PITS来提高配备队列以提交作业的多用户计算集群的利用率，并提出一个性能模型以帮助用户了解PY-PITS的性能何时随工作人员的数量而扩展。

著录项

来源
《International Symposium on Computer Architecture and High Performance Computing Workshop》|2016年|7-12|共6页
会议地点
作者
Edson Borin; Caian Benedicto; Ian L. Rodrigues; Flávia Pisani; Martin Tygel; Mauricio Breternitz;
展开▼
作者单位

展开▼
会议组织
原文格式 PDF
正文语种
中图分类
关键词
Runtime; Programming; Computational modeling; Fault tolerance; Fault tolerant systems; Load management; Computer architecture;

机译：运行时;编程;计算建模;容错;容错系统;负载管理;计算机体系结构;

相似文献

外文文献
中文文献
专利

1. Scaling Up Parallel Computation of Tiled QR Factorizations by a Distributed Scheduling Runtime System and Analytical Modeling [J] . Weijian Zheng, Fengguang Song, Lan Lin, Parallel Processing Letters . 2018,第1期

机译：通过分布式调度运行时系统和分析建模来扩展平台QR因子化的并行计算
2. The MegaM@Rt2 ECSEL project: MegaModelling at Runtime - Scalable model-based framework for continuous development and runtime validation of complex systems [J] . Afzal Wasif, Bruneliere Hugo, Di Ruscio Davide, Microprocessors and microsystems . 2018,第SEPa期

机译：MegaM @ Rt2 ECSEL项目：运行时的MegaModelling-可扩展的基于模型的框架，用于复杂系统的连续开发和运行时验证
3. The MegaM@Rt2 ECSEL project: MegaModelling at Runtime - Scalable model-based framework for continuous development and runtime validation of complex systems [J] . Afzal Wasif, Bruneliere Hugo, Di Ruscio Davide, Microprocessors and microsystems . 2018,第Sepa期

机译：MegaM @ Rt2 ECSEL项目：运行时的MegaModelling-可扩展的基于模型的框架，用于复杂系统的连续开发和运行时验证
4. PY-PITS: A Scalable Python Runtime System for the Computation of Partially Idempotent Tasks [C] . Edson Borin, Caian Benedicto, Ian L. Rodrigues, International Symposium on Computer Architecture and High Performance Computing Workshops . 2016

机译：py-pits：可扩展的Python运行时系统，用于计算部分IDEMPOTENT任务
5. Presto: A parallel runtime environment for scalable task-oriented computations. [D] . Ozog, David M. 2013

机译：Presto：用于可扩展的面向任务的计算的并行运行时环境。
6. rstoolbox - a Python library for large-scale analysis of computational protein design data and structural bioinformatics [O] . Jaume Bonet, Zander Harteveld, Fabian Sesterhenn, 2019

机译：rstoolbox-一个用于大规模分析计算蛋白设计数据和结构生物信息学的Python库
7. Asynchronous Execution of Python Code on Task-Based Runtime Systems [O] . R. Tohid, Bibek Wagle, Shahrzad Shirzad, 2018

机译：基于任务运行时系统的Python代码的异步执行

PY-PITS: A Scalable Python Runtime System for the Computation of Partially Idempotent Tasks

摘要

著录项

相似文献

相关主题

期刊订阅