Actas de congresos
Py-pits: A Scalable Python Runtime System For The Computation Of Partially Idempotent Tasks
Registro en:
978-1-5090-4844-1
2016 28th Ieee International Symposium On Computer Architecture And High Performance Computing Workshops (sbac-padw). Ieee, p. 7 - 12, 2016.
WOS:000398540400002
10.1109/SBAC-PADW.2016.10
Autor
Borin
Edson; Benedicto
Caian; Rodrigues
Ian L.; Pisani
Flavia; Tygel
Martin; Breternitz
Mauricio
Jr.
Institución
Resumen
Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES) Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP) Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) The popularization of multi-core architectures and cloud services has allowed users access to high performance computing infrastructures. However, programming for these systems might be cumbersome due to challenges involving system failures, load balancing, and task scheduling. Aiming at solving these problems, we previously introduced SPITS, a programming model and reference architecture for executing bag-of-task applications. In this work, we discuss how this programming model allowed us to design and implement PY-PITS, a simple and effective open source runtime system that is scalable, tolerates faults and allows dynamic provisioning of resources during computation of tasks. We also discuss how PY-PITS can be used to improve utilization of multi-user computational clusters equipped with queues to submit jobs and propose a performance model to aid users to understand when the performance of PY-PITS scales with the number of Workers. 7 12 Petrobras CAPES FAPESP CNPq Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES) Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP) Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) 28th IEEE International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD) OCT 26-28, 2016 Los Angeles, CA