Libro
Towards a Malleable Tensorflow Implementation
Registro en:
issn:1865-0929
issn:1865-0937
isbn:978-3-030-61218-4
Autor
Libutti, Leandro Ariel
Igual, Francisco
Piñuel, Luis
De Giusti, Laura Cristina
Naiouf, Marcelo
Rucci, Enzo
Naiouf, Marcelo
Chichizola, Franco
De Giusti, Laura Cristina
Institución
Resumen
The TensorFlow framework was designed since its inception to provide multi-thread capabilities, extended with hardware accelerator support to leverage the potential of modern architectures. The amount of parallelism in current versions of the framework can be selected at multiple levels (intra- and inter-paralellism) under demand. However, this selection is fixed, and cannot vary during the execution of training/inference sessions. This heavily restricts the flexibility and elasticity of the framework, especially in scenarios in which multiple TensorFlow instances co-exist in a parallel architecture. In this work, we propose the necessary modifications within TensorFlow to support dynamic selection of threads, in order to provide transparent malleability to the infrastructure. Experimental results show that this approach is effective in the variation of parallelism, and paves the road towards future co-scheduling techniques for multi-TensorFlow scenarios. Instituto de Investigación en Informática