dc.creatorQuiroga, Facundo Manuel
dc.date2021
dc.date2021-12-22T14:03:58Z
dc.date.accessioned2023-07-15T04:36:40Z
dc.date.available2023-07-15T04:36:40Z
dc.identifierhttp://sedici.unlp.edu.ar/handle/10915/129899
dc.identifierissn:0717-5000
dc.identifier.urihttps://repositorioslatinoamericanos.uchile.cl/handle/2250/7470215
dc.descriptionNeural networks are currently the state-of-the-art for many tasks.. Invariance and sameequivariance are two fundamental properties to characterize how a model reacts to transformation: equivariance is the generalization of both. Equivariance to transformations of the inputs can be necessary properties of the network for certain tasks. Data augmentation and specially designed layers provide a way for these properties to be learned by networks. However, the mechanisms by which networks encode them is not well understood. We propose several transformational measures to quantify the invariance and sameequivariance of individual activations of a network. Analysis of these results can yield insights into the encoding and distribution of invariance in all layers of a network. The measures are simple to understand and efficient to run, and have been implemented in an open-source library. We perform experiments to validate the measures and understand their properties, showing their stability and effectiveness. Afterwards, we use the measures to characterize common network architectures in terms of these properties, using affine transformations. Our results show, for example, that the distribution of invariance across the layers of a network has well a defined structure that is dependent only on the network design and not on the training process.
dc.descriptionInstituto de Investigación en Informática
dc.formatapplication/pdf
dc.languageen
dc.rightshttp://creativecommons.org/licenses/by/4.0/
dc.rightsCreative Commons Attribution 4.0 International (CC BY 4.0)
dc.subjectInformática
dc.subjectNeural networks
dc.subjectEquivariance
dc.subjectInvariance
dc.subjectSame-Equivariance
dc.subjectTransformations
dc.subjectConvolutional Neural Networks
dc.subjectCNN
dc.subjectMeasures
dc.titleInvariance and Same-Equivariance Measures for Convolutional Neural Networks
dc.typeArticulo
dc.typeArticulo


Este ítem pertenece a la siguiente institución