Towards optimizing the selection of neurons in affordable neural networks
Ausoni, J. T., Mitchell, R. and Holderbaum, W.
It is advisable to refer to the publisher's version if you intend to cite from this work. See Guidance on citing. Abstract/SummaryThis paper considers variations of a neuron pool selection method known as Affordable Neural Network (AfNN). A saliency measure, based on the second derivative of the objective function is proposed to assess the ability of a trained AfNN to provide neuronal redundancy. The discrepancies between the various affordability variants are explained by correlating unique sub group selections with relevant saliency variations. Overall this study shows that the method in which neurons are selected from a pool is more relevant to how salient individual neurons are, than how often a particular neuron is used during training. The findings herein are relevant to not only providing an analogy to brain function but, also, in optimizing the way a neural network using the affordability method is trained.
Related URLs Deposit Details References University Staff: Request a correction | Centaur Editors: Update this record |
Lists
Lists
![[img]](/style/images/fileicons/text.png)