Adaptive Structural Optimisation of Neural Networks

Abstract

Structural design of an artificial neural network (ANN) is a very important phase in the construction of such a network. The selection of the optimal number of hidden layers and hidden nodes has a significant impact on the performance of a neural network, though typically decided in an adhoc manner. In this paper, the structure of a neural network is adaptively optimised by determine the number of hidden layers and hidden nodes that give the optimal performance in a given problem domain. Two optimisation approaches have been developed based on the Particle Swarm Optimisation (PSO) algorithm, which is an evolutionary algorithm which uses a cooperative approach. These approaches have been applied on two well known case studies in the classification domain, namely the Iris data classification and the Ionosphere data classification.
The obtained results and comparisons done with past research work has clearly shown that this method of optimisation is by far, the best approach for adaptive structural optimisation of ANNs.