The radial basis function neural network trained with a dynamic decay adjustment (known as RBFNDDA) algorithm exhibits a greedy insertion behavior as a result of recruiting many hidden nodes for encoding information during its training process. In this chapter, a new variant RBFNDDA is proposed to rectify such deficiency. Specifically, the hidden nodes of RBFNDDA are re-organized through the supervised Fuzzy ARTMAP (FAM) classifier, and the parameters of these nodes are adapted using the Harmonic Means (HM) algorithm. The performance of the proposed model is evaluated empirically using three benchmark data sets. The results indicate that the proposed model is able to produce a compact network structure and, at the same time, to provide high classification performances.