ART-based Modular Networks for Incremental Learning of Hierarchical Clusterings


Authors: Guszti Bartfai, Roger White
Source: GZipped PostScript (107kb); Adobe PDF (393kb)

This paper introduces HART-S, a new modular neural network that can incrementally learn stable hierarchical clusterings of arbitrary sequences of input patterns by self-organisation. The network is a cascade of Adaptive Resonance Theory (ART) modules, in which each module learns to cluster the {\em differences} between the input pattern and the selected category prototype at the previous module. Input patterns are first classified into a few broad categories, and successive ART modules find increasingly specific categories until a threshold is reached, the level of which can be controlled by a global parameter called ``resolution''. The network thus essentially implements a divisive (or splitting) hierarchical clustering algorithm: hence the name HART-S (for ``Hierarchical ART with Splitting''). HART-S is also compared and contrasted to HART-J (for ``Hierarchical ART with Joining''), another variant that was proposed earlier by the first author. The network dynamics are specified and some useful properties of both networks are given and then proven. Experiments were carried out on benchmark datasets to demonstrate the representational and learning capabilities of both networks and to compare the developed clusterings with those of two classical methods and a conceptual clustering algorithm. A brief survey of related neural network models is also provided.

[Up to Computer Science Technical Report Archive: Home Page]