Entropy-Inspired Competitive Clustering Algorithms
Received:July 12, 2007  Revised:December 08, 2007  Download PDF
Daoqiang Zhang,Songcan Chen,Zhi-Hua Zhou. Entropy-Inspired Competitive Clustering Algorithms. International Journal of Software and Informatics, 2007,1(1):67~84
Hits: 6005
Download times: 2817
Daoqiang Zhang  Songcan Chen  Zhi-Hua Zhou
Fund:This work was supported by the National Science Foundation of China under Grant Nos. 60496320,60505004, 60721002, the Jiangsu Science Foundation under Grant No BK2006521, and the Founda-tion for the Author of National Excellent Doctoral Dissertation of China under Grant No. 200343.
Abstract:In this paper, the well-known competitive clustering algorithm (CA) is revisited and reformulated from a point of view of entropy minimization. That is, the second term of the objective function in CA can be seen as quadratic or second-order entropy. Along this novel explanation, two generalized competitive clustering algorithms inspired by Renyi entropy and Shannon entropy, i.e. RECA and SECA, are respectively proposed in this paper.Simulation results show that CA requires a large number of initial clusters to obtain the right number of clusters, while RECA and SECA require small and moderate number of initial clusters respectively. Also the iteration steps in RECA and SECA are less than that of CA.Further CA and RECA are generalized to CA-p and RECA-p by using the p-order entropy and Renyi's p-order entropy in CA and RECA respectively. Simulation results show that the value of phas a great impact on the performance of CA-p, whereas it has little in uence on that of RECA-p.
keywords:competitive clustering  fuzzy c-means  optimal number of clusters  cluster validity  entropy minimization
View Full Text  View/Add Comment  Download reader

 

 

more>>  
Visitor:3140858
Top Paper  |  E-mail Alert  |  Publication Ethics  |  New Version

© Copyright by Institute of Software, the Chinese Academy of Sciences
京ICP备05046678号-5

京公网安备 11040202500065号