An Efficient Parallel Algorithm for Vector Quantizer Design

Vector quantization is a technique used extensively and successfully to compress digitized data such as speech and images. The design of a vector quantizer is very computationally intensive. Parallel algorithms based on various architectures have been proposed for related applications in clustering. These algorithms are in general not practical for the vector quantization problem because of the magnitude of the parameters involved. We present a parallel SIMD algorithm which can run efficiently on parallel machines of variable sizes. The speedup and efficiency of the algorithms are high across a wide range of input parameters.

[1]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[2]  J. Makhoul,et al.  Vector quantization in speech coding , 1985, Proceedings of the IEEE.

[3]  Sartaj Sahni,et al.  Clustering on a Hypercube Multicomputer , 1991, IEEE Trans. Parallel Distributed Syst..

[4]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[5]  Shokri Z. Selim,et al.  K-Means-Type Algorithms: A Generalized Convergence Theorem and Characterization of Local Optimality , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Robert M. Gray,et al.  Global convergence and empirical consistency of the generalized Lloyd algorithm , 1986, IEEE Trans. Inf. Theory.

[7]  Gerhard J. Woeginger,et al.  Geometric Clusterings , 1991, J. Algorithms.

[8]  Anil K. Jain,et al.  A VLSI Systolic Architecture for Pattern Clustering , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Robert F. Ling,et al.  Cluster analysis algorithms for data reduction and classification of objects , 1981 .

[10]  E. Forgy.  Cluster analysis of multivariate data : efficiency versus interpretability of classifications , 1965 .

[11]  John A. Hartigan,et al.  Clustering Algorithms , 1975 .

[12]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[13]  Kai Hwang,et al.  Parallel Pattern ClusterIng on a Multiprocessor with Orthogonally Shared Memory , 1987, ICPP.

[14]  Michael R. Anderberg,et al.  Cluster Analysis for Applications , 1973 .

[15]  Jianhua Lin.  Vector quantization for image compression: algorithms and performance , 1992 .

[16]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..