Phan A.H., Cichocki A., Zdunek R., Dinh T.V.. Lab. for Advanced Brain Signal Processing, Brain Science Institute - RIKEN, Wako-shi, Saitama 351-0198,. Japan ...
Novel alternating least squares algorithm for nonnegative matrix and tensor factorizations Phan A.H., Cichocki A., Zdunek R., Dinh T.V. Lab. for Advanced Brain Signal Processing, Brain Science Institute - RIKEN, Wako-shi, Saitama 351-0198, Japan; Institute of Telecommunications, Teleinformatics and Acoustics, Wroclaw, Poland; HoChiMinh City University of Technology, Viet Nam; Dept. EE, Warsaw University of Technology, Polish Academy of Science, Poland Abstract: Alternative least squares (ALS) algorithm is considered as a "work-horse" algorithm for general tensor factorizations. For nonnegative tensor factorizations (NTF), we usually use a nonlinear projection (rectifier) to remove negative entries during the iteration process. However, this kind of ALS algorithm often fails and cannot converge to the desired solution. In this paper, we proposed a novel algorithm for NTF by recursively solving nonnegative quadratic programming problems. The validity and high performance of the proposed algorithm has been confirmed for difficult benchmarks, and also in an application of object classification. © 2010 Springer-Verlag. Author Keywords: ALS; NMF; nonnegative quadratic programming; nonnegative tensor factorization; object classification; PARAFAC; parallel computing Index Keywords: ALS; NMF; nonnegative quadratic programming; Nonnegative tensor factorizations; Object classification; PARAFAC; Parallel Computing; Algorithms; Benchmarking; Data processing; Optimization; Parallel architectures; Tensors; Factorization Year: 2010 Source title: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) Volume: 6443 LNCS Issue: PART 1 Page : 262-269 Link: Scorpus Link Correspondence Address: Phan, A. H.; Lab. for Advanced Brain Signal Processing, Brain Science Institute RIKEN, Wako-shi, Saitama 351-0198, Japan Sponsors: Asia Pacific Neural Network Assembly (APNNA) Conference name: 17th International Conference on Neural Information Processing, ICONIP 2010 Conference date: 22 November 2010 through 25 November 2010 Conference location: Sydney, NSW Conference code: 82955 ISSN: 3029743 ISBN: 3642175368; 9783642175367 DOI: 10.1007/978-3-642-17537-4_33 Language of Original Document: English
Abbreviated Source Title: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) Document Type: Conference Paper Source: Scopus Authors with affiliations: 1. Phan, A.H., Lab. for Advanced Brain Signal Processing, Brain Science Institute - RIKEN, Wako-shi, Saitama 351-0198, Japan 2. Cichocki, A., Lab. for Advanced Brain Signal Processing, Brain Science Institute - RIKEN, Wako-shi, Saitama 351-0198, Japan, Dept. EE, Warsaw University of Technology, Polish Academy of Science, Poland 3. Zdunek, R., Lab. for Advanced Brain Signal Processing, Brain Science Institute - RIKEN, Wako-shi, Saitama 351-0198, Japan, Institute of Telecommunications, Teleinformatics and Acoustics, Wroclaw, Poland 4. Dinh, T.V., HoChiMinh City University of Technology, Viet Nam
References: 1. Cichocki, A., Zdunek, R., Phan, A.H., Amari, S., (2009) Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-way Data Analysis and Blind Source Separation, , Wiley, Chichester 2. Mørup, M., Hansen, L., Parnas, J., Arnfred, S., (2006) Decomposing the Time-frequency Representation of EEG Using Nonnegative Matrix and Multi-way Factorization, , Technical report 3. Paatero, P., A weighted non-negative least squares algorithm for three-way PARAFAC factor analysis (1997) Chemometrics Intelligent Laboratory Systems, 38 (2), pp. 223-242 4. Cichocki, A., Phan, A.H., Fast local algorithms for large scale nonnegative matrix and tensor factorizations (2009) IEICE, , March invited paper 5. Phan, A.H., Cichocki, A., Multi-way nonnegative tensor factorization using fast hierarchical alternating least squares algorithm (HALS) Proc. of the 2008 International Symposium on Nonlinear Theory and Its Applications, Budapest, Hungary (2008) 6. Gillis, N., Glineur, F., Nonnegative factorization and the maximum edge biclique problem (2008) CORE Discussion Papers 2008064, , UniversitŽ catholique de Louvain, Center for Operations Research and Econometrics, CORE 7. Harshman, R., Foundations of the PARAFAC procedure: Models and conditions for an explanatory multimodal factor analysis (1970) UCLA Working Papers in Phonetics, 16, pp. 1-84 8. Nene, S.A., Nayar, S.K., Murase, H., (1996) Columbia Object Image Library (Coil-20), , Technical Report CUCS-005-96, Columbia University February 9. Canu, S., Grandvalet, Y., Guigue, V., Rakotomamonjy, A., SVM and kernel methods - Matlab toolbox (2005) Perception Systèmes et Information, , INSA de Rouen, Rouen, France
