DCFNet: Deep Neural Network with Decomposed Convolutional Filters
Repository Usage Stats
©35th International Conference on Machine Learning, ICML 2018.All Rights Reserved. Filters in a Convolutional Neural Network (CNN) contain model parameters learned from enormous amounts of data. In this paper, we suggest to decompose convolutional filters in CNN as a truncated expansion with pre-fixed bases, namely the Decomposed Convolutional Filters network (DCFNet), where the expansion coefficients remain learned from data. Such a structure not only reduces the number of trainable parameters and computation, but also imposes filter regularity by bases truncation. Through extensive experiments, we consistently observe that DCFNet maintains accuracy for image classification tasks with a significant reduction of model parameters, particularly with Fourier-Bessel (FB) bases, and even with random bases. Theoretically, we analyze the representation stability of DCFNet with respect to input variations, and prove representation stability under generic assumptions on the expansion coefficients. The analysis is consistent with the empirical observations.
More InfoShow full item record
Charles S. Sydnor Distinguished Professor of Computer Science
Robert Calderbank is Director of the Information Initiative at Duke University, where he is Professor of Electrical Engineering, Computer Science and Mathematics. He joined Duke in 2010, completed a 3 year term as Dean of Natural Sciences in August 2013, and also served as Interim Director of the Duke Initiative in Innovation and Entrepreneurship in 2012. Before joining Duke he was Professor of Electrical Engineering and Mathematics at Princeton University where he also directed the Program i
James B. Duke Distinguished Professor of Electrical and Computer Engineering
Guillermo Sapiro received his B.Sc. (summa cum laude), M.Sc., and Ph.D. from the Department of Electrical Engineering at the Technion, Israel Institute of Technology, in 1989, 1991, and 1993 respectively. After post-doctoral research at MIT, Dr. Sapiro became Member of Technical Staff at the research facilities of HP Labs in Palo Alto, California. He was with the Department of Electrical and Computer Engineering at the University of Minnesota, where he held the position of Distinguished McKni
Alphabetical list of authors with Scholars@Duke profiles.