In this lecture we will continue our discuss of unsupervised learning methods. We will study sparse coding and the manifold interpretation of autoencoders.
Please study the following material in preparation for the class:
- Lecture 8 (8.1 to 8.9) of Hugo Larochelle’s course on Neural Networks.
- Chapter 13 of the Deep Learning Textbook.
Other relevant material:
- “Sparse coding with an overcomplete basis set: A strategy employed by V1?” Bruno A. Olshausen , David J. Field