I wish that I was able to convince the students in my class that the ultimate goal of science isn't accumulation of facts but the compression of facts into theories. Mel summarizes it well here: www.nature.com/articles/nn1... Unfortunately, I think this is a minority viewpoint within neuroscience.

We collected lecture notes and blog posts by group members about recent topics in deep learning theory here. Hope it is useful! pehlevan.seas.harvard.edu/resources-0