Datacast Episode 34: Deep Learning Generalization, Representation, and Abstraction with Ari Morcos

The 34th episode of Datacast is my conversation with Ari Morcos — a research scientist at Facebook AI. Give it a listen to hear about his academic background in neuroscience at UCSD and Harvard, his wide-ranging research in the generalization, representation, and abstraction of neural networks at DeepMind and Facebook, his excitement for self-supervised learning, the importance of publishing negative results for AI researchers, and much more.

Ari Morcos is a Research Scientist at Facebook AI Research working on understanding the mechanisms underlying neural network computation and function and using these insights to build machine learning systems more intelligently.

Ari Morcos is a Research Scientist at Facebook AI Research working on understanding the mechanisms underlying neural network computation and function and using these insights to build machine learning systems more intelligently. In particular, Ari has worked on a variety of topics, including understanding the lottery ticket hypothesis, the mechanisms underlying common regularizers, and the properties predictive of generalization, as well as methods to compare representations across networks, the role of single units in computation, and on strategies to measure abstraction in neural network representations. Previously, he worked at DeepMind in London, and earned his Ph.D. in Neurobiology at Harvard University, using machine learning to study the cortical dynamics underlying evidence accumulation for decision-making.

Facebook AI Research (https://research.fb.com/)

Facebook AI Research (https://research.fb.com/)

Show Notes

His Contact Information

His Recommended Resources