Want to create an interactive transcript for this episode?
Podcast: Machine Learning Street Talk (MLST)
Episode: #64 Prof. Gary Marcus 3.0
Description: Patreon: https://www.patreon.com/mlst
Discord: https://discord.gg/HNnAwSduud
YT: https://www.youtube.com/watch?v=ZDY2nhkPZxw
We have a chat with Prof. Gary Marcus about everything which is currently top of mind for him, consciousnessÂ
[00:00:00] Gary intro
[00:01:25] Slightly conscious
[00:24:59] Abstract, compositional models
[00:32:46] Spline theory of NNs
[00:36:17] Self driving cars / algebraic reasoningÂ
[00:39:43] Extrapolation
[00:44:15] Scaling laws
[00:49:50] Maximum likelihood estimation
References:
Grokking: Generalization Beyond Overfitting on Sm...