Want to create an interactive transcript for this episode?
Podcast: Machine Learning Street Talk (MLST)
Episode: #101 DR. WALID SABA - Extrapolation, Compositionality and Learnability
Description: MLST Discord! https://discord.gg/aNPkGUQtc5
Patreon: https://www.patreon.com/mlst
YT: https://youtu.be/snUf_LIfQII
We had a discussion with Dr. Walid Saba about whether or not MLP neural networks can extrapolate outside of the training support, and what it means to extrapolate in a vector space. Then we discussed the concept of vagueness in cognitive science, for example, what does it mean to be "rich" or what is a "pile of sand"? Finally we discussed behaviourism and the reward is enough hypothesis.
References:
A Spline...