Want to create an interactive transcript for this episode?
Podcast: Stay Human, from the Artificiality Institute
Episode: Steven Sloman: LLMs and Deliberative Reasoning
Description: If youâve used a large language model, youâve likely had one or more moments of amazement as the tool immediately responded with impressive content from its massive data cosmos training set. But youâve likely also had moments of confusion or disillusionment as the tool responded with irrelevant or incorrect responses, displaying a lack of reasoning.
A recent research paper from Meta caught our eye because it proposes a new mechanism called System 2 Attention which âleverages the ability of LLMs to reason in natural language and follow instructions in order to decide what to attend to.â The n...