Want to create an interactive transcript for this episode?
Podcast: Software Engineering Daily
Episode: Unstructured Data and LLMs with Crag Wolfe and Matt Robinson
Description: The majority of enterprise data exists in heterogenous formats such as HTML, PDF, PNG, and PowerPoint. However, large language models do best when trained with clean, curated data. This presents a major data cleaning challenge.Unstructured is focused on extracting and transforming complex data to prepare it for vector databases and LLM frameworks.Crag Wolfe is Head of Engineering and Matt Robinson is Head of Product at Unstructured. They join the podcast to talk about data cleaning in the LLM age.Sean's been an academic, startup founder, and Googler. He has published works...