Want to create an interactive transcript for this episode?
Podcast: Software Engineering Daily
Episode: Data Warehouse ETL with Matthew Scullion
Description: A data warehouse provides low latency access to large volumes of data. A data warehouse is a crucial piece of infrastructure for a large company, because it can be used to answer complex questions involving a large number of data points. But a data warehouse usually cannot hold all of a company’s data at any given time. Users need to move a subset of the data into the data warehouse by reading large files from a data lake on disk and putting that data into the data warehouse.The process of moving data from one...