Want to create an interactive transcript for this episode?
Podcast: Test & Code
Episode: 95: Data Science Pipeline Testing with Great Expectations - Abe Gong
Description: Data science and machine learning are affecting more of our lives every day. Decisions based on data science and machine learning are heavily dependent on the quality of the data, and the quality of the data pipeline.Some of the software in the pipeline can be tested to some extent with traditional testing tools, like pytest.But what about the data? The data entering the pipeline, and at various stages along the pipeline, should be validated.That's where pipeline tests come in.Pipeline tests are applied to data. Pipeline tests help...