Want to create an interactive transcript for this episode?
Podcast: Software Engineering Daily
Episode: Materialize: Streaming SQL on Timely Data with Arjun Narayan and Frank McSherry
Description: Distributed stream processing frameworks are used to rapidly ingest and aggregate large volumes of incoming data. These frameworks often require the application developer to write imperative logic describing how that data should be processed. For example, a high volume of clickstream data that is getting buffered to Kafka needs to have a stream processing system evaluate that data to prepare it for a data warehouse, Spark, or some other queryable environment. In practice, many developers simply want to have the high volume of data become queryable in the fewest number of steps possible.Materialize is a...