Spark Structured Streaming
1 item tagged with Spark Structured Streaming
-
Recover a Lakeflow SDP Pipeline From a Recreated Source Table
5 min readWhen an upstream Delta table is dropped and recreated, your Lakeflow SDP pipeline breaks with DIFFERENT_DELTA_TABLE_READ_BY_STREAMING_SOURCE. Here's how to reset checkpoint selection and recover without a full refresh.