feat(iceberg): replay-safe immutable history ingestion

feat(iceberg): replay-safe immutable history ingestionphlohouse/phlo #1077 · 5 diagrams

◈ Rendered by PR Lens · crafted with ❤️ by the Coldtea team

100%

01 / 06History strategy added for immutable versionsPipelines can now insert new version rows, skip identical replays, and block conflicting payloads. sends to , defined in +86 −0.
02 / 06Decorator now validates history policy keysThe ingestion decorator requires entity and version keys, and rejects metadata or mixed deduplication settings. checks policy options and raises errors in +24 −7.
03 / 06Iceberg provider now compares version payloadsThe writer scans snapshot head versions in groups of 1000 and compares payloads with null and NaN safety. runs and checks payloads in +292 −0.
04 / 06History writes now retry commit conflictsWhen another writer commits first, the writer reloads the table snapshot and repeats lookup and comparison. reloads metadata and retries commits in +292 −0.
05 / 06Ambiguous commit now triggers reconciliationLost responses trigger table readback, record observed presence in evidence, and fail with unknown outcome. runs and sends in +53 −0.
06 / 06Everything this change touchedThe dlt ingestion decorator, executor, and Iceberg optimistic history store in one picture.

esc to leave