What Is Stored
Incremental Sync
- Cursor value — The maximum value of the cursor column from the last successful run. The next run reads only rows with a cursor value greater than this.
CDC
- CDC position — The position in the database replication log (e.g. LSN for PostgreSQL, binlog position for MySQL). The next run continues from this position.
How It Is Used
On each run:- The pipeline loads the stored sync state.
- It uses the state to determine what to read (incremental: rows after cursor; CDC: log events after position).
- After a successful run, it updates the state with the new cursor value or CDC position.
When State Is Cleared
- Reset — You can manually reset the sync state. The next run will behave like a full sync (or CDC from the current position).
- Pipeline deletion — Deleting a pipeline removes its sync state.
- Stream reconfiguration — Changing the cursor column or stream may require a reset.