Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.mantrixflow.com/llms.txt

Use this file to discover all available pages before exploring further.

Sync mode controls how MantrixFlow reads from the source on each run. It is configured in the Destination node → Config tab → Sync mode dropdown in the canvas builder.

Quick comparison

ModeStatusBest forMain tradeoff
Full syncAvailableAny table — recommended for first runs and correctness validationRe-reads everything each run
Incremental syncBetaGrowing tables with a reliable update field like updated_atDepends on correct cursor behavior; not fully production-tested

Full sync

Use full sync when the dataset is modest or the source does not expose a good cursor. Recommended for all first runs, correctness checks, and smaller reference tables. This is the safest mode and the one to start with.
Note: Full Table sync does not support automatic scheduling. The Scheduling tab in the Destination panel is disabled when this mode is active. See Schedule and automation for details.

Incremental sync

Incremental sync is in beta and has not been fully tested across all source types. Use full sync for production workloads until this notice is removed.
Use incremental sync when records have a trustworthy field such as updated_at, modified_at, or a monotonic ID. See Incremental sync for configuration steps and limitations.

How to choose

  • Start with full sync for all new pipelines. Validate that data looks correct end-to-end.
  • Consider incremental sync only once full sync is confirmed working and table volume makes full re-reads expensive.

Where sync mode lives in the UI

In the canvas builder, click ⚙️ on the Destination node, open the Config tab, and choose from the Sync mode dropdown:
  • FULL_TABLE — re-reads all rows on every run (recommended default)
  • INCREMENTAL — reads only rows newer than the cursor column value stored in sync state (beta)
The Replication key field below the dropdown is where you set the cursor column for incremental mode (e.g. updated_at).

Companion destination decision

Sync mode and write mode are separate concerns. The only available write mode today is Upsert. Append and Replace are coming soon.