Skip to main content
The builder is where production pipeline decisions happen.

​
Key routes

  • List: /workspace/data-pipelines
  • Create shell: /workspace/data-pipelines/new
  • Builder: /workspace/data-pipelines/[id]/builder
  • Detail: /workspace/data-pipelines/[id]

​
Create the shell

Create the pipeline with a name and source connection. Then open the builder.

​
Configure Source

Use the Source node to:
  • test connection
  • discover schema
  • refresh tables
  • include streams
  • preview rows

​
Configure Destination

Use the Destination node to:
  • select the destination connection
  • choose Full Table or Incremental sync
  • keep the live write mode as Upsert
  • add rename/cast Normalisation rules
  • write SQL models
  • validate and preview output
  • save the destination
  • run manually

​
Run history

After a run, use run history to check status, row counts, duration, destination targets, warnings, and errors. Investigate immediately when row counts drop unexpectedly, a run fails after credential changes, or repeated warnings appear for the same destination.