Creating a pipeline

Documentation Index

Fetch the complete documentation index at: https://docs.mantrixflow.com/llms.txt

Use this file to discover all available pages before exploring further.

​

Step by step

1. Create and test source and destination connections from Connections first.
2. Go to Data Pipelines → + New Pipeline. Enter a pipeline name, choose the source connection, and click Create & open canvas.
3. The builder canvas opens. You will see a Source node on the left and a Destination node on the right connected by a sync line.
4. Click ⚙️ on the Source node to open the Source panel:
   • Use Discover schema to list available tables.
   • Tick Include next to each table you want to sync.
   • Click Preview on any table to inspect raw source rows.
5. Click ⚙️ on the Destination node to open the Destination panel. Configure the Config tab:
   • Connection — select the destination connection
   • Final delivery schema — e.g. analytics
   • Sync mode — use FULL_TABLE for all first runs
   • Write mode — select Upsert
   • Click Validate config before saving.
6. Use the Preview tab in the Destination panel to inspect the target table before the first run.
7. Click ▷ on the Destination node (or use the top-bar Run button) to trigger a manual run.
8. Click the history icon in the top bar to inspect run results.
9. Once the manual run succeeds, open the Scheduling tab in the Destination panel to add a schedule.

​

A realistic first pipeline

• source connection: Shopify Production
• selected resource: orders
• transform: normalize currency codes and add loaded_from
• destination: Analytics Postgres
• target table: raw_shopify_orders
• cadence: hourly after one successful manual run