LinkedIn·Tuesday, 25 August 2026·1d ago
If you run incremental pipelines, you've hit this: one table syncs wrong, and you want to reload just that table - not the whole…
Peliqan
3,324 followers
If you run incremental pipelines, you've hit this: one table syncs wrong, and you want to reload just that table - not the whole connection.
Here's why re-running the pipeline doesn't fix it.
An incremental pipeline keeps a bookmark - a marker of where it stopped last time. Every run picks up from there and only pulls new and changed records. So running it again doesn't reload your table. It carries on from where it left off.
To force a full reload of that one table, you have two options:
→ Reset its bookmark, so the next run reloads the table in full
→ Or truncate the table before re-syncing, so it reloads clean
And if the source has added columns, run discovery first so the pipeline picks them up.
Then check it worked: bookmarks and row counts per table, plus the last five syncs, so you can confirm the run did what you expected.
The tutorial shows how to do all of this for a single table in Peliqan, using the Data Pipeline Manager plugin.
#DataEngineering #DataPipelines #ELT
♥ 10💬 1
View on LinkedIn Cross-referenced
Related on the wire
"Build an overview dashboard with my Shopify, HubSpot and Stripe data." That prompt fails when the AI client is wired to APIs. Not because…
Most MCP servers connect one app. Peliqan connects 300+. That difference shows up the second someone asks a real business question: -…
Vibe code with your business data. Ever asked AI to build a report, then spent longer explaining your schema than it would've taken to…
Cin7 Omni doesn't ship a native Power BI connector, so getting your inventory and sales data into a dashboard usually means manual exports…
Your AI assistant can now talk directly to PowerOffice. No more manual exports. No more wrestling with API setup. With Peliqan's no-code…
Vibe code with your business data. Describe what you want, and let AI build it for you. In our latest demo, see how you can build data apps…