Incremental import and how to prevent Orders duplicating

Created by Nicolas Wussler, Modified on Tue, 18 Apr, 2023 at 9:25 AM by Ivana B

The purpose of this article is to show you an easy way to only migrate Orders that were not already transferred via SyncSpider.

 

We will be using a simple task as an example with Shopify as a Source Integration and Google Sheets as a Target integration.

 

Step 1:


Tick the box next to "Incremental Import", while configuring the Source Integration, as shown in the picture below:

 



What is incremental import?

Monitoring of the external system, where is mostly an endpoint filtered by date, and date is been updated with every Task Execution inside the SyncSpider. Which will mean that SySp is monitoring the system from that date.


This will make only orders created after the last task run be transferred over.

 


Step 2 (optional): 


You can use our Source Filtering to further specify which orders will get transferred, by various criteria shown in the pictures below:

 

 



That is all there is to it :) 

 

Let's look at what happens with Orders when the "Incremental Import" is ticked:

 



We can see 2 orders being transferred over to our Google Sheet.

 

However, if we run this task again (provided no new orders came in), you will notice that the task ran successfully, but with 0 items processed (0 orders transferred):

 




We hope you found this article helpful :)

 

If you still have any questions or inquiries left unanswered, please email us at [email protected].

Additionally, you can shoot us a message via our website's chat widget or get in touch with us on our Facebook page, and our Customer Support Representatives will be more than happy to assist you.


Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select at least one of the reasons
CAPTCHA verification is required.

Feedback sent

We appreciate your effort and will try to fix the article