Sheetgo offers a data processor to ensure you always transfer unique values.
Note: Remove duplicates only affects what is transferred to the destination. Your source data is never modified or deleted.
Setting up duplicate removal
All you need to do is set up a regular automation with a Duplicate removal data processor.
Let's go over the steps:
Create a new automation.
Select the source of your data.
Choose the Remove duplicates data processor.
Select the Reference column to look for repeated values. If duplicates are found, only one row with repeated values in that column will be kept. Priority order determines whether the processor keeps the first or last occurrence.
First occurrence — keeps the earliest row with that value. Best for form submissions where the first entry is the intended one.
Last occurrence — keeps the most recent row. Best when later updates should overwrite earlier records.
Select a destination where you want to receive the data.
Tips
Choose a column with unique identifiers as the reference — IDs, email addresses, or product codes work well. Avoid columns where repeated values are expected for valid reasons (e.g. a "Status" or "Category" column).
Deduplicate on multiple fields — the processor uses one column as the key. If you need to match on a combination of fields (e.g. first name + last name), concatenate them into a single helper column in your source spreadsheet first, then use that column as the reference.
Combine with Merge for multi-source deduplication — use a Merge processor first to consolidate files from multiple sources, then add a Remove duplicates processor in a second automation to clean the merged output.