How to filter duplicates before adding to airtable

Im trying to setup a workflow on n8n like this http request (get Instagram users) > split out > create record. This works fine however I want to filter out duplicate usernames before adding to airtable does anyone know to achieve this?

It looks like your topic is missing some important information. Could you provide the following if applicable.

  • n8n version:
  • Database (default: SQLite):
  • n8n EXECUTIONS_PROCESS setting (default: own, main):
  • Running n8n via (Docker, npm, n8n cloud, desktop app):
  • Operating system:

Welcome to the community @SprayArks :tada: It’s hard to provide direct answer without knowing your exact data structure but you could try using the Merge node to compare two branches mentioned in this similar post here: Searching databases for duplicates before adding records - #2

If you want more specific tips, it would be great if you could share your workflow or provide details of your data structure. You can also share your workflow by pasting the workflow JSON between two ``` - hope that helps!

If you want to remove only duplicated usernames, that may be solved by pushing all usernames into one array and converting it to a set > array

1 Like

One other idea: have you considered using the Airtable node’s Create or update operation rather than its Create one?

This will avoid creating a new row if a matching one already exists.

1 Like

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.