Remove Duplicates Node Error From Arrays of Different Lengths

Hi,

I’m not sure if this should be a feature request or a bug, but I wanted to ask about the “Remove Duplicates” node.

It gives an error if the input items have different length arrays in a property. In this example, some of the items “permission” property is [‘read’], and others are [‘edit’,‘delete’,‘modify’]. When executed, it errors “NodeOperationError: ‘Permissions.1’ field is missing from some input items”.

It would be ideal if input item properties that are arrays of different length could be considered not equal (and therefore the input items not duplicate and not needing removal).

Thanks!

Share the output returned by the last node

Information on your n8n setup

  • n8n version: 1.27.2
  • Database (default: SQLite): n/a
  • n8n EXECUTIONS_PROCESS setting (default: own, main): n/a
  • Running n8n via (Docker, npm, n8n cloud, desktop app): AWS EKS
  • Operating system: AWS Linux 2

@jzrts , as a workaround (if you are looking for one), you can convert the arrays to strings, remove duplicates, and then convert what is left back to array.

2 Likes