Removing duplicates after pagination

Questions
1

Hi guys. Im trying to remove duplicates from a column Im retrieving from baserow. I cant retrieve all the rows at once because of api rate limits which causes issues because I have to send all the rows at once to the item lists node (not in multiple runs) to remove duplicates across all rows in that column. any solutions for this?

thanks

2

It looks like your topic is missing some important information. Could you provide the following if applicable.

  • n8n version:
  • Database (default: SQLite):
  • n8n EXECUTIONS_PROCESS setting (default: own, main):
  • Running n8n via (Docker, npm, n8n cloud, desktop app):
  • Operating system:
3

solved using this Merge multiple runs into one | n8n workflow template