I have a Postgres Insert node that inserts data into a staging table - this works 100%. This node is followed by a Postgres Execute Query node, that executes the following SQL:
INSERT INTO productline SELECT DISTINCT productline_id, title FROM _raw_catalogue;
But, it seems that the second node is execute once for every record inserted in the first node - causing “duplicate keys” exceptions. Is there another way to do this type of workflow?