I have a workflow that takes an http request node that connects apify (run actor synchronously and return data items) to a loop over items node, which is supposed to take those data items, check for duplicates in a read: sheet node and merge them in an append: google sheet node to ensure there are no duplicate “ownerusername”. the only issue i encounter is when i execute my workflow, the loop over items node only runs once for the specific batch quantity I tell it. (in this case its 25 data items), completely ignoring the other 2700 results i got from my http request. I understand loop over items is supposed to help with api usage, and i dont want to try to append 2700 records at once to google sheets, so I thought this was my best bet. any helpful ideas on how to fix this? or maybe another work around? should i remove the loop over items node entirely? I tested this with a limit node before executing a large http request but obviously, this only returns a few items for testing reasons. heres my workflow:
(note that I could not copy and paste the code to this community post so if you need more info please respond in the comments)