I am scraping TikTok feeds daily. I want to check my Airtable DB with the scraped songs and videos, if the scraped UID exists in my database then I will update it, if UID does NOT exist in my DB I want to create a new record for both the scraped video and the song.
I Have used the Airtable filter formula within the list module, but I could not access the list of videos that did not pass the filter for me to create a new entry for the videos and songs I did not have already.
Lastly, I could not get the automation to repeat for each of the 30-35 videos without the split in batches module, is this correct?
I had this working in make but I just can not put my finger on what I am doing wrong. Thank you!
Just wanted to add to this. You do not have to use an API call to use the upsert is is within the settings of the Airtable node.
I have never quite understood how an upsert works even in make. Am I correct in saying that this will search for me? Say I have 15 videos in the DB already and 15 that are not. This will check the parameter that I assign to be checked, then if that ID does not exist it will create a record in that database.
Is there no way to have both the items that exist and do not, pass through the node to deal with both datasets later on in the workflow?
I have updated to use the “Upsert” and all this does it create a duplicate record. No matter the matching field that I use.
So after many tries I was able to get this to work
Solution.
I used the “Upsert” option and used the UNIX timestamp as a reference to check if the record existed. I am yet to find a way to use the Airtable ID as a reference yet but as of now this works.
I was unable to get it to run smoothly while using the ID. I have since utilized the set node in a few places to cut down on the data sent throughout the workflow and the Unix timestamp seems to be the best way for me to match.
I agree, even in Make.com that was the reason I moved to N8N. The costs ran up so fast performing so many actions that could be done together.
