Loop through HTTP Request and pass to Airtable

How do I loop through individual job and pass to Airtable as individual row? Say in the Airtable, I only need 3 columns: title, description and skills.

hello @TH1

You can use the Split node to move results into different items

2 Likes

does not seem to achieve what I want:

why have you placed the Loop node? That wouldn’t work. You don’t need it.

Moreover, your Split node is configured incorrectly. Use the configuration from my example

I have 20 items in Airtable, but when I go and read from Airtable, there is only 1 row:

did you use the airtable configuration from my example?

I can’t see how the airtable is configured.

did you use the airtable configuration from my example? Yes, in fact, there is no change from mine.

So what isn’t working then?

You have only one row in Airtable. As you are using an Update operation, only one row could be updated.

If you plan to Upsert a row, you will need to use the Create or Update operation

1 Like

oh, that is useful information: If you plan to Upsert a row, you will need to use the Create or Update operation. Now, I manage to see 20 records in my Airtable now.

1 Like

for HTTP Request, there is a limit of 20? How can I overcome this? can I do a loop to extract everything?

You can use pagination, like here

But it has more than 4k of pages, so your instance/browser may hang from such a big data. If that happens, you can use a sub-workflow to pass there a page number and do all underlying logic

That’s how you can use sub-workflows.

Main workflow:

Sub-workflow

let me try it out to understand better. thanks.

Subflow works exactly, which updates Airtable with 20 records, but Mainflow does not work:

The `Execute Workflow` in the Mainflow, I use the ID for the SubFlow.

can you explains the functions of Edit Fields in the Sub-Flow?

Do I need to use pagination you described above?

I managed to extract it out with just the sub-flow: but why is HTTP Request returns 204 items while the Split Out has 4060 items?

Because that the whole point of splitting something out - you get more things after splitting something out.

so in fact, there is no need for Main flow and sub-flow suggested by barn4k?