I am fetching an api that is paginated the count is 12291 of total results. I need to paginate and then offset to move by 100 on loop. It keeps repeating same result over and over on the offset or I get n/a for 2nd loop for offset. Does anyone have a solution? Could you please help? I tried everything.
Post your workflow so everyone can see how you have it configured. Pagination is implemented on different web sites different ways, so this can’t be answered in general terms.
1 Like
cant share - but json code here. Any help and guidance would be much appreciated. This is a real struggle.
The HTTP Request node has an option to support pagination so you probably don’t need to do this in a loop.
This might not be exactly right yet, but it should be close to what you need based on variables, etc. that were in your workflow.
And this unfortunately only fetched data once - and not 100 elements i.e. full page. The api definitely responds at 100 as default. I tried a lot of different tries. I was hoping to set it as offset parameter and per loop * 100, but it is not really reading it. If you could have a look.
I don’t have an API key for glidework to see an actual response. If you can capture a raw response for the /v1/jobs endpoint, using postman or curl, and post the JSON part here (preferably in a markdown codeblock) it might be possible to figure out why it isn’t working.
In the meantime, another guess is that the currentPage value could be starting at zero, so the expression for offset might need to be {{ ($response.body.currentPage + 1) * 100 }}
There is also this working example you could compare.