Issues with Pagination?

[jjbrunton]

Describe the problem/error/question

I am working on retrieving payment ledger items from Etsy and I’ve got stuck on what feels like the easiest part of the solution - pagination. I am using the HTTP node to try and paginate and it just fails to update the offset parameter, I’ve tried so many combinations:

• Hard coding offset to prove it can be sent
• Not including offset in the main query definition
• Using the response length to try and stop pagination
• Using “Empty” as the decider

Honestly, it just feels as though the pagination option is broken?

What is the error message (if any)?

No error message but I can see 12 time windows being passed into the http block (one for each month) and a resulting set of 12 results from the node but all of them are limited to 100 with the count on the results showing many more than 100 available for each execution.

Please share your workflow

Share the output returned by the last node

[
  {
    "count": 57,
    "results": "[…] // 57 items"
  },
  {
    "count": 405,
    "results": "[…] // 100 items"
  },
  {
    "count": 823,
    "results": "[…] // 100 items"
  },
  {
    "count": 1684,
    "results": "[…] // 100 items"
  },
  {
    "count": 307,
    "results": "[…] // 100 items"
  },
  {
    "count": 487,
    "results": "[…] // 100 items"
  },
  {
    "count": 423,
    "results": "[…] // 100 items"
  },
  {
    "count": 759,
    "results": "[…] // 100 items"
  },
  {
    "count": 565,
    "results": "[…] // 100 items"
  },
  {
    "count": 554,
    "results": "[…] // 100 items"
  }
]

Information on your n8n setup

• **n8n version:**1.106.3
• Database (default: SQLite): SQLite
• n8n EXECUTIONS_PROCESS setting (default: own, main): main
• Running n8n via (Docker, npm, n8n cloud, desktop app): Docker
• Operating system:

[barn4k]

hello @jjbrunton

According to the docs, response object doesn’t contain the results property (in the complete expression of the pagination section).

Try this one:

{{ $response.body.results.length < $json.limit }}