Paginated get row for data table node

Questions
1

Describe the problem/error/question

Hi,

I don’t get how to get all the rows of a database with regards to pagination. I see a limit parameter, which is usually used with a “skip” parameter to implement pagination, but there is no skip param. A cursor is another way to paginate, used by n8n API, but again I see no cursor value in the get row output.

So how do you consume a database item by item for instance?

The n8n HTTP API mentions pagination but this is for the data table API when consuming data externally.

What is the error message (if any)?

Please share your workflow

Share the output returned by the last node

Information on your n8n setup

  • n8n version: 2
  • Database (default: SQLite): default
  • n8n EXECUTIONS_PROCESS setting (default: own, main):
  • Running n8n via (Docker, npm, n8n cloud, desktop app): Docker self hosted
  • Operating system: Linux
1 Like
2

Hi @eric-burel just use the Data Table node’s Get > Return all option to fetch every row in one go (pagination is handled automatically i guess, so you dont need skip/cursor), then process item‑by‑item with downstream nodes if needed

2 Likes
3

Sounds alright indeed, after digging the code it does paginate to get the results by blocks of 1000 items max (code lives in `packages/nodes-base/nodes/DataTable/common/selectMany.ts` in the n8n code repo), and then will return all the data.

So I don’t need pagination per se when getting the rows. I can plug a “Loop over items” node after a “Get rows” with return all option enabled so that I batch the computations later in the workflow, for instance to respect a rate limit for API calls.

1 Like
4

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.