Cannot get all files from S3 using get many files

Questions
1

Describe the problem/error/question

I have an S3 bucket that has a ‘content’ folder. The folder contains folders, and each one contains files. I need to get all files from all folders inside content. To do that, I have a ‘Get many folders’ node that successfully gets all folders:

image
image2246×1128 276 KB

I have a subsequent node that gets all files from a folder, and the folderKey is set to be the folderKey from previous node. In my mind, the node should run 7 times (the number of folders brought by previous node), get all files from each one and append them in the output. Instead, I am getting the files from the first folder repeated 7 times.

image
image2280×1220 404 KB

What am I doing wrong?

Please share your workflow

image
image1415×366 27.4 KB

(Select the nodes on your canvas and use the keyboard shortcuts CMD+C/CTRL+C and CMD+V/CTRL+V to copy and paste the workflow

Share the output returned by the last node

Information on your n8n setup

  • n8n version: Latest (2.2.5)
  • Database (default: SQLite):
  • n8n EXECUTIONS_PROCESS setting (default: own, main):
  • Running n8n via (Docker, npm, n8n cloud, desktop app): cloud
  • Operating system: mac
2

Hey @pablomorgui !

Try to put a “Loop Over items” node between your getFolder and getFiles node, with a batch of 1 configured.

Cheers!