It looks like your topic is missing some important information. Could you provide the following if applicable.
- n8n version:
- Database (default: SQLite):
- n8n EXECUTIONS_PROCESS setting (default: own, main):
- Running n8n via (Docker, npm, n8n cloud, desktop app):
- Operating system:
Hi @boscocho,
Happy to help you out, but we’ll need more information.
Here’s what you’ll need to help us help you:
please fill in your config details:
- n8n version:
- Database (default: SQLite):
- n8n EXECUTIONS_PROCESS setting (default: own, main):
- Running n8n via (Docker, npm, n8n cloud, desktop app):
- Operating system:
Please share your workflow JSON so we can see how the node parameters are being set. You can do that by following this Export and import workflows | n8n Docs and then pasting it between the </> option here.
Which of the two workflows is the error in and what node? Please share the error message you see and the output of the last working node.
And also, what is the result you are expecting?
There is only one problem, and that lies in the S3 node. I believe I need two? One for gathering many files, and the 2nd for downloading into pinecone? Essentially, if someone can share a template so that I can ingest multiple files into pinecone for rag, not just one. This can either be from Onedrive or S3, preferably.
Need config setup for S3 nodes
=>multi document rag
Hey @boscocho,
Looking at your workflow you have the right idea, So first you would need to list all of the files in your s3 bucket then use another S3 node to download them. Once you have done that the process you already have will work.
With the workflow you have shared a screenshot of did it fail at all as it looks like it should work although you may need to use a sub workflow if they are larger documents to help with the memory consumption.
1 Like
just needed the pinecone to loop itself. was doing loads of files. thanks
This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.