Guys simple question here. My n8n is set to use file system and I’m trying to upload a 4 hours video to youtube (~35GB). If I use a smaller file it works flawlessly but as soon as I bring in the big guns it gets to read from the disk and stay there forever (literally). Clear to me that the problem …

Large file Youtube Upload

Nskha December 17, 2024, 9:41pm 2

How to handle large data/files in n8n? Questions

Welcome to the community @Martin_Neumann! As n8n keeps always all the data of the workflow in memory will the SplitInBatches Node alone not have a positive impact on memory use. It is really required to split it up into different workflows for it to work. If you work with large binary data, you can also try setting the environment variable N8N_DEFAULT_BINARY_DATA_MODE=filesystem. It will then save the binary data on disk rather than memory and DB and will so require much less RAM.

or

ChatGPT

ChatGPT - Large File Upload Workaround

Shared via ChatGPT

show post in topic

Home
Categories
Guidelines
Terms of Service
Privacy Policy

Powered by Discourse, best viewed with JavaScript enabled