I have a problem with a very very slow spreasheet node. I
Describe the issue/error/question
After uncompressing zip file to csv I want to retrieve items with Spreadsheet node. The spreadsheet node don’t work. I let it work 1 hour and nothing, still processing. Can’t stop execution, error 514.
CSV file is huge (600k lines, 80mb size) but it works well for a half size file (around 300k).
Ram used : around 4gb and CPU around 25%
Server : 16 GB Memory / 8 AMD vCPUs
What is the error message (if any)?
No error (console/front)
Please share the workflow
Information on your n8n setup
- **n8n version: 0.194.0
- **Database you’re using (default: SQLite): PostgreSQL
- **Running n8n with the execution process [own(default), main]: own
- **Running n8n via [Docker, npm, n8n.cloud, desktop app]: CapRover
N8N_DEFAULT_BINARY_DATA_MODE : filesystem
If you have some tips to improve performance or how to split csv file on N8N.
Thank you very much
Hi @francoisg, welcome to the community!
I am sorry to hear you’re having trouble. I tried running this workflow on my end with a 600K line file but didn’t run into any trouble here.
When executing this workflow, does your memory usage exceed the limit for your container? Where exactly do you see the 514 error (I couldn’t find this in the MDN status code list, so wonder if this might be some custom logic on your webserver kicking in)?
Thank you for your reply.
My bad it’s not a 514 but a 504 error code.
I’ll check the server but I’m not expert on it as it’s a simple Digital Ocean droplet.
EDIT : I checked CPU usage and it seems that one CPU is at 100% when others 7 are empty. How to use all cpus to achieve task?
EDIT2 : All cpus are used when file is download from SFTP and when I unzip it but the node spreadsheet only use one core
EDIT3: The chart of the N8N container, it seems multi-cpu is not used by spreadhsheet node