Split binary file data into individual items

[MutedJam]

I am downloading a CSV file, binary file, 550MB ish, and I would like to split it in x Binary items

Hi @Gabriele_Bracciali, this seems be to be similar to what you were asking for over here:

Convert Binary file To JSON or CSV

So this is a bit tricky, but I think a possible approach would be to store that huge file on the file system, then read it in chunks. This will only work if you’re not using n8n cloud though and you would need to adjust the paths used in this workflow to your own folder structure. But the basic idea could be to have a parent workflow like this to download a large file, write it to the file system and then prepare batches: Then call a sub-workflow reading only a limited n…

You can use pretty much the same approach and have your workflow return the smaller binary files produced by the “Move to file” node in the sub workflow back to the parent workflow. This potentially costs a lot memory though, so make sure to monitor this closely.