Reading JSONL file from S3 and then parsing it

Trying to read a JSONL file from S3, parse each line into a record

I got this reading files from S3 and then downloading them, but I want to then parse the downloaded file. If I use the Spreadsheet I sort of get what I want except it wants to turn it into a spreadsheet when it’s actually a JSONL file. How do I get the download file contents so I can read and manipulate them.

Hey @zenweasel,

Welcome to the community :cake:

Have you tried using the Move Binary data node then using a code node if needed to clean up the data?

1 Like

Thanks for the reply. Yeah, that works for me, thanks. My only issue was that it loads the entire file into memory and the files are quite large. I was hoping there was something like the Spreadsheet node that read things a line at a time.

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.