Reading JSONL file from S3 and then parsing it

[zenweasel]

Trying to read a JSONL file from S3, parse each line into a record

I got this reading files from S3 and then downloading them, but I want to then parse the downloaded file. If I use the Spreadsheet I sort of get what I want except it wants to turn it into a spreadsheet when it’s actually a JSONL file. How do I get the download file contents so I can read and manipulate them.

[Jon]

Hey @zenweasel,

Welcome to the community

Have you tried using the Move Binary data node then using a code node if needed to clean up the data?

[zenweasel]

Thanks for the reply. Yeah, that works for me, thanks. My only issue was that it loads the entire file into memory and the files are quite large. I was hoping there was something like the Spreadsheet node that read things a line at a time.