I have 1,000,000 records csv. im trying to analyse the data using n8n. what ever the node i use im getting timeout errors and n8n instance is getting restart. Im a cloud n8n user (starter plan)
Hey @VIJAY_UPPALA hope all is well. Welcome to the community.
N8N instances have limited resources.
Could you please expand on what is the reason you need 1M records at once? Is there a reason you are not using database for that data?
@jabbson Thanks for your response
I want to analyse this data , when user ask any Question about this data using NLP i should respond back with the insights, and charts
Have you considered using a database? Specifically vector databases could probably be a good fit here.
@jabbson No jabbson not yet, Started looking into SupaBase db, hopefully that should sort this issue
supabase would be a solid choice here, given it is based on the postgres and in that combines good of the both worlds - regular relational database as well as vector database functionality through the pgvector extension.
This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.