Its because youre storing the document in a permantent store (pinecone) and not replacing a new version. Do you want replace the existing document or only use the document to process and then disgard?
If the latter, then rather use a in mmemory vector store which will replace everything once you add a new document.
For example below every time I send a new pdf to telegram chat, I can only ask questions about that new document as it’s stored in memory and immediately overwritten
If you’re looking to version and update existing documents in pinecone, then you can follow this video explaining how to properly overwrite documents in your vector store
Thank you for replying!
I actually managed to find out the solution a few hours ago, i just deleted all of the old Pinecone records and namespaces then run the workflow which worked but thank you for replying, i might try to do one where you don’t have to manually delete the old records and namespaces from Pinecone.
