Pinecone Vector Store: clear namespace only once?

Questions
1

Describe the problem / question

I want the following process:

  • When I add a file to my vector store (chunked), I use the filename as namespace.
  • When this file is modified, I want to clear the corresponding namespace in the database, then add the new file to the vector store (chunked).
    With this workflow, I can easily update my knowledge base and be sure I don’t have old data in it.

I tried the Clear Namespace option of the Pinecone Vector Store node.
Unfortunately, this option clears the namespace on every cycle of chunk!
If my document is more than 1 chunk, this will:

  • clear namespace
  • add chunk 1 within namespace
  • clear namespace
  • add chunk 2 within namespace
  • …
  • clear namespace
  • add chunk N within namespace

At the end of the process, my vector store contains only the last chunk :frowning:

Is there a way to clear the namespace only once?

I’ve made a workaround using another Pinecone Vector Store node at the begining of my workflow to insert a blank text in the database with “clear namespace” option, but I don’t find this elegant.

Information on your n8n setup

  • n8n version: 1.61.0
  • Database (default: SQLite): Pinecone
  • n8n EXECUTIONS_PROCESS setting (default: own, main): ?
  • Running n8n via (Docker, npm, n8n cloud, desktop app): cloud
  • Operating system: cloud
3

Hi @PhunkyBob.

This is a known issue that we’re working on fixing. Tracking here: [AI-265] Thanks for posting and we’ll keep you updated on the progress!

2 Likes
5

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.