I’m new to using vector databases and I need your expert advice.
I would like to get some feedback on the use of vector databases.
I create a lot of chatbots that need access to documents, and I have several questions:
Vector databases like QDRANT seem overkill for my needs (at least $60 per month), so if I create one for each chatbot, my costs will be huge.
I think that if I use one cluster to store the documents for all my chatbots, the responses might not be relevant, and in addition, some confidential data could potentially leak.
Maybe using the vector databases available in n8n could be interesting if I increase the storage on my virtual machine where n8n is hosted?
If you could share your experiences on all of this, it would be super helpful!
Thank you all!
I think that if I use one cluster to store the documents for all my chatbots, the responses might not be relevant, and in addition, some confidential data could potentially leak.
You can use qdrant’s filters to segment customer, department, project, documents etc.
When inserting into Qdrant, be sure to add the correct metadata in the document loader.
When retrieving data, use the “search filter” option in the qdrant node to apply the filter.