The idea is:
When enabling “Rerank Results” in a vector store node (either linked in an AI Agent or a standalone Vector Store node), and connecting a reranker model (Cohere 3.5), the number of items is always limited to 3.
While this in itself is not a bug (as the system is correctly sending all chunks to the reranker, based on the limit field, it would be great to be able to configure the number of results that the reranker model returns)
My use case:
Ideally there should be a different integer field where you can set the number of items that the reranker returns.
I think it would be beneficial to add this because:
This would be the preferred approach, as the vector store could return 100 items and the reranker could give the AI Agent the best 10 for example.
I’ve a video on this here where I talk through the need for this -
Any resources to support this?
N/A
Are you willing to work on this?
Happy to test the new feature