How to do text splitting/chunking in AI Agent?

Questions
1

My input to AI Agent is a very long text. Thus it always triggers error of exceeding context size window.

Anyone knows what’s a good way to do text splits/chunking so it fits into the window?

Thanks

2

Maybe take a look at vector database and store the long text into it.

1 Like
3

Yes i think thats one way. I also just tried a customized node for text splitting, that seem to work as well