apparently my data from my Jina AI webscraper (HTTP Request) is too large for my information extractor to handle. How can I break it up into smaller chunks so that they can be fed as more manageable chunks into my information extractor? Thanks.
There is a number of strategies applicable. Depends on the data structure and what would be considered an atom of data, i.e. fragment of data (subset) which cannot be broken down further without losing critical elements and context.
What is your data structure and how would you define the atom in terms of data structural elements?
Ideally, if you could pin data in the HTTP Request node and post the workflow using the </> button here so that the workflow gets rendered properly.
This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.