# Rate limit on Information Extractor node **URL:** \ **Category:** Questions\ **Tags:** data-transformation, node, workflow-building\ **Created:** [June 15, 2025, 3:28pm UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994 "2025-06-15T15:28:30Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![Affaaf](https://avatars.discourse-cdn.com/v4/letter/a/b77776/32.png) [@Affaaf](https://community.n8n.io/u/Affaaf)\ **Post date:** [June 15, 2025, 3:28pm UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/1 "2025-06-15T15:28:30Z")
I am trying to extract information from http request node but the error of exceeding max token keeps coming. I have tried to set the parameter to maximum token allowed, but it still is not working. Please help. TIA ---
**Author:** ![rbreen](https://dub1.discourse-cdn.com/n8n/user_avatar/community.n8n.io/rbreen/32/106993_2.png) [@rbreen](https://community.n8n.io/u/rbreen)\ **Post date:** [June 15, 2025, 5:02pm UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/2 "2025-06-15T17:02:58Z")
Hi @Affaaf How much information are you sending into the model? The limit only applies to the output tokens, it won’t truncate the input? Do you have a workflow you can share? ---
**Author:** ![Affaaf](https://avatars.discourse-cdn.com/v4/letter/a/b77776/32.png) [@Affaaf](https://community.n8n.io/u/Affaaf)\ **Post date:** [June 15, 2025, 6:33pm UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/3 "2025-06-15T18:33:25Z")
Hi, thanks for getting back to me. The website in HTTP request node is > **[Stephen Hawking](https://en.wikipedia.org/wiki/Stephen_Hawking)** > > Stephen William Hawking (8 January 1942 – 14 March 2018) was an English theoretical astrophysicist, cosmologist, and author who was director of research at the Centre for Theoretical Cosmology at the University of Cambridge. Between 1979 and 2009, he was the Lucasian Professor of Mathematics at Cambridge, widely viewed as one of the most prestigious academic posts in the world. > Hawking was born in Oxford into a family of physicians. In 1959, at the age of 17, he began his university educatio... ![workflow2](https://europe1.discourse-cdn.com/n8n/original/3X/c/b/cbe9880e76ddbba67fbbb2b0d338992dbce58cdd.jpeg) ![workflow1](https://europe1.discourse-cdn.com/n8n/original/3X/4/4/44b8d846e6ddb8c6e3768298a2ff623483bf5a8d.png) ---
**Author:** ![rbreen](https://dub1.discourse-cdn.com/n8n/user_avatar/community.n8n.io/rbreen/32/106993_2.png) [@rbreen](https://community.n8n.io/u/rbreen)\ **Post date:** [June 15, 2025, 8:27pm UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/4 "2025-06-15T20:27:53Z")
@Affaaf That page has a lot of content to send to an llm. What are you trying to do with the content? I’ll check if there is a model that can take in that much content. ---
**Author:** ![Kool\_Baudrillard](https://dub1.discourse-cdn.com/n8n/user_avatar/community.n8n.io/kool_baudrillard/32/14282_2.png) [@Kool\_Baudrillard](https://community.n8n.io/u/Kool_Baudrillard)\ **Post date:** [June 15, 2025, 8:28pm UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/5 "2025-06-15T20:28:07Z")
try either the html node to convert the payload from the http request to plain text or use the markdown node to convert html to markdown. This will reduce your token size significantly. ---
**Author:** ![rbreen](https://dub1.discourse-cdn.com/n8n/user_avatar/community.n8n.io/rbreen/32/106993_2.png) [@rbreen](https://community.n8n.io/u/rbreen)\ **Post date:** [June 16, 2025, 12:32am UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/6 "2025-06-16T00:32:31Z")
@Affaaf I connected to the site and found that chunking your data, then sending it through multiple agents is the best way to go. I’ll include the code for chunking below. Even chunking your text into chunks of 3k size results in 197 results. You can summarize each of the 197 results, then summarize the results of those. The llm will run a total of 198 times. Again, your content is gigantic. What are you attempting to accomplish with the summarization? > const text = $json[“text”]; // your long input string > const chunkSize = 3000; // characters per chunk > const overlap = 300; // overlap between chunks let chunks = ; for (let i = 0; i \< text.length; i += chunkSize - overlap) { const chunk = text.slice(i, i + chunkSize); chunks.push({ json: { chunk } }); } return chunks; ---
**Author:** ![Affaaf](https://avatars.discourse-cdn.com/v4/letter/a/b77776/32.png) [@Affaaf](https://community.n8n.io/u/Affaaf)\ **Post date:** [June 16, 2025, 2:22am UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/7 "2025-06-16T02:22:38Z")
I want to get the salient feature of the content. I guess I should be using a different attribute? The code you have mentioned, where should I enter it? Basically what I am trying to do is get news from both news source (hacker news and any other website that delivers news) and then the news on the same topic from different sources, I want to upload it in a document. Right now I am just testing my logic. I am very new to n8n (started this month) so still trying to understand everything. ---
**Author:** ![Affaaf](https://avatars.discourse-cdn.com/v4/letter/a/b77776/32.png) [@Affaaf](https://community.n8n.io/u/Affaaf)\ **Post date:** [June 16, 2025, 2:31am UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/8 "2025-06-16T02:31:58Z")
wow… thank you. I was able to resolve the rate issue by using html node. Is there a limit of token on which this will work? ---
**Author:** ![Kool\_Baudrillard](https://dub1.discourse-cdn.com/n8n/user_avatar/community.n8n.io/kool_baudrillard/32/14282_2.png) [@Kool\_Baudrillard](https://community.n8n.io/u/Kool_Baudrillard)\ **Post date:** [June 16, 2025, 9:50am UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/9 "2025-06-16T09:50:20Z")
Well depends on your model, gemini has a pretty large token context window. ---
**Author:** ![darrell\_tw](https://dub1.discourse-cdn.com/n8n/user_avatar/community.n8n.io/darrell_tw/32/52180_2.png) [@darrell\_tw](https://community.n8n.io/u/darrell_tw)\ **Post date:** [June 16, 2025, 10:16am UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/10 "2025-06-16T10:16:24Z")
You are using OpenAI so let’s find some information about it ![Screenshot_20250616_181155_RTvYiDtY@2x](https://europe1.discourse-cdn.com/n8n/original/3X/7/3/735b695baa1aa592abd14e120dd0e373da10f34d.png) Use `4o-mini` as example. Tier 1 and Tier 2 has very different limit : RPM : Request per minute RPD : Request per day TPM : Token per minute I believe you hit RPM or TPM quite often if you are in Tier1 Because sending the whole html to AI is causing some amount of the tokens. You can follow the document to check what tier you are and considering upgrade it by deposit more credits. > **[Rate limits | OpenAI API](https://developers.openai.com/api/docs/guides/rate-limits)** > > Rate limits are restrictions that our API imposes on the number of times a user or client can access our services within a specified period of time. Or not sending the whole html to AI. Find some other way to minimize the tokens ---
**Author:** ![rbreen](https://dub1.discourse-cdn.com/n8n/user_avatar/community.n8n.io/rbreen/32/106993_2.png) [@rbreen](https://community.n8n.io/u/rbreen)\ **Post date:** [June 16, 2025, 12:35pm UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/11 "2025-06-16T12:35:42Z")
@Affaaf Glad you found a model that could use that much text. Are you trying to have people ask questions of the documents? To find more info? An Agent may not be very useful with that much content. You could also move your data into a vector store in smaller chunks, and have the agent use the document’s data. Let me know if you are looking for a solution like that. Best, Robert ---
**Author:** ![Affaaf](https://avatars.discourse-cdn.com/v4/letter/a/b77776/32.png) [@Affaaf](https://community.n8n.io/u/Affaaf)\ **Post date:** [June 17, 2025, 1:22am UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/12 "2025-06-17T01:22:13Z")
I am trying to compile news about same topic from different sources. I then want to send them in a google doc. Initially I was thinking of extracting news from different news website and then merge the news that are similar but that is not working out so I am going to change my approach and now get news from one source and then get matching news from different http request nodes and see how that goes. Like I said I am very new to n8n and am still understanding the functionality. I will look into the vector store and what is that. Right now I have gotten stuck with credential for google doc. Have you ever tried them? ---
**Author:** ![rbreen](https://dub1.discourse-cdn.com/n8n/user_avatar/community.n8n.io/rbreen/32/106993_2.png) [@rbreen](https://community.n8n.io/u/rbreen)\ **Post date:** [June 17, 2025, 3:05am UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/13 "2025-06-17T03:05:52Z")
@Affaaf Are you looking to summarize content from multiple sources, then send out a google doc? What error are you getting? ---
**Author:** ![Affaaf](https://avatars.discourse-cdn.com/v4/letter/a/b77776/32.png) [@Affaaf](https://community.n8n.io/u/Affaaf)\ **Post date:** [June 17, 2025, 3:11am UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/14 "2025-06-17T03:11:14Z")
yes that is waht I am doing. I have managed to do so. Now I just need to put the similar news together under one big heading. Any idea, how to do so? I tried the sql query in the merge node but it didnt work since the data coming from different sources had different wordings despite talking about the same topic ---
**Author:** ![rbreen](https://dub1.discourse-cdn.com/n8n/user_avatar/community.n8n.io/rbreen/32/106993_2.png) [@rbreen](https://community.n8n.io/u/rbreen)\ **Post date:** [June 17, 2025, 10:30pm UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/15 "2025-06-17T22:30:15Z")
Hi @Affaaf Try sending both outputs into an ai agent. Use a system message to say something like… “Combine these two summarizations into one clean document detailing the topic” ❤If this response helped you, please click the heart to show that it is useful ✅If this response solved your issue, mark it as the solution to help the community ---
**Author:** ![rbreen](https://dub1.discourse-cdn.com/n8n/user_avatar/community.n8n.io/rbreen/32/106993_2.png) [@rbreen](https://community.n8n.io/u/rbreen)\ **Post date:** [June 18, 2025, 3:52pm UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/16 "2025-06-18T15:52:24Z")
@Affaaf Let me know if you were able to solve your issue. Or if you need more help. ---
**Author:** ![Affaaf](https://avatars.discourse-cdn.com/v4/letter/a/b77776/32.png) [@Affaaf](https://community.n8n.io/u/Affaaf)\ **Post date:** [June 18, 2025, 11:26pm UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/17 "2025-06-18T23:26:37Z")
> [@rbreen](#): > > Combine these two summarizations into one clean document detailing the topic Actually I have not been. I am trying another approach and will tell you how it went. With AI agent, the agrent returns data in 1 item. I would prefer to get it into multiple items. ---
**Author:** ![Affaaf](https://avatars.discourse-cdn.com/v4/letter/a/b77776/32.png) [@Affaaf](https://community.n8n.io/u/Affaaf)\ **Post date:** [June 18, 2025, 11:28pm UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/18 "2025-06-18T23:28:51Z")
Another issue that I am seeing is that only one news is being extracted from the html node. I am trying ot understand why would it get only one news item when in the http node I see many links. ---
**Author:** ![rbreen](https://dub1.discourse-cdn.com/n8n/user_avatar/community.n8n.io/rbreen/32/106993_2.png) [@rbreen](https://community.n8n.io/u/rbreen)\ **Post date:** [June 20, 2025, 3:46pm UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/19 "2025-06-20T15:46:08Z")
@Affaaf Can you paste your workflow into a preformatted text block so I can see you html node? ---
**Author:** ![Affaaf](https://avatars.discourse-cdn.com/v4/letter/a/b77776/32.png) [@Affaaf](https://community.n8n.io/u/Affaaf)\ **Post date:** [June 21, 2025, 12:40am UTC](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994/20 "2025-06-21T00:40:18Z")
here is the json file. Let me know if it is helpful. I am still workign on it so it is full of errors but you can see the http and html nodes and their content. I am able to extract multiple articles I think. But some of the information is not in the form I want. I don’t want the links in the output. Just the news from those links. Which I am still working on how to extract. Any idea? [Next page](https://community.n8n.io/t/rate-limit-on-information-extractor-node/132994.md?page=2)