Getting 403 error when executing HTTP request to and RSS feed

Hi n8n community,

I’m building a workflow that:
Uses the RSS Feed Trigger to get articles (academic psychology)
Sends the link from the RSS item into an HTTP Request node to fetch the full article content for summarization.

The RSS trigger is working fine and returning items correctly. However, when I pass the link into the HTTP Request node with method GET, I get 403 error with 0 items.

I’ve tried adding these headers in the HTTP Request node:

–User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125 Safari/537.36 --Accept-Language: en-US,en;q=0.9
–Accept: text/html,application/xhtml+xml`

What is the error message (if any)?

403

Please share your workflow:

{
“nodes”: [
{
“parameters”: {},
“type”: “n8n-nodes-base.manualTrigger”,
“typeVersion”: 1,
“position”: [
-240,
-40
],
“id”: “a0dab13b-9c17-4e28-96de-07ce65a041e9”,
“name”: “When clicking ‘Execute workflow’”
},
{
“parameters”: {
“url”: “Wiley-Online-Library: Keyword search for query”,
“options”: {
“ignoreSSL”: false
}
},
“type”: “n8n-nodes-base.rssFeedRead”,
“typeVersion”: 1.2,
“position”: [
-60,
-40
],
“id”: “a2f9aac2-0250-440b-b838-2b15c60bee0e”,
“name”: “RSS Read”
},
{
“parameters”: {
“maxItems”: 10
},
“type”: “n8n-nodes-base.limit”,
“typeVersion”: 1,
“position”: [
100,
-40
],
“id”: “310143fe-81bf-48eb-98da-284c644d9066”,
“name”: “Limit”
},
{
“parameters”: {
“url”: “={{ $json.link }}”,
“sendHeaders”: true,
“headerParameters”: {
“parameters”: [
{
“name”: “User-Agent”,
“value”: “request”
}
]
},
“options”: {}
},
“type”: “n8n-nodes-base.httpRequest”,
“typeVersion”: 4.2,
“position”: [
260,
-40
],
“id”: “6f533b1f-2e0c-4840-8888-b848218884c0”,
“name”: “HTTP Request”
}
],
“connections”: {
“When clicking ‘Execute workflow’”: {
“main”: [
[
{
“node”: “RSS Read”,
“type”: “main”,
“index”: 0
}
]
]
},
“RSS Read”: {
“main”: [
[
{
“node”: “Limit”,
“type”: “main”,
“index”: 0
}
]
]
},
“Limit”: {
“main”: [
[
{
“node”: “HTTP Request”,
“type”: “main”,
“index”: 0
}
]
]
}
},
“pinData”: {},
“meta”: {
“instanceId”: “aa03f8f364726646e62c8cd36cad3b8c585792370c541b63902e99f52fd70b35”
}
}

Share the output returned by the last node

Forbidden - perhaps check your credentials? [item 0]

Information on your n8n setup

  • n8n version: 1.100.1
  • Database (default: SQLite):
  • n8n EXECUTIONS_PROCESS setting (default: own, main): default (own, main)
  • Running n8n via (Docker, npm, n8n cloud, desktop app): Docker
  • Operating system: Linux container on Render

Hey @Dipanker_Mukherjee,

If you test the Url using postman do you get the same response status ?

Yes you probably encounter the website has a strong anti-crawler system.

If that happens, you need something like crawl4ai or firecrawl to do the crawl for you. But not 100% gurantee work.

1 Like

You can try to test with a free trial on scraperbee and see if it works.
There’s q scraperbee node too just use the api key provided when you crated the account

Please check the full request from Website and see if you’re missing some headers or cookies. I hope that will work.

Its working using firecrawl.

1 Like

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.