Describe the problem/error/question
I have an issue with the RSS Feed Trigger. I need to check every few minutes for new items. At the beginning, it does fetch 1-2 new items correctly. However, after fetching for about 10-15 minutes or something, it starts to fetch the old ones that have already been fetched (duplicates).
From the gif above. You can see it fetches a new item every minute, sometimes 2-3 items based on the RSS feed but it suddenly jumps up to 28 ones. Most of these items have already been fetched from previous executions.
–
Update: I have been keeping my eyes on for a few minutes now. When the poll time comes (every minute), if there is only one new item/article, then it fetches that one new item normally, but if there are multiple new items, then it starts to behave strangely in the upcoming executions. It fetches the new ones and some previous old ones, causing duplicates.
–
Please share your workflow
Share the output returned by the last node
This is the pubDate of the item from the execution before the 28 items jump:
2024-05-21T06:26:51.000Z
This is the pubDate of the first 10 items of the 28 items execution:
2024-05-21T06:26:51.000Z
2024-05-21T06:25:57.000Z
2024-05-21T06:24:42.000Z
2024-05-21T06:20:19.000Z
2024-05-21T06:04:16.000Z
2024-05-21T06:12:35.000Z
2024-05-21T06:12:29.000Z
2024-05-21T06:10:53.000Z
2024-05-21T06:09:46.000Z
2024-05-21T06:06:30.000Z
This is the first 3 of the 28 items.
[
{
"title":
"I need a video editor to edit short films for social media.",
"link":
"https://www.upwork.com/jobs/need-video-editor-edit-short-films-for-social-media_%7E01fa6a7cbc76dd9471?source=rss",
"pubDate":
"2024-05-21T06:26:51.000Z",
"content":
"Video editor to edit content... ",
"contentSnippet":
"Video editor to edit content...",
"summary":
"Video editor to edit content... ",
"id":
"https://www.upwork.com/jobs/need-video-editor-edit-short-films-for-social-media_~01fa6a7cbc76dd9471?source=rss",
"isoDate":
"2024-05-21T06:26:51.000Z"
},
{
"title":
"Looking for UGC for Tik-tok and Instagram",
"link":
"https://www.upwork.com/jobs/Looking-for-UGC-for-Tik-tok-and-Instagram_%7E0114559a7c0d47b42a?source=rss",
"pubDate":
"2024-05-21T06:25:57.000Z",
"content":
"I am looking for someone who can help me with...",
"contentSnippet":
"I am looking for someone who can help me with...",
"summary":
"I am looking for someone who can help me with...",
"id":
"https://www.upwork.com/jobs/Looking-for-UGC-for-Tik-tok-and-Instagram_~0114559a7c0d47b42a?source=rss",
"isoDate":
"2024-05-21T06:25:57.000Z"
},
{
"title":
"Looking for GFX & VFX Design Artist",
"link":
"https://www.upwork.com/jobs/Looking-for-GFX-amp-VFX-Design-Artist_%7E019b51c9a99cf8bd95?source=rss",
"pubDate":
"2024-05-21T06:24:42.000Z",
"content":
"We are looking for a Freelance Senior AI...",
"contentSnippet":
"We are looking for a Freelance Senior AI...",
"summary":
"We are looking for a Freelance Senior AI...",
"id":
"https://www.upwork.com/jobs/Looking-for-GFX-amp-VFX-Design-Artist_~019b51c9a99cf8bd95?source=rss",
"isoDate":
"2024-05-21T06:24:42.000Z"
}
]
Information on your n8n setup
- n8n version: 1.41.1
- Running n8n via (Docker, npm, n8n cloud, desktop app): Docker (Coolify)