Never Miss a New URL Again! — With n8n

[monajmian]

We wanted a simple way to keep an eye on competitors’ websites and quickly spot new pages.

So I built a small automation with n8n that checks their sitemaps every day.

How it works

1. Fetch the sitemap
   An HTTP Request node gets the competitor’s sitemap.
2. Extract URLs + Last Modified
   The sitemap is parsed and the URLs and lastmod dates are extracted.

3. Compare with previous data
   The URLs are compared with a Google Sheet containing the previous snapshot.

4. Detect new pages
   If a new URL appears, n8n identifies it automatically.

   

5. Send a Telegram notification
   The SEO/content team gets notified whenever a new page is discovered.

6. Update the database
   The Google Sheet is updated with the latest sitemap data, ready for the next day’s check.

   

Why I built it

Competitors can publish new landing pages, category pages, or content without us noticing immediately.

Now, instead of manually checking their websites, we get notified when something new appears.

It has actually been pretty useful for our SEO & Content team to monitor competitors and find new content opportunities.

The whole process runs automatically every day:

Sitemap → Extract → Compare → Detect Changes → Telegram → Update Sheet

Sharing the workflow here in case it gives someone else an idea for their own n8n automation.

Would love to hear how you’re using n8n for competitor monitoring or SEO workflows.