# Cluster nodes for complex processes

**URL:** <https://community.n8n.io/t/cluster-nodes-for-complex-processes/74905>\
**Category:** Questions\
**Tags:** core, node\
**Created:** [February 4, 2025, 1:25pm UTC](https://community.n8n.io/t/cluster-nodes-for-complex-processes/74905 "2025-02-04T13:25:08Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Anthony](https://dub1.discourse-cdn.com/n8n/user_avatar/community.n8n.io/anthony/32/24879_2.png) [@Anthony](https://community.n8n.io/u/Anthony)\
**Post date:** [February 4, 2025, 1:25pm UTC](https://community.n8n.io/t/cluster-nodes-for-complex-processes/74905/1 "2025-02-04T13:25:08Z")

</div>

I’m building a complex community node (a web crawler) and want to split its complexity into two nodes: a crawler node and web scraping rendering engines (e.g., HTTP node, web scraping API, etc.).

I’ve already built a first working version, but it’s a monstrous single node. Users have to wait 10 minutes while the node processes, after which it outputs a massive JSON containing the crawled pages.

Now, I want to improve the user experience. The ideal UI would be similar to n8n’s AI agent node and its “Tools” feature, which provides a great execution logs UI where users can click to see the chain of actions.

So, my question is:

Can I use the same pattern ( **“special inputs”** ) for web crawling nodes, or is the **cluster node** concept tightly integrated with AI agents, making it difficult to repurpose for web crawling?

> **[Cluster nodes | n8n Docs](https://docs.n8n.io/integrations/builtin/cluster-nodes/)**
>
> Understand cluster nodes in n8n, and browse the cluster nodes library.

---

<div class="post-metadata">

**Author:** ![n8n](https://dub1.discourse-cdn.com/n8n/user_avatar/community.n8n.io/n8n/32/196425_2.png) [@n8n](https://community.n8n.io/u/n8n)\
**Post date:** [February 4, 2025, 1:25pm UTC](https://community.n8n.io/t/cluster-nodes-for-complex-processes/74905/2 "2025-02-04T13:25:09Z")

</div>

It looks like your topic is missing some important information. Could you provide the following if applicable.

- **n8n version:**
- **Database (default: SQLite):**
- **n8n EXECUTIONS\_PROCESS setting (default: own, main):**
- **Running n8n via (Docker, npm, n8n cloud, desktop app):**
- **Operating system:**

---

<div class="post-metadata">

**Author:** ![system](https://dub1.discourse-cdn.com/n8n/user_avatar/community.n8n.io/system/32/195824_2.png) [@system](https://community.n8n.io/u/system)\
**Post date:** [May 5, 2025, 1:25pm UTC](https://community.n8n.io/t/cluster-nodes-for-complex-processes/74905/3 "2025-05-05T13:25:11Z")

</div>

Closed on May 5, 2025, 1:25pm UTC

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.