How to extract all links that require clicking more link

[Ruriko]

Describe the problem/error/question

I want to extract all links in a list but the problem is it requires you to click the show all link to see all available episodes. The example site is 【第5話】ひびワれこうじつ｜カドコミ (コミックウォーカー)

In the screenshot I want click the link that is circled in red in order to see the full list. After clicking the show all link I then want to extract all the links in that list. How can I do this in n8n? my workflow is partial working I just don’t know how to make it click the show all link

What is the error message (if any)?

Please share your workflow

Share the output returned by the last node

Information on your n8n setup

• n8n version: 1.98.2
• Database (default: SQLite): default
• n8n EXECUTIONS_PROCESS setting (default: own, main): default
• Running n8n via (Docker, npm, n8n cloud, desktop app): npm
• Operating system: Windows Server 2022

[mohamed3nan]

Hi @Ruriko

I noticed that all the episode information is stored in a JSON object inside:

<script id="__NEXT_DATA__" type="application/json"> ... </script>

What I’d do is scrape it like this:

Then convert it into valid JSON using .parseJson()

After that, it’s very easy to extract whatever data you need..

Here’s an example: