I’m trying to build a webscraper for a Xenforo forum, focusing on specific posts containing stories.
I’ve got it setup this way:
- Manual trigger
- Get data from datatable (thread URLs and post numbers)
- Aggregate post numbers (postNum)
- HTTP request using the thread URLs
- Merge the aggregated postNum array and HTTP query requests
- Pass postNum array and data from HTTP queries to code node to filter
I have to do it this way because the HTTP requests pull the entire page, and I’m trying to filter down to the specific post. However, I can’t seem to come up with any function that will actually generate a filtered output to pass to the HTML extraction node.
The error I keep getting is Missing HTML or postNums., which doesn’t really tell me anything useful.
Here’s what I’ve got: