Setting Max Results Parameter for scraper in Apify Node with JSON input

Questions
1

Describe the problem/error/question

I am scraping jobs from careers pages. Using an Apify node - Run Actor and Get Dataset. The scraper I'm using is returning too many results (so costing too much money). I want to limit the number of results. You can do this if you run the scraper from the Apify console (max results returned), but it doesn't give the parameter details to do program this in JSON in your n8n node. Any ideas?

What is the error message (if any)?

Please share your workflow

(Select the nodes on your canvas and use the keyboard shortcuts CMD+C/CTRL+C and CMD+V/CTRL+V to copy and paste the workflow.)

Share the output returned by the last node

Information on your n8n setup

  • n8n version:
  • Database (default: SQLite):
  • n8n EXECUTIONS_PROCESS setting (default: own, main):
  • Running n8n via (Docker, npm, n8n cloud, desktop app):
  • Operating system:
2

Can you let me know the name of the actor you are using, so I can check what options you would have?

3

Thanks — bytepulselabs/greenhouse-job-scraper

I’ve tried adding the parameter to the json limit/maxresults/etc etc but nothing works. To be honest I don’t think it’s possible with this actor, you can do it from the console but there’s nothing about it in the input…

Hoping you’ve got some better news for me! :slight_smile:

4

Alright, you need an HTTP node for this, you can copy mine:

Make sure to replace your ACTOR_ID in the URL, you can take it from Apify → Actors in the side menu → Your actor → copy from url, looks like N5bHfOymnV2adadyf.

Set maxItems as needed to control cost.
Also, replace the body JSON (which is Input in Apify) with your sites to scrape.

You can construct similar requests by checking the API documentation here:

Hope this helps, mark it as Solution if it did :slight_smile:

1 Like
5

This is brilliant and works perfectly. Thanks.

6

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.