Trying to create a web scraping for Search Grants | Grants.gov but HTTP + HTML nodes doesn’t bring any results. I need opportunities but the result is empty. Any workarounds? Any suggestions?
n8n version: 1.70.2
Database (default: SQLite): default
n8n EXECUTIONS_PROCESS setting (default: own, main): default
Running n8n via (Docker, npm, n8n cloud, desktop app): cloud
It looks like your topic is missing some important information. Could you provide the following if applicable.
Welcome to the community @Gleb_LogAutomate !
Ensure to copy your n8n workflow and paste it in the code block, that is in between the pairs of triple backticks, which also could be achieved by clicking </> (preformatted text) in the editor and pasting in your workflow.
```
<your workflow>
```
That implies to any JSON output you would like to share with us.
Make sure that you have removed any sensitive information from your workflow and include dummy or pinned data with it!
This is because HTML does not contain that data. It is rarher loaded by JavaScript asynchroniously. I’m afraid you would have to have access to their API to be able to a retrieve their data.
have you try with browserless?
Let me try it today.
So far, I’ve tried scarpingbee, ninja, and some others.
Thanks!
To get their API I have to register and go through relatively long approval process.
Hey, have you tried using the Simpler version of grants.gov?
Search Funding Opportunities | Simpler.Grants.gov
See if that gets you the data you need.
you can also access: https://wiki.simpler.grants.gov/
The way I do it is:
https://r.jina.ai/https://simpler.grants.gov/search
Try this, the data is big, so you’ll need to figure out how to set up the workflow to be running efficiently and/or adjust the search query parameters.
This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.