HTTP request with page-based authentication?

[oguruma]

I am looking to scrape LinkedIn, however it requires that I be logged into an account.

Is it possible to create an HTTP request that will handle authentication if the browser is redirected to a login page?

[n8n]

It looks like your topic is missing some important information. Could you provide the following if applicable.

• n8n version:
• Database (default: SQLite):
• n8n EXECUTIONS_PROCESS setting (default: own, main):
• Running n8n via (Docker, npm, n8n cloud, desktop app):
• Operating system:

[EmeraldHerald]

Hi @oguruma

Unfortunately LinkedIn is generally quite difficult for this reason - this post mentions an alternative that n8n has an integration with that might be helpful for you!

Http request to Linkedin

Hi @Spacewalker, cookies would typically be sent in a header with the same name, see for example here. Crawling LinkedIn is however notoriously difficult, so simply copying that header from your browser might not be enough. There are businesses who built an entire software product around crawling pages like LinkedIn, so you might want to check out these for help with your task. An example would be Phantombuster for which an n8n integration exists.