Force Airtop Website Scraping to wait 1 minute to load

[konradsl]

Hi, I’ve an Airtop node to scrape my website. But in some cases, the markdown result contains no real data, since the website sometimes is very slow and need time to load.
How can I force Airtop to wait always one minute until probably all data in the webpage is loaded (there are some async API calls in the website)? Are there any options I can set?

[Wouter_Nigrini]

Hi @konradsl,

I am assuming you’re first creating a session and then a window. I’m further assuming you’re using the Load a Page node to load your website. If so then make sure you set the “Wait Until” property to the desired option to wait for the page to fully load, before you do the extraction

[konradsl]

Thanks @Azeezat and @Wouter_Nigrini

The point was: I had only one node for scraping with Operation=Smart Scrape … and your information opened my eyes and I split up the workflow with multiple Aiirtop nodes like “Create Window”, “Create Airtop Session” and “Load a page” node