I want to create a workflow using webscrape and ai

Hello, I would like to use Google Sheets to take input from a row, use the search API to retrieve the top 10 search results, then scrape data from these links and send it to an AI. Finally, the data should be used to fill in product details in the Google Sheets. However, I am facing the error in the loop for data. can anyone help me to solve these problem.

It looks like your topic is missing some important information. Could you provide the following if applicable.

  • n8n version:
  • Database (default: SQLite):
  • n8n EXECUTIONS_PROCESS setting (default: own, main):
  • Running n8n via (Docker, npm, n8n cloud, desktop app):
  • Operating system:

Definitely doable.

I assume the google sheet contains the search terms? Then you would have a loop that scrapes each one of the 10 sites returned by the search. You will probably need an AI to convert the data returned by the webscraper into a specific JSON format that you can then map to a google sheet.

It’s a reasonably complex flow to build but not too difficult.

Share the flow you have so far.

I am a beginner, so I don’t know much about how it works. I am Facing error in the loop.

Data Example:
Prestige City Mulund
Runwal 25 Hour Life

And Chatgpt AI Should be able to fill these column:
City Area and Location,Price Range,Carpet Area Range,Project Ratings (Out of 5),FAQ Questions,FAQ Answers,Project Rera Number,Project Name,Project Location,Project Location Area,Possession Date,Developer Name,About Property,About Property Developer,Special Offers / Payment Scheme / Exclusive Offers,Number of towers,Number of Storey,Project Area Land Parcel,Tower Name - Maharera ,Project Rera No.,Project Rera Qr Code,Gallery,Possession Status,Property Available,BHK Apartments,Carpet Area in Sq. Ft,Pricing,Floor Plan Image,Pricing Description,Floor Plan Description,Amenities,Amenties Description,Property Location Address,Latitude,Longtitude,Zoom,Street Number,Street name,Street short name,City,State,State short,Post code,Country,Country short,Location Title,Location Content,Location Description,Location Map Images

This an ambitious project you have set your self as a beginner.

Your challenge will be that you have no way of knowing if the websites returned by the web search will contain the info you need. Your info needs are very specific and detailed. U risk the AI making info up to fill in the gaps where the website does not have the detail you need.

Can I check, do you want to scrape the top 10 results for Prestige City Mulund (ie 10 website scrapes) then feed the combined results of all 10 scrapes to the AI to try and find as much of the data you require as possible about Prestige City Mulund?

Yes, i want to scrape the data of top result and then feed it into the Ai to give me the answer i need.