Build Your Own DeepResearch with N8N + Apify + Notion!

Hey @erichuang
Hmm this node should use the same credential and database as set in step 3. You may need to manually update these by toggling the dropdowns in this notion node and others after it.

Hey @Jude_SV welcome to the community!

Good catch, I think this might be a bug - the follow-up questions were previously generated by the “DeepResearch Learnings” agent in step 9 but were removed (not sure what happened…). I’ll fix it in the next update.

1 Like

Thanks Jim! Just an additional question, since that’s showing as undefined does that mean that the loop isn’t able to go through and answer all the follow up questions so when the loop if triggered the condition immediately becomes true? So it only passes the loop once? Sorry, still very new to this and I’m currently studying your workflow.

Thanks Jim, now the issue is solved, I guess it might be due to my question given to the agent. I found that if the questions are too short, such as “AI” and then in the following question I say “no other questions”, then the loop has problem haha.
Again thanks for sharing this and inspire me for my biology study.

I get this error with the workflow, the subworkflow just sits on waiting it seems - any ideas how to solve it or debug? Really keen to test this, appreciate you putting it together!

Just to answer this for any future readers - I used a different browser (chrome) and it progressed past this point :slight_smile:

Hey Jude and Jim, not sure if you solve this or not but I think someone else may encounter this. For me, this was one small but incrementally reduced the performance of the research.

It turned out that in the latest version of this amazing workflow, these 2 nodes was a bit different from the old version in “n8n_deepresearch_community_share.json - Google Drive” (link in this post as well)

I replace it and it works perfect now !! Thanks Jim for this workflow

This is awesome! I was able to get everything to work perfect except the form is missing the depth/breadth sliders. Could that be a browser issue on my side?

When I trigger the form, it keeps loading forever and doesn’t go to the next step… Any cue?

I’m using AI agent automation in hidemium app. go to Hidemium to trial perfect automation

@Jim_Le this is a great workflow you created. Thank you so much for sharing with us. I have been testing it in the last few days and noticed some minor issues here and there, but nothing too crazy. Everyone here mentioned those, so overall, it’s an easy fix. Running, for example, 5 times messes it up, and I’m not sure why since it is random. Sometimes, it is related to Notion; sometimes, it is not. It happens more with higher breadth.

By the way, because I don’t have an OpenAI subscription, I switched to Gemini Flash 2.0, and so far, it’s working well, and I am getting the results I want.

One question: Do you think Apify can be switched to a local RAG/scrapper? With the amount I am testing, I am almost running out of the $5 bucks Apify gives you. I have seen RAG/scrappers done in N8N, but I kind of want to know your experience.

Thanks a lot

2 Likes

Hey @chenci_chen welcome to the community!

Thanks for giving this template a try. At higher depth/breath values, there’s quite a bit of load and waiting times due to the amount of data accumulated at this point. I’ve been told many low specced n8n instances are known to struggle so I suggest keep. it to 1 depth and 2 breadth unless you really need to go deeper.

Switching to a general purpose LLM like Gemini flash is fine but I found reasoning models (o1/o3) to be the difference between “deep search” and “deep research”.

Regarding the webscraping, yes feel free to use what works best within your budget. I prefer Apify because of the simplicity and because they have proxies which helps against some public sites which have anti-bot protection and block simple scrapers.

Hi thanks for the reply. I will try the reasoning models!

Any webscaping you have tried that are self hosted? I agree Apify works really well and super easy to setup, but want to explore something long term.

Chen

Great workflow. Could you please ask how much it costs on average per execution?

Hi and thanks for this great Flow! i have the same problem as

Mathieu_Simard

Apr 15

When I trigger the form, it keeps loading forever and doesn’t go to the next step… Any cue?


Furthermore, the flow always remains in the Learning Stage and never goes to the Report Stage, any ideas what could be wrong?

1 Like

Hey @sebru1 Welcome to the community.
From what I can see from your screenshot, I can see 3 items entering the “DeepResearch Learnings” AI node but only one item coming out - which my guess would be that this is where the loop is failing and not completing. In normal n8n behaviour, when a node doesn’t output anything the flow will stop.

I also see you’re using OpenRouter so I leaning towards whatever model you’re using is probably just not able to keep up and is deciding to quit midway (sorry for the simplification!). Of course, I could be dead wrong as well - but next steps would be definitely taking a look at the model outputs.

Unfortunately, I’m not providing general support for this template due to it being intended for advanced users to discuss workflow building techniques. I can wholeheartedly recommend commercially-backed DeepResearch products like Perplexity, Google and Jina etc instead which perform much better!

Hi Jim,

Thanks to this fast response!!!
I will try this.

Do you have an idea, why the Sliders from the question creation don’t work?
I love the look, but I only can see the text Field and n8n is dying after starting the flow, when I change the fields to Tex fields, it works.

Yeah unfortunately, n8n forms don’t support sliders and I hacked it a few times to make them work. The current hack was patched recently in an n8n update which broke the form again.

I will eventually get around to updating the template but in the meantime, convert them to text fields and you should be ok.

Also should probably take this opportunity to clear up a common misunderstanding, the workflow also works without the forms! The forms are just a nice to have - feel free to get rid of them if you don’t really need them.

Please let me know if you get this working. I’m trying to run everything locally