One thing I’m currently facing is I’d like to listen for new files added to a Microsoft Sharepoint folder and insert them into a Pinecone Vector Database. I’m building a RAG Chatbot by the way. I’m following the n8n template “rag chatbot for company documents using google drive and gemini”. The thing is, n8n has a Trigger for “new file created” or “file updated” for Google Drive, but for my workflow, I want to listen to Sharepoint and Sharepoint does not have a trigger for those in n8n.
I thought about downloading all files every time the workflow runs but this might add duplicate data to the Vector Database that had already been added before.
I thought about using a webhook to listen to Sharepoint via Microsoft Graph API but I was told this is a complex step and my colleague did not recommend I do that in n8n.
I also thought about Hashing to check for if a file had already been added to the database before.
Do you have any ideas for how I could solve this?