I need to help of the more experienced, ive made a workflow, with a node of firecrawl, that is scraping\crawling a web, taking the data scraped and inserting the content of the pages into a supabase vector store.
the workflow goes without any errors, but the content isnt getting inserted into the DB.
thanks in advance.
Can you check the output from the firecrawl node?
It should have the data you expected. Otherwise we might need to change the setting with in the node.
Share the setting currently and the screenshot of the node output might be helpful.
Or paste the workflow json in here with code block format.
{
“name”: “Rag agent”,
“nodes”: [
{
"parameters": {
"conditions": {
"options": {
"caseSensitive": true,
"leftValue": "",
"typeValidation": "strict",
"version": 2
},
"conditions": \[
{
"id": "7e37ab5d-9aad-4cc0-9e89-7492803faa49",
"leftValue": "={{ $json\['What action?'\] }}",
"rightValue": "Crawl",
"operator": {
"type": "string",
"operation": "equals",
"name": "filter.operator.equals"
}
}
\],
"combinator": "or"
},
"options": {}
},
"type": "n8n-nodes-base.if",
"typeVersion": 2.2,
"position": \[
-224,
-64
\],
"id": "ee64fc02-509d-4a2c-8faa-b2333f980f72",
"name": "If"
},
{
"parameters": {
"formTitle": "Scrape",
"formDescription": "Choose option and paste a link ",
"formFields": {
"values": \[
{
"fieldLabel": "What action?",
"fieldType": "dropdown",
"fieldOptions": {
"values": \[
{
"option": "Crawl"
},
{
"option": "Scrape"
}
\]
},
"requiredField": true
},
{
"fieldLabel": "Link",
"requiredField": true
}
\]
},
"options": {}
},
"type": "n8n-nodes-base.formTrigger",
"typeVersion": 2.2,
"position": \[
-432,
-64
\],
"id": "5b9c26df-3f88-4d1e-8dce-3dca8dfd5cb3",
"name": "Form",
"webhookId": "e6b8fd83-6cc8-44b7-ac36-b372173cb281",
"retryOnFail": false
},
{
"parameters": {
"operation": "getCrawlStatus",
"crawlId": "={{ $json.id }}",
"requestOptions": {}
},
"type": "@mendable/n8n-nodes-firecrawl.firecrawl",
"typeVersion": 1,
"position": \[
256,
-352
\],
"id": "97360115-73a2-4838-8b41-a075cd47ef07",
"name": "Status",
"credentials": {
"firecrawlApi": {
"id": "3e0ENSQOGzFtL3pa",
"name": "Firecrawl account"
}
}
},
{
"parameters": {
"operation": "crawl",
"url": "={{ $json.Link }}",
"maxDepth": 3,
"limit": 100,
"crawlOptions": {},
"scrapeOptions": {
"options": {
"headers": {}
}
},
"requestOptions": {}
},
"type": "@mendable/n8n-nodes-firecrawl.firecrawl",
"typeVersion": 1,
"position": \[
32,
-352
\],
"id": "93dd2cba-b52d-4d30-a77a-fcf7316450f0",
"name": "Crawl",
"credentials": {
"firecrawlApi": {
"id": "3e0ENSQOGzFtL3pa",
"name": "Firecrawl account"
}
}
},
{
"parameters": {
"operation": "scrape",
"url": "={{ $json.Link }}",
"scrapeOptions": {
"options": {
"headers": {}
}
},
"requestOptions": {}
},
"type": "@mendable/n8n-nodes-firecrawl.firecrawl",
"typeVersion": 1,
"position": \[
32,
96
\],
"id": "b1e0c757-88ca-4bf8-a45b-9b83f571e9e9",
"name": "Scrape",
"credentials": {
"firecrawlApi": {
"id": "3e0ENSQOGzFtL3pa",
"name": "Firecrawl account"
}
}
},
{
"parameters": {
"mode": "insert",
"tableName": {
"\__rl": true,
"value": "documents",
"mode": "list",
"cachedResultName": "documents"
},
"options": {}
},
"type": "@n8n/n8n-nodes-langchain.vectorStoreSupabase",
"typeVersion": 1.3,
"position": \[
704,
-96
\],
"id": "4d2a4493-4704-4773-a6f7-2e18135a36f3",
"name": "Supabase Vector Store",
"credentials": {
"supabaseApi": {
"id": "idW6XmRaV1dUizJZ",
"name": "Supabase account"
}
}
},
{
"parameters": {
"options": {
"dimensions": 1536
}
},
"type": "@n8n/n8n-nodes-langchain.embeddingsOpenAi",
"typeVersion": 1.2,
"position": \[
688,
160
\],
"id": "aba2b2ff-58e2-4907-b2af-1e2bae52160f",
"name": "Embeddings OpenAI",
"credentials": {
"openAiApi": {
"id": "Jjlk7EzW7JDYStDZ",
"name": "OpenAi account"
}
}
},
{
"parameters": {
"textSplittingMode": "custom",
"options": {
"metadata": {
"metadataValues": \[
{
"name": "content",
"value": "={{ $json.data.data.content }}"
},
{
"name": "title",
"value": "={{ $json.data.data.title }}"
}
\]
}
}
},
"type": "@n8n/n8n-nodes-langchain.documentDefaultDataLoader",
"typeVersion": 1.1,
"position": \[
832,
144
\],
"id": "66f08a04-b0b8-4f70-a4b9-925341385e63",
"name": "Default Data Loader"
},
{
"parameters": {
"separator": "12!sawgt!",
"chunkOverlap": 200
},
"type": "@n8n/n8n-nodes-langchain.textSplitterCharacterTextSplitter",
"typeVersion": 1,
"position": \[
896,
288
\],
"id": "842a36af-f99c-43ee-ac0e-0eff7fee6faa",
"name": "Character Text Splitter"
},
{
"parameters": {
"operation": "extract",
"urls": {
"items": \[
{
"url": "={{ $('Form').item.json.Link }}"
}
\]
},
"prompt": "extract everything and make it all readable",
"schema": "={{ $json.data }}{{ $json.data.metadata }}",
"scrapeOptions": {
"options": {
"headers": {}
}
},
"requestOptions": {}
},
"type": "@mendable/n8n-nodes-firecrawl.firecrawl",
"typeVersion": 1,
"position": \[
272,
96
\],
"id": "def82f1b-9e56-4ef9-a27e-b13fc4a6e938",
"name": "Extract Data",
"alwaysOutputData": false,
"credentials": {
"firecrawlApi": {
"id": "3e0ENSQOGzFtL3pa",
"name": "Firecrawl account"
}
}
},
{
"parameters": {
"operation": "getExtractStatus",
"extractId": "={{ $json.id }}",
"requestOptions": {}
},
"type": "@mendable/n8n-nodes-firecrawl.firecrawl",
"typeVersion": 1,
"position": \[
480,
96
\],
"id": "eb2bed0c-dc6e-4dab-bee6-29b9d1737540",
"name": "Get Extract Status",
"credentials": {
"firecrawlApi": {
"id": "3e0ENSQOGzFtL3pa",
"name": "Firecrawl account"
}
}
}
],
“pinData”: {
"Form": \[
{
"json": {
"What action?": "Scrape",
"Link": "https://quotes.toscrape.com/",
"submittedAt": "2025-08-15T10:33:31.135+03:00",
"formMode": "test"
}
}
\]
},
“connections”: {
"If": {
"main": \[
\[
{
"node": "Crawl",
"type": "main",
"index": 0
}
\],
\[
{
"node": "Scrape",
"type": "main",
"index": 0
}
\]
\]
},
"Form": {
"main": \[
\[
{
"node": "If",
"type": "main",
"index": 0
}
\]
\]
},
"Status": {
"main": \[
\[\]
\]
},
"Crawl": {
"main": \[
\[
{
"node": "Status",
"type": "main",
"index": 0
}
\]
\]
},
"Embeddings OpenAI": {
"ai_embedding": \[
\[
{
"node": "Supabase Vector Store",
"type": "ai_embedding",
"index": 0
}
\]
\]
},
"Default Data Loader": {
"ai_document": \[
\[
{
"node": "Supabase Vector Store",
"type": "ai_document",
"index": 0
}
\]
\]
},
"Character Text Splitter": {
"ai_textSplitter": \[
\[
{
"node": "Default Data Loader",
"type": "ai_textSplitter",
"index": 0
}
\]
\]
},
"Scrape": {
"main": \[
\[
{
"node": "Extract Data",
"type": "main",
"index": 0
}
\]
\]
},
"Extract Data": {
"main": \[
\[
{
"node": "Get Extract Status",
"type": "main",
"index": 0
}
\]
\]
},
"Get Extract Status": {
"main": \[
\[
{
"node": "Supabase Vector Store",
"type": "main",
"index": 0
}
\]
\]
},
"Supabase Vector Store": {
"main": \[
\[\]
\]
}
},
“active”: false,
“settings”: {
"executionOrder": "v1"
},
“versionId”: “3234f891-c914-48de-acd2-be5e1c03e3da”,
“meta”: {
"templateCredsSetupCompleted": true,
"instanceId": "1cfbbc4eef506c651e99551441c68c77b9b0151d33090dd46c28c60749c7d3f3"
},
“id”: “aj62mbOMujEF6qfZ”,
“tags”:
}
```
this is the json thanks.
{
“name”: “Rag agent”,
“nodes”: [
{
"parameters": {
"conditions": {
"options": {
"caseSensitive": true,
"leftValue": "",
"typeValidation": "strict",
"version": 2
},
"conditions": \[
{
"id": "7e37ab5d-9aad-4cc0-9e89-7492803faa49",
"leftValue": "={{ $json\['What action?'\] }}",
"rightValue": "Crawl",
"operator": {
"type": "string",
"operation": "equals",
"name": "filter.operator.equals"
}
}
\],
"combinator": "or"
},
"options": {}
},
"type": "n8n-nodes-base.if",
"typeVersion": 2.2,
"position": \[
-224,
-64
\],
"id": "ee64fc02-509d-4a2c-8faa-b2333f980f72",
"name": "If"
},
{
"parameters": {
"formTitle": "Scrape",
"formDescription": "Choose option and paste a link ",
"formFields": {
"values": \[
{
"fieldLabel": "What action?",
"fieldType": "dropdown",
"fieldOptions": {
"values": \[
{
"option": "Crawl"
},
{
"option": "Scrape"
}
\]
},
"requiredField": true
},
{
"fieldLabel": "Link",
"requiredField": true
}
\]
},
"options": {}
},
"type": "n8n-nodes-base.formTrigger",
"typeVersion": 2.2,
"position": \[
-432,
-64
\],
"id": "5b9c26df-3f88-4d1e-8dce-3dca8dfd5cb3",
"name": "Form",
"webhookId": "e6b8fd83-6cc8-44b7-ac36-b372173cb281",
"retryOnFail": false
},
{
"parameters": {
"operation": "getCrawlStatus",
"crawlId": "={{ $json.id }}",
"requestOptions": {}
},
"type": "@mendable/n8n-nodes-firecrawl.firecrawl",
"typeVersion": 1,
"position": \[
256,
-352
\],
"id": "97360115-73a2-4838-8b41-a075cd47ef07",
"name": "Status",
"credentials": {
"firecrawlApi": {
"id": "3e0ENSQOGzFtL3pa",
"name": "Firecrawl account"
}
}
},
{
"parameters": {
"operation": "crawl",
"url": "={{ $json.Link }}",
"maxDepth": 3,
"limit": 100,
"crawlOptions": {},
"scrapeOptions": {
"options": {
"headers": {}
}
},
"requestOptions": {}
},
"type": "@mendable/n8n-nodes-firecrawl.firecrawl",
"typeVersion": 1,
"position": \[
32,
-352
\],
"id": "93dd2cba-b52d-4d30-a77a-fcf7316450f0",
"name": "Crawl",
"credentials": {
"firecrawlApi": {
"id": "3e0ENSQOGzFtL3pa",
"name": "Firecrawl account"
}
}
},
{
"parameters": {
"operation": "scrape",
"url": "={{ $json.Link }}",
"scrapeOptions": {
"options": {
"headers": {}
}
},
"requestOptions": {}
},
"type": "@mendable/n8n-nodes-firecrawl.firecrawl",
"typeVersion": 1,
"position": \[
32,
96
\],
"id": "b1e0c757-88ca-4bf8-a45b-9b83f571e9e9",
"name": "Scrape",
"credentials": {
"firecrawlApi": {
"id": "3e0ENSQOGzFtL3pa",
"name": "Firecrawl account"
}
}
},
{
"parameters": {
"mode": "insert",
"tableName": {
"\__rl": true,
"value": "documents",
"mode": "list",
"cachedResultName": "documents"
},
"options": {}
},
"type": "@n8n/n8n-nodes-langchain.vectorStoreSupabase",
"typeVersion": 1.3,
"position": \[
704,
-96
\],
"id": "4d2a4493-4704-4773-a6f7-2e18135a36f3",
"name": "Supabase Vector Store",
"credentials": {
"supabaseApi": {
"id": "idW6XmRaV1dUizJZ",
"name": "Supabase account"
}
}
},
{
"parameters": {
"options": {
"dimensions": 1536
}
},
"type": "@n8n/n8n-nodes-langchain.embeddingsOpenAi",
"typeVersion": 1.2,
"position": \[
688,
160
\],
"id": "aba2b2ff-58e2-4907-b2af-1e2bae52160f",
"name": "Embeddings OpenAI",
"credentials": {
"openAiApi": {
"id": "Jjlk7EzW7JDYStDZ",
"name": "OpenAi account"
}
}
},
{
"parameters": {
"textSplittingMode": "custom",
"options": {
"metadata": {
"metadataValues": \[
{
"name": "content",
"value": "={{ $json.data.data.content }}"
},
{
"name": "title",
"value": "={{ $json.data.data.title }}"
}
\]
}
}
},
"type": "@n8n/n8n-nodes-langchain.documentDefaultDataLoader",
"typeVersion": 1.1,
"position": \[
832,
144
\],
"id": "66f08a04-b0b8-4f70-a4b9-925341385e63",
"name": "Default Data Loader"
},
{
"parameters": {
"separator": "12!sawgt!",
"chunkOverlap": 200
},
"type": "@n8n/n8n-nodes-langchain.textSplitterCharacterTextSplitter",
"typeVersion": 1,
"position": \[
896,
288
\],
"id": "842a36af-f99c-43ee-ac0e-0eff7fee6faa",
"name": "Character Text Splitter"
},
{
"parameters": {
"operation": "extract",
"urls": {
"items": \[
{
"url": "={{ $('Form').item.json.Link }}"
}
\]
},
"prompt": "extract everything and make it all readable",
"schema": "={{ $json.data }}{{ $json.data.metadata }}",
"scrapeOptions": {
"options": {
"headers": {}
}
},
"requestOptions": {}
},
"type": "@mendable/n8n-nodes-firecrawl.firecrawl",
"typeVersion": 1,
"position": \[
272,
96
\],
"id": "def82f1b-9e56-4ef9-a27e-b13fc4a6e938",
"name": "Extract Data",
"alwaysOutputData": false,
"credentials": {
"firecrawlApi": {
"id": "3e0ENSQOGzFtL3pa",
"name": "Firecrawl account"
}
}
},
{
"parameters": {
"operation": "getExtractStatus",
"extractId": "={{ $json.id }}",
"requestOptions": {}
},
"type": "@mendable/n8n-nodes-firecrawl.firecrawl",
"typeVersion": 1,
"position": \[
480,
96
\],
"id": "eb2bed0c-dc6e-4dab-bee6-29b9d1737540",
"name": "Get Extract Status",
"credentials": {
"firecrawlApi": {
"id": "3e0ENSQOGzFtL3pa",
"name": "Firecrawl account"
}
}
}
],
“pinData”: {
"Form": \[
{
"json": {
"What action?": "Scrape",
"Link": "https://quotes.toscrape.com/",
"submittedAt": "2025-08-15T10:33:31.135+03:00",
"formMode": "test"
}
}
\]
},
“connections”: {
"If": {
"main": \[
\[
{
"node": "Crawl",
"type": "main",
"index": 0
}
\],
\[
{
"node": "Scrape",
"type": "main",
"index": 0
}
\]
\]
},
"Form": {
"main": \[
\[
{
"node": "If",
"type": "main",
"index": 0
}
\]
\]
},
"Status": {
"main": \[
\[\]
\]
},
"Crawl": {
"main": \[
\[
{
"node": "Status",
"type": "main",
"index": 0
}
\]
\]
},
"Embeddings OpenAI": {
"ai_embedding": \[
\[
{
"node": "Supabase Vector Store",
"type": "ai_embedding",
"index": 0
}
\]
\]
},
"Default Data Loader": {
"ai_document": \[
\[
{
"node": "Supabase Vector Store",
"type": "ai_document",
"index": 0
}
\]
\]
},
"Character Text Splitter": {
"ai_textSplitter": \[
\[
{
"node": "Default Data Loader",
"type": "ai_textSplitter",
"index": 0
}
\]
\]
},
"Scrape": {
"main": \[
\[
{
"node": "Extract Data",
"type": "main",
"index": 0
}
\]
\]
},
"Extract Data": {
"main": \[
\[
{
"node": "Get Extract Status",
"type": "main",
"index": 0
}
\]
\]
},
"Get Extract Status": {
"main": \[
\[
{
"node": "Supabase Vector Store",
"type": "main",
"index": 0
}
\]
\]
},
"Supabase Vector Store": {
"main": \[
\[\]
\]
}
},
“active”: false,
“settings”: {
"executionOrder": "v1"
},
“versionId”: “3234f891-c914-48de-acd2-be5e1c03e3da”,
“meta”: {
"templateCredsSetupCompleted": true,
"instanceId": "1cfbbc4eef506c651e99551441c68c77b9b0151d33090dd46c28c60749c7d3f3"
},
“id”: “aj62mbOMujEF6qfZ”,
“tags”:
}
So, @FalseHyro what’s up with your workflow issue? You said it’s not inserting data into the Supabase DB, right? Can you tell me more about your setup and what you’ve tried so far? Maybe I can help you figure out what’s going on!
The problem is the extract data is something you need to wait for.
We need to check the status is completed or not. If not, we need to give it more time to process. Maybe more than 10 or 30 seconds.
Already add the wait loop for you. You can have a try.
The original workflow will only get empty data from extract and send nothing to Supabase
Ive tried changing the data base settings, the issue is im getting the data extracted, and in the output of vector store im seeing the output i want, but it doesnt go up to the db itself.
for some reason it deletes my json when i send it here
i know, i ignored the wait for now for tests, i just manually run it 30 sec after and it says its complete. i can see the output goes out, but still nothing uploads to supa
This sounds like it might be an issue with the database node configuration or the data format. Can you tell me more about your database node setup and the JSON data you’re trying to send? Maybe there’s something specific that’s causing the issue.
Also, have you tried checking the database node logs or error messages to see if there’s any hint about what’s going wrong? Sometimes, the logs can give us a clue about what’s happening.
Let’s take a closer look and see if we can figure out what’s going on!
I really appreciate the help!
ive trying formating, i couldnt find any problems with it.
theres not error in the logs of supa db, it shows theres a connection authorized, but noting passes
this been bothering me for 3 days now, i cant find the solution, maybe theres somthing wrong with the table ?
ive used the code from the n8n supabase doc
i can see the items have passed too, but nothing goes to the db itself.
any chance maybe the db itself is broken ?
@FalseHyro did you get a solution to this? if yes pls write the solutions here to help others.
