Hello n8n Community,
I’m reaching out for assistance with a workflow that transfers Mailchimp campaign click data (email, first name, last name, clicked URL, campaign name) to a Google Sheet before pushing to HubSpot in batches.
The Issue: When processing campaigns with high click volumes, our workflow consistently stops capturing data at approximately 1400 unique recipients, despite the actual click count being higher (e.g., 2400 unique clicks). This occurs specifically during the transfer to Google Sheets.
What We’ve Tried:
-
Implemented batch processing with various sizes
-
Increased delays between API calls (30s+)
-
Added IF nodes for error handling
-
Created sub-workflows for high-volume campaigns
-
Applied multiple AI-generated solutions
Context:
-
Typical campaigns: 4-5 links, 800-1000 unique clicks per campaign
-
High-volume campaigns: Up to 2500 unique clicks
-
Mailchimp has confirmed we’re within API rate limits
-
Direct HubSpot transfer also stops mid-process (~6000 total records) despite being within HubSpot limits
Key Question: What could be causing this consistent data truncation at ~1400 records during the Mailchimp to Google Sheets transfer? We suspect the issue lies in how we’re gathering the complete unique click data from Mailchimp’s API.
We’re relatively new to the n8n community and apologize if we haven’t shared our workflow in the optimal format. We’re happy to provide additional details, workflow exports, or clarifications as needed.
Has anyone encountered similar issues with large dataset transfers from Mailchimp? Are there alternative approaches we should consider?
Thank you for any insights or suggestions you can provide.
</>{“nodes”: [{“parameters”: {“rule”: {“interval”: [{“triggerAtHour”: 9,“triggerAtMinute”: 40}]}},“type”: “n8n-nodes-base.scheduleTrigger”,“typeVersion”: 1.2,“position”: [-4144,240],“id”: “7417e6ef-ee7a-4dbd-8a68-17ce65aceac6”,“name”: “Schedule Trigger1”},{“parameters”: {“resource”: “campaign”,“returnAll”: true,“options”: {“beforeSendTime”: “2025-07-29T00:00:00”,“sinceSendTime”: “2025-07-28T20:00:00”,“status”: “sent”}},“type”: “n8n-nodes-base.mailchimp”,“typeVersion”: 1,“position”: [-3936,240],“id”: “fe04bd8f-300c-4aec-a812-c6fe14d1498c”,“name”: “Get many campaigns1”,“credentials”: {“mailchimpApi”: {“id”: “tnVerLmGcLuGKnDk”,“name”: “Mailchimp account”}}},{“parameters”: {“url”: “=https://us18.api.mailchimp.com/3.0/reports/{{$json.id }}/click-details”,“authentication”: “predefinedCredentialType”,“nodeCredentialType”: “mailchimpApi”,“sendQuery”: true,“queryParameters”: {“parameters”: [{“name”: “=count”,“value”: “10000”}]},“options”: {}},“type”: “n8n-nodes-base.httpRequest”,“typeVersion”: 4.2,“position”: [-3264,96],“id”: “287d7053-6599-44cb-847c-d0933962ad3d”,“name”: “HTTP Request2”,“credentials”: {“mailchimpApi”: {“id”: “tnVerLmGcLuGKnDk”,“name”: “Mailchimp account”}}},{“parameters”: {“options”: {}},“type”: “n8n-nodes-base.splitInBatches”,“typeVersion”: 3,“position”: [-3488,240],“id”: “807374bb-913f-4494-92c5-fa60664936a4”,“name”: “Loop Over Items4”},{“parameters”: {},“type”: “n8n-nodes-base.noOp”,“name”: “Replace Me4”,“typeVersion”: 1,“position”: [-3264,288],“id”: “94217004-0e9d-406b-ac22-43fdba6449cb”},{“parameters”: {“options”: {}},“type”: “n8n-nodes-base.splitInBatches”,“typeVersion”: 3,“position”: [-2624,96],“id”: “58154639-c413-468a-b171-df5bd38e52ed”,“name”: “Loop Over Items5”},{“parameters”: {},“type”: “n8n-nodes-base.noOp”,“name”: “Replace Me5”,“typeVersion”: 1,“position”: [-2400,176],“id”: “70cacebb-c6e0-4fa1-bf05-8e302a988452”},{“parameters”: {“url”: “=https://us18.api.mailchimp.com/3.0/reports/{{ $json.campaign_id }}/click-details/{{ $json.urls_clicked.id }}/members”,“authentication”: “predefinedCredentialType”,“nodeCredentialType”: “mailchimpApi”,“sendQuery”: true,“queryParameters”: {“parameters”: [{“name”: “count”,“value”: “10000”}]},“options”: {“pagination”: {“pagination”: {“parameters”: {“parameters”: [{“name”: “offset”,“value”: “={{ $response.offset || 0 }}”},{“name”: “count”,“value”: “10000”}]},“paginationCompleteWhen”: “other”,“completeExpression”: “={{ !$response.members || $response.members.length === 0 }}”,“requestInterval”: 12000}}}},“type”: “n8n-nodes-base.httpRequest”,“typeVersion”: 4.2,“position”: [-1952,-32],“id”: “f80dce00-8dd5-49f7-bd36-14fdb770e04e”,“name”: “HTTP Request4”,“retryOnFail”: true,“maxTries”: 5,“waitBetweenTries”: 5000,“alwaysOutputData”: true,“credentials”: {“mailchimpApi”: {“id”: “tnVerLmGcLuGKnDk”,“name”: “Mailchimp account”}}},{“parameters”: {“batchSize”: 50,“options”: {}},“type”: “n8n-nodes-base.splitInBatches”,“typeVersion”: 3,“position”: [-160,-32],“id”: “118a22a6-a9bf-4592-87a8-bb9d3840dd19”,“name”: “Loop Over Items6”},{“parameters”: {},“type”: “n8n-nodes-base.noOp”,“name”: “Replace Me6”,“typeVersion”: 1,“position”: [304,144],“id”: “6c4056a0-fc4e-4a4a-9bce-4cd0c32f2036”},{“parameters”: {“conditions”: {“options”: {“caseSensitive”: true,“leftValue”: “”,“typeValidation”: “strict”,“version”: 2},“conditions”: [{“id”: “a9c47d9d-bc86-457c-8ccd-b530a4f2f23a”,“leftValue”: “={{ $json.settings.title }}”,“rightValue”: “Test”,“operator”: {“type”: “string”,“operation”: “notContains”}}],“combinator”: “and”},“options”: {}},“type”: “n8n-nodes-base.filter”,“typeVersion”: 2.2,“position”: [-3712,240],“id”: “d1eb0780-5734-4319-a8b3-a019ffaf99d1”,“name”: “Filter3”},{“parameters”: {“fieldToSplitOut”: “urls_clicked”,“include”: “allOtherFields”,“options”: {}},“type”: “n8n-nodes-base.splitOut”,“typeVersion”: 1,“position”: [-2400,-32],“id”: “28f5ff1f-1088-4282-965d-e8a4b96c228d”,“name”: “Split Out2”},{“parameters”: {“amount”: 30},“type”: “n8n-nodes-base.wait”,“typeVersion”: 1.1,“position”: [80,80],“id”: “25b32f91-a7e2-4aac-86dd-86ffa067abd2”,“name”: “Wait4”,“webhookId”: “3c36e7e3-b42f-4ca3-b329-9fe6e3f18139”},{“parameters”: {“conditions”: {“options”: {“caseSensitive”: true,“leftValue”: “”,“typeValidation”: “strict”,“version”: 2},“conditions”: [{“id”: “43a64a99-3ad8-490c-a9fb-e8de966fe91b”,“leftValue”: “={{ $json.urls_clicked.url }}”,“rightValue”: “capital-raising-company”,“operator”: {“type”: “string”,“operation”: “contains”}},{“id”: “33e0d02d-3a2b-4dd7-abcb-f0b7c9109d9d”,“leftValue”: “={{ $json.urls_clicked.url }}”,“rightValue”: “trading-company”,“operator”: {“type”: “string”,“operation”: “contains”}}],“combinator”: “or”},“options”: {}},“type”: “n8n-nodes-base.filter”,“typeVersion”: 2.2,“position”: [-2176,-32],“id”: “b4b98bc7-4805-4a0f-8ef8-bad69262e47a”,“name”: “Filter4”},{“parameters”: {“fieldToSplitOut”: “members”,“include”: “allOtherFields”,“options”: {}},“type”: “n8n-nodes-base.splitOut”,“typeVersion”: 1,“position”: [80,-128],“id”: “b2475e9c-aff7-411c-ba06-b0fca520c87b”,“name”: “Split Out3”,“retryOnFail”: true,“maxTries”: 5,“alwaysOutputData”: true},{“parameters”: {“conditions”: {“options”: {“caseSensitive”: true,“leftValue”: “”,“typeValidation”: “strict”,“version”: 2},“conditions”: [{“id”: “83cdac19-d1cd-4b29-8682-87ba779aa605”,“leftValue”: “={{ $json.data }}”,“rightValue”: “Too Many Requests”,“operator”: {“type”: “string”,“operation”: “contains”}}],“combinator”: “and”},“options”: {}},“type”: “n8n-nodes-base.if”,“typeVersion”: 2.2,“position”: [-1728,-32],“id”: “4b9462e6-9fb1-4320-9ded-60a71d61241b”,“name”: “If4”},{“parameters”: {“conditions”: {“options”: {“caseSensitive”: true,“leftValue”: “”,“typeValidation”: “strict”,“version”: 2},“conditions”: [{“id”: “8fce0eaa-2f10-4a65-b3e6-14a5e489d3ca”,“leftValue”: “={{ $json.error }}”,“rightValue”: “”,“operator”: {“type”: “string”,“operation”: “empty”,“singleValue”: true}}],“combinator”: “and”},“options”: {}},“type”: “n8n-nodes-base.if”,“typeVersion”: 2.2,“position”: [-608,-32],“id”: “98f6db52-d8fd-49b9-b125-1e76d4860cc8”,“name”: “If5”,“retryOnFail”: true},{“parameters”: {“amount”: 30},“type”: “n8n-nodes-base.wait”,“typeVersion”: 1.1,“position”: [-384,-32],“id”: “411ed984-2c35-4eaf-b4d9-b49265f11170”,“name”: “Wait5”,“webhookId”: “2185a287-462b-4440-931a-0d3281641611”},{“parameters”: {“amount”: 60},“type”: “n8n-nodes-base.wait”,“typeVersion”: 1.1,“position”: [-1488,-208],“id”: “31377c97-a4e1-4440-babd-a7e5df687aa5”,“name”: “Wait6”,“webhookId”: “436531c7-dd3f-4d8b-a504-4aee97706c93”},{“parameters”: {},“type”: “n8n-nodes-base.merge”,“typeVersion”: 3.2,“position”: [-800,-32],“id”: “e023f605-a515-4fa9-be7e-726fdf368a66”,“name”: “Merge1”},{“parameters”: {“batchSize”: 100,“options”: {}},“type”: “n8n-nodes-base.splitInBatches”,“typeVersion”: 3,“position”: [592,-176],“id”: “4aa392ed-2626-4838-a7c4-4a3d2763bb08”,“name”: “Loop Over Items7”},{“parameters”: {},“type”: “n8n-nodes-base.noOp”,“name”: “Replace Me7”,“typeVersion”: 1,“position”: [816,-208],“id”: “1d84c3da-f7d6-4c89-852c-ad9f745683e6”},{“parameters”: {},“type”: “n8n-nodes-base.wait”,“typeVersion”: 1.1,“position”: [1024,-208],“id”: “26d5a83f-816d-4bfb-8222-1df391f6f9cc”,“name”: “Wait7”,“webhookId”: “c58c958e-d161-4acc-b590-ae6642ee9ff0”},{“parameters”: {“url”: “=https://us18.api.mailchimp.com/3.0/reports/{{ $(‘Filter4’).item.json.campaign_id }}/click-details/{{ $(‘Filter4’).item.json.urls_clicked.id }}/members”,“authentication”: “predefinedCredentialType”,“nodeCredentialType”: “mailchimpApi”,“sendQuery”: true,“queryParameters”: {“parameters”: [{“name”: “count”,“value”: “10000”}]},“options”: {“pagination”: {“pagination”: {“parameters”: {“parameters”: [{“name”: “offset”,“value”: “={{ $response.offset || 0 }}”},{“name”: “count”,“value”: “10000”}]},“paginationCompleteWhen”: “other”,“completeExpression”: “={{ !$response.members || $response.members.length === 0 }}”,“requestInterval”: 20000}}}},“type”: “n8n-nodes-base.httpRequest”,“typeVersion”: 4.2,“position”: [-1264,-208],“id”: “ff4e0f3f-2c79-4082-9019-98549469d481”,“name”: “HTTP Request5”,“retryOnFail”: true,“credentials”: {“mailchimpApi”: {“id”: “tnVerLmGcLuGKnDk”,“name”: “Mailchimp account”}}},{“parameters”: {“conditions”: {“options”: {“caseSensitive”: true,“leftValue”: “”,“typeValidation”: “strict”,“version”: 2},“conditions”: [{“id”: “83cdac19-d1cd-4b29-8682-87ba779aa605”,“leftValue”: “={{ $json.data }}”,“rightValue”: “Too Many Requests”,“operator”: {“type”: “string”,“operation”: “contains”}}],“combinator”: “and”},“options”: {}},“type”: “n8n-nodes-base.if”,“typeVersion”: 2.2,“position”: [-1040,-208],“id”: “e4cb349f-967f-499b-8bfc-0965ad8ce78d”,“name”: “If6”,“retryOnFail”: true,“waitBetweenTries”: 5000,“alwaysOutputData”: true},{“parameters”: {“conditions”: {“options”: {“caseSensitive”: true,“leftValue”: “”,“typeValidation”: “strict”,“version”: 2},“conditions”: [{“id”: “e1d96c71-71df-4646-a1a8-05b0a15040c1”,“leftValue”: “={{ $(‘Filter4’).item.json.urls_clicked.url }}”,“rightValue”: “”,“operator”: {“type”: “string”,“operation”: “exists”,“singleValue”: true}},{“id”: “3a5fa8b2-73fe-40cc-af2b-91d7ce105b23”,“leftValue”: “={{ $(‘Filter4’).item.json.urls_clicked.url }}”,“rightValue”: “”,“operator”: {“type”: “string”,“operation”: “notEmpty”,“singleValue”: true}}],“combinator”: “and”},“options”: {}},“type”: “n8n-nodes-base.filter”,“typeVersion”: 2.2,“position”: [288,-128],“id”: “44617528-9bba-43dc-b8b7-16f5597acdee”,“name”: “Filter5”},{“parameters”: {“authentication”: “serviceAccount”,“operation”: “append”,“documentId”: {“__rl”: true,“value”: “1QBC7wcb8Qd0bv4KRuaibEeF029Vf_U_V8YUpPMAHmq4”,“mode”: “list”,“cachedResultName”: “test mailchimp sheet”,“cachedResultUrl”: “},“sheetName”: {“__rl”: true,“value”: 1423402638,“mode”: “list”,“cachedResultName”: “23rd_Aug Testing”,“cachedResultUrl”: “},“columns”: {“mappingMode”: “defineBelow”,“value”: {“Email address”: “={{ $json.members.email_address }}”,“Campaign”: “={{ $(‘Get many campaigns1’).item.json.settings.title }}”,“URL”: “={{ $(‘Filter4’).item.json.urls_clicked.url }}”,“First Name”: “={{ $json.members.merge_fields.FNAME }}”,“Last Name”: “={{ $json.members.merge_fields.LNAME }}”},“matchingColumns”: ,“schema”: [{“id”: “Campaign”,“displayName”: “Campaign”,“required”: false,“defaultMatch”: false,“display”: true,“type”: “string”,“canBeUsedToMatch”: true},{“id”: “URL”,“displayName”: “URL”,“required”: false,“defaultMatch”: false,“display”: true,“type”: “string”,“canBeUsedToMatch”: true},{“id”: “Email address”,“displayName”: “Email address”,“required”: false,“defaultMatch”: false,“display”: true,“type”: “string”,“canBeUsedToMatch”: true},{“id”: “First Name”,“displayName”: “First Name”,“required”: false,“defaultMatch”: false,“display”: true,“type”: “string”,“canBeUsedToMatch”: true,“removed”: false},{“id”: “Last Name”,“displayName”: “Last Name”,“required”: false,“defaultMatch”: false,“display”: true,“type”: “string”,“canBeUsedToMatch”: true,“removed”: false}],“attemptToConvertTypes”: false,“convertFieldsToString”: false},“options”: {}},“type”: “n8n-nodes-base.googleSheets”,“typeVersion”: 4.7,“position”: [1440,-144],“id”: “f21cc746-2118-47a7-8f42-9ddf3734e125”,“name”: “Append row in sheet1”,“credentials”: {“googleApi”: {“id”: “VMFKurkIhoAHYJ25”,“name”: “Google Service Account account”}}},{“parameters”: {“amount”: 30},“type”: “n8n-nodes-base.wait”,“typeVersion”: 1.1,“position”: [-784,-304],“id”: “4860b621-0c3d-40fd-8748-f01a884287ec”,“name”: “Wait8”,“webhookId”: “6f40905e-2b05-4c71-b03b-a7c2f3d2a42e”},{“parameters”: {“url”: “=https://us18.api.mailchimp.com/3.0/reports/{{ $(‘Filter4’).item.json.campaign_id }}/click-details/{{ $(‘Filter4’).item.json.urls_clicked.id }}/members”,“authentication”: “predefinedCredentialType”,“nodeCredentialType”: “mailchimpApi”,“sendQuery”: true,“queryParameters”: {“parameters”: [{“name”: “count”,“value”: “1000”}]},“options”: {“pagination”: {“pagination”: {“parameters”: {“parameters”: [{“name”: “offset”,“value”: “={{ $response.offset || 0 }}”},{“name”: “count”,“value”: “1000”}]},“paginationCompleteWhen”: “other”,“completeExpression”: “={{ !$response.members || $response.members.length === 0 }}”,“requestInterval”: 30000}}}},“type”: “n8n-nodes-base.httpRequest”,“typeVersion”: 4.2,“position”: [-544,-304],“id”: “866ccbfc-b23e-4264-9e18-477a1b90369f”,“name”: “HTTP Request6”,“retryOnFail”: true,“credentials”: {“mailchimpApi”: {“id”: “tnVerLmGcLuGKnDk”,“name”: “Mailchimp account”}}},{“parameters”: {“conditions”: {“options”: {“caseSensitive”: true,“leftValue”: “”,“typeValidation”: “strict”,“version”: 2},“conditions”: [{“id”: “83cdac19-d1cd-4b29-8682-87ba779aa605”,“leftValue”: “={{ $json.data }}”,“rightValue”: “Too Many Requests”,“operator”: {“type”: “string”,“operation”: “contains”}}],“combinator”: “and”},“options”: {}},“type”: “n8n-nodes-base.if”,“typeVersion”: 2.2,“position”: [-272,-304],“id”: “4f43b00f-6e6e-4078-99a8-a88170d3b03f”,“name”: “If8”,“retryOnFail”: true,“waitBetweenTries”: 5000,“alwaysOutputData”: true}],“connections”: {“Schedule Trigger1”: {“main”: [[{“node”: “Get many campaigns1”,“type”: “main”,“index”: 0}]]},“Get many campaigns1”: {“main”: [[{“node”: “Filter3”,“type”: “main”,“index”: 0}]]},“HTTP Request2”: {“main”: [[{“node”: “Loop Over Items5”,“type”: “main”,“index”: 0}]]},“Loop Over Items4”: {“main”: [[{“node”: “HTTP Request2”,“type”: “main”,“index”: 0}],[{“node”: “Replace Me4”,“type”: “main”,“index”: 0}]]},“Replace Me4”: {“main”: [[{“node”: “Loop Over Items4”,“type”: “main”,“index”: 0}]]},“Loop Over Items5”: {“main”: [[{“node”: “Split Out2”,“type”: “main”,“index”: 0}],[{“node”: “Replace Me5”,“type”: “main”,“index”: 0}]]},“Replace Me5”: {“main”: [[{“node”: “Loop Over Items5”,“type”: “main”,“index”: 0}]]},“HTTP Request4”: {“main”: [[{“node”: “If4”,“type”: “main”,“index”: 0}]]},“Loop Over Items6”: {“main”: [[{“node”: “Split Out3”,“type”: “main”,“index”: 0}],[{“node”: “Wait4”,“type”: “main”,“index”: 0}]]},“Replace Me6”: {“main”: [[{“node”: “Loop Over Items6”,“type”: “main”,“index”: 0}]]},“Filter3”: {“main”: [[{“node”: “Loop Over Items4”,“type”: “main”,“index”: 0}]]},“Split Out2”: {“main”: [[{“node”: “Filter4”,“type”: “main”,“index”: 0}]]},“Wait4”: {“main”: [[{“node”: “Replace Me6”,“type”: “main”,“index”: 0}]]},“Filter4”: {“main”: [[{“node”: “HTTP Request4”,“type”: “main”,“index”: 0}]]},“Split Out3”: {“main”: [[{“node”: “Filter5”,“type”: “main”,“index”: 0}]]},“If4”: {“main”: [[{“node”: “Wait6”,“type”: “main”,“index”: 0}],[{“node”: “Merge1”,“type”: “main”,“index”: 1}]]},“If5”: {“main”: [[{“node”: “Wait5”,“type”: “main”,“index”: 0}]]},“Wait5”: {“main”: [[{“node”: “Loop Over Items6”,“type”: “main”,“index”: 0}]]},“Wait6”: {“main”: [[{“node”: “HTTP Request5”,“type”: “main”,“index”: 0}]]},“Merge1”: {“main”: [[{“node”: “If5”,“type”: “main”,“index”: 0}]]},“Loop Over Items7”: {“main”: [,[{“node”: “Replace Me7”,“type”: “main”,“index”: 0}]]},“Replace Me7”: {“main”: [[{“node”: “Wait7”,“type”: “main”,“index”: 0}]]},“Wait7”: {“main”: [[{“node”: “Append row in sheet1”,“type”: “main”,“index”: 0}]]},“HTTP Request5”: {“main”: [[{“node”: “If6”,“type”: “main”,“index”: 0}]]},“If6”: {“main”: [[{“node”: “Wait8”,“type”: “main”,“index”: 0}],[{“node”: “Merge1”,“type”: “main”,“index”: 0}]]},“Filter5”: {“main”: [[{“node”: “Loop Over Items7”,“type”: “main”,“index”: 0}]]},“Append row in sheet1”: {“main”: [[{“node”: “Loop Over Items7”,“type”: “main”,“index”: 0}]]},“Wait8”: {“main”: [[{“node”: “HTTP Request6”,“type”: “main”,“index”: 0}]]},“HTTP Request6”: {“main”: [[{“node”: “If8”,“type”: “main”,“index”: 0}]]},“If8”: {“main”: [,[{“node”: “Merge1”,“type”: “main”,“index”: 0}]]}},“pinData”: {},“meta”: {“instanceId”: “b6956ec3a67c063e4893cd16585bc4f83ffe9762da8be4c5d011af4eaa4058c3”}}
