Export workflows execution logs to Datadog

[mubarak]

Describe the problem/error/question

We’re currently running an n8n enterprise trial, and I’m trying to export from all of the workflows’ execution logs, either via log streaming or via the K8s pod logs, which are then sent to Datadog. While I’m able to send a test event via the log streaming settings UI, nothing shows up in the pods’ logs or in Datadog. I’m curious if this is something that can be simply enabled via Helm deployment or if this is something that needs to be configured at the nodes level?

What is the error message (if any)?

No error message, simply no logs are sent via streaming or in the pods.

Please share your workflow

(Select the nodes on your canvas and use the keyboard shortcuts CMD+C/CTRL+C and CMD+V/CTRL+V to copy and paste the workflow.)

Share the output returned by the last node

Information on your n8n setup

• n8n version: 1.113.3
• Database (default: SQLite): Postgres
• n8n EXECUTIONS_PROCESS setting (default: own, main): main
• Running n8n via (Docker, npm, n8n cloud, desktop app): EKS Helm deployment
• Operating system: Linux

[mubarak]

We made a couple of modifications to the log streaming settings to make it work:

1. Append ddtags in the Datadog URL https://http-intake.logs.datadoghq.com/api/v2/logs?ddtags=env:dev,service:n8n

2. Build a Datadog pipeline that maps the above tags to attributes.

   

Hopefully this helps the next person who tries this setup