Capturing n8n flows with Observability & Evaluations platforms like Langfuse, Comet Opik, etc

Feature Requests
1

Dear n8n Friends:

We would like n8n to offer easy integration with Observability & Evaluation platforms such as Langfuse and Comet Opik, which enable instrumentation of n8n workflows, be it a subset workflow or end to end.

I think each of these offer OTEL interfaces, which is a common open source standard for telemetry.

Apart from helping n8n users test, debug, and run evaluations on workflows, this critical missing piece would make n8n stand apart from competitor drag & drop builder offerings.

See this separate conversation, and thank you:

2

Langfuse devs are already 100% on board just waiting for someone at n8n to wake up and acknowledge it they would be more than happy to work with n8n

3 Likes
3

100% - need tracing & evals for working with LLMs

4

Hey

I’m part of the team at Comet, thanks for calling us out. We have actively started on an integration between Comet Opik with n8n. You can follow the issue on Github n8n Integration · langfuse · Discussion #4397 · GitHub

Thanks
Vince

1 Like
5

Hi everyone,

Langfuse maintainer here. We are also happy to contribute to this effort. Tracking interest for this integration here: n8n Integration · langfuse · Discussion #4397 · GitHub

I would suggest to use OpenTelemetry to allow for interoperability with different observability and evaluation backends. Thereby, n8n users could configure their OTel endpoint and authentication in the UI (or as an env when selfhosting n8n) and it should just work.

A good read on this: AI Agent Observability - Evolving Standards and Best Practices | OpenTelemetry

Let me know if I can be helpful to figure this out.

7 Likes
6

This is what we need. :sunglasses: