Impossible to use Evaluations if I don't pay?

Questions
1

Describe the problem/error/question

I am trying to use Evaluation to test the output of my agent. I already successfully played with evaluation metrics. Everything went well until I tried to use it again today.

When I go to “evaluation” tab I get the message

Limit reached. Your plan includes custom metrics for one workflow only. Upgrade for unlimited use or delete the workflow with existing evaluation runs.

From there, it’s possible for me to run the evaluation, but impossible to see the results in the tab. I always get the message above and cannot see anything. I tried to archive my previous workflow since I was just playing with the feature but nothing changes.

From my understanding, I need to get an enterprise plan but I am just self-hosting it and I would really need this feature but I cannot spend that kind of money.

My question: is this feature totally locked up behind the highest plan (not mentioned in the documentation or pricing page btw) or is there something I am missing ?

Information on your n8n setup

  • n8n version: 1.117.3
  • Database (default: SQLite):
  • n8n EXECUTIONS_PROCESS setting (default: own, main):
  • Running n8n via (Docker, npm, n8n cloud, desktop app): Docker
  • Operating system: Ubuntu
2

In newer versions of n8n, soft delete is enabled, meaning you can’t directly delete workflows. And archiving a workflow means hiding it, not totally removing it. Go to the ‘Overview’ page where you see all workflows and toggle on ‘See archived workflows’ option from filters(refer to image). Afterwards delete all nodes in that workflow and save. You should be able to use evaluation for your new workflow.

image
image361×307 10.6 KB

3

That might solve the problem but what if I want to run evaluation (without custom metrics) in two different workflows ? The problem here I can have one and only one evaluation workflow in my entire instance.