Update on nodes:
- Google Gemini Chat Model
- Google Vertex Chat Model
The idea is:
Being able to add custom metadata labels to be able to track efficiently the cost.
My use case:
I’ve hundreds workflows running on Gemini, each having different purpose/use cases.
I want to be able to monitor the cost of each workflow. Having a metadata label per workflow on the Chat Model will help me filter out/group by the billing dashboard.
So I can exactly know which workflow need optimization/review.
I think it would be beneficial to add this because:
to better control the costs per workflow, which is currently very hard/not practical.
I got a workflow that was spending way too much money and it has been hard to identify where it was coming from.
Now I also want to know for each workflow how much they cost per month.
Business can die without having control on that.
I’m running ~2 millions executions per month.
Building a system to control the cost would take too much time and maintenance while they already provide something to help us on that.
Any resources to support this?
Are you willing to work on this?
I could help if you can provide me some tips on where to start. I can open a PR for adding the field and changing the request to integrate the labels into the API request.
- Can you provide me the link to the folder/both nodes from Github?
Thanks!
