Skip to content

fix(litellm): allow an explicit zero price for self-hosted models - #132

Merged
tarannum-2002 merged 1 commit into
developmentfrom
fix/235-litellm-zero-price
Nov 7, 2026
Merged

tarannum-2002 merged 1 commit into
developmentfrom
fix/235-litellm-zero-price

Conversation

@tarannum-2002

Copy link
Copy Markdown
Contributor

What

The litellm chart now accepts 0 as a model's price. A price still has to be written down: a model with no price fails the render as before. Chart 0.2.0 to 0.2.1.

Why

DSS on the dev VM runs on gemma-4-31b-it through the Amul LiteLLM, which is self-hosted and not billed per token, so the gateway there records it at 0. The chart treated 0 as "no price" and refused to render, so dev's cluster gateway could only copy that setup with a made-up price.

Testing

  • Rendered the chart with dev's values: prices of 0 render, and a model with its price left out still fails with "has no price".
  • scripts/lint-charts.sh litellm: the litellm chart lints clean. The script's separate Grafana provisioning check fails the same way on development without this change.

Relates to OpenAgriNet/engineering-tracker#235

@tarannum-2002
tarannum-2002 merged commit c3997ce into development Nov 7, 2026
1 check passed
@tarannum-2002
tarannum-2002 deleted the fix/235-litellm-zero-price branch November 7, 2026 15:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant