106 B
106 B
LLM-Proxy-Metrics
Rust impl of a proxy for Ollama and OpenAI endpoints that gathers prometheus metrics.
Rust impl of a proxy for Ollama and OpenAI endpoints that gathers prometheus metrics.