RouteLLM API

RouteLLM is an open-source framework from LMSYS for intelligently routing user requests between different language models. Instead of sending every request to an expensive/high-capability model, it can classify requests and send simpler queries to cheaper models while reserving stronger models for difficult queries. It provides trained routing strategies, a Python SDK and an OpenAI-compatible API server. RouteLLM can work with cloud and local models, including configurations using Ollama. It is primarily a developer/research tool rather than a consumer chatbot or hosted API subscription. There is no official country-specific unavailability noted in the project's documentation; because it is self-hosted/open-source, availability generally depends on the underlying model/API providers.