Routing Policies

Routing Policies#

Routing policies control how the Gateway selects a provider for each request. Policies are evaluated in order of priority.

How Routing Works#

• Routing rules are stored in the database and queried at dispatch time
• Rules map task types to specific providers and models
• Provider credentials are encrypted and stored per-user
• Custom providers can be added via the MOSAIC_CUSTOM_PROVIDERS environment variable

Supported Providers#

• Anthropic — Claude models (claude-opus-4-6, claude-sonnet-4-6, etc.)
• OpenAI — GPT models (gpt-4o, gpt-4o-mini, o3-mini)
• Z.ai / GLM — GLM models (glm-4.5, glm-4.5-air, glm-4.5-flash)
• Ollama — Local models (llama, codellama, mistral, etc.)
• Custom — Any provider via JSON configuration