router

module wittgenstein_llm_router.router

Classes

• LLMRouterService — Selects the best suited LLM model based on cost, context capacity, and request complexity.

wittgenstein_llm_router.router.LLMRouterService

class LLMRouterService(models: List[LLMModel], default_router: ModelRouter)

Selects the best suited LLM model based on cost, context capacity, and request complexity.

Methods

• route_request — Route request to the most optimal model based on strategies.

wittgenstein_llm_router.router.LLMRouterService.route_request

method LLMRouterService.route_request(request_type: RequestType, estimated_input_tokens: int = 500, router_override: Optional[ModelRouter] = None) → LLMModel

Route request to the most optimal model based on strategies.