radlab-dev-group

LLM Router is a service that can be deployed on‑premises or in the cloud. It adds a layer between any application and the LLM provider. In real time it controls traffic, distributes a load among providers of a specific LLM, and enables analysis of outgoing requests from a security perspective (masking, anonymization, prohibited content).

Stars

13

Forks

4

Open beginner issues

0

Indexed issues

4

Avg merge

1h 24m

Merged PRs (30d)

23