LSD

LSD (LLM Service Daemon) is an LLM gateway for Unix systems. It gives you one OpenAI-compatible API in front of every major model provider, with routing, fallbacks, and retries built in. Inferences, feedback, and configuration all live in a single PostgreSQL database, so there is no extra datastore to operate.

OpenAI-compatible

A drop-in API. Point your existing OpenAI clients at LSD and reach any provider through one endpoint.

Anthropic-compatible

Speaks the Anthropic Messages API too. Point your existing Anthropic clients at LSD with no code changes.

One database

Inferences, feedback, and config live in PostgreSQL. No separate analytics store or cache to run.

Built for Unix

Linux, FreeBSD, DragonFlyBSD, and OpenBSD are all supported. Lightweight enough for modest hardware.

Telemetry-free

No phone-home analytics, no usage tracking. The only network calls LSD makes are the ones you configure.

Open source

Apache 2.0 licensed, no CLA required. Free to run, modify, and self-host.

Capabilities

Gateway

Call any LLM through a unified, OpenAI-compatible API with routing, fallbacks, and retries. Learn more.

Observability

Every inference and feedback signal is stored in Postgres and queryable programmatically. Learn more.

Optimization

Use collected metrics and feedback to optimize prompts, models, and inference strategies. Learn more.

Evaluations

Benchmark individual inferences or end-to-end workflows with heuristics and LLM judges. Learn more.

Get started

The Quickstart walks through standing up an LLM application on LSD in minutes.