Sections 4 and 5 · Pin configuration and electrical characteristics.
Pin configuration
Bearer is the per-project virtual key on all of these.
| Pin | Function | Type |
|---|
| 1 | /v1/chat/completions | full loop |
| 2 | /v1/messages | anthropic wire |
| 3 | /v1/embeddings | passthrough |
| 4 | /v1/responses | passthrough |
| 5 | /v1/rerank | passthrough |
| 6 | /v1/moderations | passthrough |
| Pin | Function | Type |
|---|
| 7 | /v1/images/generations | adapter |
| 8 | /v1/audio/speech | adapter |
| 9 | /video/generations | submit, poll, fetch |
| 10 | /v1/models | read, validates key |
| 11 | /status/peek | read, $0 pre-call gate |
| 12 | /usage/me | read, own spend |
Speech to text has no pin. That caller still goes to
its vendor directly. Two headers a caller may send on any surface:
x-axon-source names the calling application, for routing, limits and attribution;
x-axon-timeout-ms bounds the whole failover chain rather than one attempt, so a
chain of N entries cannot keep a caller waiting N times the per-attempt timeout.
Absolute maximum ratings
Operating a part beyond these is refused, not degraded.
| Parameter | Symbol | Value |
|---|
| Request body | AXON_MAX_BODY_MB | 32 MB |
| Upstream body | AXON_MAX_UPSTREAM_BODY_MB | 64 MB |
| Caller deadline ceiling | AXON_MAX_REQUEST_TIMEOUT_MS | 120 000 ms |
| Stream read gap | AXON_STREAM_READ_TIMEOUT_SECS | 300 s |
| Parameter | Symbol | Value |
|---|
| Captured body, per side | axon_request_bodies | 32 KB |
| Injection screen, per field | guardrails | 1 MiB |
| Default calls per key | …KEY_CALLS_PER_HOUR | 1,000 /h |
| Default cost per key | …KEY_COST_PER_DAY_CENTS | $5.00 /day |
Electrical characteristics
Shipped defaults, at nominal conditions.
| Parameter | Symbol | Min | Typ | Max | Unit |
|---|
| Semantic cache match | CACHE_SIMILARITY | 0.95 | — | 1.00 | cosine |
| Cache entry life | CACHE_TTL_SECS | — | 3600 | — | s |
| Embedding width | CACHE_EMBED_DIM | 1024 | 1024 | 1024 | dim |
| Config convergence | CONFIG_REFRESH_SECS | — | 30 | — | s |
| Model catalog refresh | MODEL_REFRESH_SECS | — | 21600 | — | s |
| Failover price guard | …FAILOVER_MAX_PRICE_MULT | — | 3.0 | — | × |
| Soft cap downroute | AXON_SOFTCAP_PCT | — | 90 | 100 | % |
Every variable the code reads appears in
.env.example, grouped by purpose, with its real default stated. llmyard does not
parse a .env file itself; Docker Compose loads it and passes it in.
Vendor presets
9 vendors, one credential each.
Each preset carries a documented base URL, the auth style the vendor wants, the wire
dialect it speaks and a starting model list, so registering one is a credential and a click:
openai, anthropic, groq, openrouter,
mistral, deepseek, together, gemini,
openai-embed. Anything else with an OpenAI-shaped or Anthropic-shaped endpoint works
as a custom endpoint.