From f33aad89a260dff646f5e6c2b5dd003438599721 Mon Sep 17 00:00:00 2001 From: Your Name Date: Sun, 21 Jun 2026 15:57:05 -0400 Subject: [PATCH] =?UTF-8?q?fix(litellm):=20re-add=20gpt-4o-mini=20probe=20?= =?UTF-8?q?alias=20=E2=86=92=20free=20local?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit paperless-ai's Settings validation hard-codes a gpt-4o-mini probe (independent of OPENAI_MODEL); the bare alias was removed in the 2026-05-29 prefix-taxonomy refactor, so the probe 400s and blocks saving settings. Re-add a single narrowly-scoped shadow alias routed to free local llama3.1:8b (the one probe name unreachable via a prefix). Trade-off note updated so this isn't read as a regression. Co-Authored-By: Claude Opus 4.8 (1M context) --- vars/main.yml | 12 ++++++++++++ 1 file changed, 12 insertions(+) diff --git a/vars/main.yml b/vars/main.yml index 72b6cc4..bd7e55e 100644 --- a/vars/main.yml +++ b/vars/main.yml @@ -72,6 +72,11 @@ anvil_ollama_base: "http://192.168.1.150:11434" # Trade-off: clients that hard-code a bare model name in a probe (paperless-ai # wizard hits gpt-4o-mini) 400 until pointed at the prefixed name — or, for # OpenAI specifically, at direct_gpt-4o-mini once a key is in Infisical. +# Narrow exception (re-added 2026-06-21): a single `gpt-4o-mini` shadow alias +# is kept below SOLELY for paperless-ai's hardcoded validation probe, routed to +# free local llama3.1:8b. This is NOT a return to the bare-name scheme — it's +# the one probe name we can't reach via a prefix (paperless-ai ignores +# OPENAI_MODEL for the probe). Don't add more bare aliases. # # Single GPU, OLLAMA_NUM_PARALLEL=1 — concurrent/mixed requests queue and the # 70B+8B can't both stay resident in the ~62 GB budget (expect model swaps). @@ -89,6 +94,13 @@ litellm_models: backend: ollama_chat/llama3.1:8b api_base: "{{ anvil_ollama_base }}" api_key: ollama-no-auth + # Shadow alias SOLELY for paperless-ai's hardcoded gpt-4o-mini validation + # probe (see the "Narrow exception" note above). Routed to free local + # llama3.1:8b so the probe costs nothing. Do not point real traffic here. + - name: gpt-4o-mini + backend: ollama_chat/llama3.1:8b + api_base: "{{ anvil_ollama_base }}" + api_key: ollama-no-auth # Embeddings don't actually route through LiteLLM 1.55.10 (broken async ollama # handler → 500); consumers hit Anvil direct. Kept as a catalog entry only. - name: local_nomic-embed-text