<!-- Generated by scripts/generate_ai_collab_docs.py. Edit metadata in that script. -->

# Backend Service: llm

This file adds local guidance for `src/api/flaskr/service/llm`. Read the
repository root and `src/api/AGENTS.md` first, then use this file for
module-specific ownership and risk points.

## Scope

- This service owns thin LLM-facing HTTP route registration that should stay
  aligned with the shared LiteLLM integration layer.

- Primary checked-in entry files today: `src/api/flaskr/service/llm/route.py`

- Keep behavior in this module unless the concern is clearly cross-service and
  shared by multiple backend domains.

- Preferred pytest location: `src/api/tests/service/llm/` does not exist yet;
  create it when this service gains or changes behavior.

## Do

- Start from the local entry files and preserve how this service already
  structures helpers, models, routes, and DTO-like helpers.

- Treat `src/api/flaskr/api/llm/__init__.py` as the shared provider
  integration layer and keep this service route-focused.

- Preserve OpenAI-compatible request and response expectations when proxying
  provider traffic.

- Add provider-specific behavior only when the shared wrapper cannot
  reasonably absorb it.

## Avoid

- Do not duplicate LiteLLM or provider-registration logic in this service
  subtree.

- Do not couple route behavior tightly to one vendor when multiple
  OpenAI-compatible providers must coexist.

- Do not expose provider secrets, base URLs, or unsupported internal error
  details in API responses.

- Avoid scattering service-specific rules upward into root docs when the
  behavior only matters inside this module.

## Commands

- `rg -n "llm" src/api/flaskr/service src/api/tests` to locate all backend
  call sites and tests before editing.

- `cd src/api && pytest -q` until `src/api/tests/service/llm/` exists; create
  that directory first when this service gains behavior that needs focused
  regression coverage.

- `cd src/api && pytest -q` is usually enough unless work here also changes
  shared models in another service.

- `cd src/api && pytest -q` when a change touches shared DTOs, auth, streaming
  contracts, or other services in addition to this module.

## Tests

- Add or update focused tests around `src/api/tests/service/llm/` for the
  happy path and the highest-risk validation, permission, or failure case.

- Expand coverage when payload shapes, error codes, or shared helper contracts
  used outside this module change.

- Review persistence-related changes manually for indexing, business-key
  semantics, and migration output whenever models move.

- Document any skipped provider, network, or credential-dependent checks in
  the final task summary.

## Related Skills

- `src/api/SKILL.md`

- `SKILL.md`

- Create a new backend skill under `src/api/skills/<topic>/SKILL.md` when this
  module grows a repeatable multi-step debugging workflow.
