# 2026-03-09 Baseline

Source:

- `evals/fixtures/retrieval-candidate-benchmark/latest.json`
- `evals/fixtures/retrieval-candidate-benchmark/recommendation.md`

Command:

```bash
bun run eval:retrieval-candidates:write
```

## Baseline Decision

- expansion base: `hf:unsloth/Qwen3-1.7B-GGUF/Qwen3-1.7B-Q4_K_M.gguf`
- answer base: `hf:unsloth/Qwen3-4B-Instruct-2507-GGUF/Qwen3-4B-Instruct-2507-Q4_K_M.gguf`
- reranker: unchanged

## Key Numbers

- `Qwen3-1.7B`: `nDCG@10=0.898`, ask `Recall@5=0.938`, schema `50%`, p95 `4727ms`
- `Qwen2.5-3B`: `nDCG@10=0.853`, ask `Recall@5=0.438`, schema `83.3%`, p95 `2941ms`
- `Qwen3.5-0.8B`: `nDCG@10=0.742`, ask `Recall@5=0.313`, schema `83.3%`, p95 `3971ms`
- `Qwen3.5-4B`: `nDCG@10=0.737`, ask `Recall@5=0.188`, schema `100%`, p95 `5437ms`
- `Qwen3.5-9B`: `nDCG@10=0.675`, ask `Recall@5=0.000`, schema `100%`, p95 `6657ms`

## Implication For fn-35

Focus on making `Qwen3-1.7B` reliably structured without losing retrieval quality.
