Task — engineering-spec@1

"Retrieval config A/B + shadow evaluation on sampled live traffic"

draftTASK-MEMORY-249
module memory · class product · priority p1 · created 2026-07-08 · shipped null
depends on TASK-MEMORY-245, TASK-MEMORY-221 · blocks none

TASK-MEMORY-249: Retrieval config A/B + shadow evaluation on sampled live traffic

1. Description

config table with hash assignment; judge-scored outcomes promote winners by flag flip; shadow deltas logged

Migrated 2026-07-08 from the memory improvement backlog, folded into the task system as class: improvement. Source report refs: R48, R54.

Acceptance criteria