symfonic.evals.response_memory

response_memory

Per-item answer classification, not a bag of category words in prose.

PromptMemoryCategorized dataclass

PromptMemoryCategorized(expected: Mapping[str, str], name: str = 'prompt_memory_categories')

Bases: ResponseMemoryCategorized

Require the fact and validated category in the same recalled record line.

ResponseMemoryCategorized dataclass

ResponseMemoryCategorized(expected: Mapping[str, str], name: str = 'response_memory_categories')

Require each fact fragment and its category on the same table row.

Used with a prompt asking for subject, memory_category and detail columns. Mentioning all categories elsewhere, or labelling a fact with its storage layer, cannot pass. Expectations never appear in diagnostic output.