field-notes
Three defenses against confabulation
Three soft layers between a user and hallucination all fail silently. Three hard defenses make confabulation visible, measurable, and refusable without suppressing the answer.
2 entries
Three soft layers between a user and hallucination all fail silently. Three hard defenses make confabulation visible, measurable, and refusable without suppressing the answer.
Microsoft researchers introduce DELEGATE-52, a benchmark of long document-editing workflows across 52 professional domains. Even frontier models (Gemini 3.1 Pro, Claude 4.6 Opus, GPT-5.4) corrupt about 25% of document content by the end of these workflows, and agentic tool use does not improve performance. The paper argues current LLMs are unreliable delegates: they introduce sparse but severe errors that compound silently over long interactions.