What to check when an AI assistant gives an outdated answer
A stale answer can come from an older source, a failed content update, or missing context in the retrieved material.
What to do
- Compare the answer and any citation with the approved policy version and its publication date.
- Remove superseded copies from the assistant's source set or mark them as archived, then verify the update took effect.
- Retest the original question and a paraphrase. Record whether the assistant cites the current source or correctly requests a human review.
Reference: OpenAI guide to evaluation best practices.
Related MyNew service: AI Consulting.