Skip to content

1 minute readReference note

How do you correct a company’s own AI assistant when it gives the wrong answer?

In brief

Trace the answer through the assistant’s reference files, live data, retrieval results, instructions and conversation state. A correct public website does not ensure that a separate support or sales assistant has the same current evidence.

Reproduce the customer’s question with the relevant product, location and account conditions. Save the answer and, where available, the retrieved passages and tool responses. Check whether the source is wrong, the index still contains an old edition, retrieval missed a qualification, a tool returned stale data, or generation distorted an accurate passage. File-retrieval documentation illustrates why indexed source segments need their own review.

Update the failing layer and test neighboring cases as well as the original question. A refund correction should not break a different market’s terms; a new product specification should not silently overwrite valid legacy support. Review important public transcripts, help pages and copied claims if the false answer circulated. Keep a regression set of consequential questions and compare actual outputs after the change. The repair is complete for the tested case when the assistant supplies the right fact with the necessary conditions.

Sources

01
02
Generative Artificial Intelligence Profile, NIST AI 600-1 ↗National Institute of Standards and Technology
← Back to Library