01
It told the customer something that is simply not true.
Head of customer service, after the second complaint that week
The assistant found an answer, and it found it in a document nobody had opened since 2023. It did not lie. It repeated. And it did so with the same confidence as everything else it says.
Confidently wrong
02
Ask three colleagues and you get three answers.
Team lead, explaining why handling times differ per person
Everyone is working hard and everyone is working from something else: the intranet, a personal note, a message a colleague pasted into the team chat last spring. The variation is not attitude. It is the source.
Inconsistent by default
03
Show me who approved this answer, and when.
Compliance, three days after the automated reply went out
Under the EU AI Act, NIS2 and the GDPR the question is no longer whether the answer was right, but whether you can show how it got there. An answer with no owner and no date is not evidence.
Nothing to show the regulator
04
The pilot was brilliant. It never made it to production.
Innovation lead, on the third assistant in two years
The demo ran on twenty answers somebody cleaned up by hand. Production runs on twelve thousand that nobody has. The project did not fail on the model. It failed on what was underneath it.
Stalled before go-live