New failure shape
The system can be healthy and wrong
Traditional monitoring assumes wrong = error. With LLMs, the service can return a confident, well-formed, completely false answer with HTTP 200. Quality observability is a separate discipline.
Traditional monitoring assumes wrong = error. With LLMs, the service can return a confident, well-formed, completely false answer with HTTP 200. Quality observability is a separate discipline.