Three signals, three jobs
What each signal does
Metrics tell you when something is wrong. Logs tell you what happened. Traces tell you where time went. For LLMs, all three need to handle long-lived streaming requests, not just short HTTP calls.
Metrics tell you when something is wrong. Logs tell you what happened. Traces tell you where time went. For LLMs, all three need to handle long-lived streaming requests, not just short HTTP calls.