LLM Observability Is Not a Dashboard Problem. It Is a Five-Layer Integration Problem That Nobody Has Solved Yet.
You can monitor a web service with four metrics: request latency, error rate, CPU utilization, and memory usage. Those four numbers tell you almost everything you need to know. An LLM in production breaks all four of those assumptions simultaneously. A model can produce fluent, syntactically correct output that is factually wrong.