OpenLIT https://openlit.io/blogs OpenLIT is an open source Harness Engineering platform. Trace LLMs and agents with OpenTelemetry, run LLM evaluations, manage prompts, compare models, and self-host free under Apache 2.0. en-us contact@openlit.io (OpenLIT) contact@openlit.io (OpenLIT) Fri, 14 Aug 2026 00:00:00 GMT https://openlit.io/blogs/gpu-util-is-a-vanity-metric GPU Utilization Is a Vanity Metric. Here is the GPU SLI for Inference https://openlit.io/blogs/gpu-util-is-a-vanity-metric GPU utilization from nvidia-smi, DCGM, and NVML is a vanity metric for LLM inference. SLO memory headroom, throttle-free time, allocated vs idle, CUDA health, and NVLink instead. OpenTelemetry hw.gpu metrics work with OpenLIT or any OTLP backend. Fri, 14 Aug 2026 00:00:00 GMT contact@openlit.io (OpenLIT) openlitgpugpu-monitoringgpu-observabilityllminferenceopentelemetryself-hosted https://openlit.io/blogs/talk-to-your-telemetry-debugging-llms-with-openlits-otter-ai-copilot Talk to Your Telemetry: Debugging LLMs with OpenLIT's Otter AI Copilot https://openlit.io/blogs/talk-to-your-telemetry-debugging-llms-with-openlits-otter-ai-copilot A deep dive into OpenLIT's Otter AI Copilot—the tool-calling assistant that lets you query traces, write Rule Engine rules, manage the Prompt Hub, and register custom model pricing conversationally. Wed, 08 Jul 2026 00:00:00 GMT contact@openlit.io (OpenLIT) openlitopentelemetryllmobservabilityotterai-copilot https://openlit.io/blogs/victoriametrics-openlit-agents-observability Observability for LLM Apps and Agents: OpenLIT SDK + VictoriaMetrics Observability Stack https://openlit.io/blogs/victoriametrics-openlit-agents-observability A joint OpenLIT + VictoriaMetrics guide to observability for LLM apps and agents - OTel GenAI semantic conventions, PromQL queries for cost, recursion, and cache hit rate, alerting rules that earn their keep, and a fully self-hosted, vendor-neutral pipeline for metrics, traces, and logs. Fri, 03 Jul 2026 00:00:00 GMT contact@openlit.io (OpenLIT) openlitvictoriametricsobservabilityopentelemetrytracingmonitoringloggingai-agentsgenai https://openlit.io/blogs/how-to-detect-hallucinations-in-your-rag-pipeline How to Detect Hallucinations in Your RAG Pipeline (with Code Examples) https://openlit.io/blogs/how-to-detect-hallucinations-in-your-rag-pipeline Catch LLM hallucinations programmatically using OpenLIT's evaluation SDK. Includes Python code examples for hallucination, toxicity, and bias detection with OpenTelemetry export. Tue, 07 Apr 2026 00:00:00 GMT contact@openlit.io (OpenLIT) openlitraghallucinationevaluationllmpython https://openlit.io/blogs/tracking-llm-costs-in-production Tracking LLM Costs in Production: Per-Model, Per-Request, Per-User Attribution https://openlit.io/blogs/tracking-llm-costs-in-production Break down LLM costs by model, service, user, and environment using OpenLIT. Auto-calculated token costs exported as OpenTelemetry metrics to Grafana, Datadog, or any backend. Tue, 31 Mar 2026 00:00:00 GMT contact@openlit.io (OpenLIT) openlitcost-trackingfinopsllmopentelemetryproduction https://openlit.io/blogs/gpu-monitoring-for-llm-inference-what-to-track-and-why-it-matters GPU Monitoring for LLM Inference: What to Track and Why It Matters https://openlit.io/blogs/gpu-monitoring-for-llm-inference-what-to-track-and-why-it-matters Learn which GPU metrics matter for LLM inference workloads and how to collect them as OpenTelemetry signals using OpenLIT's GPU collector. Supports NVIDIA and AMD. Fri, 27 Mar 2026 00:00:00 GMT contact@openlit.io (OpenLIT) openlitgpunvidiaopentelemetryinfrastructurellm https://openlit.io/blogs/how-to-add-observability-to-your-llm-app-in-2-minutes-with-opentelemetry How to Add Observability to Your LLM App in 2 Minutes with OpenTelemetry https://openlit.io/blogs/how-to-add-observability-to-your-llm-app-in-2-minutes-with-opentelemetry Add full tracing, metrics, and cost tracking to any LLM application with one line of code using OpenLIT and OpenTelemetry. Works with OpenAI, Anthropic, and 40+ providers. Thu, 26 Mar 2026 00:00:00 GMT contact@openlit.io (OpenLIT) openlitopentelemetryllmobservabilitygetting-started https://openlit.io/blogs/openlit-fleet-hub-at-scale Fleet Hub Playbook for Multi-Region AI Observability https://openlit.io/blogs/openlit-fleet-hub-at-scale Coordinate fleets of OpenTelemetry collectors for GenAI workloads with OpenLIT Fleet Hub and the OpAMP protocol. Fri, 07 Nov 2025 00:00:00 GMT contact@openlit.io (OpenLIT) openlitopentelemetryllmproductionfleet-hub https://openlit.io/blogs/openlit-openwebui Monitoring LLM Usage in OpenWebUI with OpenLIT https://openlit.io/blogs/openlit-openwebui This guide walks you through integrating OpenLIT with OpenWebUI using pipelines, covering installation, configuration, and practical use cases for monitoring and observability of LLMs including token tracking, cost analysis, and GPU metrics. Fri, 28 Feb 2025 00:00:00 GMT contact@openlit.io (OpenLIT) openlitopen-webuillmsobservabilitymonitoringopentelemetry https://openlit.io/blogs/protect-prompt-injection How to protect your OpenAI/LLM Apps from Prompt Injection Attacks https://openlit.io/blogs/protect-prompt-injection Learn how to safeguard your OpenAI and LLM apps from prompt injection attacks using UUIDs, input validation, and monitoring strategies with OpenLIT. Wed, 23 Oct 2024 00:00:00 GMT contact@openlit.io (OpenLIT) openlitlangchainobservabilityprompt injectionopenai https://openlit.io/blogs/observability-with-openlit Unlocking Seamless GenAI & LLM Observability with OpenLIT https://openlit.io/blogs/observability-with-openlit OpenLIT offers seamless, OpenTelemetry-native observability for GenAI and LLMs, simplifying performance and cost tracking. Thu, 15 Aug 2024 00:00:00 GMT contact@openlit.io (OpenLIT) openlitllmgenaiobservability https://openlit.io/blogs/pipeline-for-llm-apps Designing an Observability Pipeline for LLM Applications https://openlit.io/blogs/pipeline-for-llm-apps Observability for LLMs ensures performance, user insights, and GPU monitoring. Learn how to design and implement a complete observability pipeline for your LLM applications. Thu, 15 Aug 2024 00:00:00 GMT contact@openlit.io (OpenLIT) openlitllmobservability