Observability

Observability

Forge provides comprehensive observability through integrated tracing, analytics, evaluation, and cost tracking. Every request is fully traced from ingestion through routing, security scanning, LLM execution, and response delivery.

Langfuse Tracing

All requests are traced through self-hosted Langfuse, providing detailed spans for each processing stage. View traces in the Forge Dashboard or connect your own Langfuse instance.

OpenTelemetry

Forge exports OpenTelemetry-compatible traces via OpenLLMetry. Connect your existing observability stack (Datadog, Grafana, New Relic, Honeycomb) to receive Forge telemetry data.

Evaluation Framework

Built-in support for Promptfoo and DeepEval enables continuous evaluation of model quality. Forge Eval provides automated evaluation runs, A/B model comparison, and eval-to-guardrail pipelines that automatically generate security rules from failing evaluations.

Cost Tracking

Forge FinOps provides per-request, per-agent, per-tenant cost metering with real-time dashboards. Set budget guardrails that automatically downgrade models when cost thresholds are reached. The Forge Circuit breaker prevents runaway agent costs.

Session Recording

Forge Replay records deterministic agent sessions for time-travel debugging. Step forward and backward through agent decisions, compare session runs, and export traces to OpenTelemetry format.