Skip to main content
GitHub

Observe

Understand agent behavior through traces, spans, and sessions.

Risicare's observability layer provides deep visibility into your AI agent's behavior.

Overview

Data Model

Session (user interaction)
  └── Trace (single request)
       └── Span (individual operation)
            ├── LLM Call
            ├── Tool Execution
            ├── Agent Decision
            └── Child Spans...

Key Metrics

MetricDescription
LatencyP50, P95, P99 response times
Token UsagePrompt and completion tokens
CostUSD cost per trace/session
Error RateFailed traces percentage
ThroughputTraces per minute

Dashboard Views

Trace List

View all traces with filtering:

  • Time range
  • Status (success/error)
  • Agent name
  • Session ID
  • Latency thresholds
  • Cost thresholds

Trace Detail

Deep dive into a single trace:

  • Span waterfall visualization
  • LLM prompts and completions
  • Tool inputs and outputs
  • Error details and stack traces
  • Cost breakdown by model

Analytics

Aggregate views:

  • Trace volume over time
  • Error rate trends
  • Latency distributions
  • Cost by model/agent
  • Top error codes

Real-Time Streaming

View traces as they happen:

# Traces appear in dashboard within ~100ms
response = client.chat.completions.create(...)

Query Language

status:error AND agent:planner AND latency:>5000

Filters

FilterExample
statusstatus:error
agentagent:researcher
modelmodel:gpt-4o
latencylatency:>1000
costcost:>0.01
sessionsession:sess-123
error_codeerror_code:TOOL.EXECUTION.TIMEOUT

Data Retention

PlanRetention
Free7 days
Pro30 days
Enterprise90+ days

Next Steps