Judgment Labs

Monitoring and improvement layer for long-horizon agents, open for general access since Oct 27, 2026. It stores and indexes large agent traces, runs custom judges on them, groups recurring failures into issues, lets an agent search traces for you, and supports offline tests, alerts, an MCP server and a Slack agent. SOC 2 Type II and HIPAA. Beginner plan $0/mo with $100 credits the first month ($50/mo after), 1 GB ingest and 10k evaluator runs free, then pay as you go; Pro $250/mo with 50 GB ingest, 50k evaluator runs and 180-day retention.