Skip to content

01

Changelog

Every release, newest first.

Features, improvements and fixes with version numbers and dates. We ship every week.

v2.4.0

Feature

Evals gate every deploy

Set a pass rate, latency budget and cost ceiling. A version ships only when it clears them.

  • Gates inherit from a workspace policy

  • Failing cases are linked in the alert

  • Previous version keeps serving traffic

v2.3.2

Fix

Trace export no longer truncates long spans

Exports over 2 MB were cut at the span boundary. They now stream in full.

  • Applies to JSON and Parquet

  • Existing exports are unaffected

v2.3.1

Fix

Canary percentage survives a rollback

Rolling back reset the canary slice to zero. It now returns to the last chosen value.

  • Affects projects with scheduled canaries

v2.3.0

Feature

Cost budgets and alerts

Set a budget per project or per version and get an alert before the invoice does.

  • Daily and monthly budgets

  • Slack and email alerts

  • Cost shown on every span

v2.2.4

Improvement

Faster trace search

Search across a million runs now returns in under 300 ms.

  • New index for span names

  • Filter by status and cost together

v2.2.3

Fix

Run timestamps respect your timezone

Timestamps were shown in UTC regardless of the profile setting.

  • Applies to the list and the detail view

v2.2.0

Feature

Parallel tool calls drawn to scale

Overlapping tool calls now sit on the same row of the waterfall with true timing.

  • Hover for exact start and end

  • Critical path highlighted

v2.1.2

Improvement

Clearer failure reasons in rubric evals

Each failed rubric case now shows the grader's reason next to the score.

  • Reasons are searchable

v2.1.1

Fix

Slack alerts no longer duplicate on retries

A retried webhook could post the same alert twice.

  • Alerts are now idempotent

v2.1.0

Feature

Self-hosted collector

Run the collector inside your network so raw prompts never leave it.

  • Docker and Helm packages

  • Available on Scale

v2.0.3

Improvement

SDK cold start 40% smaller

The SDK now loads lazily and adds under 5 ms to a cold start.

  • No API changes

v2.0.2

Fix

PII redaction missed nested arrays

Rules now walk arrays of arrays.

  • Re-run redaction preview on existing projects

v2.0.0

Feature

A new console

A faster console with a keyboard-first trace view, saved filters and a command palette.

  • Press Cmd K anywhere

  • Saved filters are shareable

v1.9.1

Fix

Eval replays respect the dataset version

Replays used the latest dataset instead of the pinned one.

  • Pinned datasets are now honoured

v1.9.0

Feature

Share a run with a link

Send a single run, redacted by your rules, to anyone without an account.

  • Links expire after 30 days by default

v1.8.2

Improvement

Keyboard shortcuts in the trace view

J and K move between spans, Enter opens one, Escape closes it.

  • Full list under the ? key

Create a free website with Framer, the website builder loved by startups, designers and agencies.