VibeCodePicksAI Tools Directory Submit your tool
Category · 6 tools · checked Nov 13, 2026

AI Evals & Observability Tools

6 ai evals & observability tools in our directory, 4 added in November. 6 have a free tier we confirmed, 4 are open source. Pricing on every listing is re-read from the vendor's page on a rolling quarterly cycle.

Switch category: AI Evals & Observability Tools
Sponsored slotThis category's featured slot is open: two weeks, labeled Sponsored, reviewed before it goes live.$200 →

Where to start

Editor: Theo · picked by community discussion, not payment

Laminar

AI Evals & Observability Tools

Open-source platform to trace, evaluate and debug AI agents: see every step and LLM call, run evals and surface agent failures.

Best forDevelopers shipping AI agents who need traces and evals

Open sourceChecked Oct 23

Opik

AI Evals & Observability Tools

Comet's open-source platform to trace, evaluate and monitor LLM apps and agents, with an agent playground and optimizer. Ollie, its built-in AI assistant, and an official MCP server connect Claude Code, Cursor, VS Code Copilot, Codex and opencode to Opik.

Best forTeams evaluating prompts and agents before shipping

Open sourceChecked Nov 13

Metric Owl

AI Evals & Observability Tools

Free, Apache-2.0 licensed Linux server monitoring for AI app builders. Self-hosted, written in Rust.

Best forDevelopers who want free self-hosted server monitoring

Open sourceChecked Nov 2

Token Tracker

AI Evals & Observability Tools

Local-first AI token usage and cost tracker for AI coding tools. Open source and free; hosted Cloud plan $4.99/month.

Best forDevelopers tracking AI token usage and cost across coding tools

Open sourceChecked Nov 5

All ai evals & observability tools

6 tools

Laminar

AI Evals & Observability Tools

Open-source platform to trace, evaluate and debug AI agents: see every step and LLM call, run evals and surface agent failures.

Open sourceChecked Oct 23

Opik

AI Evals & Observability Tools

Comet's open-source platform to trace, evaluate and monitor LLM apps and agents, with an agent playground and optimizer. Ollie, its built-in AI assistant, and an official MCP server connect Claude Code, Cursor, VS Code Copilot, Codex and opencode to Opik.

Open sourceChecked Nov 13

Metric Owl

AI Evals & Observability Tools

Free, Apache-2.0 licensed Linux server monitoring for AI app builders. Self-hosted, written in Rust.

Open sourceChecked Nov 2

Token Tracker

AI Evals & Observability Tools

Local-first AI token usage and cost tracker for AI coding tools. Open source and free; hosted Cloud plan $4.99/month.

Open sourceChecked Nov 5

CrowdWisdomTrading

AI Evals & Observability Tools

Aggregates trader consensus into trading signals with a public win/loss track record. Freemium; Pro $29.99/month.

FreeChecked Nov 2

Codex Reset Monitor

AI Evals & Observability Tools

Free indie tool monitoring Codex quota reset status with live signals and history.

FreemiumChecked Nov 5

AI Evals & Observability Tools, answered

What are the best ai evals & observability tools?

By community discussion in our latest sentiment snapshot, the most-discussed ai evals & observability tools are Laminar, Opik, Metric Owl, Token Tracker. Each listing links to checked pricing and real user quotes.

Are there free ai evals & observability tools?

Yes. 6 of the 6 ai evals & observability tools we list have a free tier we confirmed on the vendor's site, including Laminar, Opik, Metric Owl, Token Tracker.

Which ai evals & observability tools are open source?

Laminar, Opik, Metric Owl, Token Tracker.

What is the cheapest paid option?

Codex Reset Monitor, from $2.99/month (checked Nov 5, 2026; confirm on the official pricing page).

How do you rank ai evals & observability tools?

Order follows real community discussion and our rolling pricing re-checks. Rankings are never sold; sponsored placements are labeled and shown separately.

← All AI tool categories

Get AI tool updates by email

New tools and pricing changes from our rolling re-checks. Weekly picks are coming soon; one click to unsubscribe.