What tools does the ai-eval MCP server provide?

ai-eval exposes 3 tools: compare_responses, score_response, text_metrics. This list was returned by the running server when we connected to it.

Does ai-eval require an API key?

No. ai-eval answered a tools/list request without credentials.

How do I install ai-eval?

Run: claude mcp add --transport http ai-eval https://api.lazy-mac.com/ai-eval/mcp. One-click install links for Cursor and VS Code are also available on the server's page.

Connection check verified live · 27h ago

ai-eval

Cloudflare Workers MCP server: ai-eval

AI & LLM tooling Monitoring & observability Cloud & infrastructure

Install

Remote (HTTP)

claude mcp add --transport http ai-eval https://api.lazy-mac.com/ai-eval/mcp

Tools 3

GitHub stars —

Installs / wk —

Licence —

Transport streamable-http

Last checked 27h ago

Tools & capabilities

3 tools

Read from the running server on 27h ago.

compare_responses prompt*responses*

Compare and rank multiple AI responses to the same prompt

score_response prompt*criteriaresponse*

Score an AI response against a prompt using heuristic metrics (length, relevance, structure, completeness)

text_metrics text*

Get text quality metrics: word count, sentence count, estimated tokens, readability grade

Context cost

Light

Connecting this server adds 3 tool definitions to every request — roughly 270 tokens before you ask anything.

Adds little to your context. Safe to keep connected.

Estimated at ~90 tokens per tool. Actual size varies with schema complexity — treat this as an order of magnitude, not a measurement.

Similar servers

chess-eval verified live · 28h ago

both mention “eval” · 2 tools

lichess verified live · 27h ago

both mention “eval” · 41 tools

dcl-trust-oracle verified live · 20h ago

both mention “eval” · 18 tools

rubrkit verified live · 28h ago

both mention “eval” · 41 tools

sema local install

both mention “eval”

solo-founder-os local install

both mention “eval”

Ranked by shared tools where both expose an inventory, otherwise by shared wording.

Source & links

Repository: lazymac2x/ai-eval-api
Registry: io.github.lazymac2x/ai-eval
Endpoint: https://api.lazy-mac.com/ai-eval/mcp
Sources: registry