MCP Selection Lab
https://mcp-selection-lab-production.up.railway.app/mcp ↗
Description
Benchmark MCP tool selection with metadata-only routing, collision, abstention, and holdout checks.
What our measurements say
MCP Selection Lab is a remote MCP server published at mcp-selection-lab-production.up.railway.app. It has been probed 8 times since 9/12/2026. It answered in only 3 of them (37.5%), indicating low availability. Median response time is 15,002 ms, a delay an agent will notice. It offers a narrow, focused set of 3 tools. On the protocol side it speaks the 2026-07-28 stateless spec.
Agent readability score
Can an LLM agent pick the right tool here — names, descriptions and parameter clarity are assessed.
Agent readability score
Strengths
- Distinct tool purposes avoid overlap
- Well-defined required parameters in scan_mcp_metadata
Weaknesses
- Tool names lack precision in intent
- Descriptions insufficiently explain usage scenarios
- Ambiguous parameter explanations (e.g., 'internal_test')
- No explicit error handling documentation
selection_lab_info— Name doesn't clearly indicate metadata-only information retrievalscan_mcp_metadata— 'internal_test' parameter lacks clear purpose explanationget_selection_report— Description doesn't clarify when to use existing reports vs new scans
Verdict
Event narrative
Sign up free to generateRaw observations
| Run | Era | Modern | ms |
|---|
Schema compliance
tools/list structure, inputSchema validity, and a functional smoke test — the components of the 0-100 score.
- tools/list schema valid
- inputSchema is valid JSON Schema
- Smoke test passed · last run:
- Cold-start: cold 36ms → warm 38ms (penalty 0ms)
Tools
Tools the server advertised in the latest measurement — measured, not catalog-claimed.
selection_lab_infoGet free service capabilities, limits, privacy and connection details; does not scan a target.
scan_mcp_metadataCreate a free public report of MCP tool-description routing collisions. Reads discovery metadata (initialize/tools/list) only; never calls target business tools or spends funds. Use a public HTTP(S) URL without credentials, query or fragment. Results use at most 12 tools and 24 generated cases, not a real-model evaluation. The returned report is enriched with agent_plan candidate description-only edits and a machine-readable rerun instruction. Candidate edits are not untouched-holdout proof. Reports persist and are public by link. For an existing report use get_selection_report. Set internal_test=true for owner/CI validation so it is excluded from public scans. source is a self-reported referral bucket, not identity verification.
mcp_urlstringrequiredsourcestringinternal_testboolean
get_selection_reportRead and agent-enrich an existing public scan report by id; no new target request or model call.
report_idstringrequired
Availability history
Event log
Derived by comparing consecutive probes — changes in era, protocol version, build and reachability.
- Server build: — → 0.5.1
- Back up
- Incomplete probe — one leg did not answer, era result not counted
- Incomplete probe — one leg did not answer, era result not counted
- Incomplete probe — one leg did not answer, era result not counted
- Incomplete probe — one leg did not answer, era result not counted
- Added to watch — era: Unreachable
Get your badge
Add this badge to your README — it updates automatically as measurements change.
[](https://mcpmetrics.io/servers/io-github-changhuliu-mcp-selection-lab)<a href="https://mcpmetrics.io/servers/io-github-changhuliu-mcp-selection-lab"><img src="https://mcpmetrics.io/badge/io.github.ChanghuLiu/mcp-selection-lab/era.svg" alt="mcpmetrics"></a>You are seeing the last 7 days. Sign up for the full history. Which check failed and why is in the dashboard.
Sign up free to seeSimilar MCP servers
The catalog entries whose name and description are closest to this one, found with the same index the search box uses.
- mineral-intel-benchmarkassaychain.com
Mineral intelligence API: 8 critical minerals (USGS benchmarks) with mineral processing and ultrasound run-log data. $0.10 USDC on Base via x402. Every response carries an on-chain EAS attestation.
- Built with Jon — Hidden Profit Toolsbuiltwithjon.com
Read-only tools for finding where a small business leaks deals, time, and cash.
- Get2Great — management and selection science magazineget2great.com
Read-only Get2Great magazine essays on who is good at a job, and the management-tool catalog.
- Tool-Guardian-Proxytool-guardian-mcp.vercel.app
Safety execution proxy protecting clients during tool calls.
- MCP Observatory: one read only walk over every https endpoint in the official registryobservatory.horizonshield.dev
Public record of one read only walk over the official MCP registry: who answered, tools, who pays.
- Peek — URL metadata & Markdownsmeltworks.com
Link-preview metadata and clean page-to-Markdown for any public URL. No install.
Comments
Sign in to write a comment
No comments yet. Be the first.