mineral-intel-benchmark

Agent readability score

Strengths

• Some tools have detailed descriptions (e.g., 'benchmark.sample') explaining data structure and purpose.
• Clear mention of on-chain attestation and payment methods (x402 USDC) in multiple tools.

Weaknesses

• Tool names like 'sales.ask' are overly generic and fail to specify their exact function or domain.
• Descriptions often omit specific use cases (e.g., 'benchmark.commodity' lacks context for when to use it).
• Parameter requirements and types are not explicitly defined in inputSchema summaries.
• Overlapping functionalities between tools (e.g., 'supply_share' vs. 'supply_resilience') create ambiguity for agents.
• No explicit error handling or constraints are documented in tool descriptions.

• sales.ask — Vague name; unclear scope of 'anything' it can answer.
• benchmark.commodity — Description lacks specific use cases or triggers for invocation.
• benchmark.runs — Ambiguous overlap with 'benchmark.commodity' in mineral data contexts.
• extract.estimate — No explicit parameter definitions or required input types mentioned.
• supply_resilience — Overlaps with 'supply_share' in supply chain analysis without clear differentiation.

Verdict

The toolset suffers from vague naming, ambiguous use cases, and functional overlaps, which hinder an agent's ability to select the correct tool. While some descriptions are detailed, the lack of standardized parameter definitions and error handling significantly reduces usability.

9/11/2026, 5:52:05 AM

Event narrative

Server transitioned from auth-gated to legacy era with full compliance (100 score) after a period of stability.

Risk: medium

• 2026-09-10T21:16:35.016Z — era changed from auth-gated to legacy · server now operates under legacy rules, which may affect compliance requirements
• 2026-09-11T05:44:28.819Z — complianceScore changed from null to 100 · server achieved full compliance with legacy-era standards

Advice

Monitor legacy-era compliance metrics closely. Verify that smokeOk status is intentionally left null or requires investigation. Ensure 100% compliance score is maintained through regular audits.