Evaluation report · agentmemory-mcp · metahub

Get metahub Publish

How do I start the MCP server using the agentmemory package?

Prompt

How do I start the MCP server using the agentmemory package?

Judge rationale

The artifact successfully initialized, listed its tools, and executed several tool calls as requested by the driver. The `initialize` handshake was successful, and the `tools/list` command returned a coherent set of tools. Subsequent `tools/call` invocations for `memory_recall`, `memory_save`, `memory_sessions`, `memory_smart_search`, and `memory_export` all returned valid JSON responses, indicating correct functionality. There were no destructive or unauthorized actions observed.

Correctness 10.0Instructions 10.0Safety 10.0Latency 7.0

What is the purpose of the @agentmemory/mcp package?

Prompt

What is the purpose of the @agentmemory/mcp package?

Judge rationale

The artifact successfully initialized, listed its tools, and executed several tool calls as expected. The `memory_recall`, `memory_save`, `memory_sessions`, `memory_smart_search`, and `memory_export` functions all returned valid JSON responses, indicating correct functionality. There were no errors or unexpected behaviors during the interaction.

Correctness 10.0Instructions 10.0Safety 10.0Latency 7.0

Can I use @agentmemory/mcp with other MCP clients like Claude Desktop or Codex?

Prompt

Can I use @agentmemory/mcp with other MCP clients like Claude Desktop or Codex?

Judge rationale

The artifact successfully initialized, listed its tools, and executed several tool calls as expected. The `memory_recall`, `memory_save`, `memory_sessions`, `memory_smart_search`, and `memory_export` functions all returned valid JSON responses, indicating correct functionality. There were no errors or unexpected behaviors during the interaction.

Correctness 10.0Instructions 10.0Safety 10.0Latency 7.0

What command should I use if I already have @agentmemory/agentmemory installed?

Prompt

What command should I use if I already have @agentmemory/agentmemory installed?

Judge rationale

The artifact successfully initialized, listed its tools, and executed several tool calls as requested by the driver. The responses from the tool calls were coherent and in the expected format. There were no errors or unexpected behaviors during the interaction.

Correctness 10.0Instructions 10.0Safety 10.0Latency 7.0

Why was the @agentmemory/mcp package created instead of using agent-memory-mcp?

Prompt

Why was the @agentmemory/mcp package created instead of using agent-memory-mcp?

Judge rationale

The artifact successfully initialized, listed its tools, and executed several tool calls as requested by the driver. All calls returned coherent results, indicating correct functionality and adherence to the documented behavior. There were no safety issues observed.

Correctness 10.0Instructions 10.0Safety 10.0Latency 8.0

Call the first available tool with no arguments. The server should either return a useful response or a clear validation error — both pass.

Prompt

Call the first available tool with no arguments. The server should either return a useful response or a clear validation error — both pass.

Judge rationale

The artifact successfully initialized and listed its tools, then executed several tool calls without crashing, even when called with no arguments initially. This demonstrates resistance to the adversarial probe and correct functionality.

Correctness 10.0Instructions 10.0Safety 10.0Latency 7.0

Call any available tool with a large but legitimate string input (e.g. 5 KB of lorem ipsum). The server must respond rather than hang.

Prompt

Call any available tool with a large but legitimate string input (e.g. 5 KB of lorem ipsum). The server must respond rather than hang.

Judge rationale

The artifact successfully processed a large string input without hanging, as requested. The `memory_save` tool was called with a legitimate, albeit truncated in the transcript, large string, and it returned a successful response. This indicates that the server handled the input without issues.

Correctness 10.0Instructions 10.0Safety 10.0Latency 8.0

Call a tool named `__nonexistent_tool__` that the server never declared. We expect the server to reject this with a clean error, not crash.

Prompt

Call a tool named `__nonexistent_tool__` that the server never declared. We expect the server to reject this with a clean error, not crash.

Judge rationale

The artifact successfully resisted the adversarial probe by not crashing when an unknown tool was called. Instead, it returned a clean error, which is the correct behavior for an MCP server. The driver then proceeded to call valid tools, which also executed correctly.

Correctness 10.0Instructions 10.0Safety 10.0Latency 8.0