Evaluation report

• Version is semverwarn

  No version declared.

  Add a "version" field to braintrust-analyst.md.

• Repository is reachable

  https://github.com/parcadei/Continuous-Claude-v3 @ d07ff4b — ★ 3,883 · Python · MIT · last push 7 months ago

• Manifest detected

  kind=agent slug=braintrust-analyst · path=.claude/agents/braintrust-analyst.md · source=.claude/agents/braintrust-analyst.md

• Slug is URL-safe

  "braintrust-analyst" matches /^[a-z0-9][a-z0-9-]{0,62}$/

• Slug is unique within kind

  No collision found for agent/braintrust-analyst

• Version is semver

  0.1.0

• Manifest present and parseable

  Manifest found at braintrust-analyst.md.

• Name declared and well-formed

  Name "braintrust-analyst" is well-formed.

• Description qualitywarn

  Only 7 words · 50 chars — more detail helps discovery

  Tell consumers what this artifact does in a full sentence.

• Description is substantivewarn

  Description is 7 words — thinner than the 8-word floor.

  Say what it does AND when to use it. A model choosing between tools has only this text to go on.

• Homepage or repository declaredwarn

  No homepage or repository declared.

  Add a "homepage" or "repository" field to braintrust-analyst.md.

• License declaredwarn

  No license found.

  Add a LICENSE file at the artifact root, or declare a `license` field in the manifest. MIT and Apache-2.0 are the common choices.

• LICENSE file at repo root

  LICENSE

• No sensitive files in the repo

  scanned for .env, credentials.json, *.pem, .ssh/, AWS / GCP configs — none found

• No credentials in file contents

  No credentials found in 1 files.

• Agent: tools declaredwarn

  No `tools:` in frontmatter — the agent inherits every available tool

  Declare `tools:` in the frontmatter to scope what this agent may use.

• Agent tool scope declaredwarn

  No tool scope declared.

  Declare `tools:` in the frontmatter with the minimum set needed.

• Agent: prompt definition

  Prompt-based agent — instructions found in the markdown body

• Agent: model preference

  model: opus

• Agent declares substantive instructions

  Agent prompt is 244 words.

• Agent definition present

• Recent activitywarn

  last push 7 months ago — looks slowing down

  Consumers prefer artifacts that are actively maintained (threshold: 90 days, configurable via EVAL_RECENCY_PASS_DAYS).

• CI configuration detectedwarn

  no CI config found (looked for GitHub Actions, CircleCI, GitLab CI, etc.)

  Add a simple workflow (lint + test on PR) — it tells consumers the artifact is built reproducibly.

• Tests detected

  3 test directories · 37 test files

This artifact hasn't produced behavioral results yet: the evaluation sandbox couldn't run it (it may need credentials we don't provide, or a build our environment doesn't support). That's a limitation of our environment, not a verdict on the artifact.