06-agent-creation-discovery.yaml 2.4 KB

1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859606162636465666768697071727374757677
  1. id: contextscout-agent-creation
  2. name: "ContextScout: Agent Creation Context Discovery"
  3. description: |
  4. Tests that ContextScout correctly discovers agent-related context files
  5. when asked about creating or modifying agents.
  6. This validates:
  7. - ContextScout finds openagents-repo/core-concepts/agents.md
  8. - ContextScout finds openagents-repo/guides/adding-agent.md
  9. - ContextScout prioritizes correctly (concepts before guides)
  10. - ContextScout returns exact file paths
  11. - ContextScout provides actionable line ranges
  12. Expected Files (in priority order):
  13. 1. .opencode/context/openagents-repo/core-concepts/agents.md (CRITICAL)
  14. 2. .opencode/context/openagents-repo/guides/adding-agent.md (HIGH)
  15. 3. .opencode/context/core/standards/code-quality.md (MEDIUM)
  16. This test SHOULD FAIL if:
  17. - ContextScout doesn't find agents.md
  18. - ContextScout doesn't find adding-agent.md
  19. - ContextScout returns wrong priority order
  20. - ContextScout fabricates paths
  21. category: developer
  22. agent: subagents/core/contextscout
  23. prompts:
  24. - text: |
  25. Search for context files related to: creating a new agent
  26. Task type: agent-creation
  27. Search intent: I need to understand how to create a new agent in the OpenAgents repository
  28. Return:
  29. - Exact file paths to relevant context files
  30. - Brief summary of what each file contains
  31. - Priority order (critical, high, medium)
  32. Focus on:
  33. - Agent structure and format
  34. - Step-by-step creation guides
  35. - Code standards for agents
  36. - Testing requirements
  37. approvalStrategy:
  38. type: auto-approve
  39. behavior:
  40. forbiddenTools:
  41. - task
  42. - bash
  43. - write # Read-only agent
  44. - edit # Read-only agent
  45. minToolCalls: 1
  46. maxToolCalls: 10
  47. timeout: 60000
  48. tags:
  49. - contextscout
  50. - discovery
  51. - agent-creation
  52. - openagents-repo
  53. - critical
  54. # Expected outcome:
  55. # - Uses glob to find files matching "agent" in openagents-repo
  56. # - Uses read to load:
  57. # * .opencode/context/openagents-repo/core-concepts/agents.md
  58. # * .opencode/context/openagents-repo/guides/adding-agent.md
  59. # * .opencode/context/core/standards/code-quality.md
  60. # - Returns structured response with:
  61. # * Priority 1 (CRITICAL): agents.md - Understanding agent structure
  62. # * Priority 2 (HIGH): adding-agent.md - Step-by-step creation guide
  63. # * Priority 3 (MEDIUM): code-quality.md - Code standards to follow