06-agent-creation-uses-contextscout.yaml 2.0 KB

1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859606162636465
  1. id: openagent-agent-creation-contextscout
  2. name: "OpenAgent: Uses ContextScout for Agent Creation"
  3. description: |
  4. Tests that OpenAgent delegates to ContextScout when asked to create an agent,
  5. since this is an unfamiliar domain that requires discovering context files.
  6. This validates:
  7. - OpenAgent recognizes agent-creation as requiring context discovery
  8. - OpenAgent delegates to ContextScout via task tool
  9. - OpenAgent uses ContextScout's findings to load context
  10. - OpenAgent follows the discovered context standards
  11. Expected Behavior:
  12. 1. OpenAgent receives request to create agent
  13. 2. OpenAgent delegates to ContextScout to find relevant context
  14. 3. ContextScout returns: agents.md, adding-agent.md, code-quality.md
  15. 4. OpenAgent loads those files
  16. 5. OpenAgent creates agent following discovered standards
  17. This test SHOULD FAIL if:
  18. - OpenAgent doesn't use ContextScout
  19. - OpenAgent uses grep/read directly without ContextScout
  20. - OpenAgent doesn't load discovered context files
  21. category: developer
  22. agent: core/openagent
  23. prompts:
  24. - text: |
  25. Create a new agent called "email-writer" in the content category.
  26. This agent should help users write professional emails.
  27. Make sure to follow all repository standards for agent creation.
  28. approvalStrategy:
  29. type: auto-approve
  30. behavior:
  31. mustUseTools:
  32. - task # Must delegate to ContextScout
  33. - read # Must read discovered context files
  34. minToolCalls: 3
  35. maxToolCalls: 30
  36. expectedViolations:
  37. - rule: approval-gate
  38. shouldViolate: false
  39. severity: error
  40. timeout: 120000
  41. tags:
  42. - openagent
  43. - contextscout-integration
  44. - agent-creation
  45. - delegation
  46. - critical
  47. # Expected outcome:
  48. # - OpenAgent uses task tool to delegate to ContextScout
  49. # - Task prompt includes: "Search for context files related to: agent creation"
  50. # - OpenAgent receives ContextScout's findings
  51. # - OpenAgent uses read tool to load discovered files
  52. # - OpenAgent creates agent following standards from loaded context