09-testing-standards-discovery.yaml 2.2 KB

12345678910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758596061626364656667686970717273747576
  1. id: contextscout-testing-standards
  2. name: "ContextScout: Testing Standards Discovery"
  3. description: |
  4. Tests that ContextScout correctly discovers testing-related context files
  5. when asked about writing tests, test coverage, or TDD.
  6. This validates:
  7. - ContextScout finds test-coverage.md in core/standards
  8. - ContextScout finds testing guides in openagents-repo
  9. - ContextScout prioritizes standards over guides
  10. - ContextScout includes security testing if relevant
  11. Expected Files (in priority order):
  12. 1. .opencode/context/core/standards/test-coverage.md (CRITICAL)
  13. 2. .opencode/context/openagents-repo/guides/testing-agent.md (HIGH)
  14. 3. .opencode/context/core/standards/code-quality.md (MEDIUM)
  15. This test SHOULD FAIL if:
  16. - ContextScout doesn't find test-coverage.md
  17. - ContextScout returns unrelated files
  18. - ContextScout doesn't prioritize standards
  19. category: developer
  20. agent: subagents/core/contextscout
  21. prompts:
  22. - text: |
  23. Search for context files related to: writing comprehensive tests with good coverage
  24. Task type: testing
  25. Search intent: I need to write tests following TDD principles with proper coverage
  26. Return:
  27. - Exact file paths to relevant context files
  28. - Brief summary of what each file contains
  29. - Priority order (critical, high, medium)
  30. Focus on:
  31. - Test coverage requirements
  32. - Testing best practices
  33. - TDD workflows
  34. - Test structure and patterns
  35. approvalStrategy:
  36. type: auto-approve
  37. behavior:
  38. forbiddenTools:
  39. - task
  40. - bash
  41. - write # Read-only agent
  42. - edit # Read-only agent
  43. minToolCalls: 1
  44. maxToolCalls: 10
  45. timeout: 60000
  46. tags:
  47. - contextscout
  48. - discovery
  49. - testing
  50. - test-coverage
  51. - tdd
  52. - critical
  53. # Expected outcome:
  54. # - Uses glob to find files matching "test" in core/standards
  55. # - Uses read to load:
  56. # * .opencode/context/core/standards/test-coverage.md
  57. # * .opencode/context/openagents-repo/guides/testing-agent.md
  58. # * .opencode/context/core/standards/code-quality.md
  59. # - Returns structured response with:
  60. # * Priority 1 (CRITICAL): test-coverage.md - Coverage requirements
  61. # * Priority 2 (HIGH): testing-agent.md - Testing workflows
  62. # * Priority 3 (MEDIUM): code-quality.md - Code standards