03-code-standards-no-contextscout.yaml 1.9 KB

1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859606162636465
  1. id: opencoder-code-standards-no-contextscout
  2. name: "OpenCoder: Doesn't Use ContextScout for Code Standards"
  3. description: |
  4. Tests that OpenCoder does NOT delegate to ContextScout for familiar domains
  5. like code standards, testing, or general development patterns.
  6. This validates:
  7. - OpenCoder recognizes code standards as known domain
  8. - OpenCoder loads context directly without ContextScout
  9. - OpenCoder uses read tool directly
  10. - OpenCoder doesn't add unnecessary delegation overhead
  11. Expected Behavior:
  12. 1. OpenCoder receives code implementation request
  13. 2. OpenCoder recognizes this as known domain (code standards)
  14. 3. OpenCoder loads .opencode/context/core/standards/code-quality.md directly
  15. 4. OpenCoder does NOT delegate to ContextScout
  16. This test SHOULD FAIL if:
  17. - OpenCoder delegates to ContextScout for known domains
  18. - OpenCoder doesn't load context at all
  19. - OpenCoder loads wrong context files
  20. category: developer
  21. agent: core/opencoder
  22. prompts:
  23. - text: |
  24. Implement a function that validates user email addresses.
  25. Requirements:
  26. - Pure function
  27. - Proper error handling
  28. - Return structured result (success/error)
  29. approvalStrategy:
  30. type: auto-approve
  31. behavior:
  32. mustUseTools:
  33. - read # Must read code-quality.md directly
  34. forbiddenTools:
  35. - task # Should NOT delegate to ContextScout for known domain
  36. minToolCalls: 1
  37. maxToolCalls: 10
  38. expectedViolations:
  39. - rule: approval-gate
  40. shouldViolate: false
  41. severity: error
  42. timeout: 60000
  43. tags:
  44. - opencoder
  45. - contextscout-integration
  46. - known-domain
  47. - direct-loading
  48. - medium
  49. # Expected outcome:
  50. # - OpenCoder uses read tool to load code-quality.md directly
  51. # - OpenCoder does NOT use task tool to delegate to ContextScout
  52. # - OpenCoder implements pure function following code standards
  53. # - Function returns { success: boolean, data/error } structure