01-known-context-direct-load.yaml 1.6 KB

12345678910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758
  1. id: openagent-contextscout-known-context
  2. name: "OpenAgent: Known Context - Should Load Directly (No ContextScout)"
  3. description: |
  4. Tests that OpenAgent DOES NOT use ContextScout for standard tasks where
  5. the context path is well-known and hardcoded.
  6. This validates:
  7. - Agent loads .opencode/context/core/standards/code.md directly
  8. - Agent does NOT delegate to ContextScout (unnecessary overhead)
  9. - Fast execution without discovery phase
  10. Expected Behavior:
  11. - MUST load code.md before writing code
  12. - MUST NOT use task tool to call ContextScout
  13. - SHOULD complete in <30 seconds
  14. This test SHOULD FAIL if:
  15. - Agent uses ContextScout for known context (inefficient)
  16. - Agent doesn't load code.md at all (violates standards)
  17. - Agent takes >30s (discovery overhead detected)
  18. category: developer
  19. prompts:
  20. - text: |
  21. Write a new function called `fibonacci` that calculates the nth fibonacci number.
  22. Use TypeScript and follow the project's code standards.
  23. approvalStrategy:
  24. type: auto-approve
  25. behavior:
  26. mustUseTools:
  27. - read # Must read code.md
  28. mustNotUseTools:
  29. - task # Should NOT delegate to ContextScout
  30. minToolCalls: 2
  31. maxToolCalls: 10
  32. expectedViolations:
  33. - rule: approval-gate
  34. shouldViolate: false
  35. severity: error
  36. timeout: 30000 # Should be fast without discovery
  37. tags:
  38. - openagent
  39. - contextscout-integration
  40. - known-context
  41. - performance
  42. - critical
  43. # Expected outcome:
  44. # - Agent reads .opencode/context/core/standards/code.md
  45. # - Agent writes fibonacci function following standards
  46. # - NO delegation to ContextScout
  47. # - Completes in <30s