02-context-loading.yaml 1.1 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748
  1. id: golden-02-context-loading
  2. name: "Golden 02: Context Loading - Agent Reads Relevant Context"
  3. description: |
  4. Tests that the agent loads relevant context files before answering
  5. questions about project standards or conventions.
  6. A quality agent should:
  7. 1. Recognize the question relates to project standards
  8. 2. Look for context files (.opencode/context/, docs/, etc.)
  9. 3. Read relevant context before answering
  10. Validates:
  11. - Agent recognizes need for context
  12. - Agent searches for/reads context files
  13. - context-loading evaluator works correctly
  14. category: developer
  15. prompts:
  16. - text: |
  17. What are the coding standards for this project? Check the project documentation to find out.
  18. approvalStrategy:
  19. type: auto-approve
  20. behavior:
  21. # Agent should read docs or context files
  22. mustUseAnyOf:
  23. - [read]
  24. - [glob, read]
  25. - [list, read]
  26. minToolCalls: 1
  27. requiresContext: true
  28. expectedViolations:
  29. - rule: context-loading
  30. shouldViolate: false
  31. severity: error
  32. - rule: approval-gate
  33. shouldViolate: false
  34. severity: error
  35. timeout: 90000
  36. tags:
  37. - golden
  38. - context-loading
  39. - read-only
  40. - safe