05-no-context-handling.yaml 1.1 KB

1234567891011121314151617181920212223242526272829303132333435363738394041424344454647
  1. id: core-context-retriever-no-context
  2. name: "Context Retriever: Edge Case - No Context Found"
  3. description: |
  4. Tests the context-retriever's ability to handle repositories without
  5. formal context structure gracefully.
  6. Validates:
  7. - Searches multiple common context locations
  8. - Reports when no context is found
  9. - Suggests alternatives (README, CONTRIBUTING)
  10. - Provides helpful recommendations
  11. - Doesn't fabricate non-existent context
  12. Critical Behavior:
  13. - MUST search multiple locations
  14. - MUST report honestly when nothing found
  15. - MUST suggest alternatives
  16. - MUST NOT claim files exist that don't
  17. category: developer
  18. prompts:
  19. - text: |
  20. Search for API design guidelines in the .tmp/test-fixtures/context-retriever
  21. directory (which is empty). How do you handle this?
  22. approvalStrategy:
  23. type: auto-approve
  24. behavior:
  25. mustUseTools:
  26. - list
  27. minToolCalls: 1
  28. maxToolCalls: 10
  29. expectedViolations:
  30. - rule: approval-gate
  31. shouldViolate: false
  32. severity: error
  33. timeout: 90000
  34. tags:
  35. - context-retriever
  36. - edge-case
  37. - error-handling
  38. - core-subagent
  39. - read-only