05-no-context-handling.yaml 1.0 KB

1234567891011121314151617181920212223242526272829303132333435363738394041424344
  1. id: core-contextscout-no-context
  2. name: "ContextScout: Edge Case - No Context Found"
  3. description: |
  4. Tests ContextScout's ability to handle repositories without
  5. formal context structure gracefully.
  6. Validates:
  7. - Searches multiple common context locations
  8. - Reports when no context is found
  9. - Suggests alternatives (README, CONTRIBUTING)
  10. - Provides helpful recommendations
  11. - Doesn't fabricate non-existent context
  12. Critical Behavior:
  13. - MUST search multiple locations
  14. - MUST report honestly when nothing found
  15. - MUST suggest alternatives
  16. - MUST NOT claim files exist that don't
  17. category: developer
  18. prompts:
  19. - text: |
  20. Search for API design guidelines in the .tmp/test-fixtures/contextscout
  21. directory (which is empty). How do you handle this?
  22. approvalStrategy:
  23. type: auto-approve
  24. behavior:
  25. minToolCalls: 1
  26. maxToolCalls: 10
  27. expectedViolations:
  28. - rule: approval-gate
  29. shouldViolate: false
  30. severity: error
  31. timeout: 90000
  32. tags:
  33. - contextscout
  34. - edge-case
  35. - error-handling
  36. - core-subagent