10-mvi-compliance-detection.yaml 1.5 KB

1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556
  1. id: core-contextscout-mvi-detection
  2. name: "ContextScout: Positive Test - MVI Compliance Detection"
  3. description: |
  4. Tests that ContextScout correctly identifies MVI-compliant context files.
  5. This is a POSITIVE test that verifies the agent:
  6. - Detects files <200 lines (MVI compliant)
  7. - Prioritizes MVI-compliant files higher
  8. - Identifies files with clear section headers
  9. - Recognizes function-based folder structure
  10. - Notes presence of navigation README
  11. Expected Behavior:
  12. - MUST check file size/line count
  13. - SHOULD prioritize smaller, focused files
  14. - SHOULD note MVI compliance in output
  15. - SHOULD prefer files with clear structure
  16. This test SHOULD FAIL if:
  17. - Agent doesn't consider file size
  18. - Agent prioritizes large files over small ones
  19. - Agent doesn't mention MVI compliance
  20. category: developer
  21. prompts:
  22. - text: |
  23. Find context files for testing, and tell me which ones follow MVI principles
  24. (Minimal Viable Information - files under 200 lines, clear structure, focused content).
  25. Prioritize MVI-compliant files.
  26. approvalStrategy:
  27. type: auto-approve
  28. behavior:
  29. minToolCalls: 1
  30. maxToolCalls: 10
  31. expectedViolations:
  32. - rule: approval-gate
  33. shouldViolate: false
  34. severity: error
  35. timeout: 120000
  36. tags:
  37. - contextscout
  38. - positive-test
  39. - mvi-compliance
  40. - prioritization
  41. # Expected outcome: Agent should:
  42. # - Find .opencode/context/core/standards/tests.md
  43. # - Note it's ~128 lines (MVI compliant)
  44. # - Prioritize it higher than larger files
  45. # - Mention MVI compliance in output