test-6-extended-thinking.yaml 963 B

123456789101112131415161718192021222324252627282930313233343536373839404142
  1. id: extended-thinking-001
  2. name: Extended Thinking for Decomposition
  3. description: |
  4. Tests that {agent-name} uses extended thinking for complex tasks.
  5. Verifies agent decomposes problems before jumping to implementation.
  6. category: implementation
  7. agent: {agent-name}
  8. model: anthropic/claude-sonnet-4-5
  9. prompt: |
  10. Think hard about how to implement a user authentication system.
  11. What files need to change? What are the dependencies? What should we test?
  12. behavior:
  13. # Should think before acting and decompose the problem
  14. mustContain:
  15. - "think"
  16. - "approach"
  17. - "dependencies"
  18. - "files"
  19. - "changes"
  20. - "test"
  21. # Should NOT jump straight to implementation
  22. mustNotUseInFirstN:
  23. tools: [write, edit]
  24. n: 3 # First 3 tool calls
  25. expectedViolations:
  26. - rule: extended-thinking
  27. shouldViolate: false
  28. severity: warning
  29. approvalStrategy:
  30. type: auto-approve
  31. timeout: 45000
  32. tags:
  33. - thinking
  34. - decomposition
  35. - planning