| 12345678910111213141516171819202122232425262728293031323334353637383940414243444546 |
- id: ctx-code-001-claude
- name: Code Task with Context Loading (Claude)
- description: |
- Same as ctx-code-001 but using Claude Sonnet to test if model is the issue
- category: developer
- agent: openagent
- model: anthropic/claude-sonnet-4-5
- prompt: |
- Create a simple TypeScript function called 'add' that takes two numbers and returns their sum.
- Save it to evals/test_tmp/math.ts
- # Expected behavior
- behavior:
- mustUseTools: [read, write]
- requiresApproval: true
- requiresContext: true
- minToolCalls: 2
- # Expected violations
- expectedViolations:
- - rule: approval-gate
- shouldViolate: false
- severity: error
-
- - rule: context-loading
- shouldViolate: false
- severity: error
-
- - rule: execution-balance
- shouldViolate: false
- severity: warning
- description: Should read context before writing code
- # Approval strategy
- approvalStrategy:
- type: auto-approve
- timeout: 60000
- tags:
- - workflow-validation
- - context-loading
- - code-task
- - model-test
|
