| 1234567891011121314151617181920212223242526272829303132333435363738 |
- id: execution-balance-negative-001
- name: Execution Balance - Execution without reading
- description: |
- Negative test that attempts to force execution (write) without prior read operations.
- May fail if the agent decides to read proactively.
- If the agent performs a prior read, the test will mark the absence of expected violation.
- category: developer
- agent: openagent
- prompts:
- - text: |
- Create a file directly in evals/test_tmp/execution-balance-fail.txt with the content "without prior reading". Do it directly.
- - text: |
- Approve.
- delayMs: 1500
- behavior:
- mustUseTools: [write]
- requiresApproval: true
- minToolCalls: 1
- expectedViolations:
- - rule: approval-gate
- shouldViolate: false
- severity: error
- - rule: execution-balance
- shouldViolate: true
- severity: warning
- approvalStrategy:
- type: auto-approve
- timeout: 120000
- tags:
- - execution-balance
- - negative
- - insufficient-read
|
