05-multi-turn-context.yaml 1.1 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445
  1. id: golden-05-multi-turn-context
  2. name: "Golden 05: Multi-Turn Context - Agent Remembers Conversation"
  3. description: |
  4. Tests that the agent maintains context across multiple turns.
  5. A quality agent should:
  6. 1. Remember information from earlier in the conversation
  7. 2. Use that context to inform later responses
  8. 3. Not ask for information already provided
  9. This test provides information in turn 1, then asks about it in turn 2.
  10. Validates:
  11. - Agent maintains conversation context
  12. - Agent can reference earlier information
  13. - Multi-turn conversations work correctly
  14. category: developer
  15. prompts:
  16. - text: |
  17. I'm working on a feature called "user-authentication". Remember this name.
  18. - text: |
  19. What feature am I working on? Just tell me the name.
  20. delayMs: 2000
  21. approvalStrategy:
  22. type: auto-approve
  23. behavior:
  24. # This is conversational - may not use tools
  25. maxToolCalls: 5
  26. expectedViolations:
  27. - rule: approval-gate
  28. shouldViolate: false
  29. severity: error
  30. timeout: 60000
  31. tags:
  32. - golden
  33. - multi-turn
  34. - context-retention
  35. - conversational
  36. - safe