Home Esplora Aiuto
Accedi
logic855
/
OpenAgentsControl
mirror da https://github.com/darrenhinde/OpenAgentsControl.git
1
0
Forka 0
File Problemi 0 Wiki
Albero (Tree): 8caf167d54
Rami (Branch) Tag
OpenAgentsCo...
/
evals
/
agents
/
subagents
/
system-builder
/
context-organizer
/
README.md

README.md 2.2 KB
Cronologia Originale

Context Organizer - Evaluation Tests

Overview

Agent: ContextOrganizer
Parent Agent: system-builder
Description: Organizes and generates context files for knowledge management

Test Structure

system-builder/context-organizer/
├── config/
│   └── config.yaml          # Test configuration
├── tests/
│   └── smoke-test.yaml      # Basic sanity check
├── prompts/                 # Prompt variants (future)
└── README.md                # This file

Running Tests

Standalone Mode

Tests the subagent directly (forces mode: primary):

# Using npm
npm run eval:sdk -- --subagent=system-builder-context-organizer

# Using Makefile
make test-subagent SUBAGENT=system-builder-context-organizer

# Verbose output
npm run eval:sdk -- --subagent=system-builder-context-organizer --verbose

Delegation Mode

Tests via parent agent (real-world usage):

# Using npm
npm run eval:sdk -- --subagent=system-builder-context-organizer --delegate

# Using Makefile
make test-subagent-delegate SUBAGENT=system-builder-context-organizer

Test Suites

Smoke Tests

  • Purpose: Basic sanity checks
  • Coverage: Agent initialization, basic tool usage
  • Status: ✅ Implemented

Standalone Tests

  • Purpose: Test subagent in isolation
  • Coverage: Core functionality without parent delegation
  • Status: 🚧 TODO

Delegation Tests

  • Purpose: Test subagent via parent agent
  • Coverage: Real-world delegation scenarios
  • Status: 🚧 TODO

Adding Tests

  1. Create test file in tests/ directory
  2. Follow the YAML schema from evals/agents/shared/tests/golden/
  3. Add appropriate tags: subagent, system-builder-context-organizer, suite name
  4. Update this README with test description

Prompt Variants

The prompts/ directory is reserved for model-specific prompt variants:

  • gpt.md - GPT-optimized prompts
  • gemini.md - Gemini-optimized prompts
  • llama.md - Llama-optimized prompts
  • etc.

Status: 🚧 Not yet implemented

Related Documentation