OpenAgentsControl/evals/agents/subagents/code/codebase-pattern-analyst/README.md

Codebase Pattern Analyst - Evaluation Tests

Overview

Agent: PatternAnalyst
Parent Agent: opencoder
Description: Finds similar implementations across the codebase

Test Structure

code/codebase-pattern-analyst/
├── config/
│   └── config.yaml          # Test configuration
├── tests/
│   └── smoke-test.yaml      # Basic sanity check
├── prompts/                 # Prompt variants (future)
└── README.md                # This file

Running Tests

Standalone Mode

Tests the subagent directly (forces mode: primary):

# Using npm
npm run eval:sdk -- --subagent=code-codebase-pattern-analyst

# Using Makefile
make test-subagent SUBAGENT=code-codebase-pattern-analyst

# Verbose output
npm run eval:sdk -- --subagent=code-codebase-pattern-analyst --verbose

Delegation Mode

Tests via parent agent (real-world usage):

# Using npm
npm run eval:sdk -- --subagent=code-codebase-pattern-analyst --delegate

# Using Makefile
make test-subagent-delegate SUBAGENT=code-codebase-pattern-analyst

Test Suites

Smoke Tests

• Purpose: Basic sanity checks
• Coverage: Agent initialization, basic tool usage
• Status: ✅ Implemented

Standalone Tests

• Purpose: Test subagent in isolation
• Coverage: Core functionality without parent delegation
• Status: 🚧 TODO

Delegation Tests

• Purpose: Test subagent via parent agent
• Coverage: Real-world delegation scenarios
• Status: 🚧 TODO

Adding Tests

1. Create test file in tests/ directory
2. Follow the YAML schema from evals/agents/shared/tests/golden/
3. Add appropriate tags: subagent, code-codebase-pattern-analyst, suite name
4. Update this README with test description

Prompt Variants

The prompts/ directory is reserved for model-specific prompt variants:

• gpt.md - GPT-optimized prompts
• gemini.md - Gemini-optimized prompts
• llama.md - Llama-optimized prompts
• etc.

Status: 🚧 Not yet implemented

Related Documentation

• Subagent Testing Guide
• Eval Framework Guide
• Agent Source