Skip to content

Implement provider adapter layer (direct API or via LiteLLM) #5

@Aureliolo

Description

@Aureliolo

Context

Based on the LiteLLM evaluation (#4), implement the actual provider adapter layer. This is the concrete implementation of the unified interface designed in #3, connecting the framework to real LLM APIs.

Acceptance Criteria

  • Anthropic provider working (Claude models)
  • At least one additional provider working (OpenRouter or Ollama)
  • Implements the unified interface from Design unified provider interface (base classes, protocols) #3
  • Provider configuration loaded from YAML config files
  • API keys sourced from environment variables
  • Full async support for all provider operations
  • Integration tests with mock/recorded API responses
  • Error handling for: rate limits (429), authentication errors, timeouts
  • Clean separation between provider-specific and generic code

Dependencies

Design Spec Reference

Section 9.1, 9.3 — Provider Interface and LiteLLM Integration

Metadata

Metadata

Assignees

No one assigned

    Labels

    prio:criticalBlocks other work, must do firstscope:large3+ days of workspec:providersDESIGN_SPEC Section 9 - Model Provider Layertype:featureNew feature implementation

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions