Skip to content

Move CPOTrainer to trl.experimental #4460

@behroozazarkhalili

Description

@behroozazarkhalili

Context

Part of #4223 and #4374 - Moving trainers to experimental submodule for V1.

Task

Move CPOTrainer from main trl module to trl.experimental:

  • Move trainer file to trl/experimental/
  • Update imports in init.py files
  • Update documentation
  • Add deprecation warning in old location
  • Update tests
  • Verify examples still work

Post-V1 Plan

May be removed based on usage and maintenance requirements.

Related

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions