Skip to content

Move ORPOTrainer to trl.experimental #4465

@behroozazarkhalili

Description

@behroozazarkhalili

Context

Part of #4223 and #4374 - Moving trainers to experimental submodule for V1.

Task

Move ORPOTrainer from main trl module to trl.experimental:

  • Move trainer file to trl/experimental/
  • Update imports in init.py files
  • Update documentation
  • Add deprecation warning in old location
  • Update tests
  • Verify examples still work

Post-V1 Plan

May stay in trl.experimental.

Related

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions