Skip to content

Flyte Callback #23476

@peridotml

Description

@peridotml

Feature request

Hi! I am an OSS contributor to Flyte, a workflow orchestration tool. I am working on a HuggingFace plugin to integrate better with Hugging Face.

I am working on a FlyteCallback that will automatically integrate with Flyte's checkpointing, visualizations, and eventually logging!

I was hoping that we could add it to the integrations.py similar to other ML Tools, but I wanted to check with you all before making a PR.

Motivation

A good way to help Flyte users working with Hugging Face and Hugging Face users who end up using Flyte for orchestration.

Your contribution

I would clean up and extend the callback in this gist and create a PR.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions