Skip to content

Refactor UME losses#111

Merged
karinazad merged 5 commits intomainfrom
k/refactor-ume
Jun 17, 2025
Merged

Refactor UME losses#111
karinazad merged 5 commits intomainfrom
k/refactor-ume

Conversation

@karinazad
Copy link
Collaborator

@karinazad karinazad commented Jun 17, 2025

  • Refactor Ume losses

Verified that:

  • We can load previous checkpoints
  • Embeddings before and after refactor are the same

@karinazad karinazad requested a review from ncfrey June 17, 2025 17:15
"cosine_with_min_lr",
"warmup_stable_decay",
] = "constant_with_warmup",
scheduler: SchedulerType = "constant_with_warmup",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice

@karinazad karinazad merged commit 277bbdc into main Jun 17, 2025
5 checks passed
@karinazad karinazad deleted the k/refactor-ume branch June 17, 2025 23:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants