Skip to content
This repository was archived by the owner on Sep 30, 2024. It is now read-only.
This repository was archived by the owner on Sep 30, 2024. It is now read-only.

Embeddings: fix slow scheduling queries #58360

@jtibshirani

Description

@jtibshirani

Once a minute, we query the repo_embedding_jobs table to check a repo needs to be re-embedded, or if there is already an up-to-date embeddings index. At some customer sites, we've seen this query add a ton of load to the DB.

Ideas for a quick fix:

  • Run this query less frequently -- we can likely check this much less often, as default minimum interval between embedding jobs is 24 hours
  • Add indexes to this table

/cc @sourcegraph/search-platform

Metadata

Metadata

Assignees

Labels

bugAn error, flaw or fault that produces an incorrect or unexpected result, or behavior.customerImportant issues reported or desired by a customer.team/search-platformIssues owned by the search platform team

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions