Skip to content

feat: Add config to limit the concurrency for async embedding#21662

Closed
Classic298 wants to merge 1 commit intoopen-webui:devfrom
Classic298:async-embedding-concurrency
Closed

feat: Add config to limit the concurrency for async embedding#21662
Classic298 wants to merge 1 commit intoopen-webui:devfrom
Classic298:async-embedding-concurrency

Conversation

@Classic298
Copy link
Collaborator

Users have asked for this multiple times, so I decided to make a PR for it.

This is tested locally

Tests made:

  • change config, refresh page, check for the persistence of config
  • test embedding, if semaphore value is applied correctly (worked perfectly)
  • defaults to zero which means unlimited (old existing behaviour)
  • only displays in the UI, if async embedding is on at all
  • tested OpenAI embedding with 0, 1, 5 and 10 set as the value - speed adjusted accordingly, worked perfectly.
  • values persisted

Contributor License Agreement

By submitting this pull request, I confirm that I have read and fully agree to the Contributor License Agreement (CLA), and I am providing my contributions under its terms.

Note

Deleting the CLA section will lead to immediate closure of your PR and it will not be merged in.

@Classic298 Classic298 requested a review from tjbck February 20, 2026 18:31
@pr-validator-bot
Copy link

👋 Welcome and Thank You for Contributing!

We appreciate you taking the time to submit a pull request to Open WebUI!

⚠️ Important: Testing Requirements

We've recently seen an increase in PRs that have significant issues:

  • PRs that don't actually fix the bug they claim to fix
  • PRs that don't implement the feature they describe
  • PRs that break existing functionality
  • PRs that are clearly AI-generated without proper testing being done by the author
  • PRs that simply don't work as intended

These untested PRs consume significant time from maintainers and volunteer contributors who review and test PRs in their free time.
Time that could be spent testing other PRs or improving Open WebUI in other ways.

Before marking your PR as "Ready for Review":

Please explicitly confirm:

  1. ✅ You have personally tested ALL changes in this PR
  2. How you tested it (specific steps you took to verify it works)
  3. Visual evidence where applicable (screenshots or videos showing the feature/fix working) - if applicable to your specific PR

If you're not certain your PR works exactly as intended, please leave it in DRAFT mode until you've thoroughly tested it.

Thank you for helping us maintain quality and respecting the time of our community! 🙏

@tjbck
Copy link
Contributor

tjbck commented Feb 21, 2026

Addressed!

@tjbck tjbck closed this Feb 21, 2026
@Classic298
Copy link
Collaborator Author

5d4547f

@Classic298 Classic298 deleted the async-embedding-concurrency branch February 21, 2026 20:49
@rbsn-cpu
Copy link

Finally, awesome! Thanks, will help a lot :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants