Elasticsearch Version

9.2+

Installed Plugins

No response

Java Version

bundled

OS Version

any

Problem Description

We inappropriately scale num_candidates as a value of visit percentage. We scale it too aggressively given the data size. Instead it should be more linear and less dependent on data size as a whole. Additionally, this transformation should be VERY simple, right now its pretty complicated.

Steps to Reproduce

have a medium sized index (100k+), see num_candidate visit percentage is likely < 1%.

Logs (if relevant)

No response