Skip to content

Update the table of Samplers in docs#6287

Merged
y0z merged 2 commits intooptuna:masterfrom
fusawa-yugo:fusawa-yugo/add_NSGAIII_in_docs
Oct 1, 2025
Merged

Update the table of Samplers in docs#6287
y0z merged 2 commits intooptuna:masterfrom
fusawa-yugo:fusawa-yugo/add_NSGAIII_in_docs

Conversation

@fusawa-yugo
Copy link
Copy Markdown
Contributor

Motivation

Changing the layout of the Samplers table would help users.

Description of the changes

Changes I made are:

  1. Reorder of columns
    • popular ones are placed on the left
  2. Add NSGAIIISampler
    • (next to NSGAIISampler)
  3. Embed links for each Sampler

Image:
スクリーンショット 2025-09-26 16 02 59

スクリーンショット 2025-09-26 16 03 22

@y0z
Copy link
Copy Markdown
Member

y0z commented Sep 26, 2025

Could you review this PR?

@y0z y0z added the document Documentation related. label Sep 26, 2025
Comment on lines +17 to +44
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| | AutoSampler | :class:`~optuna.samplers.RandomSampler` | :class:`~optuna.samplers.TPESampler` | :class:`~optuna.samplers.GPSampler` | :class:`~optuna.samplers.CmaEsSampler` | :class:`~optuna.samplers.NSGAIISampler` | :class:`~optuna.samplers.NSGAIIISampler` | :class:`~optuna.samplers.GridSampler` | :class:`~optuna.samplers.QMCSampler` | :class:`~optuna.samplers.BoTorchSampler` | :class:`~optuna.samplers.BruteForceSampler` |
+====================================+=================================+=========================================+======================================+=====================================+========================================+===============================================================================+===============================================================================+=======================================+======================================+==========================================+================================================================================+
| Float parameters | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` (:math:`\color{red}\times` for infinite domain)|
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Integer parameters | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Categorical parameters | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Pruning | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\color{red}\times` (:math:`\blacktriangle` for single-objective) | :math:`\color{red}\times` (:math:`\blacktriangle` for single-objective) | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Multivariate optimization | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Conditional search space | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Multi-objective optimization | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{red}\times` | :math:`\color{green}\checkmark` (:math:`\blacktriangle` for single-objective) | :math:`\color{green}\checkmark` (:math:`\blacktriangle` for single-objective) | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Batch optimization | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Distributed optimization | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Constrained optimization | :math:`\color{green}\checkmark` | :math:`\color{red}\times` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{red}\times` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{red}\times` | :math:`\color{red}\times` | :math:`\color{green}\checkmark` | :math:`\color{red}\times` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Time complexity (per trial) (*) | N/A | :math:`O(d)` | :math:`O(dn \log n)` | :math:`O(n^3)` | :math:`O(d^3)` | :math:`O(mp^2)` (\*\*\*) | :math:`O(mp^2)` (\*\*\*) | :math:`O(dn)` | :math:`O(dn)` | :math:`O(n^3)` | :math:`O(d)` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Recommended budgets (#trials) (**) | as many as one likes | as many as one likes | 100 – 1000 | – 500 | 1000 – 10000 | 100 – 10000 | 100 – 10000 | number of combinations | as many as one likes | 10 – 100 | number of combinations |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| | AutoSampler | :class:`~optuna.samplers.RandomSampler` | :class:`~optuna.samplers.TPESampler` | :class:`~optuna.samplers.GPSampler` | :class:`~optuna.samplers.CmaEsSampler` | :class:`~optuna.samplers.NSGAIISampler` | :class:`~optuna.samplers.NSGAIIISampler` | :class:`~optuna.samplers.GridSampler` | :class:`~optuna.samplers.QMCSampler` | :class:`~optuna.samplers.BoTorchSampler` | :class:`~optuna.samplers.BruteForceSampler` |
+====================================+=================================+=========================================+======================================+=====================================+========================================+===============================================================================+===============================================================================+=======================================+======================================+==========================================+================================================================================+
| Float parameters | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` (:math:`\color{red}\times` for infinite domain)|
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Integer parameters | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Categorical parameters | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Pruning | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\color{red}\times` (:math:`\blacktriangle` for single-objective) | :math:`\color{red}\times` (:math:`\blacktriangle` for single-objective) | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Multivariate optimization | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Conditional search space | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Multi-objective optimization | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{red}\times` | :math:`\color{green}\checkmark` (:math:`\blacktriangle` for single-objective) | :math:`\color{green}\checkmark` (:math:`\blacktriangle` for single-objective) | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Batch optimization | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Distributed optimization | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Constrained optimization | :math:`\color{green}\checkmark` | :math:`\color{red}\times` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{red}\times` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{red}\times` | :math:`\color{red}\times` | :math:`\color{green}\checkmark` | :math:`\color{red}\times` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Time complexity (per trial) (*) | N/A | :math:`O(d)` | :math:`O(dn \log n)` | :math:`O(n^3)` | :math:`O(d^3)` | :math:`O(mp^2)` (\*\*\*) | :math:`O(mp^2)` (\*\*\*) | :math:`O(dn)` | :math:`O(dn)` | :math:`O(n^3)` | :math:`O(d)` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
| Recommended budgets (#trials) (**) | as many as one likes | as many as one likes | 100 – 1000 | – 500 | 1000 – 10000 | 100 – 10000 | 100 – 10000 | number of combinations | as many as one likes | 10 – 100 | number of combinations |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+------------------------------------------+--------------------------------------------------------------------------------+
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+---------------------------------+---------------------------------------------------------------------------------+
| | |AutoSampler|_ | :class:`~optuna.samplers.RandomSampler` | :class:`~optuna.samplers.TPESampler` | :class:`~optuna.samplers.GPSampler` | :class:`~optuna.samplers.CmaEsSampler` | :class:`~optuna.samplers.NSGAIISampler` | :class:`~optuna.samplers.NSGAIIISampler` | :class:`~optuna.samplers.GridSampler` | :class:`~optuna.samplers.QMCSampler` | |BoTorchSampler|_ | :class:`~optuna.samplers.BruteForceSampler` |
+====================================+=================================+=========================================+======================================+=====================================+========================================+===============================================================================+===============================================================================+=======================================+======================================+=================================+=================================================================================+
| Float parameters | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` (:math:`\color{red}\times` for infinite domain) |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+---------------------------------+---------------------------------------------------------------------------------+
| Integer parameters | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+---------------------------------+---------------------------------------------------------------------------------+
| Categorical parameters | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+---------------------------------+---------------------------------------------------------------------------------+
| Pruning | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\color{red}\times` (:math:`\blacktriangle` for single-objective) | :math:`\color{red}\times` (:math:`\blacktriangle` for single-objective) | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+---------------------------------+---------------------------------------------------------------------------------+
| Multivariate optimization | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+---------------------------------+---------------------------------------------------------------------------------+
| Conditional search space | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+---------------------------------+---------------------------------------------------------------------------------+
| Multi-objective optimization | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{red}\times` | :math:`\color{green}\checkmark` (:math:`\blacktriangle` for single-objective) | :math:`\color{green}\checkmark` (:math:`\blacktriangle` for single-objective) | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+---------------------------------+---------------------------------------------------------------------------------+
| Batch optimization | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+---------------------------------+---------------------------------------------------------------------------------+
| Distributed optimization | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\blacktriangle` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+---------------------------------+---------------------------------------------------------------------------------+
| Constrained optimization | :math:`\color{green}\checkmark` | :math:`\color{red}\times` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{red}\times` | :math:`\color{green}\checkmark` | :math:`\color{green}\checkmark` | :math:`\color{red}\times` | :math:`\color{red}\times` | :math:`\color{green}\checkmark` | :math:`\color{red}\times` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+---------------------------------+---------------------------------------------------------------------------------+
| Time complexity (per trial) (*) | N/A | :math:`O(d)` | :math:`O(dn \log n)` | :math:`O(n^3)` | :math:`O(d^3)` | :math:`O(mp^2)` (\*\*\*) | :math:`O(mp^2)` (\*\*\*) | :math:`O(dn)` | :math:`O(dn)` | :math:`O(n^3)` | :math:`O(d)` |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+---------------------------------+---------------------------------------------------------------------------------+
| Recommended budgets (#trials) (**) | as many as one likes | as many as one likes | 100–1000 | –500 | 1000–10000 | 100–10000 | 100–10000 | number of combinations | as many as one likes | 10–100 | number of combinations |
+------------------------------------+---------------------------------+-----------------------------------------+--------------------------------------+-------------------------------------+----------------------------------------+-------------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------+--------------------------------------+---------------------------------+---------------------------------------------------------------------------------+
.. |AutoSampler| replace:: ``AutoSampler``
.. _AutoSampler: https://hub.optuna.org/samplers/auto_sampler/
.. |BoTorchSampler| replace:: ``BoTorchSampler``
.. _BoTorchSampler: https://optuna-integration.readthedocs.io/en/latest/reference/generated/optuna_integration.BoTorchSampler.html

Copy link
Copy Markdown
Collaborator

@kAIto47802 kAIto47802 Oct 1, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

To keep consistency with the other samplers, AutoSampler should also have a link attached. You can achieve this by using a substitution directive, which allows inline code blocks to also function as links.

Also, ":class:~optuna.samplers.BoTorchSampler" does not work, since BoTorchSampler is located in optuna_integration, not in optuna.

Furthermore, we don't insert spaces before and after the en dash (U+2013). This is defined in several style guides, including Chicago Manual of Style 1, APA Style, IEEE Editorial Style Manual, Oxford Style Manual, New Oxford Style Manual.

I also fixed the spacing around BruteForceSampler, which was slightly misaligned.

Footnotes

  1. https://www.chicagomanualofstyle.org/qanda/data/faq/topics/HyphensEnDashesEmDashes/faq0108.html

@kAIto47802
Copy link
Copy Markdown
Collaborator

Thank you for the PR! I was also thinking that this table isn’t very user-friendly.
I’ve left some comments on the table, PTAL :octocat:

Also, could you fix the order of the samplers in the autosummary section to make it consistent with the table?

@y0z y0z self-assigned this Oct 1, 2025
@kAIto47802
Copy link
Copy Markdown
Collaborator

I’ve decided to address this in a follow-up PR, so I’ll go ahead and approve this one for now.

Copy link
Copy Markdown
Member

@y0z y0z left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@y0z y0z merged commit 84d3223 into optuna:master Oct 1, 2025
15 checks passed
@y0z y0z added this to the v4.6.0 milestone Oct 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

document Documentation related.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants