Skip to content

enhance: split available experiments#232

Merged
jeffpaul merged 8 commits intoWordPress:developfrom
sapayth:enhance/split_available_experiments
Mar 3, 2026
Merged

enhance: split available experiments#232
jeffpaul merged 8 commits intoWordPress:developfrom
sapayth:enhance/split_available_experiments

Conversation

@sapayth
Copy link
Contributor

@sapayth sapayth commented Feb 18, 2026 •
edited by github-actions bot
Loading

What?

Closes #218

Organizes AI experiments into categories. Editor features (content generation, alt text) and Admin features (exploration tools) with separate sections in the settings page.

Why?

Update the AI Experiments settings screen to group available experiments into two clear sections: Editor Experiments and Admin Experiments. This improves clarity for users by distinguishing features that appear in the editor from tools intended for site administration, exploration, or developer experience.

How?

  • Added Experiment_Area class with EDITOR and ADMIN constants
  • Added get_category() method to the Experiment interface
  • All experiments must now define a category in their metadata
  • Experiments are grouped in the settings UI by category instead of a single list

Use of AI Tools

AI assistance: Yes
Tool(s): Claude Code
Used for: Initial implementation suggestions and refactoring; all code was reviewed, tested, and edited by me.
All changes have been reviewed and tested manually. Code is licensed under GPLv2 or later.

Testing Instructions

Testing Instructions for Keyboard

Screenshots or screencast

Before After
image CleanShot 2026-02-18 at 22 42 02@2x
Open WordPress Playground Preview

@github-actions
Copy link

github-actions bot commented Feb 18, 2026 •
edited
Loading

The following accounts have interacted with this PR and/or linked issues. I will continue to update these lists as activity occurs. You can also manually ask me to refresh this list by adding the props-bot label.

If you're merging code through a pull request on GitHub, copy and paste the following into the bottom of the merge commit message.

Co-authored-by: sapayth <sapayth@git.wordpress.org>
Co-authored-by: jeffpaul <jeffpaul@git.wordpress.org>
Co-authored-by: dkotter <dkotter@git.wordpress.org>
Co-authored-by: Ryujiyasu <ryujiyasu@git.wordpress.org>

To understand the WordPress project's expectations around crediting contributors, please review the Contributor Attribution page in the Core Handbook.

@jeffpaul jeffpaul requested a review from dkotter February 18, 2026 17:04
@jeffpaul jeffpaul added this to the 0.4.0 milestone Feb 18, 2026
@dkotter
Copy link
Collaborator

dkotter commented Feb 20, 2026

So I know there's discussion ongoing right now around graduating some experiments into features (basically dropping the experiment label). I don't know what the settings UI will look like with that change but that may impact what we want to do here, so may be worth holding on this until that decision has been made.

In addition, lots of failing tests here that will need fixed up before we can proceed.

@jeffpaul
Copy link
Member

jeffpaul commented Feb 23, 2026

In addition, lots of failing tests here that will need fixed up before we can proceed.

@sapayth if you can focus on resolving those, I think we'd probably still proceed with this PR as I may not have specifics ready until end of week on Experiments vs. Features and any related documentation and UI updates there

@dkotter dkotter mentioned this pull request Mar 2, 2026
Closed
6 tasks
@dkotter
Copy link
Collaborator

dkotter commented Mar 3, 2026

@jeffpaul This is ready for review now. I've gotten all tests passing (besides our known failures on trunk) and I've also updated the approach here to add in a general "Other" category so we support backwards compat. The idea is any existing Experiment that does not have a category assigned (or has one assigned that we don't support) will automatically go into this "Other" section

@dkotter dkotter requested a review from jeffpaul March 3, 2026 21:35
@codecov
Copy link

codecov bot commented Mar 3, 2026 •
edited
Loading

Codecov Report

❌ Patch coverage is 12.76596% with 82 lines in your changes missing coverage. Please review.
✅ Project coverage is 55.67%. Comparing base (90ed6d9) to head (2aa4f64).
⚠️ Report is 9 commits behind head on develop.

Files with missing lines Patch % Lines
includes/Settings/Settings_Page.php 0.00% 82 Missing ⚠️
Additional details and impacted files 
@@              Coverage Diff              @@
##             develop     #232      +/-   ##
=============================================
- Coverage      56.02%   55.67%   -0.35%     
- Complexity       511      516       +5     
=============================================
  Files             32       32              
  Lines           2622     2660      +38     
=============================================
+ Hits            1469     1481      +12     
- Misses          1153     1179      +26
Flag Coverage Δ
unit 55.67% <12.76%> (-0.35%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

jeffpaul
jeffpaul approved these changes Mar 3, 2026
View reviewed changes
Copy link
Member

@jeffpaul jeffpaul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, thanks!

@jeffpaul jeffpaul merged commit e63b750 into WordPress:develop Mar 3, 2026
17 of 25 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@dkotter dkotter dkotter approved these changes

@jeffpaul jeffpaul jeffpaul approved these changes

Assignees

@sapayth sapayth

Labels

None yet

Projects

None yet

Milestone

0.4.0

Development

Successfully merging this pull request may close these issues.

Split Available Experiments into Editor and Admin sections

3 participants

@sapayth @dkotter @jeffpaul