Skip to content

Add some initial v0.3.0 API testing in daily integration tests#1358

Open
bharat-thotakura wants to merge 59 commits into
mainfrom
bt/update-daily-tests
Open

Add some initial v0.3.0 API testing in daily integration tests#1358
bharat-thotakura wants to merge 59 commits into
mainfrom
bt/update-daily-tests

Conversation

@bharat-thotakura

@bharat-thotakura bharat-thotakura commented Mar 5, 2026

Copy link
Copy Markdown
Contributor

Closes #1354

bharat-thotakura and others added 7 commits March 5, 2026 16:56
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
@bharat-thotakura bharat-thotakura marked this pull request as ready for review March 5, 2026 23:29
@bharat-thotakura bharat-thotakura marked this pull request as draft March 6, 2026 03:06
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
@bharat-thotakura bharat-thotakura marked this pull request as ready for review March 10, 2026 02:22
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
@bharat-thotakura bharat-thotakura marked this pull request as draft March 10, 2026 05:31
bharat-thotakura added a commit that referenced this pull request Mar 18, 2026
Presently, the daily integration test workflow uses only 2 workers from
`pytest-xdist` and generally can take a while to finish, waiting on some
slower tests relative to others. Anticipating
#1358, which [will
slow
down](https://github.com/Infleqtion/client-superstaq/actions/runs/22884111478)
the workflow even more, this PR adds `pytest-split` to break up the
(current) total of 44 unit tests from the `css` and `qss` integration
tests combined into 4 concurrent workflows, each using 2 workers. (Note:
the tests are split up evenly across the 4 workflows (called 'groups'),
but `pytest-split` can unevenly group time-consuming tests if given
`pytest` timing info)

Additionally, on a more speculative & hopeful note, this PR also applies
`pytest-split` on the three notebook checks in the regular CI to
continue to mitigate against
#1129 (with the
idea being that each concurrent workflow should now only assign 1
notebook per worker (of course, subject to change if new notebooks are
added)). In [initial
testing](https://github.com/Infleqtion/client-superstaq/actions/runs/22887601930/job/66403774452),
this did not seem to offer much in time reduction due to the small
number of notebooks being tested to begin with (& the worker overhead
perhaps), but this approach might still be worth experimenting with.

Lastly, to confer any potential speed benefits, this PR also updates all
relevant CI jobs to use Python 3.14 from the previous Python 3.13

---------

Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Co-authored-by: richrines1 <85512171+richrines1@users.noreply.github.com>
bharat-thotakura and others added 3 commits March 18, 2026 11:05
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
@bharat-thotakura

bharat-thotakura commented Mar 19, 2026

Copy link
Copy Markdown
Contributor Author

An example integration test workflow against this branch can be found here

@bharat-thotakura bharat-thotakura marked this pull request as ready for review March 19, 2026 16:31
Comment thread cirq-superstaq/cirq_superstaq/daily_integration_test.py Outdated
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
@bharat-thotakura

Copy link
Copy Markdown
Contributor Author

Integration test has now passed against the latest commits

@bharat-thotakura

Copy link
Copy Markdown
Contributor Author

Looks like the backoff implementation isn't helping as expected (see failed workflow). Will need to look into some revisions

@bharat-thotakura bharat-thotakura marked this pull request as draft April 22, 2026 19:46
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
Signed-off-by: Bharath <bharath.thotakura@infleqtion.com>
@bharat-thotakura bharat-thotakura marked this pull request as ready for review May 5, 2026 21:41
python -m pip install --upgrade pip
python -m pip install ${{ matrix.dependencies }}
- name: Pytest integration check (group ${{ matrix.group }} of 2)
python -m pip install -e ./general-superstaq

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

To remove python -m pip install -e ./general-superstaq before merging

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Integration test failed

2 participants