Description

Modify the two functions in mpi_service that return true-match and non-match pairs to be iterators. We have the potential of reducing our memory footprint by 85% if we don't store the pairs.

Related Issues

refs #456

Additional Notes

This will not resolve #456, this is just the first step of a few to get us there. There will be follow-up steps to change the prob_calc functions to accept iterators and then eventually one to change tuning/base.py::tune to process the data as iterators.

Apologies, but a lot of the changes within are just formatting changes. My editor automatically runs ruff format when I save.

<--------------------- REMOVE THE LINES BELOW BEFORE MERGING --------------------->

Checklist

Please review and complete the following checklist before submitting your pull request:

• I have ensured that the pull request is of a manageable size, allowing it to be reviewed within a single session.
• I have reviewed my changes to ensure they are clear, concise, and well-documented.
• I have updated the documentation, if applicable.
• I have added or updated test cases to cover my changes, if applicable.
• I have minimized the number of reviewers to include only those essential for the review.

Checklist for Reviewers

Please review and complete the following checklist during the review process:

• The code follows best practices and conventions.
• The changes implement the desired functionality or fix the reported issue.
• The tests cover the new changes and pass successfully.
• Any potential edge cases or error scenarios have been considered.