Summary
Run both the algorithm and the performance test suites using main and the last tagged release. Compare the results.
Details / Tasks
Algorithm Tests: Please use the circulated NBS test / seed files, not the sample files in the repo.
Performance Tests: We'd likely want to benchmark a few runs and take the average. For parameters, please keep the population size at 100, split records to 1, and increase the number of iterations to 2.
NOTE: For the first performance test, run as is. For all subsequent tests, comment out line 19 (generate synthetic data) in the test_synthea_data.sh script. We want to make sure the input for each run is exactly the same.
Related Issues/PRs
See #343 for prior metrics
Summary
Run both the algorithm and the performance test suites using main and the last tagged release. Compare the results.
Details / Tasks
Algorithm Tests: Please use the circulated NBS test / seed files, not the sample files in the repo.
Performance Tests: We'd likely want to benchmark a few runs and take the average. For parameters, please keep the population size at 100, split records to 1, and increase the number of iterations to 2.
NOTE: For the first performance test, run as is. For all subsequent tests, comment out line 19 (generate synthetic data) in the test_synthea_data.sh script. We want to make sure the input for each run is exactly the same.
Related Issues/PRs
See #343 for prior metrics