Summary
Run both the algorithm and the performance test suites using main and the 25.3.0 tag. Compare the results.
Details / Tasks
Algorithm Tests: Please use the circulated NBS test / seed files, not the sample files in the repo.
Performance Tests: We'd likely want to benchmark a few runs and take the average. For parameters, please keep the population size at 100, split records to 1, and increase the number of iterations to 2.
NOTE: For the first performance test, run as is. For all subsequent tests, comment out line 19 (generate synthetic data) in the test_synthea_data.sh script. We want to make sure the input for each run is exactly the same.
Summary
Run both the algorithm and the performance test suites using main and the 25.3.0 tag. Compare the results.
Details / Tasks
Algorithm Tests: Please use the circulated NBS test / seed files, not the sample files in the repo.
Performance Tests: We'd likely want to benchmark a few runs and take the average. For parameters, please keep the population size at 100, split records to 1, and increase the number of iterations to 2.
NOTE: For the first performance test, run as is. For all subsequent tests, comment out line 19 (generate synthetic data) in the test_synthea_data.sh script. We want to make sure the input for each run is exactly the same.