Summary
Separate the default algorithm configuration into 2, one with empty log odds for production and another with the LAC values for testing.
Details / Tasks
- Create a second algorithm config named testing in the new
assets/testing_algorithms.json file. This new config, will look exactly like what dibbs-default is today.
- Update the dibbs-default algorithm, to have all the log odds values set to 0.0. It will work out of the box, but won't yield meaningful results (all linkage results will return certainly-not).
- Update the
default_algorithm function in conftest.py to return the testing algorithm.
- Add an env variable for INITIAL_ALGORITHMS=assets/testing_algorithms.json to the api service in compose.yml (necessary so the performance testing suite has log odds values to use)
- Using 0.0 in all the log odds values will cause some issues. Algorithm schema validation will fail and there will be some divide by 0 issues in blocking / evaluation. These should be addressed.
Dependencies
We should hold off on merging these changes until tuning is ready for use.
Summary
Separate the default algorithm configuration into 2, one with empty log odds for production and another with the LAC values for testing.
Details / Tasks
assets/testing_algorithms.jsonfile. This new config, will look exactly like what dibbs-default is today.default_algorithmfunction in conftest.py to return the testing algorithm.Dependencies
We should hold off on merging these changes until tuning is ready for use.