Skip to content

DIBBS default with empty log-odds #444

@ericbuckley

Description

@ericbuckley

Summary

Separate the default algorithm configuration into 2, one with empty log odds for production and another with the LAC values for testing.

Details / Tasks

  • Create a second algorithm config named testing in the new assets/testing_algorithms.json file. This new config, will look exactly like what dibbs-default is today.
  • Update the dibbs-default algorithm, to have all the log odds values set to 0.0. It will work out of the box, but won't yield meaningful results (all linkage results will return certainly-not).
  • Update the default_algorithm function in conftest.py to return the testing algorithm.
  • Add an env variable for INITIAL_ALGORITHMS=assets/testing_algorithms.json to the api service in compose.yml (necessary so the performance testing suite has log odds values to use)
  • Using 0.0 in all the log odds values will cause some issues. Algorithm schema validation will fail and there will be some divide by 0 issues in blocking / evaluation. These should be addressed.

Dependencies

We should hold off on merging these changes until tuning is ready for use.

Metadata

Metadata

Assignees

Labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions