Summary
Load testing data will need to be scrambled to account for some matches and some non-matches. The expand_test_data.py script does a nice job of scrambling data but it only accepts CSV data that comes from NBS while the load testing data will be PIIRecods. We need to update the script to abstract away the CSV-specific parts so that the apply_field_scrambling function can accept other formats.
Acceptance Criteria
Details / Tasks
Note: for the purposes of load testing, it is okay if the individual records are scrambled such that they no longer match the original record.
Summary
Load testing data will need to be scrambled to account for some matches and some non-matches. The
expand_test_data.pyscript does a nice job of scrambling data but it only accepts CSV data that comes from NBS while the load testing data will bePIIRecods. We need to update the script to abstract away the CSV-specific parts so that theapply_field_scramblingfunction can accept other formats.Acceptance Criteria
expand_test_data.pyis refactored to work on a variety on input data (not just the NBS CSV data)Details / Tasks
Note: for the purposes of load testing, it is okay if the individual records are scrambled such that they no longer match the original record.