Skip to content

Refactor expand_test_data.py to accept PIIRecords #376

@m-goggins

Description

@m-goggins

Summary

Load testing data will need to be scrambled to account for some matches and some non-matches. The expand_test_data.py script does a nice job of scrambling data but it only accepts CSV data that comes from NBS while the load testing data will be PIIRecods. We need to update the script to abstract away the CSV-specific parts so that the apply_field_scrambling function can accept other formats.

Acceptance Criteria

  • expand_test_data.py is refactored to work on a variety on input data (not just the NBS CSV data)
  • For the purposes of load testing, it can accept an individual PIIRecord, multiply it approximately 5 times (we need roughly a 5:1 ratio of records to individuals to replicate Montana's data), scramble some of the data, and return it

Details / Tasks

Note: for the purposes of load testing, it is okay if the individual records are scrambled such that they no longer match the original record.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No fields configured for Task.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions