-
Notifications
You must be signed in to change notification settings - Fork 719
BUG harm categories for AdvBench Dataset aren't added yet #730
Copy link
Copy link
Closed
Labels
datasetsPulling in external datasets into PyRITPulling in external datasets into PyRITgood first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is needed
Description
The fetch_adv_bench_dataset currently does not have any applied harm categories to the different prompts. We want to be able to use this dataset with harm category filters and this requires we manually apply category labels to the dataset to use in PyRIT.
This may look like adding harm categories in a separate file to import into PyRIT instead of using this CSV file in the fetch function here: https://github.com/Azure/PyRIT/blob/main/pyrit/datasets/fetch_example_datasets.py
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
datasetsPulling in external datasets into PyRITPulling in external datasets into PyRITgood first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is needed