Describe the bug
Description:
The FAIL_TO_PASS and PASS_TO_PASS fields of some instances contain unrelated strings instead of references to unit tests.
An example is provided below. django__django-16950 has ["If form data is provided, a parent's auto-generated alternate key is"] as its FAIL_TO_PASS and some comments as its PASS_TO_PASS
I haven't checked thoroughly, but I can see django__django-15525 and django__django-14792 also have the same problem. Not sure if this will affect the actual evaluation of swebench.
Steps/Code to Reproduce
Buggy Example: django__django-16950
Expected Results
The actual unit tests
Actual Results
As described above
System Information
No response
Describe the bug
Description:
The
FAIL_TO_PASSandPASS_TO_PASSfields of some instances contain unrelated strings instead of references to unit tests.An example is provided below.
django__django-16950has ["If form data is provided, a parent's auto-generated alternate key is"] as itsFAIL_TO_PASSand some comments as itsPASS_TO_PASSI haven't checked thoroughly, but I can see
django__django-15525anddjango__django-14792also have the same problem. Not sure if this will affect the actual evaluation of swebench.Steps/Code to Reproduce
Buggy Example: django__django-16950
Expected Results
The actual unit tests
Actual Results
As described above
System Information
No response