Describe the bug
Problem Description
- An
ExecutionResultSet (ERS) contains multiple ExecutionResults with test cases referring to the same track but to different track versions.
- When this ERS is now evaluated by
EvaluatorCSV, the trackPerformanceCube.csv evaluates the versions separately but it is not reconizable which track version was used.
To Reproduce
Reproducible in all MELT versions on all OS.
Full log output
Not relevant
Expected behavior
One of the following:
- Always print the track version.
- Automatically detect if multiple track versions are used and display the version in such cases in the produced CSV.
- Treat such cases as if this were only one track. Allow the user to manually set whether to treat track versions differently.
Describe the bug
Problem Description
ExecutionResultSet(ERS) contains multipleExecutionResults with test cases referring to the same track but to different track versions.EvaluatorCSV, thetrackPerformanceCube.csvevaluates the versions separately but it is not reconizable which track version was used.To Reproduce
Reproducible in all MELT versions on all OS.
Full log output
Not relevant
Expected behavior
One of the following: