Example test that does not have tee: https://app.circleci.com/pipelines/github/huggingface/transformers/63142/workflows/4754f622-1e12-40bb-be2f-0dcb363a216b/jobs/778648/steps?invite=true#step-111-6582

CI outputs without tee:

With tee:

Other files are still available:
~/transformers/installed.txt
~/transformers/reports/tests_onnx/durations.txt
~/transformers/reports/tests_onnx/stats.txt
~/transformers/reports/tests_onnx/summary_short.txt
~/transformers/reports/tests_onnx/warnings.txt

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

No one looks at the artifacts

Speak for yourself ;-) , I only look at artifacts since it's impossible to get the traceback in the output. I do not look at the output artifact however, so that change wouldn't impact how I use the reports. However I'm not alone so make sure @LysandreJik @amyeroberts and @ydshieh all agree before merging this.

(The full traceback can still be seen!)

It seems expanding the run test step is still fast, and personally I don't read test_output.txt but just the reports given by --make_reports, I am OK for this change.

One thing remaining is to remove the upload artifact step if we don't produce it. So far, we get

Uploading /home/circleci/transformers/tests_output.txt to ~/transformers/tests_output.txt
  No artifact files found at /home/circleci/transformers/tests_output.txt
Total size uploaded: 0 B

I use the artefacts all the time :D!

I think it's fine for test_outputs.txt to go though, as I rarely look at it and I think all the other info can be found in the other .txt files 👍

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.