Skip to content

Commit 569f80d

Browse files
janeyx99janeyx99
committed
Fix test tools
1 parent 86a961a commit 569f80d

1 file changed

Lines changed: 31 additions & 36 deletions

File tree

‎tools/stats/test_history.py‎

Lines changed: 31 additions & 36 deletions
Original file line numberDiff line numberDiff line change
@@ -193,50 +193,45 @@ def description() -> str:
193193
followed by the time of the specified test in that job at that commit.
194194
Example:
195195
196-
$ tools/stats/test_history.py --mode=multiline --ref=594a66 --sha-length=8 --test=test_set_dir \
197-
--job pytorch_linux_xenial_py3_6_gcc5_4_test --job pytorch_linux_xenial_py3_6_gcc7_test
198-
2021-02-10 11:13:34Z 594a66d7 pytorch_linux_xenial_py3_6_gcc5_4_test 0.36s
199-
2021-02-10 11:13:34Z 594a66d7 pytorch_linux_xenial_py3_6_gcc7_test 0.573s errored
200-
2021-02-10 10:13:25Z 9c0caf03 pytorch_linux_xenial_py3_6_gcc5_4_test 0.819s
201-
2021-02-10 10:13:25Z 9c0caf03 pytorch_linux_xenial_py3_6_gcc7_test 0.449s
202-
2021-02-10 10:09:14Z 602434bc pytorch_linux_xenial_py3_6_gcc5_4_test 0.361s
203-
2021-02-10 10:09:14Z 602434bc pytorch_linux_xenial_py3_6_gcc7_test 0.454s
204-
2021-02-10 10:09:10Z 2e35fe95 (no reports in S3)
205-
2021-02-10 10:09:07Z ff73be7e (no reports in S3)
206-
2021-02-10 10:05:39Z 74082f0d (no reports in S3)
207-
2021-02-10 07:42:29Z 0620c96f pytorch_linux_xenial_py3_6_gcc5_4_test 0.414s
208-
2021-02-10 07:42:29Z 0620c96f pytorch_linux_xenial_py3_6_gcc5_4_test 0.476s
209-
2021-02-10 07:42:29Z 0620c96f pytorch_linux_xenial_py3_6_gcc7_test 0.377s
210-
2021-02-10 07:42:29Z 0620c96f pytorch_linux_xenial_py3_6_gcc7_test 0.326s
196+
$ tools/stats/test_history.py --mode=multiline --ref=86a961af879 --sha-length=8 \
197+
--test=test_composite_compliance_dot_cpu_float32 \
198+
--job linux-xenial-py3.7-gcc5.4-test-default1 --job linux-xenial-py3.7-gcc7-test-default1
199+
2022-02-18 15:47:37Z 86a961af linux-xenial-py3.7-gcc5.4-test-default1 0.001s
200+
2022-02-18 15:47:37Z 86a961af linux-xenial-py3.7-gcc7-test-default1 0.001s
201+
2022-02-18 15:12:34Z f5e201e4 linux-xenial-py3.7-gcc5.4-test-default1 0.001s
202+
2022-02-18 15:12:34Z f5e201e4 linux-xenial-py3.7-gcc7-test-default1 0.001s
203+
2022-02-18 13:14:56Z 1c0df265 linux-xenial-py3.7-gcc5.4-test-default1 0.001s
204+
2022-02-18 13:14:56Z 1c0df265 linux-xenial-py3.7-gcc7-test-default1 0.001s
205+
2022-02-18 13:14:56Z e73eaffd (no reports in S3)
206+
2022-02-18 06:29:12Z 710f12f5 linux-xenial-py3.7-gcc5.4-test-default1 0.001s
211207
212208
Another multiline example, this time with the --all flag:
213209
214-
$ tools/stats/test_history.py --mode=multiline --all --ref=321b9 --delta=12 --sha-length=8 \
215-
--test=test_qr_square_many_batched_complex_cuda
216-
2021-01-07 10:04:56Z 321b9883 pytorch_linux_xenial_cuda10_2_cudnn7_py3_gcc7_test2 424.284s
217-
2021-01-07 10:04:56Z 321b9883 pytorch_linux_xenial_cuda10_2_cudnn7_py3_slow_test 0.006s skipped
218-
2021-01-07 10:04:56Z 321b9883 pytorch_linux_xenial_cuda11_1_cudnn8_py3_gcc7_test 402.572s
219-
2021-01-07 10:04:56Z 321b9883 pytorch_linux_xenial_cuda9_2_cudnn7_py3_gcc7_test 287.164s
220-
2021-01-06 20:58:28Z fcb69d2e pytorch_linux_xenial_cuda10_2_cudnn7_py3_gcc7_test2 436.732s
221-
2021-01-06 20:58:28Z fcb69d2e pytorch_linux_xenial_cuda10_2_cudnn7_py3_slow_test 0.006s skipped
222-
2021-01-06 20:58:28Z fcb69d2e pytorch_linux_xenial_cuda11_1_cudnn8_py3_gcc7_test 407.616s
223-
2021-01-06 20:58:28Z fcb69d2e pytorch_linux_xenial_cuda9_2_cudnn7_py3_gcc7_test 287.044s
210+
$ tools/stats/test_history.py --mode=multiline --all --ref=86a961af879 --delta=12 --sha-length=8 \
211+
--test=test_composite_compliance_dot_cuda_float32
212+
2022-02-18 03:49:46Z 69389fb5 linux-bionic-cuda10.2-py3.9-gcc7-test-default1 0.001s skipped
213+
2022-02-18 03:49:46Z 69389fb5 linux-bionic-cuda10.2-py3.9-gcc7-test-slow1 0.001s skipped
214+
2022-02-18 03:49:46Z 69389fb5 linux-xenial-cuda11.3-py3.7-gcc7-test-default1 0.001s skipped
215+
2022-02-18 03:49:46Z 69389fb5 periodic-linux-bionic-cuda11.5-py3.7-gcc7-test-default1 0.001s skipped
216+
2022-02-18 03:49:46Z 69389fb5 periodic-linux-xenial-cuda10.2-py3-gcc7-slow-gradcheck-test-default1 0.001s skipped
217+
2022-02-18 03:49:46Z 69389fb5 periodic-linux-xenial-cuda11.1-py3.7-gcc7-debug-test-default1 0.001s skipped
224218
225219
In columns mode, the name of the job isn't printed, but the order of the
226220
columns is guaranteed to match the order of the jobs passed on the
227221
command line. Example:
228222
229-
$ tools/stats/test_history.py --mode=columns --ref=3cf783 --sha-length=8 --test=test_set_dir \
230-
--job pytorch_linux_xenial_py3_6_gcc5_4_test --job pytorch_linux_xenial_py3_6_gcc7_test
231-
2021-02-10 12:18:50Z 3cf78395 0.644s 0.312s
232-
2021-02-10 11:13:34Z 594a66d7 0.360s errored
233-
2021-02-10 10:13:25Z 9c0caf03 0.819s 0.449s
234-
2021-02-10 10:09:14Z 602434bc 0.361s 0.454s
235-
2021-02-10 10:09:10Z 2e35fe95
236-
2021-02-10 10:09:07Z ff73be7e
237-
2021-02-10 10:05:39Z 74082f0d
238-
2021-02-10 07:42:29Z 0620c96f 0.414s 0.377s (2 job re-runs omitted)
239-
2021-02-10 07:27:53Z 33afb5f1 0.381s 0.294s
223+
$ tools/stats/test_history.py --mode=columns --ref=86a961af879 --sha-length=8 \
224+
--test=test_composite_compliance_dot_cpu_float32 \
225+
--job linux-xenial-py3.7-gcc5.4-test-default1 --job linux-xenial-py3.7-gcc7-test-default1
226+
2022-02-18 15:47:37Z 86a961af 0.001s 0.001s
227+
2022-02-18 15:12:34Z f5e201e4 0.001s 0.001s
228+
2022-02-18 13:14:56Z 1c0df265 0.001s 0.001s
229+
2022-02-18 13:14:56Z e73eaffd
230+
2022-02-18 06:29:12Z 710f12f5 0.001s 0.001s
231+
2022-02-18 05:20:30Z 51b04f27 0.001s 0.001s
232+
2022-02-18 03:49:46Z 69389fb5 0.001s 0.001s
233+
2022-02-18 00:19:12Z 056b6260 0.001s 0.001s
234+
2022-02-17 23:58:32Z 39fb7714 0.001s 0.001s
240235
241236
Minor note: in columns mode, a blank cell means that no report was found
242237
in S3, while the word "absent" means that a report was found but the

0 commit comments

Comments
 (0)