Skip to content

[DataPipe] Snapshotting prototype#70216

Closed
NivekT wants to merge 54 commits intogh/nivekt/38/basefrom
gh/nivekt/38/head
Closed

[DataPipe] Snapshotting prototype#70216
NivekT wants to merge 54 commits intogh/nivekt/38/basefrom
gh/nivekt/38/head

Conversation

@NivekT
Copy link
Contributor

@NivekT NivekT commented Dec 20, 2021 •
edited
Loading

This was referenced Dec 20, 2021
Closed
Closed
@pytorch-probot
Copy link

pytorch-probot bot commented Dec 20, 2021 •
edited
Loading

CI Flow Status

⚛️ CI Flow

Ruleset - Version: v1
Ruleset - File: https://github.com/pytorch/pytorch/blob/806cca03bfa79e2793f7147ca55620e8b91e55f2/.github/generated-ciflow-ruleset.json
PR ciflow labels: ciflow/default

Workflows Labels (bold enabled) Status
Triggered Workflows
linux-binary-conda ciflow/binaries, ciflow/binaries/conda, ciflow/default ✅ triggered
linux-binary-libtorch-cxx11-abi ciflow/binaries, ciflow/binaries/libtorch, ciflow/default ✅ triggered
linux-binary-libtorch-pre-cxx11 ciflow/binaries, ciflow/binaries/libtorch, ciflow/default ✅ triggered
linux-binary-manywheel ciflow/binaries, ciflow/binaries/wheel, ciflow/default ✅ triggered
linux-bionic-py3.7-clang9 ciflow/all, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/noarch, ciflow/trunk, ciflow/xla ✅ triggered
linux-docs ciflow/all, ciflow/cpu, ciflow/default, ciflow/docs, ciflow/linux, ciflow/trunk ✅ triggered
linux-vulkan-bionic-py3.7-clang9 ciflow/all, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/trunk, ciflow/vulkan ✅ triggered
linux-xenial-cuda11.3-py3.7-gcc7 ciflow/all, ciflow/cuda, ciflow/default, ciflow/linux, ciflow/trunk ✅ triggered
linux-xenial-cuda11.3-py3.7-gcc7-bazel-test ciflow/all, ciflow/bazel, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/trunk ✅ triggered
linux-xenial-py3-clang5-mobile-build ciflow/all, ciflow/default, ciflow/linux, ciflow/mobile, ciflow/trunk ✅ triggered
linux-xenial-py3-clang5-mobile-custom-build-static ciflow/all, ciflow/default, ciflow/linux, ciflow/mobile, ciflow/trunk ✅ triggered
linux-xenial-py3.7-clang7-asan ciflow/all, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/sanitizers, ciflow/trunk ✅ triggered
linux-xenial-py3.7-clang7-onnx ciflow/all, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/onnx, ciflow/trunk ✅ triggered
linux-xenial-py3.7-gcc5.4 ciflow/all, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/trunk ✅ triggered
linux-xenial-py3.7-gcc7 ciflow/all, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/trunk ✅ triggered
linux-xenial-py3.7-gcc7-no-ops ciflow/all, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/trunk ✅ triggered
pytorch-linux-xenial-py3-clang5-android-ndk-r19c-gradle-custom-build-single ciflow/all, ciflow/android, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/trunk ✅ triggered
pytorch-linux-xenial-py3-clang5-android-ndk-r19c-gradle-custom-build-single-full-jit ciflow/all, ciflow/android, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/trunk ✅ triggered
win-vs2019-cpu-py3 ciflow/all, ciflow/cpu, ciflow/default, ciflow/trunk, ciflow/win ✅ triggered
win-vs2019-cuda11.3-py3 ciflow/all, ciflow/cuda, ciflow/default, ciflow/trunk, ciflow/win ✅ triggered
Skipped Workflows
caffe2-linux-xenial-py3.7-gcc5.4 ciflow/all, ciflow/cpu, ciflow/linux, ciflow/trunk 🚫 skipped
docker-builds ciflow/all, ciflow/trunk 🚫 skipped
ios-12-5-1-arm64 ciflow/all, ciflow/ios, ciflow/macos, ciflow/trunk 🚫 skipped
ios-12-5-1-arm64-coreml ciflow/all, ciflow/ios, ciflow/macos, ciflow/trunk 🚫 skipped
ios-12-5-1-arm64-custom-ops ciflow/all, ciflow/ios, ciflow/macos, ciflow/trunk 🚫 skipped
ios-12-5-1-arm64-full-jit ciflow/all, ciflow/ios, ciflow/macos, ciflow/trunk 🚫 skipped
ios-12-5-1-arm64-metal ciflow/all, ciflow/ios, ciflow/macos, ciflow/trunk 🚫 skipped
ios-12-5-1-x86-64 ciflow/all, ciflow/ios, ciflow/macos, ciflow/trunk 🚫 skipped
ios-12-5-1-x86-64-coreml ciflow/all, ciflow/ios, ciflow/macos, ciflow/trunk 🚫 skipped
ios-12-5-1-x86-64-full-jit ciflow/all, ciflow/ios, ciflow/macos, ciflow/trunk 🚫 skipped
libtorch-linux-xenial-cuda10.2-py3.7-gcc7 ciflow/all, ciflow/cuda, ciflow/libtorch, ciflow/linux, ciflow/trunk 🚫 skipped
libtorch-linux-xenial-cuda11.3-py3.7-gcc7 ciflow/all, ciflow/cuda, ciflow/libtorch, ciflow/linux, ciflow/trunk 🚫 skipped
linux-bionic-cuda10.2-py3.9-gcc7 ciflow/all, ciflow/cuda, ciflow/linux, ciflow/slow, ciflow/trunk 🚫 skipped
linux-bionic-rocm4.5-py3.7 ciflow/all, ciflow/linux, ciflow/rocm, ciflow/trunk 🚫 skipped
linux-docs-push ciflow/all, ciflow/cpu, ciflow/linux, ciflow/scheduled 🚫 skipped
linux-xenial-cuda11.3-py3.7-gcc7-no-ops ciflow/all, ciflow/cuda, ciflow/linux, ciflow/trunk 🚫 skipped
macos-10-15-py3-arm64 ciflow/all, ciflow/macos, ciflow/trunk 🚫 skipped
macos-10-15-py3-lite-interpreter-x86-64 ciflow/all, ciflow/macos, ciflow/trunk 🚫 skipped
macos-11-py3-x86-64 ciflow/all, ciflow/macos, ciflow/trunk 🚫 skipped
parallelnative-linux-xenial-py3.7-gcc5.4 ciflow/all, ciflow/cpu, ciflow/linux, ciflow/trunk 🚫 skipped
periodic-libtorch-linux-bionic-cuda11.5-py3.7-gcc7 ciflow/all, ciflow/cuda, ciflow/libtorch, ciflow/linux, ciflow/scheduled 🚫 skipped
periodic-libtorch-linux-xenial-cuda11.1-py3.7-gcc7 ciflow/all, ciflow/cuda, ciflow/libtorch, ciflow/linux, ciflow/scheduled 🚫 skipped
periodic-linux-bionic-cuda11.5-py3.7-gcc7 ciflow/all, ciflow/cuda, ciflow/linux, ciflow/scheduled 🚫 skipped
periodic-linux-xenial-cuda10.2-py3-gcc7-slow-gradcheck ciflow/all, ciflow/cuda, ciflow/linux, ciflow/scheduled, ciflow/slow, ciflow/slow-gradcheck 🚫 skipped
periodic-linux-xenial-cuda11.1-py3.7-gcc7-debug ciflow/all, ciflow/cuda, ciflow/linux, ciflow/scheduled 🚫 skipped
periodic-win-vs2019-cuda11.1-py3 ciflow/all, ciflow/cuda, ciflow/scheduled, ciflow/win 🚫 skipped
periodic-win-vs2019-cuda11.5-py3 ciflow/all, ciflow/cuda, ciflow/scheduled, ciflow/win 🚫 skipped
pytorch-linux-xenial-py3-clang5-android-ndk-r19c-build ciflow/all, ciflow/android, ciflow/cpu, ciflow/linux, ciflow/trunk 🚫 skipped

You can add a comment to the PR and tag @pytorchbot with the following commands: 
# ciflow rerun, "ciflow/default" will always be added automatically
@pytorchbot ciflow rerun

# ciflow rerun with additional labels "-l <ciflow/label_name>", which is equivalent to adding these labels manually and trigger the rerun
@pytorchbot ciflow rerun -l ciflow/scheduled -l ciflow/slow

For more information, please take a look at the CI Flow Wiki.

NivekT added a commit that referenced this pull request Dec 20, 2021
@NivekT
[DataPipe] Snapshotting prototype
39778c8 
ghstack-source-id: 7a96077
Pull Request resolved: #70216
@facebook-github-bot
Copy link
Contributor

facebook-github-bot commented Dec 20, 2021 •
edited
Loading

🔗 Helpful links

❌ 8 New Failures

As of commit 70f179d (more details on the Dr. CI page):

Expand to see more
  • 8/8 failures introduced in this PR

🕵️ 8 new failures recognized by patterns

The following CI failures do not appear to be due to upstream breakages

See GitHub Actions build pull / linux-bionic-cuda11.6-py3.7-gcc7 / test (default, 4, 4, linux.4xlarge.nvidia.gpu) (1/8)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-07-20T23:11:06.1621221Z NameError: name 'reset_dps' is not defined 
2022-07-20T23:11:06.1617408Z   File "test_datapipe.py", line 1423, in test_collate_iterdatapipe
2022-07-20T23:11:06.1617872Z     snapshot_test_helper(collate_dp, new_dp, n_elements_to_advance)
2022-07-20T23:11:06.1618464Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T23:11:06.1618836Z 
2022-07-20T23:11:06.1618978Z ======================================================================
2022-07-20T23:11:06.1619340Z ERROR [0.005s]: test_concat_iterdatapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T23:11:06.1619869Z ----------------------------------------------------------------------
2022-07-20T23:11:06.1620244Z Traceback (most recent call last):
2022-07-20T23:11:06.1620593Z   File "test_datapipe.py", line 885, in test_concat_iterdatapipe
2022-07-20T23:11:06.1620883Z     reset_dps()
2022-07-20T23:11:06.1621221Z NameError: name 'reset_dps' is not defined
2022-07-20T23:11:06.1621415Z 
2022-07-20T23:11:06.1621553Z ======================================================================
2022-07-20T23:11:06.1621926Z ERROR [0.006s]: test_filter_datapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T23:11:06.1622398Z ----------------------------------------------------------------------
2022-07-20T23:11:06.1622749Z Traceback (most recent call last):
2022-07-20T23:11:06.1623089Z   File "test_datapipe.py", line 1573, in test_filter_datapipe
2022-07-20T23:11:06.1623454Z     snapshot_test_helper(filter_dp, new_dp, n_elements_to_advance)
2022-07-20T23:11:06.1623870Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T23:11:06.1624111Z 
2022-07-20T23:11:06.1624253Z ======================================================================

See GitHub Actions build pull / linux-bionic-py3.7-clang9 / test (dynamo, 2, 2, linux.2xlarge) (2/8)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-07-20T22:42:49.0713694Z NameError: name 'reset_dps' is not defined 
2022-07-20T22:42:49.0710161Z   File "test_datapipe.py", line 1423, in test_collate_iterdatapipe
2022-07-20T22:42:49.0710536Z     snapshot_test_helper(collate_dp, new_dp, n_elements_to_advance)
2022-07-20T22:42:49.0710844Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:42:49.0711043Z 
2022-07-20T22:42:49.0711142Z ======================================================================
2022-07-20T22:42:49.0711435Z ERROR [0.004s]: test_concat_iterdatapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:42:49.0712008Z ----------------------------------------------------------------------
2022-07-20T22:42:49.0712424Z Traceback (most recent call last):
2022-07-20T22:42:49.0712829Z   File "test_datapipe.py", line 885, in test_concat_iterdatapipe
2022-07-20T22:42:49.0713231Z     reset_dps()
2022-07-20T22:42:49.0713694Z NameError: name 'reset_dps' is not defined
2022-07-20T22:42:49.0713943Z 
2022-07-20T22:42:49.0714118Z ======================================================================
2022-07-20T22:42:49.0714645Z ERROR [0.005s]: test_filter_datapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:42:49.0715315Z ----------------------------------------------------------------------
2022-07-20T22:42:49.0715705Z Traceback (most recent call last):
2022-07-20T22:42:49.0716129Z   File "test_datapipe.py", line 1573, in test_filter_datapipe
2022-07-20T22:42:49.0716647Z     snapshot_test_helper(filter_dp, new_dp, n_elements_to_advance)
2022-07-20T22:42:49.0717170Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:42:49.0717496Z 
2022-07-20T22:42:49.0717662Z ======================================================================

See GitHub Actions build pull / win-vs2019-cpu-py3 / test (default, 1, 2, windows.4xlarge) (3/8)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-07-20T23:53:51.2752836Z NameError: name 'reset_dps' is not defined 
2022-07-20T23:53:51.2750406Z   File "test_datapipe.py", line 1423, in test_collate_iterdatapipe
2022-07-20T23:53:51.2750696Z     snapshot_test_helper(collate_dp, new_dp, n_elements_to_advance)
2022-07-20T23:53:51.2751014Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T23:53:51.2751213Z 
2022-07-20T23:53:51.2751307Z ======================================================================
2022-07-20T23:53:51.2751567Z ERROR [0.000s]: test_concat_iterdatapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T23:53:51.2751882Z ----------------------------------------------------------------------
2022-07-20T23:53:51.2752136Z Traceback (most recent call last):
2022-07-20T23:53:51.2752421Z   File "test_datapipe.py", line 885, in test_concat_iterdatapipe
2022-07-20T23:53:51.2752629Z     reset_dps()
2022-07-20T23:53:51.2752836Z NameError: name 'reset_dps' is not defined
2022-07-20T23:53:51.2752972Z 
2022-07-20T23:53:51.2753073Z ======================================================================
2022-07-20T23:53:51.2753329Z ERROR [0.016s]: test_filter_datapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T23:53:51.2753640Z ----------------------------------------------------------------------
2022-07-20T23:53:51.2753892Z Traceback (most recent call last):
2022-07-20T23:53:51.2754166Z   File "test_datapipe.py", line 1573, in test_filter_datapipe
2022-07-20T23:53:51.2754435Z     snapshot_test_helper(filter_dp, new_dp, n_elements_to_advance)
2022-07-20T23:53:51.2754739Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T23:53:51.2754920Z 
2022-07-20T23:53:51.2755117Z ======================================================================

See GitHub Actions build pull / linux-focal-py3.7-clang7-asan / test (default, 4, 5, linux.2xlarge) (4/8)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-07-20T22:48:59.6137919Z NameError: name 'reset_dps' is not defined 
2022-07-20T22:48:59.6134524Z   File "test_datapipe.py", line 1423, in test_collate_iterdatapipe
2022-07-20T22:48:59.6135104Z     snapshot_test_helper(collate_dp, new_dp, n_elements_to_advance)
2022-07-20T22:48:59.6135686Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:48:59.6136029Z 
2022-07-20T22:48:59.6136201Z ======================================================================
2022-07-20T22:48:59.6136502Z ERROR [0.005s]: test_concat_iterdatapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:48:59.6136891Z ----------------------------------------------------------------------
2022-07-20T22:48:59.6137173Z Traceback (most recent call last):
2022-07-20T22:48:59.6137441Z   File "test_datapipe.py", line 885, in test_concat_iterdatapipe
2022-07-20T22:48:59.6137662Z     reset_dps()
2022-07-20T22:48:59.6137919Z NameError: name 'reset_dps' is not defined
2022-07-20T22:48:59.6138061Z 
2022-07-20T22:48:59.6138160Z ======================================================================
2022-07-20T22:48:59.6138427Z ERROR [0.005s]: test_filter_datapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:48:59.6138810Z ----------------------------------------------------------------------
2022-07-20T22:48:59.6139076Z Traceback (most recent call last):
2022-07-20T22:48:59.6139332Z   File "test_datapipe.py", line 1573, in test_filter_datapipe
2022-07-20T22:48:59.6139607Z     snapshot_test_helper(filter_dp, new_dp, n_elements_to_advance)
2022-07-20T22:48:59.6139928Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:48:59.6140112Z 
2022-07-20T22:48:59.6140216Z ======================================================================

See GitHub Actions build pull / linux-bionic-py3.7-clang9 / test (crossref, 1, 2, linux.2xlarge) (5/8)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-07-20T22:42:46.7484073Z NameError: name 'reset_dps' is not defined 
2022-07-20T22:42:46.7480311Z   File "test_datapipe.py", line 1423, in test_collate_iterdatapipe
2022-07-20T22:42:46.7480803Z     snapshot_test_helper(collate_dp, new_dp, n_elements_to_advance)
2022-07-20T22:42:46.7481538Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:42:46.7481857Z 
2022-07-20T22:42:46.7482022Z ======================================================================
2022-07-20T22:42:46.7482452Z ERROR [0.004s]: test_concat_iterdatapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:42:46.7482889Z ----------------------------------------------------------------------
2022-07-20T22:42:46.7483162Z Traceback (most recent call last):
2022-07-20T22:42:46.7483431Z   File "test_datapipe.py", line 885, in test_concat_iterdatapipe
2022-07-20T22:42:46.7483685Z     reset_dps()
2022-07-20T22:42:46.7484073Z NameError: name 'reset_dps' is not defined
2022-07-20T22:42:46.7484371Z 
2022-07-20T22:42:46.7484585Z ======================================================================
2022-07-20T22:42:46.7485174Z ERROR [0.004s]: test_filter_datapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:42:46.7486018Z ----------------------------------------------------------------------
2022-07-20T22:42:46.7486435Z Traceback (most recent call last):
2022-07-20T22:42:46.7486870Z   File "test_datapipe.py", line 1573, in test_filter_datapipe
2022-07-20T22:42:46.7487382Z     snapshot_test_helper(filter_dp, new_dp, n_elements_to_advance)
2022-07-20T22:42:46.7487915Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:42:46.7488243Z 
2022-07-20T22:42:46.7488417Z ======================================================================

See GitHub Actions build pull / linux-bionic-py3.7-clang9 / test (default, 1, 2, linux.2xlarge) (6/8)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-07-20T22:42:34.3580875Z NameError: name 'reset_dps' is not defined 
2022-07-20T22:42:34.3577268Z   File "test_datapipe.py", line 1423, in test_collate_iterdatapipe
2022-07-20T22:42:34.3577610Z     snapshot_test_helper(collate_dp, new_dp, n_elements_to_advance)
2022-07-20T22:42:34.3578329Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:42:34.3578653Z 
2022-07-20T22:42:34.3578822Z ======================================================================
2022-07-20T22:42:34.3579443Z ERROR [0.004s]: test_concat_iterdatapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:42:34.3579851Z ----------------------------------------------------------------------
2022-07-20T22:42:34.3580125Z Traceback (most recent call last):
2022-07-20T22:42:34.3580391Z   File "test_datapipe.py", line 885, in test_concat_iterdatapipe
2022-07-20T22:42:34.3580613Z     reset_dps()
2022-07-20T22:42:34.3580875Z NameError: name 'reset_dps' is not defined
2022-07-20T22:42:34.3581017Z 
2022-07-20T22:42:34.3581116Z ======================================================================
2022-07-20T22:42:34.3581400Z ERROR [0.004s]: test_filter_datapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:42:34.3581775Z ----------------------------------------------------------------------
2022-07-20T22:42:34.3582047Z Traceback (most recent call last):
2022-07-20T22:42:34.3582308Z   File "test_datapipe.py", line 1573, in test_filter_datapipe
2022-07-20T22:42:34.3582585Z     snapshot_test_helper(filter_dp, new_dp, n_elements_to_advance)
2022-07-20T22:42:34.3582900Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:42:34.3583083Z 
2022-07-20T22:42:34.3583179Z ======================================================================

See GitHub Actions build Lint / lintrunner (7/8)

Step: "Run lintrunner on all files" (full log | diagnosis details | 🔁 rerun)

2022-07-20T22:06:04.0619455Z ##[error]oncall: f...se from https://github.com/pytorch/pytorch/labels) 
2022-07-20T22:06:04.0602749Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0604412Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0606062Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0607705Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0609358Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0611016Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0612777Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0614442Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0616144Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0617799Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0619455Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0657174Z Post job cleanup.
2022-07-20T22:06:04.0690908Z Post job cleanup.
2022-07-20T22:06:04.1782803Z [command]/usr/bin/git version
2022-07-20T22:06:04.1831218Z git version 2.37.1
2022-07-20T22:06:04.1875299Z Temporarily overriding HOME='/home/runner/actions-runner/_work/_temp/92dafca9-108f-4c23-b738-dd0a390adc3b' before making global git config changes
2022-07-20T22:06:04.1875778Z Adding repository directory to the temporary git global config as a safe directory
2022-07-20T22:06:04.1881602Z [command]/usr/bin/git config --global --add safe.directory /home/runner/actions-runner/_work/pytorch/pytorch
2022-07-20T22:06:04.1930106Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2022-07-20T22:06:04.1972608Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2022-07-20T22:06:04.2240931Z Entering 'android/libs/fbjni'

See GitHub Actions build pull / linux-focal-py3.7-gcc7 / test (default, 2, 2, linux.2xlarge) (8/8)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-07-20T22:37:15.7396436Z NameError: name 'reset_dps' is not defined 
2022-07-20T22:37:15.7392975Z   File "test_datapipe.py", line 1423, in test_collate_iterdatapipe
2022-07-20T22:37:15.7393266Z     snapshot_test_helper(collate_dp, new_dp, n_elements_to_advance)
2022-07-20T22:37:15.7393575Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:37:15.7393756Z 
2022-07-20T22:37:15.7394044Z ======================================================================
2022-07-20T22:37:15.7394445Z ERROR [0.004s]: test_concat_iterdatapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:37:15.7394857Z ----------------------------------------------------------------------
2022-07-20T22:37:15.7395270Z Traceback (most recent call last):
2022-07-20T22:37:15.7395607Z   File "test_datapipe.py", line 885, in test_concat_iterdatapipe
2022-07-20T22:37:15.7395970Z     reset_dps()
2022-07-20T22:37:15.7396436Z NameError: name 'reset_dps' is not defined
2022-07-20T22:37:15.7396606Z 
2022-07-20T22:37:15.7396700Z ======================================================================
2022-07-20T22:37:15.7397047Z ERROR [0.004s]: test_filter_datapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:37:15.7398347Z ----------------------------------------------------------------------
2022-07-20T22:37:15.7398800Z Traceback (most recent call last):
2022-07-20T22:37:15.7399282Z   File "test_datapipe.py", line 1573, in test_filter_datapipe
2022-07-20T22:37:15.7399630Z     snapshot_test_helper(filter_dp, new_dp, n_elements_to_advance)
2022-07-20T22:37:15.7399940Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:37:15.7400119Z 
2022-07-20T22:37:15.7400217Z ======================================================================
This comment was automatically generated by Dr. CI (expand for details).

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

@NivekT NivekT marked this pull request as draft December 20, 2021 23:55
@NivekT NivekT added the module: data torch.utils.data label Dec 20, 2021
@NivekT NivekT mentioned this pull request Dec 21, 2021
Closed
NivekT added a commit that referenced this pull request Dec 21, 2021
@NivekT
[DataPipe] Snapshotting prototype
a34ee6c 
ghstack-source-id: 51ad768
Pull Request resolved: #70216
@NivekT NivekT mentioned this pull request Dec 23, 2021
Closed
NivekT added a commit that referenced this pull request Dec 23, 2021
@NivekT
[DataPipe] Snapshotting prototype
e583b8b 
ghstack-source-id: 229604b
Pull Request resolved: #70216
@NivekT NivekT mentioned this pull request Dec 29, 2021
Closed
NivekT added a commit that referenced this pull request Dec 29, 2021
@NivekT
[DataPipe] Snapshotting prototype
24238de 
ghstack-source-id: 088fdc8
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Dec 30, 2021
@NivekT
[DataPipe] Snapshotting prototype
05f70b8 
ghstack-source-id: 3e6e893
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Jun 24, 2022
@NivekT
[DataPipe] Snapshotting prototype
21ceee4 
ghstack-source-id: cf4840c
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Jun 28, 2022
@NivekT
[DataPipe] Snapshotting prototype
5f720a1 
ghstack-source-id: e3883c7
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Jun 28, 2022
@NivekT
[DataPipe] Snapshotting prototype
9fe65b3 
ghstack-source-id: c9d0b23
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Jun 28, 2022
@NivekT
[DataPipe] Snapshotting prototype
8ba3c59 
ghstack-source-id: 2174050
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Jun 29, 2022
@NivekT
[DataPipe] Snapshotting prototype
a242908 
ghstack-source-id: 012226c
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Jul 13, 2022
@NivekT
[DataPipe] Snapshotting prototype
03dcc7a 
ghstack-source-id: da839c1
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Jul 18, 2022
@NivekT
[DataPipe] Snapshotting prototype
c90b20e 
ghstack-source-id: f61b860
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Jul 19, 2022
@NivekT
[DataPipe] Snapshotting prototype
43588ad 
ghstack-source-id: e8973a1
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Jul 20, 2022
@NivekT
[DataPipe] Snapshotting prototype
4836d14 
ghstack-source-id: 69213ec
Pull Request resolved: #70216
@github-actions
Copy link
Contributor

github-actions bot commented Sep 19, 2022

Looks like this PR hasn't been updated in a while so we're going to go ahead and mark this as Stale.
Feel free to remove the Stale label if you feel this was a mistake.
If you are unable to remove the Stale label please contact a maintainer in order to do so.
If you want the bot to never mark this PR stale again, add the no-stale label.
Stale pull requests will automatically be closed after 30 days of inactivity.

@github-actions github-actions bot added the Stale label Sep 19, 2022
@facebook-github-bot
Copy link
Contributor

facebook-github-bot commented Oct 4, 2022

/easycla

As part of the transition to the PyTorch Foundation, this project now requires contributions be covered under the new CLA. See #85559 for additional details.

This comment will trigger a new check of this PR. If you are already covered, you will simply see a new "EasyCLA" check that passes. If you are not covered, a bot will leave a new comment with a link to sign.

@github-actions github-actions bot closed this Nov 3, 2022
@facebook-github-bot facebook-github-bot deleted the gh/nivekt/38/head branch June 8, 2023 18:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

cla signed module: data torch.utils.data Stale

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@NivekT @facebook-github-bot @suo