Multi-GPU training with DP and DDP documentation by nzarif · Pull Request #503 · NVIDIA-Merlin/Transformers4Rec

nzarif · 2022-10-06T02:29:45Z

Fixes #492
Fixes #488

Goals ⚽

Document how to use DataParallel and DistributedDataParallel multi-gpu training.
Demonstrate the potential performance benefit of DataParallel and DistributedDataParallel multi-gpu training through presenting experiment results.

Implementation Details 🚧

Experiments were done on a node with 2 Tesla V100-SXM2-32GB-LS GPUs using T4Rec after changes included in [feature]Multi-GPU DistributedDataParallel Fixed #496. The scripts used were the ones included in ci/test_integration.sh.

Testing Details 🔍

Refer to the documentation content to use DataParallel or DistributedDataParallel mode.

nvidia-merlin-bot · 2022-10-06T02:31:37Z

Click to view CI Results

GitHub pull request #503 of commit 93570d0072ec037e9b30b395c97c6f230ece8bef, no merge conflicts.
Running as SYSTEM
Setting status of 93570d0072ec037e9b30b395c97c6f230ece8bef to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/204/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse 93570d0072ec037e9b30b395c97c6f230ece8bef^{commit} # timeout=10
Checking out Revision 93570d0072ec037e9b30b395c97c6f230ece8bef (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 93570d0072ec037e9b30b395c97c6f230ece8bef # timeout=10
Commit message: "Documentation for DP and DDP done"
 > git rev-list --no-walk 6f3254102892a60af0bfe9527d925f8899960836 # timeout=10
First time build. Skipping changelog.
[transformers4rec_tests] $ /bin/bash /tmp/jenkins6624946338174573545.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.30s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins5266983498762719754.sh

nvidia-merlin-bot · 2022-10-06T02:46:42Z

Click to view CI Results

GitHub pull request #503 of commit 6135fe95cb4dc778f3bb4e0a36a3e449a216653c, no merge conflicts.
Running as SYSTEM
Setting status of 6135fe95cb4dc778f3bb4e0a36a3e449a216653c to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/205/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse 6135fe95cb4dc778f3bb4e0a36a3e449a216653c^{commit} # timeout=10
Checking out Revision 6135fe95cb4dc778f3bb4e0a36a3e449a216653c (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 6135fe95cb4dc778f3bb4e0a36a3e449a216653c # timeout=10
Commit message: "Documentation for DP and DDP done"
 > git rev-list --no-walk 93570d0072ec037e9b30b395c97c6f230ece8bef # timeout=10
First time build. Skipping changelog.
[transformers4rec_tests] $ /bin/bash /tmp/jenkins1011805495026681469.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.67s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins10732763606964561760.sh

nvidia-merlin-bot · 2022-10-06T03:06:17Z

Click to view CI Results

GitHub pull request #503 of commit cd455a1ab814ca2f6332069cdb673f3e28200306, no merge conflicts.
Running as SYSTEM
Setting status of cd455a1ab814ca2f6332069cdb673f3e28200306 to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/206/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse cd455a1ab814ca2f6332069cdb673f3e28200306^{commit} # timeout=10
Checking out Revision cd455a1ab814ca2f6332069cdb673f3e28200306 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f cd455a1ab814ca2f6332069cdb673f3e28200306 # timeout=10
Commit message: "spell correction"
 > git rev-list --no-walk 6135fe95cb4dc778f3bb4e0a36a3e449a216653c # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins12168237209930475940.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.51s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins8021495778600158398.sh

github-actions · 2022-10-06T03:18:36Z

Documentation preview

https://nvidia-merlin.github.io/Transformers4Rec/review/pr-503

nvidia-merlin-bot · 2022-10-06T21:46:41Z

Click to view CI Results

GitHub pull request #503 of commit 792f1a5248b654db5200114ca69a0cce63f0ad7e, no merge conflicts.
Running as SYSTEM
Setting status of 792f1a5248b654db5200114ca69a0cce63f0ad7e to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/208/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse 792f1a5248b654db5200114ca69a0cce63f0ad7e^{commit} # timeout=10
Checking out Revision 792f1a5248b654db5200114ca69a0cce63f0ad7e (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 792f1a5248b654db5200114ca69a0cce63f0ad7e # timeout=10
Commit message: "cropped table image and changed it to  tag"
 > git rev-list --no-walk 3dded907d3d42ef32f30c4e77126889d8e1b6af4 # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins552223528551070230.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.68s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins8972013019757650072.sh

Co-authored-by: Gabriel Moreira <gmoreira@nvidia.com>

nvidia-merlin-bot · 2022-10-06T21:52:59Z

Click to view CI Results

GitHub pull request #503 of commit e112dcaca81b585883836de231502277ed2277ec, no merge conflicts.
Running as SYSTEM
Setting status of e112dcaca81b585883836de231502277ed2277ec to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/209/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse e112dcaca81b585883836de231502277ed2277ec^{commit} # timeout=10
Checking out Revision e112dcaca81b585883836de231502277ed2277ec (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f e112dcaca81b585883836de231502277ed2277ec # timeout=10
Commit message: "Update docs/source/multi_gpu_train.md"
 > git rev-list --no-walk 792f1a5248b654db5200114ca69a0cce63f0ad7e # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins2770240049619200221.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.37s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins1246291123191111385.sh

Co-authored-by: Gabriel Moreira <gmoreira@nvidia.com>

gabrielspmoreira · 2022-10-06T21:53:47Z

@nzarif You need to add a link to your new doc page in the TOC (Table of Content)

nvidia-merlin-bot · 2022-10-06T21:54:47Z

Click to view CI Results

GitHub pull request #503 of commit ab46963a599431c7613f31378522fe3558e2bcfd, no merge conflicts.
Running as SYSTEM
Setting status of ab46963a599431c7613f31378522fe3558e2bcfd to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/210/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse ab46963a599431c7613f31378522fe3558e2bcfd^{commit} # timeout=10
Checking out Revision ab46963a599431c7613f31378522fe3558e2bcfd (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f ab46963a599431c7613f31378522fe3558e2bcfd # timeout=10
Commit message: "Update docs/source/multi_gpu_train.md"
 > git rev-list --no-walk e112dcaca81b585883836de231502277ed2277ec # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins8548489720420601141.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.69s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins6035980597557824389.sh

nvidia-merlin-bot · 2022-10-06T21:56:47Z

Click to view CI Results

GitHub pull request #503 of commit 540ef41a4f4927d36569ad36aa0d53bf83351fd6, no merge conflicts.
Running as SYSTEM
Setting status of 540ef41a4f4927d36569ad36aa0d53bf83351fd6 to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/211/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse 540ef41a4f4927d36569ad36aa0d53bf83351fd6^{commit} # timeout=10
Checking out Revision 540ef41a4f4927d36569ad36aa0d53bf83351fd6 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 540ef41a4f4927d36569ad36aa0d53bf83351fd6 # timeout=10
Commit message: "Update docs/source/multi_gpu_train.md"
 > git rev-list --no-walk ab46963a599431c7613f31378522fe3558e2bcfd # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins5493696038537469036.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.61s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins9605509655296552205.sh

nvidia-merlin-bot · 2022-10-06T21:58:47Z

Click to view CI Results

GitHub pull request #503 of commit 77aa408d37ba64da063a94c4c348e53dc0ec296e, no merge conflicts.
Running as SYSTEM
Setting status of 77aa408d37ba64da063a94c4c348e53dc0ec296e to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/212/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse 77aa408d37ba64da063a94c4c348e53dc0ec296e^{commit} # timeout=10
Checking out Revision 77aa408d37ba64da063a94c4c348e53dc0ec296e (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 77aa408d37ba64da063a94c4c348e53dc0ec296e # timeout=10
Commit message: "Update docs/source/multi_gpu_train.md"
 > git rev-list --no-walk 540ef41a4f4927d36569ad36aa0d53bf83351fd6 # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins4143659633718136811.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.21s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins14986741611687850056.sh

nvidia-merlin-bot · 2022-10-06T22:00:32Z

Click to view CI Results

GitHub pull request #503 of commit 8d80a1eaa73a97733ca9e244d60a8affcc8b4e68, no merge conflicts.
Running as SYSTEM
Setting status of 8d80a1eaa73a97733ca9e244d60a8affcc8b4e68 to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/213/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse 8d80a1eaa73a97733ca9e244d60a8affcc8b4e68^{commit} # timeout=10
Checking out Revision 8d80a1eaa73a97733ca9e244d60a8affcc8b4e68 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 8d80a1eaa73a97733ca9e244d60a8affcc8b4e68 # timeout=10
Commit message: "Update docs/source/multi_gpu_train.md"
 > git rev-list --no-walk 77aa408d37ba64da063a94c4c348e53dc0ec296e # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins808392260159194758.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.66s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins895058706010360233.sh

nvidia-merlin-bot · 2022-10-06T22:03:34Z

Click to view CI Results

GitHub pull request #503 of commit 4483bea31303d2a5d01f409cb42255b204003735, no merge conflicts.
Running as SYSTEM
Setting status of 4483bea31303d2a5d01f409cb42255b204003735 to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/214/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse 4483bea31303d2a5d01f409cb42255b204003735^{commit} # timeout=10
Checking out Revision 4483bea31303d2a5d01f409cb42255b204003735 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 4483bea31303d2a5d01f409cb42255b204003735 # timeout=10
Commit message: "Update docs/source/multi_gpu_train.md"
 > git rev-list --no-walk 8d80a1eaa73a97733ca9e244d60a8affcc8b4e68 # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins13638447381606203607.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.49s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins36905133830848361.sh

nvidia-merlin-bot · 2022-10-06T22:05:20Z

Click to view CI Results

GitHub pull request #503 of commit 19d180b14a6ee2dde105329a6bcc4e90251cf5a7, no merge conflicts.
Running as SYSTEM
Setting status of 19d180b14a6ee2dde105329a6bcc4e90251cf5a7 to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/215/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse 19d180b14a6ee2dde105329a6bcc4e90251cf5a7^{commit} # timeout=10
Checking out Revision 19d180b14a6ee2dde105329a6bcc4e90251cf5a7 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 19d180b14a6ee2dde105329a6bcc4e90251cf5a7 # timeout=10
Commit message: "Update docs/source/multi_gpu_train.md"
 > git rev-list --no-walk 4483bea31303d2a5d01f409cb42255b204003735 # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins9162008770940700738.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.18s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins6511491643202267090.sh

nvidia-merlin-bot · 2022-10-06T22:07:08Z

Click to view CI Results

GitHub pull request #503 of commit 604ee2436815043bb9cc3e42d6553ef1bb0f2ff9, no merge conflicts.
Running as SYSTEM
Setting status of 604ee2436815043bb9cc3e42d6553ef1bb0f2ff9 to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/216/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse 604ee2436815043bb9cc3e42d6553ef1bb0f2ff9^{commit} # timeout=10
Checking out Revision 604ee2436815043bb9cc3e42d6553ef1bb0f2ff9 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 604ee2436815043bb9cc3e42d6553ef1bb0f2ff9 # timeout=10
Commit message: "Update docs/source/multi_gpu_train.md"
 > git rev-list --no-walk 19d180b14a6ee2dde105329a6bcc4e90251cf5a7 # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins15515044314748555723.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 35.91s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins9402033618762569707.sh

nvidia-merlin-bot · 2022-10-06T22:09:23Z

Click to view CI Results

GitHub pull request #503 of commit b356c25e45224e163ccc52f25535469ff2997612, no merge conflicts.
Running as SYSTEM
Setting status of b356c25e45224e163ccc52f25535469ff2997612 to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/217/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse b356c25e45224e163ccc52f25535469ff2997612^{commit} # timeout=10
Checking out Revision b356c25e45224e163ccc52f25535469ff2997612 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f b356c25e45224e163ccc52f25535469ff2997612 # timeout=10
Commit message: "Update docs/source/multi_gpu_train.md"
 > git rev-list --no-walk 604ee2436815043bb9cc3e42d6553ef1bb0f2ff9 # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins15802821217856166041.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.26s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins16161797852682873937.sh

nvidia-merlin-bot · 2022-10-06T22:11:40Z

Click to view CI Results

GitHub pull request #503 of commit d49f1a9c2770be356539aecbe255445006b6b5eb, no merge conflicts.
Running as SYSTEM
Setting status of d49f1a9c2770be356539aecbe255445006b6b5eb to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/218/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse d49f1a9c2770be356539aecbe255445006b6b5eb^{commit} # timeout=10
Checking out Revision d49f1a9c2770be356539aecbe255445006b6b5eb (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f d49f1a9c2770be356539aecbe255445006b6b5eb # timeout=10
Commit message: "Update docs/source/multi_gpu_train.md"
 > git rev-list --no-walk b356c25e45224e163ccc52f25535469ff2997612 # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins5353190733898573006.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.51s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins2321465897854461212.sh

nvidia-merlin-bot · 2022-10-06T22:13:39Z

Click to view CI Results

GitHub pull request #503 of commit 9feb285acf31eebec8b05fa3ac13c8a2cf1c1e8a, no merge conflicts.
Running as SYSTEM
Setting status of 9feb285acf31eebec8b05fa3ac13c8a2cf1c1e8a to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/219/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse 9feb285acf31eebec8b05fa3ac13c8a2cf1c1e8a^{commit} # timeout=10
Checking out Revision 9feb285acf31eebec8b05fa3ac13c8a2cf1c1e8a (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 9feb285acf31eebec8b05fa3ac13c8a2cf1c1e8a # timeout=10
Commit message: "Update docs/source/multi_gpu_train.md"
 > git rev-list --no-walk d49f1a9c2770be356539aecbe255445006b6b5eb # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins14599794573128113221.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.78s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins5210781037348750801.sh

nvidia-merlin-bot · 2022-10-06T22:18:12Z

Click to view CI Results

GitHub pull request #503 of commit 4279298e54dbf5d05d914ea120fdf765745b5bff, no merge conflicts.
Running as SYSTEM
Setting status of 4279298e54dbf5d05d914ea120fdf765745b5bff to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/220/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse 4279298e54dbf5d05d914ea120fdf765745b5bff^{commit} # timeout=10
Checking out Revision 4279298e54dbf5d05d914ea120fdf765745b5bff (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 4279298e54dbf5d05d914ea120fdf765745b5bff # timeout=10
Commit message: "Update docs/source/multi_gpu_train.md"
 > git rev-list --no-walk 9feb285acf31eebec8b05fa3ac13c8a2cf1c1e8a # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins13969218958387885300.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.30s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins18227071460531811937.sh

nvidia-merlin-bot · 2022-10-06T22:23:35Z

Click to view CI Results

GitHub pull request #503 of commit e4dc87d9a5549d6dd8241c6cb4bef83c315f7ce5, no merge conflicts.
Running as SYSTEM
Setting status of e4dc87d9a5549d6dd8241c6cb4bef83c315f7ce5 to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/221/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse e4dc87d9a5549d6dd8241c6cb4bef83c315f7ce5^{commit} # timeout=10
Checking out Revision e4dc87d9a5549d6dd8241c6cb4bef83c315f7ce5 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f e4dc87d9a5549d6dd8241c6cb4bef83c315f7ce5 # timeout=10
Commit message: "Update docs/source/multi_gpu_train.md"
 > git rev-list --no-walk 4279298e54dbf5d05d914ea120fdf765745b5bff # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins3916939642514358569.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.49s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins13439530227384601432.sh

sararb

Thank you @nzarif for this detailed documentation, I left two questions.

Do you think we can add a quick note about the impact of DP/DDP on ndcg/recall metrics and advise the user to tune the learning rate for better accuracy?

sararb · 2022-10-06T12:49:44Z

+This is the suggested and more efficient method. When a model is trained using the `DistributedDataParallel` mode:
+- A eparate process will be assigned to each GPU in the beginning and GPU0 will replicate the model on each GPU
+- On each step each GPU will consume the separate mini-batch produced for it by the dataloader
+- On the backward pass the gradient from GPUs will be averaged for accumulation


Where does the accumulation happen? On GPU0?

sararb · 2022-10-06T12:52:26Z

+
+<b>Note:</b> When using `DistributedDataParallel` number of partitions of the dataset must be equal or larger than number of processes. If a parquet file with small number of partitions is used, try repartitioning it using cudf or pandas before training. The dataloader checks `dataloader.dataset.npartitions` and will repartition if needed but we advise users to repartition the dataset and save it for better efficiency. Use pandas or cudf for repartitioning. Example of repartitioning a parquet file with cudf:
+
+```df.to_parquet("filename.parquet", row_group_size=10000, engine="pyarrow"```


Do cudf and pandas use the same syntax for row partitioning?

nvidia-merlin-bot · 2022-10-06T22:29:14Z

Click to view CI Results

GitHub pull request #503 of commit c847a41377b035e5d4c4d53baa0574f661e4e595, no merge conflicts.
Running as SYSTEM
Setting status of c847a41377b035e5d4c4d53baa0574f661e4e595 to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/222/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse c847a41377b035e5d4c4d53baa0574f661e4e595^{commit} # timeout=10
Checking out Revision c847a41377b035e5d4c4d53baa0574f661e4e595 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f c847a41377b035e5d4c4d53baa0574f661e4e595 # timeout=10
Commit message: "added file to toc.yaml"
 > git rev-list --no-walk e4dc87d9a5549d6dd8241c6cb4bef83c315f7ce5 # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins3579289901567840435.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.32s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins2727270267518956851.sh

nvidia-merlin-bot · 2022-10-06T22:37:52Z

Click to view CI Results

GitHub pull request #503 of commit ca6c417478dea0ef5ba9569b3949f2344b7574c9, no merge conflicts.
Running as SYSTEM
Setting status of ca6c417478dea0ef5ba9569b3949f2344b7574c9 to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/223/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse ca6c417478dea0ef5ba9569b3949f2344b7574c9^{commit} # timeout=10
Checking out Revision ca6c417478dea0ef5ba9569b3949f2344b7574c9 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f ca6c417478dea0ef5ba9569b3949f2344b7574c9 # timeout=10
Commit message: "revised the doc text"
 > git rev-list --no-walk c847a41377b035e5d4c4d53baa0574f661e4e595 # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins2049939994541293191.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.29s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins244051491166213806.sh

nvidia-merlin-bot · 2022-10-06T22:45:26Z

Click to view CI Results

GitHub pull request #503 of commit 0f5b64bf82ddf0857da7b74f504fa92238d6112f, no merge conflicts.
Running as SYSTEM
Setting status of 0f5b64bf82ddf0857da7b74f504fa92238d6112f to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/224/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse 0f5b64bf82ddf0857da7b74f504fa92238d6112f^{commit} # timeout=10
Checking out Revision 0f5b64bf82ddf0857da7b74f504fa92238d6112f (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 0f5b64bf82ddf0857da7b74f504fa92238d6112f # timeout=10
Commit message: "Merge branch 'main' into multi_gpu_doc"
 > git rev-list --no-walk ca6c417478dea0ef5ba9569b3949f2344b7574c9 # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins5950366045731369854.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 36.35s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins12459291226318260558.sh

nvidia-merlin-bot · 2022-10-11T19:37:32Z

Click to view CI Results

GitHub pull request #503 of commit 981e5d30a33a639197f6f572d36682e45b4b4e2f, no merge conflicts.
Running as SYSTEM
Setting status of 981e5d30a33a639197f6f572d36682e45b4b4e2f to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/226/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse 981e5d30a33a639197f6f572d36682e45b4b4e2f^{commit} # timeout=10
Checking out Revision 981e5d30a33a639197f6f572d36682e45b4b4e2f (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 981e5d30a33a639197f6f572d36682e45b4b4e2f # timeout=10
Commit message: "Merge branch 'main' into multi_gpu_doc"
 > git rev-list --no-walk 6be97b9272bd97ff4576309aa517725f7343340d # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins16549003786856672508.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 34.17s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins8645629622613797585.sh

nvidia-merlin-bot · 2022-10-11T19:43:49Z

Click to view CI Results

GitHub pull request #503 of commit 546ba348580ee47dead1d7e69e816b5369a9f51b, no merge conflicts.
Running as SYSTEM
Setting status of 546ba348580ee47dead1d7e69e816b5369a9f51b to PENDING with url http://10.20.17.181:8080/job/transformers4rec_tests/227/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/transformers4rec_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git init /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Transformers4Rec.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Transformers4Rec.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Transformers4Rec.git +refs/pull/503/*:refs/remotes/origin/pr/503/* # timeout=10
 > git rev-parse 546ba348580ee47dead1d7e69e816b5369a9f51b^{commit} # timeout=10
Checking out Revision 546ba348580ee47dead1d7e69e816b5369a9f51b (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 546ba348580ee47dead1d7e69e816b5369a9f51b # timeout=10
Commit message: "Update docs/source/multi_gpu_train.md"
 > git rev-list --no-walk 981e5d30a33a639197f6f572d36682e45b4b4e2f # timeout=10
[transformers4rec_tests] $ /bin/bash /tmp/jenkins10630638085656843602.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/transformers4rec_tests/transformers4rec
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 1 item
tests/unit/test_notebooks.py .                                           [100%]
============================== 1 passed in 34.53s ==============================

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=2 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Transformers4Rec/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[transformers4rec_tests] $ /bin/bash /tmp/jenkins2734921807868530297.sh

nzarif added documentation Improvements or additions to documentation status/needs-review labels Oct 6, 2022

nzarif requested review from gabrielspmoreira, rnyak and sararb October 6, 2022 02:29

nzarif self-assigned this Oct 6, 2022

Documentation for DP and DDP done

6135fe9

nzarif force-pushed the multi_gpu_doc branch from 93570d0 to 6135fe9 Compare October 6, 2022 02:39

spell correction

cd455a1

cropped table image and changed it to <img> tag

792f1a5

gabrielspmoreira approved these changes Oct 6, 2022

View reviewed changes

nzarif and others added 10 commits October 6, 2022 14:51

Update docs/source/multi_gpu_train.md

e112dca

Co-authored-by: Gabriel Moreira <gmoreira@nvidia.com>

Update docs/source/multi_gpu_train.md

ab46963

Co-authored-by: Gabriel Moreira <gmoreira@nvidia.com>

Update docs/source/multi_gpu_train.md

540ef41

Co-authored-by: Gabriel Moreira <gmoreira@nvidia.com>

Update docs/source/multi_gpu_train.md

77aa408

Co-authored-by: Gabriel Moreira <gmoreira@nvidia.com>

Update docs/source/multi_gpu_train.md

8d80a1e

Co-authored-by: Gabriel Moreira <gmoreira@nvidia.com>

Update docs/source/multi_gpu_train.md

4483bea

Co-authored-by: Gabriel Moreira <gmoreira@nvidia.com>

Update docs/source/multi_gpu_train.md

19d180b

Co-authored-by: Gabriel Moreira <gmoreira@nvidia.com>

Update docs/source/multi_gpu_train.md

604ee24

Co-authored-by: Gabriel Moreira <gmoreira@nvidia.com>

Update docs/source/multi_gpu_train.md

b356c25

Co-authored-by: Gabriel Moreira <gmoreira@nvidia.com>

Update docs/source/multi_gpu_train.md

d49f1a9

Co-authored-by: Gabriel Moreira <gmoreira@nvidia.com>

nzarif and others added 3 commits October 6, 2022 14:53

Update docs/source/multi_gpu_train.md

9feb285

Co-authored-by: Gabriel Moreira <gmoreira@nvidia.com>

Update docs/source/multi_gpu_train.md

4279298

Co-authored-by: Gabriel Moreira <gmoreira@nvidia.com>

Update docs/source/multi_gpu_train.md

e4dc87d

Co-authored-by: Gabriel Moreira <gmoreira@nvidia.com>

added file to toc.yaml

c847a41

revised the doc text

ca6c417

sararb approved these changes Oct 6, 2022

View reviewed changes

gabrielspmoreira approved these changes Oct 6, 2022

View reviewed changes

Merge branch 'main' into multi_gpu_doc

0f5b64b

Merge branch 'main' into multi_gpu_doc

981e5d3

gabrielspmoreira reviewed Oct 11, 2022

View reviewed changes

Comment thread docs/source/multi_gpu_train.md Outdated

Update docs/source/multi_gpu_train.md

546ba34

gabrielspmoreira merged commit 4f23a8b into main Oct 11, 2022


		<b>Note:</b> When using `DistributedDataParallel` number of partitions of the dataset must be equal or larger than number of processes. If a parquet file with small number of partitions is used, try repartitioning it using cudf or pandas before training. The dataloader checks `dataloader.dataset.npartitions` and will repartition if needed but we advise users to repartition the dataset and save it for better efficiency. Use pandas or cudf for repartitioning. Example of repartitioning a parquet file with cudf:

		```df.to_parquet("filename.parquet", row_group_size=10000, engine="pyarrow"```

Conversation

nzarif commented Oct 6, 2022 • edited by gabrielspmoreira Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Goals ⚽

Implementation Details 🚧

Testing Details 🔍

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

github-actions bot commented Oct 6, 2022

Documentation preview

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

gabrielspmoreira commented Oct 6, 2022

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

sararb left a comment

Choose a reason for hiding this comment

Uh oh!

sararb Oct 6, 2022

Choose a reason for hiding this comment

Uh oh!

sararb Oct 6, 2022

Choose a reason for hiding this comment

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

nvidia-merlin-bot commented Oct 6, 2022

Uh oh!

nvidia-merlin-bot commented Oct 11, 2022

Uh oh!

Uh oh!

nvidia-merlin-bot commented Oct 11, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

nzarif commented Oct 6, 2022 •

edited by gabrielspmoreira

Loading