test j2xunit by efd6 · Pull Request #721 · elastic/elastic-package

efd6 · 2022-03-07T05:15:04Z

TEST DO NOT MERGE

…eNumber By default, numbers are unmarshaled as float64 resulting in low bits truncation in longs that are above 53 bits wide, so use a decoder and UseNumber to ensure results are not corrupted.

elasticmachine · 2022-03-07T05:19:18Z

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS
[](https://ci-stats.elastic.co/app/apm/services/beats-ci/transactions/view?rangeFrom=2022-03-09T23:16:40.351Z&rangeTo=2022-03-09T23:36:40.351Z&transactionName=BUILD Ingest-manager/elastic-package/PR-{number}&transactionType=job&latencyAggregationType=avg&traceId=d7fb2c8b6f25f50a58a0d9e122465def&transactionId=d7db2b23fcf80b40)

Expand to view the summary

Build stats

Start Time: 2022-03-09T23:26:40.351+0000
Duration: 4 min 14 sec

Test stats 🧪

Test	Results
Failed	4
Passed	181
Skipped	0
Total	185

Test errors

Expand to view the tests failures

`TestScripts/run_generate – github.com/elastic/elastic-package/internal/testrunner/runners/pipeline`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   TestScripts/run_generate
=== PAUSE TestScripts/run_generate
=== CONT  TestScripts/run_generate
=== CONT  TestScripts/run_generate
    testscript.go:397: 
        WORK=$WORK
        PATH=/tmp/testscript-main3810549424/bin:/var/lib/jenkins/workspace/t-manager_elastic-package_PR-721/bin:/var/lib/jenkins/workspace/t-manager_elastic-package_PR-721/.gvm/versions/go1.17.6.linux.amd64/bin:/command:/usr/local/bin:/usr/local/sbin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/X11R6/bin
        HOME=/no-home
        TMPDIR=$WORK/.tmp
        devnull=/dev/null
        /=/
        :=:
        $=$
        TESTSCRIPT_COVER_DIR=/tmp/testscript-main3810549424/cover
        exe=
        
        # Demonstrate that long numerical fields are properly regenerated when the
        # low bits are set in values greater than 53 bits wide.
        # Irrespective of the marshalling approach, this will succeed, since all
        # the values are being unmarshaled through the same process. Bad things
        # have happened if this is not the case. (0.010s)
        > ! runValidation config.json datastream golden.json obtained.json true
        FAIL: testdata/run_generate.txt:7: unexpected command success
        
    --- FAIL: TestScripts/run_generate (0.01s)

`TestScripts/run – github.com/elastic/elastic-package/internal/testrunner/runners/pipeline`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   TestScripts/run
=== PAUSE TestScripts/run
=== CONT  TestScripts/run
=== CONT  TestScripts/run
    testscript.go:397: 
        WORK=$WORK
        PATH=/tmp/testscript-main3810549424/bin:/var/lib/jenkins/workspace/t-manager_elastic-package_PR-721/bin:/var/lib/jenkins/workspace/t-manager_elastic-package_PR-721/.gvm/versions/go1.17.6.linux.amd64/bin:/command:/usr/local/bin:/usr/local/sbin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/X11R6/bin
        HOME=/no-home
        TMPDIR=$WORK/.tmp
        devnull=/dev/null
        /=/
        :=:
        $=$
        TESTSCRIPT_COVER_DIR=/tmp/testscript-main3810549424/cover
        exe=
        
        # Demonstrate that long numerical fields match when the low bits are set
        # in values greater than 53 bits wide. (0.011s)
        > ! runValidation config.json datastream golden.json obtained.json false
        FAIL: testdata/run.txt:4: unexpected command success
        
    --- FAIL: TestScripts/run (0.01s)

`TestScripts/run_failing – github.com/elastic/elastic-package/internal/testrunner/runners/pipeline`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   TestScripts/run_failing
=== PAUSE TestScripts/run_failing
=== CONT  TestScripts/run_failing
=== CONT  TestScripts/run_failing
    testscript.go:397: 
        WORK=$WORK
        PATH=/tmp/testscript-main3810549424/bin:/var/lib/jenkins/workspace/t-manager_elastic-package_PR-721/bin:/var/lib/jenkins/workspace/t-manager_elastic-package_PR-721/.gvm/versions/go1.17.6.linux.amd64/bin:/command:/usr/local/bin:/usr/local/sbin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/X11R6/bin
        HOME=/no-home
        TMPDIR=$WORK/.tmp
        devnull=/dev/null
        /=/
        :=:
        $=$
        TESTSCRIPT_COVER_DIR=/tmp/testscript-main3810549424/cover
        exe=
        
        # Demonstrate that long numerical fields mis-match when the low bits are set
        # differently in values greater than 53 bits wide. (0.017s)
        > ! runValidation config.json datastream golden.json obtained.json false
        [stderr]
        2022/03/09 23:30:49 failed to verify: test case failed: Expected results are different from actual ones
        [exit status 1]
        > ! stdout .
        > ! stderr 'failed to verify: test case failed: Expected results are different from actual ones'
        FAIL: testdata/run_failing.txt:6: unexpected match for `failed to verify: test case failed: Expected results are different from actual ones` found in stderr: failed to verify: test case failed: Expected results are different from actual ones
        
    --- FAIL: TestScripts/run_failing (0.02s)

`TestScripts – github.com/elastic/elastic-package/internal/testrunner/runners/pipeline`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   TestScripts
--- FAIL: TestScripts (0.00s)

Steps errors

Expand to view the steps failures

`Check`

Took 0 min 19 sec . View more details here
Description: make test-go-ci

`Google Storage Download`

Took 0 min 0 sec . View more details here

🤖 GitHub comments

To re-run your PR in the CI, just comment with:

/test : Re-trigger the build.

jsoriano · 2022-03-18T12:58:38Z

Closing this as this will be superseded by #732 and #740. Thanks @efd6!

efd6 added 5 commits March 5, 2022 00:36

internal/testrunner/runners/pipeline: unmarshal test results using Us…

fd610f1

…eNumber By default, numbers are unmarshaled as float64 resulting in low bits truncation in longs that are above 53 bits wide, so use a decoder and UseNumber to ensure results are not corrupted.

internal/testrunner/runners/pipeline: add tests

6e4527b

Merge branch 'master' into safenumbers

43d9310

clean up debugging scars and make test doc more accurate

ea4c797

keep go2xunit happy

2434b9d

efd6 force-pushed the j2x branch from 0d596d7 to f50dc30 Compare March 7, 2022 05:25

efd6 added 2 commits March 7, 2022 16:32

test j2xunit

cafdaee

break some tests

880eaac

efd6 force-pushed the j2x branch from f50dc30 to 880eaac Compare March 7, 2022 06:09

efd6 mentioned this pull request Mar 8, 2022

internal/testrunner/runners/pipeline: unmarshal test results using UseNumber #717

Merged

efd6 added 2 commits March 10, 2022 09:47

try using gotestsum

8f8e466

and for local testing

3390b72

This was referenced Mar 18, 2022

Use gotestsum as test runner #740

Merged

Add unit testing for pipeline test runner to cover json decoding and encoding #732

Closed

jsoriano closed this Mar 18, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

test j2xunit#721

test j2xunit#721
efd6 wants to merge 9 commits intoelastic:mainfrom
efd6:j2x

efd6 commented Mar 7, 2022

Uh oh!

elasticmachine commented Mar 7, 2022 •

edited

Loading

Build stats

Test stats 🧪

`TestScripts/run_generate – github.com/elastic/elastic-package/internal/testrunner/runners/pipeline`

`TestScripts/run – github.com/elastic/elastic-package/internal/testrunner/runners/pipeline`

`TestScripts/run_failing – github.com/elastic/elastic-package/internal/testrunner/runners/pipeline`

`TestScripts – github.com/elastic/elastic-package/internal/testrunner/runners/pipeline`

`Check`

`Google Storage Download`

Uh oh!

jsoriano commented Mar 18, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

efd6 commented Mar 7, 2022

Uh oh!

elasticmachine commented Mar 7, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

💔 Tests Failed

Build stats

Test stats 🧪

Test errors

TestScripts/run_generate – github.com/elastic/elastic-package/internal/testrunner/runners/pipeline

TestScripts/run – github.com/elastic/elastic-package/internal/testrunner/runners/pipeline

TestScripts/run_failing – github.com/elastic/elastic-package/internal/testrunner/runners/pipeline

TestScripts – github.com/elastic/elastic-package/internal/testrunner/runners/pipeline

Steps errors

Check

Google Storage Download

🤖 GitHub comments

Uh oh!

jsoriano commented Mar 18, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

elasticmachine commented Mar 7, 2022 •

edited

Loading

`TestScripts/run_generate – github.com/elastic/elastic-package/internal/testrunner/runners/pipeline`

`TestScripts/run – github.com/elastic/elastic-package/internal/testrunner/runners/pipeline`

`TestScripts/run_failing – github.com/elastic/elastic-package/internal/testrunner/runners/pipeline`

`TestScripts – github.com/elastic/elastic-package/internal/testrunner/runners/pipeline`

`Check`

`Google Storage Download`