Skip to content

[Release][Go] Verification tasks for the Release Candidate fail on Go parquet encryption tests #38345

@raulcd

Description

@raulcd

Describe the bug, including details regarding any error messages, version, and platform.

We have created the RC 2 for the Apache Arrow 14.0.0 release and currently we are facing the following error on the release verification for the go sources:

 /tmp/parquet-encryption-test-3157156869
--- FAIL: TestFileEncryptionDecryption (0.40s)
    --- FAIL: TestFileEncryptionDecryption/TestDecryption (0.34s)
        --- FAIL: TestFileEncryptionDecryption/TestDecryption/uniform_encryption.parquet.encrypted (0.07s)
            --- FAIL: TestFileEncryptionDecryption/TestDecryption/uniform_encryption.parquet.encrypted/config_1 (0.00s)
                encryption_read_config_test.go:217: 
                    	Error Trace:	/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:217
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:406
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:430
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:468
                    	            				/tmp/arrow-14.0.0.Rm87k/go/gopath/pkg/mod/github.com/stretchr/testify@v1.8.4/suite/suite.go:112
                    	Error:      	Not equal: 
                    	            	expected: int(0)
                    	            	actual  : int64(50)
                    	Test:       	TestFileEncryptionDecryption/TestDecryption/uniform_encryption.parquet.encrypted/config_1
            --- FAIL: TestFileEncryptionDecryption/TestDecryption/uniform_encryption.parquet.encrypted/config_3 (0.01s)
                encryption_read_config_test.go:217: 
                    	Error Trace:	/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:217
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:406
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:430
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:468
                    	            				/tmp/arrow-14.0.0.Rm87k/go/gopath/pkg/mod/github.com/stretchr/testify@v1.8.4/suite/suite.go:112
                    	Error:      	Not equal: 
                    	            	expected: int(0)
                    	            	actual  : int64(50)
                    	Test:       	TestFileEncryptionDecryption/TestDecryption/uniform_encryption.parquet.encrypted/config_3
        --- FAIL: TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer.parquet.encrypted (0.06s)
            --- FAIL: TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer.parquet.encrypted/config_1 (0.01s)
                encryption_read_config_test.go:217: 
                    	Error Trace:	/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:217
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:406
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:430
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:468
                    	            				/tmp/arrow-14.0.0.Rm87k/go/gopath/pkg/mod/github.com/stretchr/testify@v1.8.4/suite/suite.go:112
                    	Error:      	Not equal: 
                    	            	expected: int(0)
                    	            	actual  : int64(50)
                    	Test:       	TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer.parquet.encrypted/config_1
            --- FAIL: TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer.parquet.encrypted/config_3 (0.01s)
                encryption_read_config_test.go:217: 
                    	Error Trace:	/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:217
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:406
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:430
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:468
                    	            				/tmp/arrow-14.0.0.Rm87k/go/gopath/pkg/mod/github.com/stretchr/testify@v1.8.4/suite/suite.go:112
                    	Error:      	Not equal: 
                    	            	expected: int(0)
                    	            	actual  : int64(50)
                    	Test:       	TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer.parquet.encrypted/config_3
        --- FAIL: TestFileEncryptionDecryption/TestDecryption/encrypt_columns_plaintext_footer.parquet.encrypted (0.08s)
            --- FAIL: TestFileEncryptionDecryption/TestDecryption/encrypt_columns_plaintext_footer.parquet.encrypted/config_1 (0.01s)
                encryption_read_config_test.go:217: 
                    	Error Trace:	/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:217
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:406
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:430
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:468
                    	            				/tmp/arrow-14.0.0.Rm87k/go/gopath/pkg/mod/github.com/stretchr/testify@v1.8.4/suite/suite.go:112
                    	Error:      	Not equal: 
                    	            	expected: int(0)
                    	            	actual  : int64(50)
                    	Test:       	TestFileEncryptionDecryption/TestDecryption/encrypt_columns_plaintext_footer.parquet.encrypted/config_1
            --- FAIL: TestFileEncryptionDecryption/TestDecryption/encrypt_columns_plaintext_footer.parquet.encrypted/config_3 (0.00s)
                encryption_read_config_test.go:217: 
                    	Error Trace:	/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:217
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:406
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:430
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:468
                    	            				/tmp/arrow-14.0.0.Rm87k/go/gopath/pkg/mod/github.com/stretchr/testify@v1.8.4/suite/suite.go:112
                    	Error:      	Not equal: 
                    	            	expected: int(0)
                    	            	actual  : int64(50)
                    	Test:       	TestFileEncryptionDecryption/TestDecryption/encrypt_columns_plaintext_footer.parquet.encrypted/config_3
            --- FAIL: TestFileEncryptionDecryption/TestDecryption/encrypt_columns_plaintext_footer.parquet.encrypted/config_4 (0.00s)
                encryption_read_config_test.go:217: 
                    	Error Trace:	/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:217
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:406
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:430
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:468
                    	            				/tmp/arrow-14.0.0.Rm87k/go/gopath/pkg/mod/github.com/stretchr/testify@v1.8.4/suite/suite.go:112
                    	Error:      	Not equal: 
                    	            	expected: int(0)
                    	            	actual  : int64(50)
                    	Test:       	TestFileEncryptionDecryption/TestDecryption/encrypt_columns_plaintext_footer.parquet.encrypted/config_4
        --- FAIL: TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer_aad.parquet.encrypted (0.06s)
            --- FAIL: TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer_aad.parquet.encrypted/config_1 (0.00s)
                encryption_read_config_test.go:217: 
                    	Error Trace:	/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:217
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:406
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:430
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:468
                    	            				/tmp/arrow-14.0.0.Rm87k/go/gopath/pkg/mod/github.com/stretchr/testify@v1.8.4/suite/suite.go:112
                    	Error:      	Not equal: 
                    	            	expected: int(0)
                    	            	actual  : int64(50)
                    	Test:       	TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer_aad.parquet.encrypted/config_1
            --- FAIL: TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer_aad.parquet.encrypted/config_2 (0.00s)
                encryption_read_config_test.go:217: 
                    	Error Trace:	/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:217
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:406
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:430
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:468
                    	            				/tmp/arrow-14.0.0.Rm87k/go/gopath/pkg/mod/github.com/stretchr/testify@v1.8.4/suite/suite.go:112
                    	Error:      	Not equal: 
                    	            	expected: int(0)
                    	            	actual  : int64(50)
                    	Test:       	TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer_aad.parquet.encrypted/config_2
            --- FAIL: TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer_aad.parquet.encrypted/config_3 (0.00s)
                encryption_read_config_test.go:217: 
                    	Error Trace:	/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:217
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:406
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:430
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:468
                    	            				/tmp/arrow-14.0.0.Rm87k/go/gopath/pkg/mod/github.com/stretchr/testify@v1.8.4/suite/suite.go:112
                    	Error:      	Not equal: 
                    	            	expected: int(0)
                    	            	actual  : int64(50)
                    	Test:       	TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer_aad.parquet.encrypted/config_3
        --- FAIL: TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer_disable_aad_storage.parquet.encrypted (0.02s)
            --- FAIL: TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer_disable_aad_storage.parquet.encrypted/config_2 (0.00s)
                encryption_read_config_test.go:217: 
                    	Error Trace:	/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:217
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:406
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:430
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:468
                    	            				/tmp/arrow-14.0.0.Rm87k/go/gopath/pkg/mod/github.com/stretchr/testify@v1.8.4/suite/suite.go:112
                    	Error:      	Not equal: 
                    	            	expected: int(0)
                    	            	actual  : int64(50)
                    	Test:       	TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer_disable_aad_storage.parquet.encrypted/config_2
        --- FAIL: TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer_ctr.parquet.encrypted (0.05s)
            --- FAIL: TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer_ctr.parquet.encrypted/config_1 (0.00s)
                encryption_read_config_test.go:217: 
                    	Error Trace:	/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:217
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:406
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:430
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:468
                    	            				/tmp/arrow-14.0.0.Rm87k/go/gopath/pkg/mod/github.com/stretchr/testify@v1.8.4/suite/suite.go:112
                    	Error:      	Not equal: 
                    	            	expected: int(0)
                    	            	actual  : int64(50)
                    	Test:       	TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer_ctr.parquet.encrypted/config_1
            --- FAIL: TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer_ctr.parquet.encrypted/config_3 (0.01s)
                encryption_read_config_test.go:217: 
                    	Error Trace:	/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:217
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:406
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:430
                    	            				/tmp/arrow-14.0.0.Rm87k/apache-arrow-14.0.0/go/parquet/encryption_read_config_test.go:468
                    	            				/tmp/arrow-14.0.0.Rm87k/go/gopath/pkg/mod/github.com/stretchr/testify@v1.8.4/suite/suite.go:112
                    	Error:      	Not equal: 
                    	            	expected: int(0)
                    	            	actual  : int64(50)
                    	Test:       	TestFileEncryptionDecryption/TestDecryption/encrypt_columns_and_footer_ctr.parquet.encrypted/config_3
/tmp/parquet-encryption-test-3429813239
FAIL
FAIL	github.com/apache/arrow/go/v14/parquet	0.464s

This is reproducible locally with:

archery docker run  -e VERIFY_VERSION="14.0.0" -e VERIFY_RC="2" -e TEST_DEFAULT=0 -e TEST_GO=1 almalinux-verify-rc

We didn't noticed before because this doesn't fail with non-official releases (local source):

archery docker run  -e VERIFY_VERSION="" -e VERIFY_RC="" -e TEST_DEFAULT=0 -e TEST_GO=1 almalinux-verify-rc

See error here: https://github.com/ursacomputing/crossbow/actions/runs/6572466559/job/17853633830
And workflow file: https://github.com/ursacomputing/crossbow/actions/runs/6572466559/workflow

Successful one on maintenance branch where we test from local: https://github.com/ursacomputing/crossbow/actions/runs/6572711355/job/17854324601
And workflow file: https://github.com/ursacomputing/crossbow/actions/runs/6572711355/workflow

Component(s)

Go, Release

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions