Skip to content

correctness: TPCDS Q69 has incorrect output between Comet and Spark #2667

@comphead

Description

@comphead

Describe the bug

Comparing subfolder: q69

Spark Schema

root
 |-- cd_gender: string (nullable = true)
 |-- cd_marital_status: string (nullable = true)
 |-- cd_education_status: string (nullable = true)
 |-- cnt1: long (nullable = true)
 |-- cd_purchase_estimate: long (nullable = true)
 |-- cnt2: long (nullable = true)
 |-- cd_credit_rating: string (nullable = true)
 |-- cnt3: long (nullable = true)

Comet Schema

root
 |-- cd_gender: string (nullable = true)
 |-- cd_marital_status: string (nullable = true)
 |-- cd_education_status: string (nullable = true)
 |-- cnt1: long (nullable = true)
 |-- cd_purchase_estimate: long (nullable = true)
 |-- cnt2: long (nullable = true)
 |-- cd_credit_rating: string (nullable = true)
 |-- cnt3: long (nullable = true)

First difference at row 0:
Spark: F,D,2 yr Degree,2,7500,2,Good,2
Comet: F,D,2 yr Degree,1,9500,1,Good,1

Steps to reproduce

No response

Expected behavior

No response

Additional context

No response

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions