Skip to content

export: remove deprecated parquet library#120834

Merged
craig[bot] merged 1 commit intocockroachdb:masterfrom
jayshrivastava:cleanup-parquet
Apr 1, 2024
Merged

export: remove deprecated parquet library#120834
craig[bot] merged 1 commit intocockroachdb:masterfrom
jayshrivastava:cleanup-parquet

Conversation

@jayshrivastava
Copy link
Copy Markdown
Contributor

@jayshrivastava jayshrivastava commented Mar 21, 2024

This change removes the github.com/fraugster/parquet-go dependency and all code which uses it. This library has been unused since #104234 landed. This change officially removes the code and dependency from the repo.

This change also adds support for Oid-like types such as regrole, regtype etc to util/parquet. These types are
used in export parquet testing and were previously not supported by util/parquet.

Closes: #104278
Release note: None
Epic: None

@cockroach-teamcity
Copy link
Copy Markdown
Member

This change is Reviewable

@jayshrivastava jayshrivastava marked this pull request as ready for review March 21, 2024 14:18
@jayshrivastava jayshrivastava requested a review from a team as a code owner March 21, 2024 14:18
@jayshrivastava jayshrivastava requested review from a team, DrewKimball and rharding6373 and removed request for a team March 21, 2024 14:18
@jayshrivastava
Copy link
Copy Markdown
Contributor Author

@rharding6373 I believe CDC owns export now, so this should fall under our team for review.

Copy link
Copy Markdown
Collaborator

@rharding6373 rharding6373 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:lgtm: Nice to see so much code deletion.

Reviewable status: :shipit: complete! 1 of 0 LGTMs obtained (waiting on @DrewKimball)

@jayshrivastava
Copy link
Copy Markdown
Contributor Author

bors r=rharding6373

@jayshrivastava
Copy link
Copy Markdown
Contributor Author

TYFR!

@craig
Copy link
Copy Markdown
Contributor

craig bot commented Mar 21, 2024

Build failed (retrying...):

@craig
Copy link
Copy Markdown
Contributor

craig bot commented Mar 21, 2024

Build failed:

@rickystewart
Copy link
Copy Markdown
Collaborator

The problem here is check_generated_code flaked so you couldn't see the legitimate failure until you bors'ed. I'm going to take some steps to address the flakiness.

@jayshrivastava jayshrivastava requested a review from a team as a code owner March 21, 2024 21:10
Copy link
Copy Markdown
Collaborator

@rickystewart rickystewart left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like TestRandomParquetExports failed in CI. It seems like it's flaky.

@jayshrivastava
Copy link
Copy Markdown
Contributor Author

The flake is related to this. Looking into it... #112693

@jayshrivastava jayshrivastava force-pushed the cleanup-parquet branch 3 times, most recently from 55f4e9f to 7b8f8a2 Compare March 27, 2024 13:13
This change removes the github.com/fraugster/parquet-go dependency and all code which uses it. This
libary has been unused since cockroachdb#104234 landed. This change officially removes the code and dependency
from the repo.

This change also adds support for Oid-like types such as regrole, regtype etc to util/parquet. These types are
used in export parquet testing and were previously not supported by util/parquet.

Closes: cockroachdb#104278
Release note: None
Epic: None
@jayshrivastava
Copy link
Copy Markdown
Contributor Author

bors r+

@craig
Copy link
Copy Markdown
Contributor

craig bot commented Apr 1, 2024

👎 Rejected by code reviews

@jayshrivastava
Copy link
Copy Markdown
Contributor Author

TYFR!

@jayshrivastava
Copy link
Copy Markdown
Contributor Author

bors r+

@craig
Copy link
Copy Markdown
Contributor

craig bot commented Apr 1, 2024

@craig craig bot merged commit 20deb30 into cockroachdb:master Apr 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

export: clean up old parquet writer

4 participants