Skip to content
This repository is currently being migrated. It's locked while the migration is in progress.

Fix dataset-serialize benchmark by setting pre_buffer=False#152

Merged
austin3dickey merged 3 commits intomainfrom
aus/pre_buffer
Oct 24, 2023
Merged

Fix dataset-serialize benchmark by setting pre_buffer=False#152
austin3dickey merged 3 commits intomainfrom
aus/pre_buffer

Conversation

@austin3dickey
Copy link
Copy Markdown
Contributor

Fixes voltrondata-labs/arrow-benchmarks-ci#166.

This PR sets pre_buffer=False when reading files in the dataset-serialize benchmark in order to avoid apache/arrow#38438.

Once that's fixed, we can probably come back and remove this.

@coveralls
Copy link
Copy Markdown

coveralls commented Oct 24, 2023

Pull Request Test Coverage Report for Build 6631563598

  • 4 of 5 (80.0%) changed or added relevant lines in 1 file are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage increased (+0.02%) to 87.164%

Changes Missing Coverage Covered Lines Changed/Added Lines %
benchmarks/dataset_serialize_benchmark.py 4 5 80.0%
Totals Coverage Status
Change from base Build 6262213233: 0.02%
Covered Lines: 1555
Relevant Lines: 1784

💛 - Coveralls

@austin3dickey austin3dickey merged commit d412d2f into main Oct 24, 2023
@austin3dickey austin3dickey deleted the aus/pre_buffer branch October 24, 2023 21:06
austin3dickey added a commit that referenced this pull request Nov 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

dataset-serialize benchmark is failing with segfaults

2 participants