-
Notifications
You must be signed in to change notification settings - Fork 616
Comparing changes
Open a pull request
base repository: delta-io/delta-rs
base: python-v0.16.3
head repository: delta-io/delta-rs
compare: python-v0.16.4
- 11 commits
- 42 files changed
- 5 contributors
Commits on Mar 26, 2024
-
fix(python): wrong batch size (#2314)
# Description Was passing the wrong param - closes #2309
Configuration menu - View commit details
-
Copy full SHA for 5b404e2 - Browse repository at this point
Copy the full SHA 5b404e2View commit details
Commits on Mar 28, 2024
-
fix(rust): throw schema mismatch when decimal doesn't fit in the deci…
…mal type of table (#2330) # Description The `can_cast_types` is a bit to flexible with decimals, since we define the decimal type in the table metadata. So if the source data contains a decimal that is larger than the decimal in the table metadata, we should throw an error. Before we would let our writer just write because `can_cast_types `does not check precision and scale for casting so Decimal(30.1) could be written after the table was set to only allow precision=1, scale=1. After the write, the json parser would not be able to read the table anymore since it throws a decimal overflow, and rightfully so. This fix will prevent tables to get in these invalid states.
Configuration menu - View commit details
-
Copy full SHA for bb46c8a - Browse repository at this point
Copy the full SHA bb46c8aView commit details -
Configuration menu - View commit details
-
Copy full SHA for e2aa8ba - Browse repository at this point
Copy the full SHA e2aa8baView commit details -
Configuration menu - View commit details
-
Copy full SHA for 01f832c - Browse repository at this point
Copy the full SHA 01f832cView commit details -
fix: remove tmp files in cleanup_metadata (#2356)
# Description We didn't clean up failed commits when possible. # Related Issue(s) - fixes #2351
Configuration menu - View commit details
-
Copy full SHA for 88937d3 - Browse repository at this point
Copy the full SHA 88937d3View commit details
Commits on Mar 29, 2024
-
fix(python,rust): optimize compact on schema evolved table (#2358)
# Description Default should be always to add missing columns in compaction. # Related Issue(s) - fixes #2347
Configuration menu - View commit details
-
Copy full SHA for fa435e1 - Browse repository at this point
Copy the full SHA fa435e1View commit details -
feat(rust): derive Copy on some public enums (#2329)
# Description This PR derives the `Copy` trait on public enums that had the `Clone` trait derived, when applicable.
Configuration menu - View commit details
-
Copy full SHA for e58df28 - Browse repository at this point
Copy the full SHA e58df28View commit details
Commits on Mar 31, 2024
-
fix: add config for parquet pushdown on delta scan (#2364)
# Description Delta scan will push filter to the parquet scan when possible. Added a new configuration for the special case where operations need to operate on an entire file but still want to perform pruning. # Related Issue(s) - fixes #2362
Configuration menu - View commit details
-
Copy full SHA for 7568b57 - Browse repository at this point
Copy the full SHA 7568b57View commit details
Commits on Apr 1, 2024
-
fix: add snappy compression on checkpoint files (#2365)
# Description Noticed that we didn't set any compression, this should bring down the file size a bit for users that have large checkpoints
Configuration menu - View commit details
-
Copy full SHA for e34767d - Browse repository at this point
Copy the full SHA e34767dView commit details -
chore(rust): bump datafusion to 36 (#2249)
# Description The description of the main changes of your pull request # Related Issue(s) <!--- For example: - closes #106 ---> # Documentation <!--- Share links to useful documentation --->
Configuration menu - View commit details
-
Copy full SHA for 2963692 - Browse repository at this point
Copy the full SHA 2963692View commit details -
chore: bump python 0.16.4 (#2371)
# Description Another patch release
Configuration menu - View commit details
-
Copy full SHA for dcd6be0 - Browse repository at this point
Copy the full SHA dcd6be0View commit details
This comparison is taking too long to generate.
Unfortunately it looks like we can’t render this comparison for you right now. It might be too big, or there might be something weird with your repository.
You can try running this command locally to see the comparison on your machine:
git diff python-v0.16.3...python-v0.16.4