PARQUET-133: Upgrade snappy-java to 1.1.1.6#85
Conversation
|
The release notes for Snappy 1.1.0 include: "Upgrade to snappy-1.1.0". @xerial can you tell us more about this? I'm trying to figure out if there are any forward-incompatible changes to snappy brought in by this. If so, then I think we should wait until parquet-mr 2.x is released so we don't break old readers (allows version rollback). |
|
@rdblue |
|
@xerial, what is framing-format and when is it used? If it isn't forward-incompatible, then it must just be read-side support for this? |
|
@rdblue I'm a little bit confused with the usage of the forward/backward compatibility. What I meant is there is no format change in what Snappy.compress/uncompress and SnappyInput/OutputStream produce since 1.0.x. |
|
@xerial, thanks for clarifying, that's exactly what I was looking for. I just wanted to make sure there weren't changes to the way data would be written (without code changes in Parquet) that would prevent older readers from working. It sounds like the new format is contained in its own set of methods and classes, so I think we're okay. +1 |
|
@rdblue do you want to merge? |
|
@julienledem done. @xerial thanks for the contribution! |
Upgrade snappy-java to 1.1.1.6 (the latest vesrion), since 1.0.5 is no longer maintained in https://github.com/xerial/snappy-java, and 1.1.1.6 supports broader platforms including PowerPC, IBM-AIX 6.4, SunOS, etc. And also it has a better native coding loading mechanism (allowing to use snappy-java from multiple class loaders) Author: Taro L. Saito <leo@xerial.org> Closes apache#85 from xerial/PARQUET-133 and squashes the following commits: 01d7b78 [Taro L. Saito] PARQUET-133: Upgrade snappy-java to 1.1.1.6
add field_id in SchemaElement
https://issues.apache.org/jira/browse/PARQUET-1236 Author: 1028332163 <1028332163@qq.com> Closes apache#85 from PandaMonkey/master and squashes the following commits: 158f082 [1028332163] align version of slf4j-api
Upgrade snappy-java to 1.1.1.6 (the latest vesrion), since 1.0.5 is no longer maintained in https://github.com/xerial/snappy-java, and 1.1.1.6 supports broader platforms including PowerPC, IBM-AIX 6.4, SunOS, etc. And also it has a better native coding loading mechanism (allowing to use snappy-java from multiple class loaders)