Skip to content

Conversation

@jayzhan211
Copy link
Contributor

Which issue does this PR close?

Closes #.

Part of #10484

Rationale for this change

These two allocExtension is used in binary map (datafusion/physical-expr/src/binary_map.rs), which is planned to move to functions-aggregate, so I move it to common to avoid importing execution crate.

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

Signed-off-by: jayzhan211 <jayzhan211@gmail.com>
@jayzhan211 jayzhan211 changed the title Move proxy to datafusion common Minor: Move proxy to datafusion common May 17, 2024
@github-actions github-actions bot added physical-expr Changes to the physical-expr crates optimizer Optimizer rules core Core DataFusion crate labels May 17, 2024
Signed-off-by: jayzhan211 <jayzhan211@gmail.com>
@jayzhan211 jayzhan211 marked this pull request as ready for review May 17, 2024 15:01
Copy link
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me @jayzhan211 other than the name of the new memory_pool module -- maybe we can just put it in utils instead

// specific language governing permissions and limitations
// under the License.

pub mod proxy;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think moving the proxy code (that helps track allocations) makes sense to me

What do you think about putting it somewhere other than a directory called "memory_pool"

Perhaps datafusion/common/src/utils/proxy.rs 🤔

Signed-off-by: jayzhan211 <jayzhan211@gmail.com>
Signed-off-by: jayzhan211 <jayzhan211@gmail.com>
datafusion-expr = { workspace = true }
datafusion-physical-expr = { workspace = true, default-features = true }
hashbrown = { version = "0.14", features = ["raw"], optional = true }
hashbrown = { workspace = true, optional = true }
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

Copy link
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @jayzhan211

@alamb alamb merged commit b36f5e2 into apache:main May 20, 2024
findepi pushed a commit to findepi/datafusion that referenced this pull request Jul 16, 2024
* move proxy to common

Signed-off-by: jayzhan211 <jayzhan211@gmail.com>

* fix doc

Signed-off-by: jayzhan211 <jayzhan211@gmail.com>

* move to utils

Signed-off-by: jayzhan211 <jayzhan211@gmail.com>

* fix doc

Signed-off-by: jayzhan211 <jayzhan211@gmail.com>

---------

Signed-off-by: jayzhan211 <jayzhan211@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

core Core DataFusion crate optimizer Optimizer rules physical-expr Changes to the physical-expr crates

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants