Skip to content

Fix Spark split function#8825

Closed
rui-mo wants to merge 20 commits intofacebookincubator:mainfrom
rui-mo:wip_split
Closed

Fix Spark split function#8825
rui-mo wants to merge 20 commits intofacebookincubator:mainfrom
rui-mo:wip_split

Conversation

@rui-mo
Copy link
Copy Markdown
Contributor

@rui-mo rui-mo commented Feb 22, 2024

Supports limit as a parameter of split function, supports general regex pattern
as delimiter, and allows non-constant input vectors for delimiter and limit.
Fixes #4066.

Doc: https://spark.apache.org/docs/latest/api/sql/index.html#split
Spark implementation: https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/regexpExpressions.scala#L514-L543.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Feb 22, 2024
@netlify
Copy link
Copy Markdown

netlify Bot commented Feb 22, 2024

Deploy Preview for meta-velox failed.

Name Link
🔨 Latest commit f895362
🔍 Latest deploy log https://app.netlify.com/sites/meta-velox/deploys/668cd9c3a41fbe00084459da

@stale
Copy link
Copy Markdown

stale Bot commented May 24, 2024

This pull request has been automatically marked as stale because it has not had recent activity. If you'd still like this PR merged, please comment on the PR, make sure you've addressed reviewer comments, and rebase on the latest main. Thank you for your contributions!

@stale stale Bot added the stale label May 24, 2024
@stale stale Bot removed the stale label May 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Spark] Split function should accept non constant delimiter

10 participants