Skip to content

Support Grok command in Calcite engine#3678

Merged
penghuo merged 7 commits intoopensearch-project:mainfrom
songkant-aws:grok-command
Jun 4, 2025
Merged

Support Grok command in Calcite engine#3678
penghuo merged 7 commits intoopensearch-project:mainfrom
songkant-aws:grok-command

Conversation

@songkant-aws
Copy link
Copy Markdown
Collaborator

@songkant-aws songkant-aws commented May 27, 2025

Description

Support Grok command in Calcite engine

Related Issues

Resolves #3677

Check List

  • New functionality includes testing.
  • New functionality has been documented.
  • New functionality has javadoc added.
  • New functionality has a user manual doc added.
  • API changes companion pull request created.
  • Commits are signed per the DCO using --signoff.
  • Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Songkan Tang <songkant@amazon.com>
Signed-off-by: Songkan Tang <songkant@amazon.com>
Signed-off-by: Songkan Tang <songkant@amazon.com>
Signed-off-by: Songkan Tang <songkant@amazon.com>
Signed-off-by: Songkan Tang <songkant@amazon.com>
Signed-off-by: Songkan Tang <songkant@amazon.com>
@LantaoJin
Copy link
Copy Markdown
Member

CI failure is not related.

Copy link
Copy Markdown
Collaborator

@dai-chen dai-chen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the changes!

registerOperator(IF, SqlStdOperatorTable.CASE);
registerOperator(IFNULL, SqlStdOperatorTable.COALESCE);
registerOperator(COALESCE, SqlStdOperatorTable.COALESCE);
registerOperator(INTERNAL_ITEM, SqlStdOperatorTable.ITEM);
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Calcite ITEM function is public right? Why we need another internal one?

@penghuo penghuo merged commit 2f2117b into opensearch-project:main Jun 4, 2025
22 checks passed
@songkant-aws songkant-aws deleted the grok-command branch June 6, 2025 05:48
penghuo pushed a commit that referenced this pull request Jun 16, 2025
* Support Grok command in Calcite engine

Signed-off-by: Songkan Tang <songkant@amazon.com>

* Register SqlStdOperatorTable.ITEM into PPLFuncImpTable

Signed-off-by: Songkan Tang <songkant@amazon.com>

* Fix case function ITs caused by weblogs index data change

Signed-off-by: Songkan Tang <songkant@amazon.com>

* Enforce Locale attempt to fix flaky grok compilation

Signed-off-by: Songkan Tang <songkant@amazon.com>

* Fix checkstyle

Signed-off-by: Songkan Tang <songkant@amazon.com>

* Add anonymizer test for grok command

Signed-off-by: Songkan Tang <songkant@amazon.com>

---------

Signed-off-by: Songkan Tang <songkant@amazon.com>
Signed-off-by: xinyual <xinyual@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[FEATURE] Support Grok command for Calcite engine

4 participants