Skip to content

Change filebeat azure eventhub input to use processor v2 as default#47292

Merged
kaiyan-sheng merged 9 commits intomainfrom
azure_v2
Nov 25, 2025
Merged

Change filebeat azure eventhub input to use processor v2 as default#47292
kaiyan-sheng merged 9 commits intomainfrom
azure_v2

Conversation

@kaiyan-sheng
Copy link
Copy Markdown
Contributor

@kaiyan-sheng kaiyan-sheng commented Oct 22, 2025 •
edited
Loading

Proposed commit message

This PR is to change Filebeat azure eventhub input and related modules to use processor v2 as the default.

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have added an entry in ./changelog/fragments using the changelog tool.

Disruptive User Impact

For users that are currently still using v1 processor version, they need to add this into their config manually for the new version to work for v1.

How to test this PR locally

Test cases I would like to cover for this change are:

  1. Default (no processor_version)
  2. Set processor_version to v1 for backwards compatibility
  3. Set processor_version to v2
  4. v2 requires connection string, existing user using v1 and not setting connection string, we should build the connection string.

Related issues

This PR takes care of the Beats side of elastic/integrations#15703. We will need to make the same change in the Integrations.

@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Oct 22, 2025
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Oct 22, 2025

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

  • run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

@mergify
Copy link
Copy Markdown
Contributor

mergify bot commented Oct 22, 2025

This pull request does not have a backport label.
If this is a bug or security fix, could you label this PR @kaiyan-sheng? 🙏.
For such, you'll need to label your PR with:

  • The upcoming major version of the Elastic Stack
  • The upcoming minor version of the Elastic Stack (if you're not pushing a breaking change)

To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

  • backport-8./d is the label to automatically backport to the 8./d branch. /d is the digit
  • backport-active-all is the label that automatically backports to all active branches.
  • backport-active-8 is the label that automatically backports to all active minor branches for the 8 major.
  • backport-active-9 is the label that automatically backports to all active minor branches for the 9 major.

@kaiyan-sheng kaiyan-sheng marked this pull request as ready for review October 28, 2025 00:22
@kaiyan-sheng kaiyan-sheng requested a review from a team as a code owner October 28, 2025 00:22
@kaiyan-sheng kaiyan-sheng added Team:obs-ds-hosted-services Label for the Observability Hosted Services team backport-skip Skip notification from the automated backport with mergify labels Oct 30, 2025
@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Oct 30, 2025
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Oct 30, 2025

Pinging @elastic/obs-ds-hosted-services (Team:obs-ds-hosted-services)

@kaiyan-sheng kaiyan-sheng linked an issue Nov 6, 2025 that may be closed by this pull request
[azure logs] make azure-eventhub processor v2 the default option in the Azure Logs integration package elastic/integrations#15703
Closed
3 tasks
kaiyan-sheng
kaiyan-sheng commented Nov 20, 2025
View reviewed changes
@kaiyan-sheng kaiyan-sheng requested a review from zmoog November 21, 2025 18:04
zmoog
zmoog approved these changes Nov 24, 2025
View reviewed changes
Copy link
Copy Markdown
Contributor

@zmoog zmoog left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, with a question on setting migrate_checkpoint: true and a couple of uber-minor nits.

@kaiyan-sheng kaiyan-sheng enabled auto-merge (squash) November 24, 2025 23:27
@kaiyan-sheng kaiyan-sheng merged commit e1c8a0a into main Nov 25, 2025
39 checks passed
@kaiyan-sheng kaiyan-sheng deleted the azure_v2 branch November 25, 2025 02:15
andrzej-stencel pushed a commit to andrzej-stencel/beats that referenced this pull request Dec 1, 2025
@andrzej-stencel
Change filebeat azure eventhub input to use processor v2 as default (e…
a25e49f 
…lastic#47292)
@kaiyan-sheng kaiyan-sheng linked an issue Dec 9, 2025 that may be closed by this pull request
[Filebeat] make azure-eventhub processor v2 the default option #47979
Closed
@kaiyan-sheng kaiyan-sheng mentioned this pull request Dec 9, 2025
Closed
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@zmoog zmoog zmoog approved these changes

Assignees

@kaiyan-sheng kaiyan-sheng

Labels

backport-skip Skip notification from the automated backport with mergify Team:obs-ds-hosted-services Label for the Observability Hosted Services team

Projects

None yet

Milestone

No milestone

3 participants

@kaiyan-sheng @elasticmachine @zmoog