Skip to content

Cloudflare Logpush - fix SQS worker setting#13346

Merged
flexitrev merged 6 commits intomainfrom
cloudflare_logpush_sqs_fix2
Apr 1, 2025
Merged

Cloudflare Logpush - fix SQS worker setting#13346
flexitrev merged 6 commits intomainfrom
cloudflare_logpush_sqs_fix2

Conversation

@flexitrev
Copy link
Copy Markdown
Contributor

  • Bug

Proposed commit message

Fixes number_of_workers setting so it is not dependent on S3 bucket collection being enabled

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • [] I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.
  • [N/A] I have verified that any added dashboard complies with Kibana's Dashboard good practices

How to test this PR locally

Modify number of worker settings on previous version of the integration without enabling S3 bucket selection.
Download policy
Observe that default number of workers is still present or not present at all, relying on aws-s3 input defaults

Modify number of worker settings on this version of the integration without enabling S3 bucket selection.
Download policy
Observe that default number of workers is the value of user input

Related issues

Screenshots

@flexitrev flexitrev requested a review from a team as a code owner March 28, 2025 16:04
@andrewkroh andrewkroh added Integration:cloudflare_logpush Cloudflare Logpush Team:Security-Service Integrations Security Service Integrations team [elastic/security-service-integrations] labels Mar 28, 2025
@elasticmachine
Copy link
Copy Markdown

Pinging @elastic/security-service-integrations (Team:Security-Service Integrations)

@elastic-vault-github-plugin-prod
Copy link
Copy Markdown

elastic-vault-github-plugin-prod bot commented Mar 28, 2025

🚀 Benchmarks report

Package cloudflare_logpush 👍(8) 💚(3) 💔(7)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
network_analytics 3095.98 2450.98 -645 (-20.83%) 💔
access_request 3663 2724.8 -938.2 (-25.61%) 💔
audit 7874.02 4405.29 -3468.73 (-44.05%) 💔
device_posture 6993.01 5813.95 -1179.06 (-16.86%) 💔
dns 14705.88 11764.71 -2941.17 (-20%) 💔
firewall_event 3154.57 2314.81 -839.76 (-26.62%) 💔
gateway_dns 5181.35 3906.25 -1275.1 (-24.61%) 💔

To see the full report comment with /test benchmark fullreport

flexitrev and others added 2 commits March 31, 2025 11:22
Co-authored-by: Dan Kortschak <dan.kortschak@elastic.co>
…t.yml

Co-authored-by: Dan Kortschak <dan.kortschak@elastic.co>
@flexitrev flexitrev requested a review from efd6 March 31, 2025 15:22
Co-authored-by: Andrew Kroh <andrew.kroh@elastic.co>
@flexitrev flexitrev enabled auto-merge (squash) April 1, 2025 21:44
@elasticmachine
Copy link
Copy Markdown

💚 Build Succeeded

History

@flexitrev flexitrev merged commit b90febd into main Apr 1, 2025
5 checks passed
@flexitrev flexitrev deleted the cloudflare_logpush_sqs_fix2 branch April 1, 2025 21:45
@elastic-sonarqube
Copy link
Copy Markdown

@elastic-vault-github-plugin-prod
Copy link
Copy Markdown

Package cloudflare_logpush - 1.35.2 containing this change is available at https://epr.elastic.co/package/cloudflare_logpush/1.35.2/

kcreddy added a commit that referenced this pull request Jun 20, 2025
#14270)

#13346 introduced a bug inside gateway_http data stream which allows 
input config to have a duplicate of number_of_workers since it was not
removed from the S3 options logic.

Fix this by removing number_of_workers dependency on S3 bucket collection 
being enabled, similar to other data streams in #13346.
shmsr pushed a commit to shmsr/integrations that referenced this pull request Jun 30, 2025
elastic#14270)

elastic#13346 introduced a bug inside gateway_http data stream which allows 
input config to have a duplicate of number_of_workers since it was not
removed from the S3 options logic.

Fix this by removing number_of_workers dependency on S3 bucket collection 
being enabled, similar to other data streams in elastic#13346.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Integration:cloudflare_logpush Cloudflare Logpush Team:Security-Service Integrations Security Service Integrations team [elastic/security-service-integrations]

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Cloudflare Logpush] Setting number_of_workers is ignored if SQS is used.

4 participants