Skip to content

Change batch processor defaults#4363

Merged
ptodev merged 2 commits intomainfrom
4000-limit-otelcolexporterotlphttp-to-not-exceed-grafana-cloud-defaults
Sep 10, 2025
Merged

Change batch processor defaults#4363
ptodev merged 2 commits intomainfrom
4000-limit-otelcolexporterotlphttp-to-not-exceed-grafana-cloud-defaults

Conversation

@ptodev
Copy link
Contributor

@ptodev ptodev commented Sep 5, 2025

PR Description

In dogfooding clusters we tend to set send_batch_size/send_batch_max_size at 1800/2000, and even at 400/500 in some cases (to avoid really large spans). I think setting the default values at 2000 and 3000 should be totally ok and won't lead to issues.

Users with a poor network they might prefer to send larger batches, but even then they might hit the limit of what the DB allows them to send. For most users 2000/3000 should be ok.

In theory the defaults could be brought down even more. But I'm not sure by how much, and also there's no point pondering about the defaults for the batch processor much right now. It is going to be EOL soon and we need to focus on getting the defaults right for the new batch blocks in the exporter config.

Which issue(s) this PR fixes

Fixes #4000

PR Checklist

  • CHANGELOG.md updated
  • Documentation added
  • Tests updated
  • Config converters updated

@ptodev ptodev requested review from a team and clayton-cornell as code owners September 5, 2025 15:10
@ptodev ptodev linked an issue Sep 5, 2025 that may be closed by this pull request
@github-actions
Copy link
Contributor

github-actions bot commented Sep 5, 2025

💻 Deploy preview deleted.

Copy link
Contributor

@kgeckhart kgeckhart left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for this one!

@clayton-cornell clayton-cornell added the type/docs Docs Squad label across all Grafana Labs repos label Sep 8, 2025
@ptodev ptodev force-pushed the 4000-limit-otelcolexporterotlphttp-to-not-exceed-grafana-cloud-defaults branch from c209ac2 to dfae383 Compare September 10, 2025 14:52
@ptodev ptodev merged commit eef6f5a into main Sep 10, 2025
42 checks passed
@ptodev ptodev deleted the 4000-limit-otelcolexporterotlphttp-to-not-exceed-grafana-cloud-defaults branch September 10, 2025 15:58
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Oct 11, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

frozen-due-to-age type/docs Docs Squad label across all Grafana Labs repos

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Limit otelcol.exporter.otlphttp to not exceed Grafana Cloud defaults

3 participants