Skip to content

test: Flaky main_test TestMonitoring #20695

@carsonip

Description

@carsonip

Example https://github.com/elastic/apm-server/actions/runs/22914497942/job/66495897238

2026/03/10 17:06:07 Found 0 WALs
    logger.go:146: 2026-03-10T17:06:07.309Z	INFO	sampling	setting disk usage threshold to 80% of total disk space of 319.5gb
    main_test.go:57: 
        	Error Trace:	/Users/runner/work/apm-server/apm-server/internal/beater/monitoringtest/opentelemetry.go:81
        	            				/Users/runner/work/apm-server/apm-server/internal/beater/monitoringtest/opentelemetry.go:62
        	            				/Users/runner/work/apm-server/apm-server/x-pack/apm-server/main_test.go:58
        	            				/Users/runner/hostedtoolcache/go/1.25.7/arm64/src/runtime/asm_arm64.s:1268
        	Error:      	Should not be: 0
    main_test.go:57: 
        	Error Trace:	/Users/runner/work/apm-server/apm-server/internal/beater/monitoringtest/opentelemetry.go:148
        	            				/Users/runner/work/apm-server/apm-server/internal/beater/monitoringtest/opentelemetry.go:62
        	            				/Users/runner/work/apm-server/apm-server/x-pack/apm-server/main_test.go:58
        	            				/Users/runner/hostedtoolcache/go/1.25.7/arm64/src/runtime/asm_arm64.s:1268
        	Error:      	[]string(nil) does not contain "apm-server.sampling.tail.storage.lsm_size"
    main_test.go:57: 
        	Error Trace:	/Users/runner/work/apm-server/apm-server/x-pack/apm-server/main_test.go:57
        	            				/Users/runner/work/apm-server/apm-server/x-pack/apm-server/main.go:222
        	            				/Users/runner/go/pkg/mod/golang.org/x/sync@v0.19.0/errgroup/errgroup.go:93
        	            				/Users/runner/hostedtoolcache/go/1.25.7/arm64/src/runtime/asm_arm64.s:1268
        	Error:      	Condition never satisfied
        	Test:       	TestMonitoring
    logger.go:146: 2026-03-10T17:06:08.312Z	INFO	aggregator	aggregators/aggregator.go:292	stopping aggregator
    logger.go:146: 2026-03-10T17:06:08.312Z	DEBUG	sampling	finalizing local sampling reservoirs
    logger.go:146: 2026-03-10T17:06:08.312Z	INFO	LSM aggregator stopped
    logger.go:146: 2026-03-10T17:06:08.313Z	INFO	aggregator	aggregators/aggregator.go:304	running final aggregation
    logger.go:146: 2026-03-10T17:06:08.313Z	DEBUG	aggregator	aggregators/aggregator.go:459	Finished harvesting aggregated metrics	{"combined_metrics_successfully_harvested": 0, "aggregation_interval_ns": "1m0s", "harvested_till(exclusive)": "2026-03-10T17:07:00.000Z"}
    logger.go:146: 2026-03-10T17:06:08.313Z	DEBUG	aggregator	aggregators/aggregator.go:459	Finished harvesting aggregated metrics	{"combined_metrics_successfully_harvested": 0, "aggregation_interval_ns": "1m0s", "harvested_till(exclusive)": "2026-03-10T17:10:00.000Z"}
    logger.go:146: 2026-03-10T17:06:08.313Z	DEBUG	aggregator	aggregators/aggregator.go:459	Finished harvesting aggregated metrics	{"combined_metrics_successfully_harvested": 0, "aggregation_interval_ns": "10m0s", "harvested_till(exclusive)": "2026-03-10T17:10:00.000Z"}
    logger.go:146: 2026-03-10T17:06:08.314Z	DEBUG	aggregator	aggregators/aggregator.go:459	Finished harvesting aggregated metrics	{"combined_metrics_successfully_harvested": 0, "aggregation_interval_ns": "1m0s", "harvested_till(exclusive)": "2026-03-10T18:00:00.000Z"}
    logger.go:146: 2026-03-10T17:06:08.314Z	DEBUG	aggregator	aggregators/aggregator.go:459	Finished harvesting aggregated metrics	{"combined_metrics_successfully_harvested": 0, "aggregation_interval_ns": "10m0s", "harvested_till(exclusive)": "2026-03-10T18:00:00.000Z"}
    logger.go:146: 2026-03-10T17:06:08.314Z	DEBUG	aggregator	aggregators/aggregator.go:459	Finished harvesting aggregated metrics	{"combined_metrics_successfully_harvested": 0, "aggregation_interval_ns": "1h0m0s", "harvested_till(exclusive)": "2026-03-10T18:00:00.000Z"}
    logger.go:146: 2026-03-10T17:06:08.314Z	INFO	tail sampler stopped
--- FAIL: TestMonitoring (1.12s)

Metadata

Metadata

Assignees

Labels

bugflaky testUnstable or unreliable test cases.

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions