Skip to content

testDataFrameTransformCrud failed with "Failed to retrieve checkpointing info" #44011

@DaveCTurner

Description

@DaveCTurner

I see (very occasional) failures of integTestRunnerorg.elasticsearch.xpack.dataframe.integration.DataFrameTransformIT.testDataFrameTransformCrud:

The exception looks like this:

org.elasticsearch.ElasticsearchStatusException: Unable to parse response bodyClose stacktrace
at __randomizedtesting.SeedInfo.seed([D2EC9756C9B4990F:6F9BE6D8A6D3A141]:0)
at org.elasticsearch.client.RestHighLevelClient.parseResponseException(RestHighLevelClient.java:1701)
at org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:1461)
at org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:1433)
at org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:1400)
at org.elasticsearch.client.DataFrameClient.getDataFrameTransformStats(DataFrameClient.java:105)
at org.elasticsearch.xpack.dataframe.integration.DataFrameIntegTestCase.getDataFrameTransformStats(DataFrameIntegTestCase.java:121)
at org.elasticsearch.xpack.dataframe.integration.DataFrameIntegTestCase.lambda$waitUntilCheckpoint$0(DataFrameIntegTestCase.java:135)
at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:888)
at org.elasticsearch.xpack.dataframe.integration.DataFrameIntegTestCase.waitUntilCheckpoint(DataFrameIntegTestCase.java:134)
at org.elasticsearch.xpack.dataframe.integration.DataFrameIntegTestCase.waitUntilCheckpoint(DataFrameIntegTestCase.java:130)
at org.elasticsearch.xpack.dataframe.integration.DataFrameTransformIT.testDataFrameTransformCrud(DataFrameTransformIT.java:65)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.elasticsearch.client.ResponseException: 
method [GET], host [http://[::1]:34681], URI [/_data_frame/transforms/data-frame-transform-crud/_stats], status line [HTTP/1.1 500 Internal Server Error]
{"node_failures":[{"type":"failed_node_exception","reason":"Failed to retrieve checkpointing info","node_id":"ClCfyxTvT-udgCmvKlEPFg","caused_by":{"type":"checkpoint_exception","reason":"checkpoint_exception: Failure during source checkpoint info retrieval","caused_by":{"type":"null_pointer_exception","reason":null}}}],"count":1,"transforms":[{"id":"data-frame-transform-crud","state":{"task_state":"started","indexer_state":"started","checkpoint":0,"node":{"id":"ClCfyxTvT-udgCmvKlEPFg","name":"integTest-1","ephemeral_id":"xrmt63p0S8KyN28YbIpPrg","transport_address":"127.0.0.1:35199","attributes":{}}},"stats":{"pages_processed":0,"documents_processed":0,"documents_indexed":0,"trigger_count":1,"index_time_in_ms":0,"index_total":0,"index_failures":0,"search_time_in_ms":0,"search_total":0,"search_failures":0},"checkpointing":{"operations_behind":0}}]}

Apparently you can ...

REPRODUCE WITH: ./gradlew :x-pack:plugin:data-frame:qa:multi-node-tests:integTestRunner --tests "org.elasticsearch.xpack.dataframe.integration.DataFrameTransformIT.testDataFrameTransformCrud" -Dtests.seed=ED02F21FF219DD2A -Dtests.security.manager=true -Dtests.locale=he -Dtests.timezone=America/Indiana/Knox -Dcompiler.java=12 -Druntime.java=8

... but I had no success doing so.

Metadata

Metadata

Assignees

Labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions