Description
After release v1.31.0, transactions are stuck in a pending state, even the ones which were successful in v1.30.1.
Steps to Reproduce
In order to replicate the behavior, please provide a detailed list of steps:
- Download chainspec.json, this will be used as a path parameter in the subsequent script
- The script here is used to test the behaviour.
- The line 13 mentions the version of Nethermind to use. Using
nethermind/nethermind:1.30.1 results in expected behavior, while using nethermind/nethermind:latest causes the issue.
Actual behavior
The transaction is stuck in pending, and outputs the following:
eth_sendRawTransaction RESPONSE {"jsonrpc":"2.0","error":{"code":-32010,"message":"Syncing"},"id":1}
20 Feb 15:01:07 | Error when handling Id:1, eth_sendRawTransaction(["f8bb808477359400833a8bd58080b86a60618060095f395ff33373fffffffffffffffffffffffffffffffffffffffe14604d57602036146024575f5ffd5b5f35801560495762001fff810690815414603c575f5ffd5b62001fff01545f5260205ff35b5f5ffd5b62001fff42064281555f359062001fff0155001ba0e150dfe4eb457e2be80add404502c646bb0f371951d21fb1ed59e9095d78c447a06872491f5d6920fa66aab23bc19c5c6511d5227735f30fd91f78d7f186799a96"]) | {
"jsonrpc": "2.0",
"error": {
"code": -32010,
"message": "Syncing"
},
"id": 1
}
TX1HASH=null
Transaction not sent
Expected behavior
The transaction is sent, and the script prints "Transaction Sent" to the console.
Desktop (please complete the following information):
Please provide the following information regarding your setup:
- Operating System: MacOS Sequoia 15.1.1
- Version: 15.1.1
- Installation Method: Docker Image
- Consensus Client: None
Logs
debjit@mack reth_gnosis % ./scripts/nethermind-test-script.sh
curl: (7) Failed to connect to localhost port 8545 after 0 ms: Couldn't connect to server
Retrying...
20 Feb 15:00:54 | Nethermind is starting up
20 Feb 15:00:54 | Version: 1.31.0+a7337ba9
20 Feb 15:00:54 | Loading embedded plugins
20 Feb 15:00:54 | Found plugin type Nethermind.Consensus.AuRa.AuRaPlugin
20 Feb 15:00:54 | Found plugin type Nethermind.Consensus.Clique.CliquePlugin
20 Feb 15:00:54 | Found plugin type Nethermind.Consensus.Ethash.EthashPlugin
20 Feb 15:00:54 | Found plugin type Nethermind.Consensus.Ethash.NethDevPlugin
20 Feb 15:00:54 | Found plugin type Nethermind.Hive.HivePlugin
20 Feb 15:00:54 | Found plugin type Nethermind.UPnP.Plugin.UPnPPlugin
20 Feb 15:00:54 | Loading 13 assemblies from /nethermind/plugins
20 Feb 15:00:54 | Loading assembly Nethermind.Taiko
20 Feb 15:00:54 | Found plugin type Nethermind.Taiko
20 Feb 15:00:54 | Loading assembly Nethermind.Init
20 Feb 15:00:54 | Loading assembly Nethermind.ExternalSigner.Plugin
20 Feb 15:00:54 | Found plugin type Nethermind.ExternalSigner.Plugin
20 Feb 15:00:54 | Loading assembly Nethermind.Optimism
20 Feb 15:00:54 | Found plugin type Nethermind.Optimism
20 Feb 15:00:54 | Loading assembly Nethermind.EthStats
20 Feb 15:00:54 | Found plugin type Nethermind.EthStats
20 Feb 15:00:54 | Loading assembly Nethermind.Consensus.AuRa
20 Feb 15:00:54 | Loading assembly Nethermind.Merge.AuRa
20 Feb 15:00:54 | Found plugin type Nethermind.Merge.AuRa
20 Feb 15:00:54 | Loading assembly Nethermind.Merge.Plugin
20 Feb 15:00:54 | Found plugin type Nethermind.Merge.Plugin
20 Feb 15:00:54 | Loading assembly Nethermind.Init.Snapshot
20 Feb 15:00:54 | Found plugin type Nethermind.Init.Snapshot
20 Feb 15:00:54 | Loading assembly Nethermind.Api
20 Feb 15:00:54 | Loading assembly Nethermind.JsonRpc.TraceStore
20 Feb 15:00:54 | Found plugin type Nethermind.JsonRpc.TraceStore
20 Feb 15:00:54 | Loading assembly Nethermind.HealthChecks
20 Feb 15:00:54 | Found plugin type Nethermind.HealthChecks
20 Feb 15:00:54 | Loading assembly Nethermind.Shutter
20 Feb 15:00:54 | Found plugin type Nethermind.Shutter
20 Feb 15:00:54 | Loading configuration from /nethermind/configs/none.json
20 Feb 15:00:54 | Configuration complete
20 Feb 15:00:54 | RocksDB: v9.7.3
20 Feb 15:00:54 | Did not find chainspec in embedded resources: /networkdata/chainspec.json
20 Feb 15:00:54 | Loading chainspec from file: /networkdata/chainspec.json
20 Feb 15:00:54 | Loading Ckzg trusted setup from file /nethermind/kzg_trusted_setup.txt
20 Feb 15:00:54 | CPU: (CT)
20 Feb 15:00:54 | Using http://ipv4.icanhazip.com to get external ip
20 Feb 15:00:55 | Generating private key for the node (no node key in configuration) - stored in plain + key store for JSON RPC unlocking
20 Feb 15:00:56 | Store this password for unlocking the node key for JSON RPC - this is not secure - this log message will be in your log files. Use only in DEV contexts.
20 Feb 15:00:56 | Block tree initialized, last processed is 0, best queued is 0, best known is 0, lowest inserted header , lowest sync inserted block number
20 Feb 15:00:56 | Initializing 16 plugins
20 Feb 15:00:56 | Clique by Nethermind
20 Feb 15:00:56 | Clique by Nethermind initialized in 0ms
20 Feb 15:00:56 | AuRa by Nethermind
20 Feb 15:00:56 | AuRa by Nethermind initialized in 0ms
20 Feb 15:00:56 | Ethash by Nethermind
20 Feb 15:00:56 | Ethash by Nethermind initialized in 0ms
20 Feb 15:00:56 | Optimism by Nethermind
20 Feb 15:00:56 | Optimism by Nethermind initialized in 0ms
20 Feb 15:00:56 | Taiko by Nethermind
20 Feb 15:00:56 | Taiko by Nethermind initialized in 0ms
20 Feb 15:00:56 | NethDev by Nethermind
20 Feb 15:00:56 | NethDev by Nethermind initialized in 0ms
20 Feb 15:00:56 | Shutter by Nethermind
20 Feb 15:00:56 | Initializing Shutter plugin.
20 Feb 15:00:56 | Shutter by Nethermind initialized in 0ms
20 Feb 15:00:56 | AuRaMerge by Nethermind
20 Feb 15:00:56 | Client started with TTD: 0, TTD reached: True, Terminal Block Number , FinalTotalDifficulty: 1
20 Feb 15:00:56 | AuRaMerge by Nethermind initialized in 8ms
20 Feb 15:00:56 | Merge by Nethermind
20 Feb 15:00:56 | Merge by Nethermind initialized in 0ms
20 Feb 15:00:56 | HealthChecks by Nethermind
20 Feb 15:00:56 | HealthChecks by Nethermind initialized in 2ms
20 Feb 15:00:56 | Hive by Nethermind
20 Feb 15:00:56 | Hive by Nethermind initialized in 0ms
20 Feb 15:00:56 | Clef signer by Nethermind
20 Feb 15:00:56 | Clef signer by Nethermind initialized in 0ms
20 Feb 15:00:56 | EthStats by Nethermind
20 Feb 15:00:56 | EthStats by Nethermind initialized in 0ms
20 Feb 15:00:56 | Snapshot by Nethermind
20 Feb 15:00:56 | Snapshot by Nethermind initialized in 0ms
20 Feb 15:00:56 | TraceStore by Nethermind
20 Feb 15:00:56 | TraceStore by Nethermind initialized in 13ms
20 Feb 15:00:56 | UPnP by Nethermind
20 Feb 15:00:56 | UPnP by Nethermind initialized in 0ms
20 Feb 15:00:56 | No current state db key scheme.
20 Feb 15:00:56 | Snap serving enabled, but PruningBoundary is less than 128. Setting to 128.
curl: (52) Empty reply from server
Retrying...
20 Feb 15:00:57 | Persisting from root 0xdd8f94...515512 in block 0
20 Feb 15:00:57 | Persisting from root 0xdd8f94...515512 in block 0
20 Feb 15:00:57 | Block 0: Transitioning to 2/3 quorum.
20 Feb 15:00:57 | Loaded 0 static nodes from file: /nethermind/Data/static-nodes.json
20 Feb 15:00:57 | Starting TraceStore with Trace, Rewards traces.
20 Feb 15:00:57 | Skipping pivot update
20 Feb 15:00:57 | Skipping discovery init due to DiscoveryEnabled set to false
20 Feb 15:00:57 | Found no blocks to load from DB
20 Feb 15:00:57 | Numbers resolved, level = 0, header = 0, body = 0
20 Feb 15:00:57 | Beacon Numbers resolved, level = 0, header = 0, body = 0
20 Feb 15:00:57 | Loading fork choice info
20 Feb 15:00:57 | Grafana / Prometheus metrics are disabled in configuration
20 Feb 15:00:57 | System.Diagnostics.Metrics disabled
20 Feb 15:00:57 | Starting Merge block producer & sealer
curl: (52) Empty reply from server
Retrying...
curl: (52) Empty reply from server
Retrying...
curl: (52) Empty reply from server
Retrying...
20 Feb 15:01:02 | Engine Module has been enabled
20 Feb 15:01:02 | Starting AuRa block producer & sealer
20 Feb 15:01:02 | Reading authentication secret from '/networkdata/jwtsecret'
20 Feb 15:01:02 |
======================== Nethermind initialization completed ========================
This node : enode://c31473c328d7f28ce1082ea67aec9362b71cb1ebd704545426546b169286f7360703ee673abb8582b7dd18a8789460997df5c9f6d5357de177daf1b62c87ed7e@119.243.166.144:30303
RPC modules : Eth, Net, Parity, Personal, Proof, Rpc, Subscribe, Trace, TxPool, Web3
Node address : 0x80e9c974795ef4174f28d53a3fccd88b400bf4f3 (do not use as an account)
Mem est tx : 26 MB
Mem est DB : 16 MB
JSON RPC : http://0.0.0.0:8545 ; http://0.0.0.0:8546
Genesis hash : 0x574c165efc3205be13affbd3bc165df6a6a023e21d142dd4f4c682d2aa3a054e
External IP : 119.243.166.144
Ethereum : tcp://119.243.166.144:30303
Client id : Nethermind/v1.31.0+a7337ba9/linux-arm64/dotnet9.0.2
Chainspec : /networkdata/chainspec.json
Chain head : 0
Chain ID : 10209
=====================================================================================
{"jsonrpc":"2.0","result":{"author":"0x0000000000000000000000000000000000000000","difficulty":"0x1","extraData":"0x","gasLimit":"0x989680","gasUsed":"0x0","hash":"0x574c165efc3205be13affbd3bc165df6a6a023e21d142dd4f4c682d2aa3a054e","logsBloom":"0x00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000","miner":"0x0000000000000000000000000000000000000000","mixHash":"0x0000000000000000000000000000000000000000000000000000000000000000","nonce":"0x0000000000000000","number":"0x0","parentHash":"0x0000000000000000000000000000000000000000000000000000000000000000","receiptsRoot":"0x56e81f171bcc55a6ff8345e692c0f86e5b48e01b996cadc001622fb5e363b421","sha3Uncles":"0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347","size":"0x1fd","stateRoot":"0xdd8f9496ada2bf1d090d141ed33b83f2934a2eb7e67c48e57f656d83df515512","totalDifficulty":"0x1","timestamp":"0x0","baseFeePerGas":"0x3b9aca00","transactions":[],"transactionsRoot":"0x56e81f171bcc55a6ff8345e692c0f86e5b48e01b996cadc001622fb5e363b421","uncles":[]},"id":1}EL is available
JWT_TOKEN: eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpYXQiOjE3NDAwNjM2NjR9.QKvlQTBZDfuOt6QCEyOmp3ts8X-kaFM1t1EC_0k8XiM
Making block 1
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1627 0 1477 100 150 120k 12554 --:--:-- --:--:-- --:--:-- 144k
HEAD_BLOCK_HASH=0x574c165efc3205be13affbd3bc165df6a6a023e21d142dd4f4c682d2aa3a054e
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 020 Feb 15:01:07 | Received ForkChoice: 0x574c16...3a054e, Safe: 0x000000...000000, Finalized: 0x000000...000000
100 1032 0 213 100 819 2563 9858 --:--:-- --:--:-- --:--:-- 12433
engine_forkchoiceUpdatedV3 trigger block production RESPONSE {"jsonrpc":"2.0","result":{"payloadStatus":{"status":"VALID","latestValidHash":"0x574c165efc3205be13affbd3bc165df6a6a023e21d142dd4f4c682d2aa3a054e","validationError":null},"payloadId":"0xd0dba1e3fa2e438a"},"id":1}
20 Feb 15:01:07 | Produced block 1 (0xa87ff5...8b0f9f), diff: 0, tx count: 0
20 Feb 15:01:07 | Improved post-merge block 1 (0xa87ff5...8b0f9f), diff: 0, tx count: 0
PAYLOAD_ID=0xd0dba1e3fa2e438a
Sending transaction on block 1 to create deposit contract
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 518 0 68 100 450 5907 39096 --:--:-- --:--:-- --:--:-- 47090
eth_sendRawTransaction RESPONSE {"jsonrpc":"2.0","error":{"code":-32010,"message":"Syncing"},"id":1}
20 Feb 15:01:07 | Error when handling Id:1, eth_sendRawTransaction(["f8bb808477359400833a8bd58080b86a60618060095f395ff33373fffffffffffffffffffffffffffffffffffffffe14604d57602036146024575f5ffd5b5f35801560495762001fff810690815414603c575f5ffd5b62001fff01545f5260205ff35b5f5ffd5b62001fff42064281555f359062001fff0155001ba0e150dfe4eb457e2be80add404502c646bb0f371951d21fb1ed59e9095d78c447a06872491f5d6920fa66aab23bc19c5c6511d5227735f30fd91f78d7f186799a96"]) | {
"jsonrpc": "2.0",
"error": {
"code": -32010,
"message": "Syncing"
},
"id": 1
}
TX1HASH=null
Transaction not sent
neth-vec-gen
Stopping node process (PID: 66927)...
Description
After release v1.31.0, transactions are stuck in a pending state, even the ones which were successful in v1.30.1.
Steps to Reproduce
In order to replicate the behavior, please provide a detailed list of steps:
nethermind/nethermind:1.30.1results in expected behavior, while usingnethermind/nethermind:latestcauses the issue.Actual behavior
The transaction is stuck in pending, and outputs the following:
eth_sendRawTransaction RESPONSE {"jsonrpc":"2.0","error":{"code":-32010,"message":"Syncing"},"id":1} 20 Feb 15:01:07 | Error when handling Id:1, eth_sendRawTransaction(["f8bb808477359400833a8bd58080b86a60618060095f395ff33373fffffffffffffffffffffffffffffffffffffffe14604d57602036146024575f5ffd5b5f35801560495762001fff810690815414603c575f5ffd5b62001fff01545f5260205ff35b5f5ffd5b62001fff42064281555f359062001fff0155001ba0e150dfe4eb457e2be80add404502c646bb0f371951d21fb1ed59e9095d78c447a06872491f5d6920fa66aab23bc19c5c6511d5227735f30fd91f78d7f186799a96"]) | { "jsonrpc": "2.0", "error": { "code": -32010, "message": "Syncing" }, "id": 1 } TX1HASH=null Transaction not sentExpected behavior
The transaction is sent, and the script prints "Transaction Sent" to the console.
Desktop (please complete the following information):
Please provide the following information regarding your setup:
Logs