Comments (7)
DamianStraszak
commented on June 12, 2024
1
Hi!
Yes, the order of drop stage merkle was slightly different in the correct command, but it worked -- now the node is running fine again.
from reth.
gakonst
commented on June 12, 2024
Think we can repro this, thanks for flagging. In the meantime could you try running reth drop stage merkle and re-run the node, see if it helps?
from reth.
MrFrogoz
commented on June 12, 2024
Got now same issue on sepolia, restored with yesterday's backup.
I have three clusters (reth and lighthouse latest version) for : ethereum, holesky, sepolia.
This problem often happens on sepolia (like 1 time every 2 weeks on some node), rarely on ethereum, never on holesky
Apr 02 18:54:09 reth[218445]: 2024-04-02T18:54:09.691181Z INFO Executing stage pipeline_stages=8/12 stage=MerkleExecute checkpoint=5615114 target=5615128
Apr 02 18:54:10 reth[218445]: 2024-04-02T18:54:10.151634Z WARN Failed to verify block state root target_block=5615128 got=0xa654d2eba8e1084ebe9eab7a8d6f4425bff437fce32cd045544e1fed7fe573f3 expected=SealedHeader { hash: 0xfa79f0bb5168ca7d88f2fd4f8be17ae7b83e431cd5bcd6b798b60509b250bdb6, header: Header { parent_hash: 0xd5d311298b2d3231c5b5596cd9d510fe489f60cd214089de0e1394488ba2ff70, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0x0000000000000000000000000000000000000000, state_root: 0x65f18f2c4aec7ba7a4e34de49b59cadd24a70ca3cf8491f7a4edc25184c77641, transactions_root: 0xff83f8d8ae71ea7c98b158a4826635b43db9ff75174edc0bac0fbd81f7a3d10b, receipts_root: 0x9e53f1954e0de9c50ea32468219f0ecbf179da304943fc9ec5e03de23892076c, withdrawals_root: Some(0x75d6ec0b756c2feeef5dafd75c213bc14ecd9d045b78edb09530158a6d34839f), logs_bloom: 0x824c014a11004008115002123d114b081011790801404044110040160482a5b8001861cab0b8042c6ca6870d829cb0820814301c4539902080811a0032282c03685062209c25ab8842ca000a032a68053420ae0646226215ac4a5448814052a3404490023e03005106446644140c4b02440800c0002d06050100b01d00180a53024291051a585521f40004052428c286006040052a0844600203f0921c40622023088020c4420e966840aa826018000e28103241a26048808ce53a02d2180081c90694e30a001f0080218701ac0a71004228810c0068a00086118945a16522085e5a012b4260e5080e02148071a40120248a00314c35424640100082090c0015, difficulty: 0x0_U256, number: 5615128, gas_limit: 30000000, gas_used: 15226835, timestamp: 1712082528, mix_hash: 0xd69d81934500ca1f0583bdfd324d32c5c357516338366c80090208c71c02c380, nonce: 0, base_fee_per_gas: Some(152581075), blob_gas_used: Some(393216), excess_blob_gas: Some(87687168), parent_beacon_block_root: Some(0x1dcf36ad0c9c1d83bfdf296b2c748714ca5e06698c59f953474e8cd53a1096b9), extra_data: 0xd883010d0d846765746888676f312e32302e34856c696e7578 } }
Apr 02 18:54:10 reth[218445]: 2024-04-02T18:54:10.151750Z ERROR Stage encountered a validation error: mismatched block state root: got 0xa654d2eba8e1084ebe9eab7a8d6f4425bff437fce32cd045544e1fed7fe573f3, expected 0x65f18f2c4aec7ba7a4e34de49b59cadd24a70ca3cf8491f7a4edc25184c77641 stage=MerkleExecute bad_block=5615128
Apr 02 18:54:10 reth[218445]: 2024-04-02T18:54:10.170785Z INFO Unwinding{stage=StorageHashing}: Stage unwound stage=StorageHashing unwind_to=5615114 progress=5615114 done=true
Apr 02 18:54:10 reth[218445]: 2024-04-02T18:54:10.613654Z INFO Unwinding{stage=AccountHashing}: Stage unwound stage=AccountHashing unwind_to=5615114 progress=5615114 done=true
Apr 02 18:54:10 reth[218445]: 2024-04-02T18:54:10.932690Z WARN Unwinding{stage=MerkleUnwind}: Failed to verify block state root target_block=5615114 got=0x2e7d83dbeb720e605d95097a37cdd71698c7537f42405804fc1e8842f5ef4f50 expected=SealedHeader { hash: 0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076, header: Header { parent_hash: 0x196aadcebc91579a05f5ac6f54a533e9b216e3c48c2d4317ceb98e4f3b660a63, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0xf24a01ae29dec4629dfb4170647c4ed4efc392cd, state_root: 0xb03b2eb3d5662a0a151558519798ed43e240c2ac2f86471c2d4ba02478c560ba, transactions_root: 0x0ea0eb2bc3e0823911047d8afb8cee30516bb19f726e38bba05dc06d19ef88bc, receipts_root: 0x50deecc56df7b98472931832198c0587cae2c43b804099299de1aeb4fe1c3cc0, withdrawals_root: Some(0xaf377386ae27bd5d30b3d7c5a32cb6d5e9294be0d5bc0bd1ca441fbb3b4b9958), logs_bloom: 0x82010008010a05a814b002602c12020006155028000104822280404e4408841e21015a682434108068144b220000000e008000ae622ab0010c73180c002c6808405080901001800b869900191126001412202205014642011600c040202040201804200223006000004440440a144f0420050209801802d40200e0bc684c00108860480583100028a4002929080c44800022c48178021000918010441c5260082608422370400246300090900410100c085042c4420200440820002021100001819698621630092080110000c411c10412000b1080da084302c0d10c04556a1814d32324006524088c22800002a4020400810040502102026080028400084400, difficulty: 0x0_U256, number: 5615114, gas_limit: 30000000, gas_used: 9156629, timestamp: 1712082360, mix_hash: 0xcd3b84a6731693e756e15331136c1e861a044b81d6481927812510c3f7996be3, nonce: 0, base_fee_per_gas: Some(192308831), blob_gas_used: Some(0), excess_blob_gas: Some(86900736), parent_beacon_block_root: Some(0x508943102249a5acd78469474b725c1d1635895c3103bbacb56a9280f79a23c5), extra_data: 0xd883010d0b846765746888676f312e32312e36856c696e7578 } }
Apr 02 18:54:10 reth[218445]: 2024-04-02T18:54:10.933735Z ERROR shutting down due to error
Apr 02 18:54:10 reth[218445]: Error: stage encountered an error in block #5615114: validation error: mismatched block state root: got 0x2e7d83dbeb720e605d95097a37cdd71698c7537f42405804fc1e8842f5ef4f50, expected 0xb03b2eb3d5662a0a151558519798ed43e240c2ac2f86471c2d4ba02478c560ba
Apr 02 18:54:10 reth[218445]: Caused by:
Apr 02 18:54:10 reth[218445]: 0: validation error: mismatched block state root: got 0x2e7d83dbeb720e605d95097a37cdd71698c7537f42405804fc1e8842f5ef4f50, expected 0xb03b2eb3d5662a0a151558519798ed43e240c2ac2f86471c2d4ba02478c560ba
Apr 02 18:54:10 reth[218445]: 1: mismatched block state root: got 0x2e7d83dbeb720e605d95097a37cdd71698c7537f42405804fc1e8842f5ef4f50, expected 0xb03b2eb3d5662a0a151558519798ed43e240c2ac2f86471c2d4ba02478c560ba
Apr 02 18:54:10 reth[218445]: Location:
Apr 02 18:54:10 reth[218445]: /rustc/aedd173a2c086e558c2b66d3743b344f977621a7/library/core/src/task/poll.rs:255:39
from reth.
Rjected
commented on June 12, 2024
Got now same issue on sepolia, restored with yesterday's backup.
I have three clusters (reth and lighthouse latest version) for : ethereum, holesky, sepolia.
This problem often happens on sepolia (like 1 time every 2 weeks on some node), rarely on ethereum, never on holesky
Apr 02 18:54:09 reth[218445]: 2024-04-02T18:54:09.691181Z INFO Executing stage pipeline_stages=8/12 stage=MerkleExecute checkpoint=5615114 target=5615128 Apr 02 18:54:10 reth[218445]: 2024-04-02T18:54:10.151634Z WARN Failed to verify block state root target_block=5615128 got=0xa654d2eba8e1084ebe9eab7a8d6f4425bff437fce32cd045544e1fed7fe573f3 expected=SealedHeader { hash: 0xfa79f0bb5168ca7d88f2fd4f8be17ae7b83e431cd5bcd6b798b60509b250bdb6, header: Header { parent_hash: 0xd5d311298b2d3231c5b5596cd9d510fe489f60cd214089de0e1394488ba2ff70, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0x0000000000000000000000000000000000000000, state_root: 0x65f18f2c4aec7ba7a4e34de49b59cadd24a70ca3cf8491f7a4edc25184c77641, transactions_root: 0xff83f8d8ae71ea7c98b158a4826635b43db9ff75174edc0bac0fbd81f7a3d10b, receipts_root: 0x9e53f1954e0de9c50ea32468219f0ecbf179da304943fc9ec5e03de23892076c, withdrawals_root: Some(0x75d6ec0b756c2feeef5dafd75c213bc14ecd9d045b78edb09530158a6d34839f), logs_bloom: 0x824c014a11004008115002123d114b081011790801404044110040160482a5b8001861cab0b8042c6ca6870d829cb0820814301c4539902080811a0032282c03685062209c25ab8842ca000a032a68053420ae0646226215ac4a5448814052a3404490023e03005106446644140c4b02440800c0002d06050100b01d00180a53024291051a585521f40004052428c286006040052a0844600203f0921c40622023088020c4420e966840aa826018000e28103241a26048808ce53a02d2180081c90694e30a001f0080218701ac0a71004228810c0068a00086118945a16522085e5a012b4260e5080e02148071a40120248a00314c35424640100082090c0015, difficulty: 0x0_U256, number: 5615128, gas_limit: 30000000, gas_used: 15226835, timestamp: 1712082528, mix_hash: 0xd69d81934500ca1f0583bdfd324d32c5c357516338366c80090208c71c02c380, nonce: 0, base_fee_per_gas: Some(152581075), blob_gas_used: Some(393216), excess_blob_gas: Some(87687168), parent_beacon_block_root: Some(0x1dcf36ad0c9c1d83bfdf296b2c748714ca5e06698c59f953474e8cd53a1096b9), extra_data: 0xd883010d0d846765746888676f312e32302e34856c696e7578 } } Apr 02 18:54:10 reth[218445]: 2024-04-02T18:54:10.151750Z ERROR Stage encountered a validation error: mismatched block state root: got 0xa654d2eba8e1084ebe9eab7a8d6f4425bff437fce32cd045544e1fed7fe573f3, expected 0x65f18f2c4aec7ba7a4e34de49b59cadd24a70ca3cf8491f7a4edc25184c77641 stage=MerkleExecute bad_block=5615128 Apr 02 18:54:10 reth[218445]: 2024-04-02T18:54:10.170785Z INFO Unwinding{stage=StorageHashing}: Stage unwound stage=StorageHashing unwind_to=5615114 progress=5615114 done=true Apr 02 18:54:10 reth[218445]: 2024-04-02T18:54:10.613654Z INFO Unwinding{stage=AccountHashing}: Stage unwound stage=AccountHashing unwind_to=5615114 progress=5615114 done=true Apr 02 18:54:10 reth[218445]: 2024-04-02T18:54:10.932690Z WARN Unwinding{stage=MerkleUnwind}: Failed to verify block state root target_block=5615114 got=0x2e7d83dbeb720e605d95097a37cdd71698c7537f42405804fc1e8842f5ef4f50 expected=SealedHeader { hash: 0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076, header: Header { parent_hash: 0x196aadcebc91579a05f5ac6f54a533e9b216e3c48c2d4317ceb98e4f3b660a63, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0xf24a01ae29dec4629dfb4170647c4ed4efc392cd, state_root: 0xb03b2eb3d5662a0a151558519798ed43e240c2ac2f86471c2d4ba02478c560ba, transactions_root: 0x0ea0eb2bc3e0823911047d8afb8cee30516bb19f726e38bba05dc06d19ef88bc, receipts_root: 0x50deecc56df7b98472931832198c0587cae2c43b804099299de1aeb4fe1c3cc0, withdrawals_root: Some(0xaf377386ae27bd5d30b3d7c5a32cb6d5e9294be0d5bc0bd1ca441fbb3b4b9958), logs_bloom: 0x82010008010a05a814b002602c12020006155028000104822280404e4408841e21015a682434108068144b220000000e008000ae622ab0010c73180c002c6808405080901001800b869900191126001412202205014642011600c040202040201804200223006000004440440a144f0420050209801802d40200e0bc684c00108860480583100028a4002929080c44800022c48178021000918010441c5260082608422370400246300090900410100c085042c4420200440820002021100001819698621630092080110000c411c10412000b1080da084302c0d10c04556a1814d32324006524088c22800002a4020400810040502102026080028400084400, difficulty: 0x0_U256, number: 5615114, gas_limit: 30000000, gas_used: 9156629, timestamp: 1712082360, mix_hash: 0xcd3b84a6731693e756e15331136c1e861a044b81d6481927812510c3f7996be3, nonce: 0, base_fee_per_gas: Some(192308831), blob_gas_used: Some(0), excess_blob_gas: Some(86900736), parent_beacon_block_root: Some(0x508943102249a5acd78469474b725c1d1635895c3103bbacb56a9280f79a23c5), extra_data: 0xd883010d0b846765746888676f312e32312e36856c696e7578 } } Apr 02 18:54:10 reth[218445]: 2024-04-02T18:54:10.933735Z ERROR shutting down due to error Apr 02 18:54:10 reth[218445]: Error: stage encountered an error in block #5615114: validation error: mismatched block state root: got 0x2e7d83dbeb720e605d95097a37cdd71698c7537f42405804fc1e8842f5ef4f50, expected 0xb03b2eb3d5662a0a151558519798ed43e240c2ac2f86471c2d4ba02478c560ba Apr 02 18:54:10 reth[218445]: Caused by: Apr 02 18:54:10 reth[218445]: 0: validation error: mismatched block state root: got 0x2e7d83dbeb720e605d95097a37cdd71698c7537f42405804fc1e8842f5ef4f50, expected 0xb03b2eb3d5662a0a151558519798ed43e240c2ac2f86471c2d4ba02478c560ba Apr 02 18:54:10 reth[218445]: 1: mismatched block state root: got 0x2e7d83dbeb720e605d95097a37cdd71698c7537f42405804fc1e8842f5ef4f50, expected 0xb03b2eb3d5662a0a151558519798ed43e240c2ac2f86471c2d4ba02478c560ba Apr 02 18:54:10 reth[218445]: Location: Apr 02 18:54:10 reth[218445]: /rustc/aedd173a2c086e558c2b66d3743b344f977621a7/library/core/src/task/poll.rs:255:39
can you share some of the logs before the Executing stage pipeline_stages=8/12 log if you still have them?
from reth.
MrFrogoz
commented on June 12, 2024
Apr 2 18:41:47 reth[175551]: [2024-04-02T18:41:47.779344Z[ WARN[ Invalid block error on new payload [invalid_hash[[=[0x80be50e7e31b6939fd58a81af8406c5ee7428226cce0d59b3ab9baafb0461b69 [invalid_number[[=[5615115 [error[[=[mismatched block state root: got 0xabcc34867075a29bbc57e683e2b16feeb14e60353661c9037e97f7ce487cab3b, expected 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f
Apr 2 18:41:47 lighthouse[203823]: Apr 02 18:41:47.784 WARN Invalid execution payload method: new_payload, slot: 4695731, proposer_index: 1774, graffiti: teku/v24.3.1, root: 0x0a5178922fa62468bec3af83c01cf56c5fc14fb08b446422ea66318a9011c03a, execution_block_hash: 0x80be50e7e31b6939fd58a81af8406c5ee7428226cce0d59b3ab9baafb0461b69, latest_valid_hash: Some(0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076), validation_error: Some("mismatched block state root: got 0xabcc34867075a29bbc57e683e2b16feeb14e60353661c9037e97f7ce487cab3b, expected 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f"), service: beacon
Apr 2 18:41:49 reth[175551]: [2024-04-02T18:41:49.148746Z[ WARN[ Error while processing payload [error[[=[Failed to insert block (hash=0x80be50e7e31b6939fd58a81af8406c5ee7428226cce0d59b3ab9baafb0461b69, number=5615115, parent_hash=0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076): mismatched block state root: got 0xabcc34867075a29bbc57e683e2b16feeb14e60353661c9037e97f7ce487cab3b, expected 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f
Apr 2 18:41:49 reth[175551]: [2024-04-02T18:41:49.148780Z[ WARN[ Invalid block error on new payload [invalid_hash[[=[0x80be50e7e31b6939fd58a81af8406c5ee7428226cce0d59b3ab9baafb0461b69 [invalid_number[[=[5615115 [error[[=[mismatched block state root: got 0xabcc34867075a29bbc57e683e2b16feeb14e60353661c9037e97f7ce487cab3b, expected 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f
Apr 2 18:41:49 lighthouse[203823]: Apr 02 18:41:49.153 WARN Invalid execution payload method: new_payload, slot: 4695731, proposer_index: 1774, graffiti: teku/v24.3.1, root: 0x0a5178922fa62468bec3af83c01cf56c5fc14fb08b446422ea66318a9011c03a, execution_block_hash: 0x80be50e7e31b6939fd58a81af8406c5ee7428226cce0d59b3ab9baafb0461b69, latest_valid_hash: Some(0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076), validation_error: Some("mismatched block state root: got 0xabcc34867075a29bbc57e683e2b16feeb14e60353661c9037e97f7ce487cab3b, expected 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f"), service: beacon
Apr 2 18:41:50 reth[175551]: [2024-04-02T18:41:50.936112Z[ WARN[ Error while processing payload [error[[=[Failed to insert block (hash=0x80be50e7e31b6939fd58a81af8406c5ee7428226cce0d59b3ab9baafb0461b69, number=5615115, parent_hash=0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076): mismatched block state root: got 0xabcc34867075a29bbc57e683e2b16feeb14e60353661c9037e97f7ce487cab3b, expected 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f
Apr 2 18:41:50 reth[175551]: [2024-04-02T18:41:50.936162Z[ WARN[ Invalid block error on new payload [invalid_hash[[=[0x80be50e7e31b6939fd58a81af8406c5ee7428226cce0d59b3ab9baafb0461b69 [invalid_number[[=[5615115 [error[[=[mismatched block state root: got 0xabcc34867075a29bbc57e683e2b16feeb14e60353661c9037e97f7ce487cab3b, expected 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f
Apr 2 18:41:50 lighthouse[203823]: Apr 02 18:41:50.941 WARN Invalid execution payload method: new_payload, slot: 4695731, proposer_index: 1774, graffiti: teku/v24.3.1, root: 0x0a5178922fa62468bec3af83c01cf56c5fc14fb08b446422ea66318a9011c03a, execution_block_hash: 0x80be50e7e31b6939fd58a81af8406c5ee7428226cce0d59b3ab9baafb0461b69, latest_valid_hash: Some(0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076), validation_error: Some("mismatched block state root: got 0xabcc34867075a29bbc57e683e2b16feeb14e60353661c9037e97f7ce487cab3b, expected 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f"), service: beacon
Apr 2 18:41:52 reth[175551]: [2024-04-02T18:41:52.738260Z[ WARN[ Error while processing payload [error[[=[Failed to insert block (hash=0x80be50e7e31b6939fd58a81af8406c5ee7428226cce0d59b3ab9baafb0461b69, number=5615115, parent_hash=0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076): mismatched block state root: got 0xabcc34867075a29bbc57e683e2b16feeb14e60353661c9037e97f7ce487cab3b, expected 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f
Apr 2 18:41:52 reth[175551]: [2024-04-02T18:41:52.738298Z[ WARN[ Invalid block error on new payload [invalid_hash[[=[0x80be50e7e31b6939fd58a81af8406c5ee7428226cce0d59b3ab9baafb0461b69 [invalid_number[[=[5615115 [error[[=[mismatched block state root: got 0xabcc34867075a29bbc57e683e2b16feeb14e60353661c9037e97f7ce487cab3b, expected 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f
Apr 2 18:41:52 lighthouse[203823]: Apr 02 18:41:52.743 WARN Invalid execution payload method: new_payload, slot: 4695731, proposer_index: 1774, graffiti: teku/v24.3.1, root: 0x0a5178922fa62468bec3af83c01cf56c5fc14fb08b446422ea66318a9011c03a, execution_block_hash: 0x80be50e7e31b6939fd58a81af8406c5ee7428226cce0d59b3ab9baafb0461b69, latest_valid_hash: Some(0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076), validation_error: Some("mismatched block state root: got 0xabcc34867075a29bbc57e683e2b16feeb14e60353661c9037e97f7ce487cab3b, expected 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f"), service: beacon
Apr 2 18:41:53 lighthouse[203823]: Apr 02 18:41:53.868 INFO Sync state updated new_state: Syncing Finalized Chain, old_state: Syncing Head Chain, service: sync
Apr 2 18:41:54 lighthouse[203823]: Apr 02 18:41:54.001 INFO Syncing est_time: --, distance: 79 slots (15 mins), peers: 31, service: slot_notifier
Apr 2 18:41:54 reth[175551]: [2024-04-02T18:41:54.777016Z[ INFO[ Live sync in progress, downloading blocks [remaining_blocks[[=[1 [target_block_hash[[=[0xd5d311298b2d3231c5b5596cd9d510fe489f60cd214089de0e1394488ba2ff70
Apr 2 18:41:54 reth[175551]: [2024-04-02T18:41:54.777587Z[ INFO[ Received forkchoice updated message when syncing [head_block_hash[[=[0xd5d311298b2d3231c5b5596cd9d510fe489f60cd214089de0e1394488ba2ff70 [safe_block_hash[[=[0xac27ebe6798941f2fcff14006376d48557ae0d02bbd95b5190dedef235ff8ee1 [finalized_block_hash[[=[0x1a80fec506985cf749c26c59db1959b07f9525fb2d57407b5f21bca1d0ef9cfb
Apr 2 18:41:54 reth[175551]: [2024-04-02T18:41:54.856577Z[ INFO[ Live sync in progress, downloading blocks [remaining_blocks[[=[12 [target_block_hash[[=[0x7a8419431d782baab21104712a756d6f09a1eb87293d2eec915d5a65f38d2257
Apr 2 18:41:55 reth[175551]: [2024-04-02T18:41:55.470716Z[ WARN[ Bad block with existing invalid ancestor [hash[[=[0x5bc672fdadf90ef63bf8e31d70615d6f21e27b099a79786c976de649591c2a3c [invalid_ancestor[[=[Header { parent_hash: 0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0x0c06b6d4ec451987e8c0b772ffcf7f080c46447a, state_root: 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f, transactions_root: 0x62d122052e2fedaaf36b0b7e7ca1659613e2687ecabd21678428bb534fac745c, receipts_root: 0x6258f997945883a81e56453c2f52fc9a423babd830b29585992909f340db14ca, withdrawals_root: Some(0x35e4bfcdaeb424a9df8fc7d1b9e2b2f895c3d12be7162feb1b12116701139878), logs_bloom: 0x800c540ec00a409c031006226118820a940d3488801202840000c2124483800028804440201806042830475081a500870002100ca220d110048058090a6425202460328a0c750ba0c026046e11280805a42ca8078186f0442c0ac1c1a580e26309080006068300922054005436580b0274da00c38509241c08018014412a0801eac6c10c0310463064447521001c0e9200304925408c0466d419b09a06402120629a4213a00408a6e44020d0489036090c56300302480c6cc0c10002920400044005f1e3a818002cc221c5bccc029100102840144248600602209107d405601416720220443a200b0e86122224346004144020304c720052018818130d084250, difficulty: 0x0_U256, number: 5615115, gas_limit: 30000000, gas_used: 15164257, timestamp: 1712082372, mix_hash: 0xaf913a75e180e2380ce78f6152175d9e1bc97ee147e483d81c4b5732c167beba, nonce: 0, base_fee_per_gas: Some(182944399), blob_gas_used: Some(786432), excess_blob_gas: Some(86507520), parent_beacon_block_root: Some(0x8ecb10007396ca2d7d620312270897c057058d3d3ab8108d44566bb8b178f3a6), extra_data: 0x3863333934646239 }
Apr 2 18:41:55 reth[175551]: [2024-04-02T18:41:55.471004Z[ WARN[ Bad block with existing invalid ancestor [hash[[=[0xf16b8a2a184a5fb3986d030288c567559331715ecc55560956a8ab24344abfe2 [invalid_ancestor[[=[Header { parent_hash: 0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0x0c06b6d4ec451987e8c0b772ffcf7f080c46447a, state_root: 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f, transactions_root: 0x62d122052e2fedaaf36b0b7e7ca1659613e2687ecabd21678428bb534fac745c, receipts_root: 0x6258f997945883a81e56453c2f52fc9a423babd830b29585992909f340db14ca, withdrawals_root: Some(0x35e4bfcdaeb424a9df8fc7d1b9e2b2f895c3d12be7162feb1b12116701139878), logs_bloom: 0x800c540ec00a409c031006226118820a940d3488801202840000c2124483800028804440201806042830475081a500870002100ca220d110048058090a6425202460328a0c750ba0c026046e11280805a42ca8078186f0442c0ac1c1a580e26309080006068300922054005436580b0274da00c38509241c08018014412a0801eac6c10c0310463064447521001c0e9200304925408c0466d419b09a06402120629a4213a00408a6e44020d0489036090c56300302480c6cc0c10002920400044005f1e3a818002cc221c5bccc029100102840144248600602209107d405601416720220443a200b0e86122224346004144020304c720052018818130d084250, difficulty: 0x0_U256, number: 5615115, gas_limit: 30000000, gas_used: 15164257, timestamp: 1712082372, mix_hash: 0xaf913a75e180e2380ce78f6152175d9e1bc97ee147e483d81c4b5732c167beba, nonce: 0, base_fee_per_gas: Some(182944399), blob_gas_used: Some(786432), excess_blob_gas: Some(86507520), parent_beacon_block_root: Some(0x8ecb10007396ca2d7d620312270897c057058d3d3ab8108d44566bb8b178f3a6), extra_data: 0x3863333934646239 }
Apr 2 18:41:55 reth[175551]: [2024-04-02T18:41:55.471044Z[ WARN[ Bad block with existing invalid ancestor [hash[[=[0x11ac3683a796b95a79cd7be9dcac421cc18d69a1804440abd7ef7e79057a4204 [invalid_ancestor[[=[Header { parent_hash: 0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0x0c06b6d4ec451987e8c0b772ffcf7f080c46447a, state_root: 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f, transactions_root: 0x62d122052e2fedaaf36b0b7e7ca1659613e2687ecabd21678428bb534fac745c, receipts_root: 0x6258f997945883a81e56453c2f52fc9a423babd830b29585992909f340db14ca, withdrawals_root: Some(0x35e4bfcdaeb424a9df8fc7d1b9e2b2f895c3d12be7162feb1b12116701139878), logs_bloom: 0x800c540ec00a409c031006226118820a940d3488801202840000c2124483800028804440201806042830475081a500870002100ca220d110048058090a6425202460328a0c750ba0c026046e11280805a42ca8078186f0442c0ac1c1a580e26309080006068300922054005436580b0274da00c38509241c08018014412a0801eac6c10c0310463064447521001c0e9200304925408c0466d419b09a06402120629a4213a00408a6e44020d0489036090c56300302480c6cc0c10002920400044005f1e3a818002cc221c5bccc029100102840144248600602209107d405601416720220443a200b0e86122224346004144020304c720052018818130d084250, difficulty: 0x0_U256, number: 5615115, gas_limit: 30000000, gas_used: 15164257, timestamp: 1712082372, mix_hash: 0xaf913a75e180e2380ce78f6152175d9e1bc97ee147e483d81c4b5732c167beba, nonce: 0, base_fee_per_gas: Some(182944399), blob_gas_used: Some(786432), excess_blob_gas: Some(86507520), parent_beacon_block_root: Some(0x8ecb10007396ca2d7d620312270897c057058d3d3ab8108d44566bb8b178f3a6), extra_data: 0x3863333934646239 }
Apr 2 18:41:55 reth[175551]: [2024-04-02T18:41:55.471073Z[ WARN[ Bad block with existing invalid ancestor [hash[[=[0x360aa4588a071156b1393f9ccb4a9c4121de4d192de53463ca8e90625c3e0018 [invalid_ancestor[[=[Header { parent_hash: 0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0x0c06b6d4ec451987e8c0b772ffcf7f080c46447a, state_root: 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f, transactions_root: 0x62d122052e2fedaaf36b0b7e7ca1659613e2687ecabd21678428bb534fac745c, receipts_root: 0x6258f997945883a81e56453c2f52fc9a423babd830b29585992909f340db14ca, withdrawals_root: Some(0x35e4bfcdaeb424a9df8fc7d1b9e2b2f895c3d12be7162feb1b12116701139878), logs_bloom: 0x800c540ec00a409c031006226118820a940d3488801202840000c2124483800028804440201806042830475081a500870002100ca220d110048058090a6425202460328a0c750ba0c026046e11280805a42ca8078186f0442c0ac1c1a580e26309080006068300922054005436580b0274da00c38509241c08018014412a0801eac6c10c0310463064447521001c0e9200304925408c0466d419b09a06402120629a4213a00408a6e44020d0489036090c56300302480c6cc0c10002920400044005f1e3a818002cc221c5bccc029100102840144248600602209107d405601416720220443a200b0e86122224346004144020304c720052018818130d084250, difficulty: 0x0_U256, number: 5615115, gas_limit: 30000000, gas_used: 15164257, timestamp: 1712082372, mix_hash: 0xaf913a75e180e2380ce78f6152175d9e1bc97ee147e483d81c4b5732c167beba, nonce: 0, base_fee_per_gas: Some(182944399), blob_gas_used: Some(786432), excess_blob_gas: Some(86507520), parent_beacon_block_root: Some(0x8ecb10007396ca2d7d620312270897c057058d3d3ab8108d44566bb8b178f3a6), extra_data: 0x3863333934646239 }
Apr 2 18:41:55 reth[175551]: [2024-04-02T18:41:55.471110Z[ WARN[ Bad block with existing invalid ancestor [hash[[=[0xdd617c81d82f8a426c885c6503f177def1938b10a34274e9c05ea5aeb21cb70f [invalid_ancestor[[=[Header { parent_hash: 0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0x0c06b6d4ec451987e8c0b772ffcf7f080c46447a, state_root: 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f, transactions_root: 0x62d122052e2fedaaf36b0b7e7ca1659613e2687ecabd21678428bb534fac745c, receipts_root: 0x6258f997945883a81e56453c2f52fc9a423babd830b29585992909f340db14ca, withdrawals_root: Some(0x35e4bfcdaeb424a9df8fc7d1b9e2b2f895c3d12be7162feb1b12116701139878), logs_bloom: 0x800c540ec00a409c031006226118820a940d3488801202840000c2124483800028804440201806042830475081a500870002100ca220d110048058090a6425202460328a0c750ba0c026046e11280805a42ca8078186f0442c0ac1c1a580e26309080006068300922054005436580b0274da00c38509241c08018014412a0801eac6c10c0310463064447521001c0e9200304925408c0466d419b09a06402120629a4213a00408a6e44020d0489036090c56300302480c6cc0c10002920400044005f1e3a818002cc221c5bccc029100102840144248600602209107d405601416720220443a200b0e86122224346004144020304c720052018818130d084250, difficulty: 0x0_U256, number: 5615115, gas_limit: 30000000, gas_used: 15164257, timestamp: 1712082372, mix_hash: 0xaf913a75e180e2380ce78f6152175d9e1bc97ee147e483d81c4b5732c167beba, nonce: 0, base_fee_per_gas: Some(182944399), blob_gas_used: Some(786432), excess_blob_gas: Some(86507520), parent_beacon_block_root: Some(0x8ecb10007396ca2d7d620312270897c057058d3d3ab8108d44566bb8b178f3a6), extra_data: 0x3863333934646239 }
Apr 2 18:41:55 reth[175551]: [2024-04-02T18:41:55.471132Z[ WARN[ Bad block with existing invalid ancestor [hash[[=[0xe05bd9da19b64e845b5a53fe764317a1c839deede7e0312c49116691f5fac3d9 [invalid_ancestor[[=[Header { parent_hash: 0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0x0c06b6d4ec451987e8c0b772ffcf7f080c46447a, state_root: 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f, transactions_root: 0x62d122052e2fedaaf36b0b7e7ca1659613e2687ecabd21678428bb534fac745c, receipts_root: 0x6258f997945883a81e56453c2f52fc9a423babd830b29585992909f340db14ca, withdrawals_root: Some(0x35e4bfcdaeb424a9df8fc7d1b9e2b2f895c3d12be7162feb1b12116701139878), logs_bloom: 0x800c540ec00a409c031006226118820a940d3488801202840000c2124483800028804440201806042830475081a500870002100ca220d110048058090a6425202460328a0c750ba0c026046e11280805a42ca8078186f0442c0ac1c1a580e26309080006068300922054005436580b0274da00c38509241c08018014412a0801eac6c10c0310463064447521001c0e9200304925408c0466d419b09a06402120629a4213a00408a6e44020d0489036090c56300302480c6cc0c10002920400044005f1e3a818002cc221c5bccc029100102840144248600602209107d405601416720220443a200b0e86122224346004144020304c720052018818130d084250, difficulty: 0x0_U256, number: 5615115, gas_limit: 30000000, gas_used: 15164257, timestamp: 1712082372, mix_hash: 0xaf913a75e180e2380ce78f6152175d9e1bc97ee147e483d81c4b5732c167beba, nonce: 0, base_fee_per_gas: Some(182944399), blob_gas_used: Some(786432), excess_blob_gas: Some(86507520), parent_beacon_block_root: Some(0x8ecb10007396ca2d7d620312270897c057058d3d3ab8108d44566bb8b178f3a6), extra_data: 0x3863333934646239 }
Apr 2 18:41:55 reth[175551]: [2024-04-02T18:41:55.471165Z[ WARN[ Bad block with existing invalid ancestor [hash[[=[0x4e9ecb66c37504ae23a9f0e32e8a77c31d5a5d5bbdf46dc5db2014ea29e90a8d [invalid_ancestor[[=[Header { parent_hash: 0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0x0c06b6d4ec451987e8c0b772ffcf7f080c46447a, state_root: 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f, transactions_root: 0x62d122052e2fedaaf36b0b7e7ca1659613e2687ecabd21678428bb534fac745c, receipts_root: 0x6258f997945883a81e56453c2f52fc9a423babd830b29585992909f340db14ca, withdrawals_root: Some(0x35e4bfcdaeb424a9df8fc7d1b9e2b2f895c3d12be7162feb1b12116701139878), logs_bloom: 0x800c540ec00a409c031006226118820a940d3488801202840000c2124483800028804440201806042830475081a500870002100ca220d110048058090a6425202460328a0c750ba0c026046e11280805a42ca8078186f0442c0ac1c1a580e26309080006068300922054005436580b0274da00c38509241c08018014412a0801eac6c10c0310463064447521001c0e9200304925408c0466d419b09a06402120629a4213a00408a6e44020d0489036090c56300302480c6cc0c10002920400044005f1e3a818002cc221c5bccc029100102840144248600602209107d405601416720220443a200b0e86122224346004144020304c720052018818130d084250, difficulty: 0x0_U256, number: 5615115, gas_limit: 30000000, gas_used: 15164257, timestamp: 1712082372, mix_hash: 0xaf913a75e180e2380ce78f6152175d9e1bc97ee147e483d81c4b5732c167beba, nonce: 0, base_fee_per_gas: Some(182944399), blob_gas_used: Some(786432), excess_blob_gas: Some(86507520), parent_beacon_block_root: Some(0x8ecb10007396ca2d7d620312270897c057058d3d3ab8108d44566bb8b178f3a6), extra_data: 0x3863333934646239 }
Apr 2 18:41:55 reth[175551]: [2024-04-02T18:41:55.471188Z[ WARN[ Bad block with existing invalid ancestor [hash[[=[0xdba094c1f0ad2864364526ad25bab14c572a9f869e24b4a0a4aac16c0e237d42 [invalid_ancestor[[=[Header { parent_hash: 0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0x0c06b6d4ec451987e8c0b772ffcf7f080c46447a, state_root: 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f, transactions_root: 0x62d122052e2fedaaf36b0b7e7ca1659613e2687ecabd21678428bb534fac745c, receipts_root: 0x6258f997945883a81e56453c2f52fc9a423babd830b29585992909f340db14ca, withdrawals_root: Some(0x35e4bfcdaeb424a9df8fc7d1b9e2b2f895c3d12be7162feb1b12116701139878), logs_bloom: 0x800c540ec00a409c031006226118820a940d3488801202840000c2124483800028804440201806042830475081a500870002100ca220d110048058090a6425202460328a0c750ba0c026046e11280805a42ca8078186f0442c0ac1c1a580e26309080006068300922054005436580b0274da00c38509241c08018014412a0801eac6c10c0310463064447521001c0e9200304925408c0466d419b09a06402120629a4213a00408a6e44020d0489036090c56300302480c6cc0c10002920400044005f1e3a818002cc221c5bccc029100102840144248600602209107d405601416720220443a200b0e86122224346004144020304c720052018818130d084250, difficulty: 0x0_U256, number: 5615115, gas_limit: 30000000, gas_used: 15164257, timestamp: 1712082372, mix_hash: 0xaf913a75e180e2380ce78f6152175d9e1bc97ee147e483d81c4b5732c167beba, nonce: 0, base_fee_per_gas: Some(182944399), blob_gas_used: Some(786432), excess_blob_gas: Some(86507520), parent_beacon_block_root: Some(0x8ecb10007396ca2d7d620312270897c057058d3d3ab8108d44566bb8b178f3a6), extra_data: 0x3863333934646239 }
Apr 2 18:41:55 reth[175551]: [2024-04-02T18:41:55.471221Z[ WARN[ Bad block with existing invalid ancestor [hash[[=[0x8b6e3830afc16063bc07ceabaf57b4a278293097e7b432819da44533f94a6279 [invalid_ancestor[[=[Header { parent_hash: 0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0x0c06b6d4ec451987e8c0b772ffcf7f080c46447a, state_root: 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f, transactions_root: 0x62d122052e2fedaaf36b0b7e7ca1659613e2687ecabd21678428bb534fac745c, receipts_root: 0x6258f997945883a81e56453c2f52fc9a423babd830b29585992909f340db14ca, withdrawals_root: Some(0x35e4bfcdaeb424a9df8fc7d1b9e2b2f895c3d12be7162feb1b12116701139878), logs_bloom: 0x800c540ec00a409c031006226118820a940d3488801202840000c2124483800028804440201806042830475081a500870002100ca220d110048058090a6425202460328a0c750ba0c026046e11280805a42ca8078186f0442c0ac1c1a580e26309080006068300922054005436580b0274da00c38509241c08018014412a0801eac6c10c0310463064447521001c0e9200304925408c0466d419b09a06402120629a4213a00408a6e44020d0489036090c56300302480c6cc0c10002920400044005f1e3a818002cc221c5bccc029100102840144248600602209107d405601416720220443a200b0e86122224346004144020304c720052018818130d084250, difficulty: 0x0_U256, number: 5615115, gas_limit: 30000000, gas_used: 15164257, timestamp: 1712082372, mix_hash: 0xaf913a75e180e2380ce78f6152175d9e1bc97ee147e483d81c4b5732c167beba, nonce: 0, base_fee_per_gas: Some(182944399), blob_gas_used: Some(786432), excess_blob_gas: Some(86507520), parent_beacon_block_root: Some(0x8ecb10007396ca2d7d620312270897c057058d3d3ab8108d44566bb8b178f3a6), extra_data: 0x3863333934646239 }
Apr 2 18:41:55 reth[175551]: [2024-04-02T18:41:55.471243Z[ WARN[ Bad block with existing invalid ancestor [hash[[=[0x630589ae43d950a9d0d2ab22e7f16e6c07b72a31751cbef7466a9cd66640a28d [invalid_ancestor[[=[Header { parent_hash: 0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0x0c06b6d4ec451987e8c0b772ffcf7f080c46447a, state_root: 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f, transactions_root: 0x62d122052e2fedaaf36b0b7e7ca1659613e2687ecabd21678428bb534fac745c, receipts_root: 0x6258f997945883a81e56453c2f52fc9a423babd830b29585992909f340db14ca, withdrawals_root: Some(0x35e4bfcdaeb424a9df8fc7d1b9e2b2f895c3d12be7162feb1b12116701139878), logs_bloom: 0x800c540ec00a409c031006226118820a940d3488801202840000c2124483800028804440201806042830475081a500870002100ca220d110048058090a6425202460328a0c750ba0c026046e11280805a42ca8078186f0442c0ac1c1a580e26309080006068300922054005436580b0274da00c38509241c08018014412a0801eac6c10c0310463064447521001c0e9200304925408c0466d419b09a06402120629a4213a00408a6e44020d0489036090c56300302480c6cc0c10002920400044005f1e3a818002cc221c5bccc029100102840144248600602209107d405601416720220443a200b0e86122224346004144020304c720052018818130d084250, difficulty: 0x0_U256, number: 5615115, gas_limit: 30000000, gas_used: 15164257, timestamp: 1712082372, mix_hash: 0xaf913a75e180e2380ce78f6152175d9e1bc97ee147e483d81c4b5732c167beba, nonce: 0, base_fee_per_gas: Some(182944399), blob_gas_used: Some(786432), excess_blob_gas: Some(86507520), parent_beacon_block_root: Some(0x8ecb10007396ca2d7d620312270897c057058d3d3ab8108d44566bb8b178f3a6), extra_data: 0x3863333934646239 }
Apr 2 18:41:55 reth[175551]: [2024-04-02T18:41:55.471267Z[ WARN[ Bad block with existing invalid ancestor [hash[[=[0x7a8419431d782baab21104712a756d6f09a1eb87293d2eec915d5a65f38d2257 [invalid_ancestor[[=[Header { parent_hash: 0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0x0c06b6d4ec451987e8c0b772ffcf7f080c46447a, state_root: 0xc32ac971d596387a722c16b77b3f88785352545e7e6897dd0c5533ac53d77f0f, transactions_root: 0x62d122052e2fedaaf36b0b7e7ca1659613e2687ecabd21678428bb534fac745c, receipts_root: 0x6258f997945883a81e56453c2f52fc9a423babd830b29585992909f340db14ca, withdrawals_root: Some(0x35e4bfcdaeb424a9df8fc7d1b9e2b2f895c3d12be7162feb1b12116701139878), logs_bloom: 0x800c540ec00a409c031006226118820a940d3488801202840000c2124483800028804440201806042830475081a500870002100ca220d110048058090a6425202460328a0c750ba0c026046e11280805a42ca8078186f0442c0ac1c1a580e26309080006068300922054005436580b0274da00c38509241c08018014412a0801eac6c10c0310463064447521001c0e9200304925408c0466d419b09a06402120629a4213a00408a6e44020d0489036090c56300302480c6cc0c10002920400044005f1e3a818002cc221c5bccc029100102840144248600602209107d405601416720220443a200b0e86122224346004144020304c720052018818130d084250, difficulty: 0x0_U256, number: 5615115, gas_limit: 30000000, gas_used: 15164257, timestamp: 1712082372, mix_hash: 0xaf913a75e180e2380ce78f6152175d9e1bc97ee147e483d81c4b5732c167beba, nonce: 0, base_fee_per_gas: Some(182944399), blob_gas_used: Some(786432), excess_blob_gas: Some(86507520), parent_beacon_block_root: Some(0x8ecb10007396ca2d7d620312270897c057058d3d3ab8108d44566bb8b178f3a6), extra_data: 0x3863333934646239 }
Apr 2 18:41:55 reth[175551]: [2024-04-02T18:41:55.745109Z[ INFO[ Live sync in progress, downloading blocks [remaining_blocks[[=[1 [target_block_hash[[=[0xe6adcf23395aa6c4ad577d1ef5d2e4c8c9965bac18fc780fdd4cdd22b2f8226b
Apr 2 18:41:55 reth[175551]: [2024-04-02T18:41:55.745626Z[ INFO[ Received forkchoice updated message when syncing [head_block_hash[[=[0xe6adcf23395aa6c4ad577d1ef5d2e4c8c9965bac18fc780fdd4cdd22b2f8226b [safe_block_hash[[=[0xfa79f0bb5168ca7d88f2fd4f8be17ae7b83e431cd5bcd6b798b60509b250bdb6 [finalized_block_hash[[=[0xac27ebe6798941f2fcff14006376d48557ae0d02bbd95b5190dedef235ff8ee1
Apr 2 18:41:55 reth[175551]: [2024-04-02T18:41:55.832551Z[ INFO[ Live sync in progress, downloading blocks [remaining_blocks[[=[44 [target_block_hash[[=[0x1bd3ad94c7c966b70e1d0e0603c8bbec9036173ea72b8fca9a6516124c829f75
Apr 2 18:41:56 reth[175551]: [2024-04-02T18:41:56.408344Z[ INFO[ Live sync in progress, downloading blocks [remaining_blocks[[=[1 [target_block_hash[[=[0x2add16aa7cf18e212ed2e790f0f95080e35bd169e58ad12a1d428d42ebda0e55
Apr 2 18:41:56 reth[175551]: [2024-04-02T18:41:56.408369Z[ INFO[ Received forkchoice updated message when syncing [head_block_hash[[=[0x2add16aa7cf18e212ed2e790f0f95080e35bd169e58ad12a1d428d42ebda0e55 [safe_block_hash[[=[0xa99fbee24ea441b02556e6260109bd48a997698c81be054b866a115ec72f418b [finalized_block_hash[[=[0xfa79f0bb5168ca7d88f2fd4f8be17ae7b83e431cd5bcd6b798b60509b250bdb6
Apr 2 18:41:56 lighthouse[203823]: Apr 02 18:41:56.413 INFO Sync state updated new_state: Synced, old_state: Syncing Finalized Chain, service: sync
Apr 2 18:41:56 reth[175551]: [2024-04-02T18:41:56.774126Z[ INFO[ Static File Producer started [targets[[=[StaticFileTargets { headers: Some(5615033..=5615114), receipts: Some(5615033..=5615114), transactions: Some(5615033..=5615114) }
Apr 2 18:41:56 reth[175551]: [2024-04-02T18:41:56.910166Z[ INFO[ Static File Producer finished [targets[[=[StaticFileTargets { headers: Some(5615033..=5615114), receipts: Some(5615033..=5615114), transactions: Some(5615033..=5615114) } [elapsed[[=[135.975177ms
Apr 2 18:41:56 reth[175551]: [2024-04-02T18:41:56.910240Z[ INFO[ Preparing stage [pipeline_stages[[=[1/12 [stage[[=[Headers [checkpoint[[=[5615114 [target[[=[None
Apr 2 18:41:56 reth[175551]: [2024-04-02T18:41:56.966069Z[ INFO[ Received headers [total[[=[14 [from_block[[=[5615128 [to_block[[=[5615115
Apr 2 18:41:56 reth[175551]: [2024-04-02T18:41:56.966154Z[ INFO[ Executing stage [pipeline_stages[[=[1/12 [stage[[=[Headers [checkpoint[[=[5615114 [target[[=[None
Apr 2 18:41:56 reth[175551]: [2024-04-02T18:41:56.966234Z[ INFO[ Writing headers [total[[=[14
Apr 2 18:41:56 reth[175551]: [2024-04-02T18:41:56.966451Z[ INFO[ Writing headers hash index [total[[=[14
Apr 2 18:41:56 reth[175551]: [2024-04-02T18:41:56.986710Z[ INFO[ Stage finished executing [pipeline_stages[[=[1/12 [stage[[=[Headers [checkpoint[[=[5615128 [target[[=[None [stage_progress[[=[100.00%
Apr 2 18:41:57 reth[175551]: [2024-04-02T18:41:57.001171Z[ INFO[ Preparing stage [pipeline_stages[[=[2/12 [stage[[=[Bodies [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:41:57 reth[175551]: [2024-04-02T18:41:57.001182Z[ INFO[ Downloading bodies [count[[=[14 [range[[=[5615115..=5615128
Apr 2 18:41:57 reth[175551]: [2024-04-02T18:41:57.089509Z[ INFO[ Executing stage [pipeline_stages[[=[2/12 [stage[[=[Bodies [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:41:57 reth[175551]: [2024-04-02T18:41:57.109587Z[ INFO[ Stage finished executing [pipeline_stages[[=[2/12 [stage[[=[Bodies [checkpoint[[=[5615128 [target[[=[5615128 [stage_progress[[=[100.00%
Apr 2 18:41:57 reth[175551]: [2024-04-02T18:41:57.124194Z[ INFO[ Preparing stage [pipeline_stages[[=[3/12 [stage[[=[SenderRecovery [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:41:57 reth[175551]: [2024-04-02T18:41:57.124200Z[ INFO[ Recovering senders [tx_range[[=[187863576..187864956
Apr 2 18:41:57 reth[175551]: [2024-04-02T18:41:57.124223Z[ INFO[ Executing stage [pipeline_stages[[=[3/12 [stage[[=[SenderRecovery [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:41:57 reth[175551]: [2024-04-02T18:41:57.188208Z[ INFO[ Stage finished executing [pipeline_stages[[=[3/12 [stage[[=[SenderRecovery [checkpoint[[=[5615128 [target[[=[5615128 [stage_progress[[=[100.00%
Apr 2 18:41:57 reth[175551]: [2024-04-02T18:41:57.194447Z[ INFO[ Preparing stage [pipeline_stages[[=[4/12 [stage[[=[Execution [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:41:57 reth[175551]: [2024-04-02T18:41:57.194612Z[ INFO[ Executing stage [pipeline_stages[[=[4/12 [stage[[=[Execution [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:41:57 reth[175551]: [2024-04-02T18:41:57.955180Z[ INFO[ Stage finished executing [pipeline_stages[[=[4/12 [stage[[=[Execution [checkpoint[[=[5615128 [target[[=[5615128 [stage_progress[[=[100.00%
Apr 2 18:41:58 reth[175551]: [2024-04-02T18:41:58.339726Z[ INFO[ Preparing stage [pipeline_stages[[=[5/12 [stage[[=[MerkleUnwind [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:41:58 reth[175551]: [2024-04-02T18:41:58.339747Z[ INFO[ Stage is always skipped
Apr 2 18:41:58 reth[175551]: [2024-04-02T18:41:58.339755Z[ INFO[ Executing stage [pipeline_stages[[=[5/12 [stage[[=[MerkleUnwind [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:41:58 reth[175551]: [2024-04-02T18:41:58.339848Z[ INFO[ Stage finished executing [pipeline_stages[[=[5/12 [stage[[=[MerkleUnwind [checkpoint[[=[5615128 [target[[=[5615128
Apr 2 18:41:58 reth[175551]: [2024-04-02T18:41:58.342144Z[ INFO[ Preparing stage [pipeline_stages[[=[6/12 [stage[[=[AccountHashing [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:41:58 reth[175551]: [2024-04-02T18:41:58.342171Z[ INFO[ Executing stage [pipeline_stages[[=[6/12 [stage[[=[AccountHashing [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:41:58 reth[175551]: [2024-04-02T18:41:58.527293Z[ INFO[ Stage finished executing [pipeline_stages[[=[6/12 [stage[[=[AccountHashing [checkpoint[[=[5615128 [target[[=[5615128 [stage_progress[[=[100.00%
Apr 2 18:41:58 reth[175551]: [2024-04-02T18:41:58.663173Z[ INFO[ Status [connected_peers[[=[98 [freelist[[=[10326 [latest_block[[=[5615114
Apr 2 18:41:58 reth[175551]: [2024-04-02T18:41:58.673949Z[ INFO[ Preparing stage [pipeline_stages[[=[7/12 [stage[[=[StorageHashing [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:41:58 reth[175551]: [2024-04-02T18:41:58.673979Z[ INFO[ Executing stage [pipeline_stages[[=[7/12 [stage[[=[StorageHashing [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:41:58 reth[175551]: [2024-04-02T18:41:58.855895Z[ INFO[ Stage finished executing [pipeline_stages[[=[7/12 [stage[[=[StorageHashing [checkpoint[[=[5615128 [target[[=[5615128 [stage_progress[[=[100.00%
Apr 2 18:41:59 lighthouse[203823]: Apr 02 18:41:59.110 INFO New RPC block received hash: 0x89fb…6044, slot: 4695801
Apr 2 18:41:59 reth[175551]: [2024-04-02T18:41:59.129335Z[ INFO[ Preparing stage [pipeline_stages[[=[8/12 [stage[[=[MerkleExecute [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:41:59 reth[175551]: [2024-04-02T18:41:59.129365Z[ INFO[ Executing stage [pipeline_stages[[=[8/12 [stage[[=[MerkleExecute [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:42:01 reth[175551]: [2024-04-02T18:42:01.530740Z[ WARN[ Failed to verify block state root [target_block[[=[5615128 [got[[=[0xa654d2eba8e1084ebe9eab7a8d6f4425bff437fce32cd045544e1fed7fe573f3 [expected[[=[SealedHeader { hash: 0xfa79f0bb5168ca7d88f2fd4f8be17ae7b83e431cd5bcd6b798b60509b250bdb6, header: Header { parent_hash: 0xd5d311298b2d3231c5b5596cd9d510fe489f60cd214089de0e1394488ba2ff70, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0x0000000000000000000000000000000000000000, state_root: 0x65f18f2c4aec7ba7a4e34de49b59cadd24a70ca3cf8491f7a4edc25184c77641, transactions_root: 0xff83f8d8ae71ea7c98b158a4826635b43db9ff75174edc0bac0fbd81f7a3d10b, receipts_root: 0x9e53f1954e0de9c50ea32468219f0ecbf179da304943fc9ec5e03de23892076c, withdrawals_root: Some(0x75d6ec0b756c2feeef5dafd75c213bc14ecd9d045b78edb09530158a6d34839f), logs_bloom: 0x824c014a11004008115002123d114b081011790801404044110040160482a5b8001861cab0b8042c6ca6870d829cb0820814301c4539902080811a0032282c03685062209c25ab8842ca000a032a68053420ae0646226215ac4a5448814052a3404490023e03005106446644140c4b02440800c0002d06050100b01d00180a53024291051a585521f40004052428c286006040052a0844600203f0921c40622023088020c4420e966840aa826018000e28103241a26048808ce53a02d2180081c90694e30a001f0080218701ac0a71004228810c0068a00086118945a16522085e5a012b4260e5080e02148071a40120248a00314c35424640100082090c0015, difficulty: 0x0_U256, number: 5615128, gas_limit: 30000000, gas_used: 15226835, timestamp: 1712082528, mix_hash: 0xd69d81934500ca1f0583bdfd324d32c5c357516338366c80090208c71c02c380, nonce: 0, base_fee_per_gas: Some(152581075), blob_gas_used: Some(393216), excess_blob_gas: Some(87687168), parent_beacon_block_root: Some(0x1dcf36ad0c9c1d83bfdf296b2c748714ca5e06698c59f953474e8cd53a1096b9), extra_data: 0xd883010d0d846765746888676f312e32302e34856c696e7578 } }
Apr 2 18:42:01 reth[175551]: [2024-04-02T18:42:01.530899Z[ [ERROR[ Stage encountered a validation error: mismatched block state root: got 0xa654d2eba8e1084ebe9eab7a8d6f4425bff437fce32cd045544e1fed7fe573f3, expected 0x65f18f2c4aec7ba7a4e34de49b59cadd24a70ca3cf8491f7a4edc25184c77641 [stage[[=[MerkleExecute [bad_block[[=[5615128
Apr 2 18:42:01 reth[175551]: [2024-04-02T18:42:01.553042Z[ INFO[ [1mUnwinding[[1m{[[stage[[=[StorageHashing[1m}[[:[ Stage unwound [stage[[=[StorageHashing [unwind_to[[=[5615114 [progress[[=[5615114 [done[[=[true
Apr 2 18:42:01 lighthouse[203823]: Apr 02 18:42:01.738 WARN Snapshot cache miss for blob verification, index: 2, block_root: 0x9421…b0ca, service: beacon
Apr 2 18:42:01 lighthouse[203823]: Apr 02 18:42:01.739 INFO New block received root: 0x942101d08d2db35934d4640e8b1d332b93beb89f3b6e25bc901d9e468107b0ca, slot: 4695810
Apr 2 18:42:02 reth[175551]: [2024-04-02T18:42:02.059925Z[ INFO[ [1mUnwinding[[1m{[[stage[[=[AccountHashing[1m}[[:[ Stage unwound [stage[[=[AccountHashing [unwind_to[[=[5615114 [progress[[=[5615114 [done[[=[true
Apr 2 18:42:02 lighthouse[203823]: Apr 02 18:42:02.238 INFO Gossipsub blob processed, imported fully available block, block_root: 0x9421…b0ca
Apr 2 18:42:02 reth[175551]: [2024-04-02T18:42:02.382338Z[ WARN[ [1mUnwinding[[1m{[[stage[[=[MerkleUnwind[1m}[[:[ Failed to verify block state root [target_block[[=[5615114 [got[[=[0x2e7d83dbeb720e605d95097a37cdd71698c7537f42405804fc1e8842f5ef4f50 [expected[[=[SealedHeader { hash: 0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076, header: Header { parent_hash: 0x196aadcebc91579a05f5ac6f54a533e9b216e3c48c2d4317ceb98e4f3b660a63, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0xf24a01ae29dec4629dfb4170647c4ed4efc392cd, state_root: 0xb03b2eb3d5662a0a151558519798ed43e240c2ac2f86471c2d4ba02478c560ba, transactions_root: 0x0ea0eb2bc3e0823911047d8afb8cee30516bb19f726e38bba05dc06d19ef88bc, receipts_root: 0x50deecc56df7b98472931832198c0587cae2c43b804099299de1aeb4fe1c3cc0, withdrawals_root: Some(0xaf377386ae27bd5d30b3d7c5a32cb6d5e9294be0d5bc0bd1ca441fbb3b4b9958), logs_bloom: 0x82010008010a05a814b002602c12020006155028000104822280404e4408841e21015a682434108068144b220000000e008000ae622ab0010c73180c002c6808405080901001800b869900191126001412202205014642011600c040202040201804200223006000004440440a144f0420050209801802d40200e0bc684c00108860480583100028a4002929080c44800022c48178021000918010441c5260082608422370400246300090900410100c085042c4420200440820002021100001819698621630092080110000c411c10412000b1080da084302c0d10c04556a1814d32324006524088c22800002a4020400810040502102026080028400084400, difficulty: 0x0_U256, number: 5615114, gas_limit: 30000000, gas_used: 9156629, timestamp: 1712082360, mix_hash: 0xcd3b84a6731693e756e15331136c1e861a044b81d6481927812510c3f7996be3, nonce: 0, base_fee_per_gas: Some(192308831), blob_gas_used: Some(0), excess_blob_gas: Some(86900736), parent_beacon_block_root: Some(0x508943102249a5acd78469474b725c1d1635895c3103bbacb56a9280f79a23c5), extra_data: 0xd883010d0b846765746888676f312e32312e36856c696e7578 } }
Apr 2 18:42:02 reth[175551]: [2024-04-02T18:42:02.383543Z[ [ERROR[ shutting down due to error
Apr 2 18:42:02 reth[175551]: Error: stage encountered an error in block #5615114: validation error: mismatched block state root: got 0x2e7d83dbeb720e605d95097a37cdd71698c7537f42405804fc1e8842f5ef4f50, expected 0xb03b2eb3d5662a0a151558519798ed43e240c2ac2f86471c2d4ba02478c560ba
Apr 2 18:42:02 reth[175551]: Caused by:
Apr 2 18:42:02 reth[175551]: 0: validation error: mismatched block state root: got 0x2e7d83dbeb720e605d95097a37cdd71698c7537f42405804fc1e8842f5ef4f50, expected 0xb03b2eb3d5662a0a151558519798ed43e240c2ac2f86471c2d4ba02478c560ba
Apr 2 18:42:02 reth[175551]: 1: mismatched block state root: got 0x2e7d83dbeb720e605d95097a37cdd71698c7537f42405804fc1e8842f5ef4f50, expected 0xb03b2eb3d5662a0a151558519798ed43e240c2ac2f86471c2d4ba02478c560ba
Apr 2 18:42:02 reth[175551]: Location:
Apr 2 18:42:02 reth[175551]: /rustc/aedd173a2c086e558c2b66d3743b344f977621a7/library/core/src/task/poll.rs:255:39
Apr 2 18:42:02 reth[175551]: [2024-04-02T18:42:02.389924Z[ INFO[ Wrote network peers to file [peers_file[[=["/db/reth/sepolia/known-peers.json"
Apr 2 18:42:03 systemd[1]: reth.service: Main process exited, code=exited, status=1/FAILURE
Apr 2 18:42:03 systemd[1]: reth.service: Failed with result 'exit-code'.
Apr 2 18:42:03 systemd[1]: reth.service: Consumed 9h 35min 59.257s CPU time.
Apr 2 18:42:06 lighthouse[203823]: Apr 02 18:42:06.000 WARN Head is optimistic execution_block_hash: 0xb16283003031eb554a078b438b428d23ba284f9d99575fe4b9315087e7563c9c, info: chain not fully verified, block and attestation production disabled until execution engine syncs, service: slot_notifier
Apr 2 18:42:06 lighthouse[203823]: Apr 02 18:42:06.000 INFO Synced slot: 4695810, block: 0x9421…b0ca, epoch: 146744, finalized_epoch: 146742, finalized_root: 0xbb89…82e6, exec_hash: 0xb162…3c9c (unverified), peers: 30, service: slot_notifier
Apr 2 18:42:06 lighthouse[203823]: Apr 02 18:42:06.775 ERRO Error during execution engine upcheck error: HttpClient(url: http://localhost:8551/, kind: request, detail: error trying to connect: tcp connect error: Connection refused (os error 111)), service: exec
Apr 2 18:42:08 systemd[1]: reth.service: Scheduled restart job, restart counter is at 1.
Apr 2 18:42:08 systemd[1]: Stopped Reth Node.
Apr 2 18:42:08 systemd[1]: reth.service: Consumed 9h 35min 59.257s CPU time.
Apr 2 18:42:08 systemd[1]: Started Reth Node.
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.296171Z[ INFO[ Starting reth [version[[=["0.2.0-beta.4 (c04dbe6)"
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.296229Z[ INFO[ Opening database [path[[=["/db/reth/sepolia/db"
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.351599Z[ INFO[ Configuration loaded [path[[=["/db/reth/sepolia/reth.toml"
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.371591Z[ INFO[ Database opened
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.379619Z[ INFO[
Apr 2 18:42:08 reth[216180]: Pre-merge hard forks (block based):
Apr 2 18:42:08 reth[216180]: - Frontier @0
Apr 2 18:42:08 reth[216180]: - Homestead @0
Apr 2 18:42:08 reth[216180]: - Dao @0
Apr 2 18:42:08 reth[216180]: - Tangerine @0
Apr 2 18:42:08 reth[216180]: - SpuriousDragon @0
Apr 2 18:42:08 reth[216180]: - Byzantium @0
Apr 2 18:42:08 reth[216180]: - Constantinople @0
Apr 2 18:42:08 reth[216180]: - Petersburg @0
Apr 2 18:42:08 reth[216180]: - Istanbul @0
Apr 2 18:42:08 reth[216180]: - MuirGlacier @0
Apr 2 18:42:08 reth[216180]: - Berlin @0
Apr 2 18:42:08 reth[216180]: - London @0
Apr 2 18:42:08 reth[216180]: Merge hard forks:
Apr 2 18:42:08 reth[216180]: - Paris @17000000000000000 (network is known to be merged)
Apr 2 18:42:08 reth[216180]: Post-merge hard forks (timestamp based):
Apr 2 18:42:08 reth[216180]: - Shanghai @1677557088
Apr 2 18:42:08 reth[216180]: - Cancun @1706655072
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.505620Z[ INFO[ Transaction pool initialized
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.505743Z[ INFO[ Connecting to P2P network
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.506527Z[ INFO[ Loading saved peers [file[[=[/db/reth/sepolia/known-peers.json
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.531674Z[ INFO[ StaticFileProducer initialized
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.531800Z[ INFO[ Pruner initialized [prune_config[[=[PruneConfig { block_interval: 5, segments: PruneModes { sender_recovery: None, transaction_lookup: None, receipts: None, account_history: None, storage_history: None, receipts_log_filter: ReceiptsLogPruneConfig({}) } }
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.531904Z[ INFO[ Consensus engine initialized
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.531937Z[ INFO[ Engine API handler initialized
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.534679Z[ INFO[ RPC auth server started [url[[=[0.0.0.0:8551
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.534860Z[ INFO[ RPC IPC server started [url[[=[/tmp/reth.ipc
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.534890Z[ INFO[ RPC HTTP server started [url[[=[0.0.0.0:50005
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.534897Z[ INFO[ RPC WS server started [url[[=[127.0.0.1:8546
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.534917Z[ INFO[ Starting consensus engine
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.535267Z[ INFO[ Static File Producer started [targets[[=[StaticFileTargets { headers: None, receipts: None, transactions: None }
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.535287Z[ INFO[ Static File Producer finished [targets[[=[StaticFileTargets { headers: None, receipts: None, transactions: None } [elapsed[[=[11.432µs
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.535298Z[ INFO[ Preparing stage [pipeline_stages[[=[1/12 [stage[[=[Headers [checkpoint[[=[5615128 [target[[=[None
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.535328Z[ INFO[ Target block already reached [checkpoint[[=[5615128 [target[[=[Hash(0xfa79f0bb5168ca7d88f2fd4f8be17ae7b83e431cd5bcd6b798b60509b250bdb6)
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.535357Z[ INFO[ Executing stage [pipeline_stages[[=[1/12 [stage[[=[Headers [checkpoint[[=[5615128 [target[[=[None
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.535432Z[ INFO[ Stage finished executing [pipeline_stages[[=[1/12 [stage[[=[Headers [checkpoint[[=[5615128 [target[[=[None [stage_progress[[=[100.00%
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.535515Z[ INFO[ Preparing stage [pipeline_stages[[=[2/12 [stage[[=[Bodies [checkpoint[[=[5615128 [target[[=[5615128
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.535528Z[ INFO[ Executing stage [pipeline_stages[[=[2/12 [stage[[=[Bodies [checkpoint[[=[5615128 [target[[=[5615128
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.535537Z[ INFO[ Stage finished executing [pipeline_stages[[=[2/12 [stage[[=[Bodies [checkpoint[[=[5615128 [target[[=[5615128 [stage_progress[[=[100.00%
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.537310Z[ INFO[ Preparing stage [pipeline_stages[[=[3/12 [stage[[=[SenderRecovery [checkpoint[[=[5615128 [target[[=[5615128
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.537333Z[ INFO[ Executing stage [pipeline_stages[[=[3/12 [stage[[=[SenderRecovery [checkpoint[[=[5615128 [target[[=[5615128
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.537342Z[ INFO[ Stage finished executing [pipeline_stages[[=[3/12 [stage[[=[SenderRecovery [checkpoint[[=[5615128 [target[[=[5615128 [stage_progress[[=[100.00%
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.537372Z[ INFO[ Preparing stage [pipeline_stages[[=[4/12 [stage[[=[Execution [checkpoint[[=[5615128 [target[[=[5615128
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.537380Z[ INFO[ Executing stage [pipeline_stages[[=[4/12 [stage[[=[Execution [checkpoint[[=[5615128 [target[[=[5615128
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.537388Z[ INFO[ Stage finished executing [pipeline_stages[[=[4/12 [stage[[=[Execution [checkpoint[[=[5615128 [target[[=[5615128 [stage_progress[[=[100.00%
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.537424Z[ INFO[ Preparing stage [pipeline_stages[[=[5/12 [stage[[=[MerkleUnwind [checkpoint[[=[5615128 [target[[=[5615128
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.537431Z[ INFO[ Stage is always skipped
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.537432Z[ INFO[ Executing stage [pipeline_stages[[=[5/12 [stage[[=[MerkleUnwind [checkpoint[[=[5615128 [target[[=[5615128
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.537457Z[ INFO[ Stage finished executing [pipeline_stages[[=[5/12 [stage[[=[MerkleUnwind [checkpoint[[=[5615128 [target[[=[5615128
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.537487Z[ INFO[ Preparing stage [pipeline_stages[[=[6/12 [stage[[=[AccountHashing [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.537495Z[ INFO[ Executing stage [pipeline_stages[[=[6/12 [stage[[=[AccountHashing [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.561555Z[ INFO[ Stage finished executing [pipeline_stages[[=[6/12 [stage[[=[AccountHashing [checkpoint[[=[5615128 [target[[=[5615128 [stage_progress[[=[100.00%
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.658464Z[ INFO[ Preparing stage [pipeline_stages[[=[7/12 [stage[[=[StorageHashing [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.658494Z[ INFO[ Executing stage [pipeline_stages[[=[7/12 [stage[[=[StorageHashing [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.703408Z[ INFO[ Stage finished executing [pipeline_stages[[=[7/12 [stage[[=[StorageHashing [checkpoint[[=[5615128 [target[[=[5615128 [stage_progress[[=[100.00%
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.859806Z[ INFO[ Preparing stage [pipeline_stages[[=[8/12 [stage[[=[MerkleExecute [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:42:08 reth[216180]: [2024-04-02T18:42:08.859837Z[ INFO[ Executing stage [pipeline_stages[[=[8/12 [stage[[=[MerkleExecute [checkpoint[[=[5615114 [target[[=[5615128
Apr 2 18:42:09 reth[216180]: [2024-04-02T18:42:09.327620Z[ WARN[ Failed to verify block state root [target_block[[=[5615128 [got[[=[0xa654d2eba8e1084ebe9eab7a8d6f4425bff437fce32cd045544e1fed7fe573f3 [expected[[=[SealedHeader { hash: 0xfa79f0bb5168ca7d88f2fd4f8be17ae7b83e431cd5bcd6b798b60509b250bdb6, header: Header { parent_hash: 0xd5d311298b2d3231c5b5596cd9d510fe489f60cd214089de0e1394488ba2ff70, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0x0000000000000000000000000000000000000000, state_root: 0x65f18f2c4aec7ba7a4e34de49b59cadd24a70ca3cf8491f7a4edc25184c77641, transactions_root: 0xff83f8d8ae71ea7c98b158a4826635b43db9ff75174edc0bac0fbd81f7a3d10b, receipts_root: 0x9e53f1954e0de9c50ea32468219f0ecbf179da304943fc9ec5e03de23892076c, withdrawals_root: Some(0x75d6ec0b756c2feeef5dafd75c213bc14ecd9d045b78edb09530158a6d34839f), logs_bloom: 0x824c014a11004008115002123d114b081011790801404044110040160482a5b8001861cab0b8042c6ca6870d829cb0820814301c4539902080811a0032282c03685062209c25ab8842ca000a032a68053420ae0646226215ac4a5448814052a3404490023e03005106446644140c4b02440800c0002d06050100b01d00180a53024291051a585521f40004052428c286006040052a0844600203f0921c40622023088020c4420e966840aa826018000e28103241a26048808ce53a02d2180081c90694e30a001f0080218701ac0a71004228810c0068a00086118945a16522085e5a012b4260e5080e02148071a40120248a00314c35424640100082090c0015, difficulty: 0x0_U256, number: 5615128, gas_limit: 30000000, gas_used: 15226835, timestamp: 1712082528, mix_hash: 0xd69d81934500ca1f0583bdfd324d32c5c357516338366c80090208c71c02c380, nonce: 0, base_fee_per_gas: Some(152581075), blob_gas_used: Some(393216), excess_blob_gas: Some(87687168), parent_beacon_block_root: Some(0x1dcf36ad0c9c1d83bfdf296b2c748714ca5e06698c59f953474e8cd53a1096b9), extra_data: 0xd883010d0d846765746888676f312e32302e34856c696e7578 } }
Apr 2 18:42:09 reth[216180]: [2024-04-02T18:42:09.327757Z[ [ERROR[ Stage encountered a validation error: mismatched block state root: got 0xa654d2eba8e1084ebe9eab7a8d6f4425bff437fce32cd045544e1fed7fe573f3, expected 0x65f18f2c4aec7ba7a4e34de49b59cadd24a70ca3cf8491f7a4edc25184c77641 [stage[[=[MerkleExecute [bad_block[[=[5615128
Apr 2 18:42:09 reth[216180]: [2024-04-02T18:42:09.348025Z[ INFO[ [1mUnwinding[[1m{[[stage[[=[StorageHashing[1m}[[:[ Stage unwound [stage[[=[StorageHashing [unwind_to[[=[5615114 [progress[[=[5615114 [done[[=[true
Apr 2 18:42:09 reth[216180]: [2024-04-02T18:42:09.809002Z[ INFO[ [1mUnwinding[[1m{[[stage[[=[AccountHashing[1m}[[:[ Stage unwound [stage[[=[AccountHashing [unwind_to[[=[5615114 [progress[[=[5615114 [done[[=[true
Apr 2 18:42:10 reth[216180]: [2024-04-02T18:42:10.123938Z[ WARN[ [1mUnwinding[[1m{[[stage[[=[MerkleUnwind[1m}[[:[ Failed to verify block state root [target_block[[=[5615114 [got[[=[0x2e7d83dbeb720e605d95097a37cdd71698c7537f42405804fc1e8842f5ef4f50 [expected[[=[SealedHeader { hash: 0x3cf7133e0068fcd219eab93e8ebd523a0d800a2eb33265fb71927b3403b8e076, header: Header { parent_hash: 0x196aadcebc91579a05f5ac6f54a533e9b216e3c48c2d4317ceb98e4f3b660a63, ommers_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, beneficiary: 0xf24a01ae29dec4629dfb4170647c4ed4efc392cd, state_root: 0xb03b2eb3d5662a0a151558519798ed43e240c2ac2f86471c2d4ba02478c560ba, transactions_root: 0x0ea0eb2bc3e0823911047d8afb8cee30516bb19f726e38bba05dc06d19ef88bc, receipts_root: 0x50deecc56df7b98472931832198c0587cae2c43b804099299de1aeb4fe1c3cc0, withdrawals_root: Some(0xaf377386ae27bd5d30b3d7c5a32cb6d5e9294be0d5bc0bd1ca441fbb3b4b9958), logs_bloom: 0x82010008010a05a814b002602c12020006155028000104822280404e4408841e21015a682434108068144b220000000e008000ae622ab0010c73180c002c6808405080901001800b869900191126001412202205014642011600c040202040201804200223006000004440440a144f0420050209801802d40200e0bc684c00108860480583100028a4002929080c44800022c48178021000918010441c5260082608422370400246300090900410100c085042c4420200440820002021100001819698621630092080110000c411c10412000b1080da084302c0d10c04556a1814d32324006524088c22800002a4020400810040502102026080028400084400, difficulty: 0x0_U256, number: 5615114, gas_limit: 30000000, gas_used: 9156629, timestamp: 1712082360, mix_hash: 0xcd3b84a6731693e756e15331136c1e861a044b81d6481927812510c3f7996be3, nonce: 0, base_fee_per_gas: Some(192308831), blob_gas_used: Some(0), excess_blob_gas: Some(86900736), parent_beacon_block_root: Some(0x508943102249a5acd78469474b725c1d1635895c3103bbacb56a9280f79a23c5), extra_data: 0xd883010d0b846765746888676f312e32312e36856c696e7578 } }
Apr 2 18:42:10 reth[216180]: [2024-04-02T18:42:10.125015Z[ [ERROR[ shutting down due to error
Apr 2 18:42:10 reth[216180]: Error: stage encountered an error in block #5615114: validation error: mismatched block state root: got 0x2e7d83dbeb720e605d95097a37cdd71698c7537f42405804fc1e8842f5ef4f50, expected 0xb03b2eb3d5662a0a151558519798ed43e240c2ac2f86471c2d4ba02478c560ba
Apr 2 18:42:10 reth[216180]: Caused by:
Apr 2 18:42:10 reth[216180]: 0: validation error: mismatched block state root: got 0x2e7d83dbeb720e605d95097a37cdd71698c7537f42405804fc1e8842f5ef4f50, expected 0xb03b2eb3d5662a0a151558519798ed43e240c2ac2f86471c2d4ba02478c560ba
Apr 2 18:42:10 reth[216180]: 1: mismatched block state root: got 0x2e7d83dbeb720e605d95097a37cdd71698c7537f42405804fc1e8842f5ef4f50, expected 0xb03b2eb3d5662a0a151558519798ed43e240c2ac2f86471c2d4ba02478c560ba
Apr 2 18:42:10 reth[216180]: Location:
Apr 2 18:42:10 reth[216180]: /rustc/aedd173a2c086e558c2b66d3743b344f977621a7/library/core/src/task/poll.rs:255:39
Apr 2 18:42:10 systemd[1]: reth.service: Main process exited, code=exited, status=1/FAILURE
Apr 2 18:42:10 systemd[1]: reth.service: Failed with result 'exit-code'.
Apr 2 18:42:10 systemd[1]: reth.service: Consumed 1.320s CPU time.
from reth.
gakonst
commented on June 12, 2024
@MrFrogoz can you confirm whether reth stage drop merkle lets you resume progress?
from reth.
MrFrogoz
commented on June 12, 2024
unfortunately I used backup, I didn't try that command
from reth.
Related Issues (20)
- E2E Tests: P2P Sync
- Interupted sync fails with "Failed to decompress: Frame requires too much memory for decoding" HOT 3
- Update `iai` benchmarks to use `iai-callgrind` HOT 2
- Request for Documentation Addition: Retrieving Peer ID from Local REVM Node HOT 5
- Use alloy-rpc types for admin namespace HOT 1
- replace lru with schnellru HOT 1
- Launch disc services concurrently HOT 1
- Hive Test Failure: ethereum/sync HOT 2
- Hive Test Failure: ethereum/engine HOT 2
- op-reth base sync stalling HOT 5
- Failed to open the database: the environment opened in read-only (13) when trying to read the DB from external process HOT 1
- op-reth finalized block is far behind https://mainnet.base.org finalized block
- Extend `NodeBuilder::extend_rpc_modules` to a more general rpc config call
- docker error after merkle snapshot HOT 4
- Add anvil_ hardhat rpc-api traits HOT 4
- Replace ethsigner trait with alloy-signer HOT 3
- remove WsHttpServerKind type and simplify server launch HOT 3
- Abstract rpc pending block building
- Auto impl Arc, & and Box for `StateProviderFactory` HOT 3
- Sync process hangs during the execution stage HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from reth.