blockworks-foundation / geyser-grpc-connector Goto Github PK

Version: 0.7.1

thread 'tokio-runtime-worker' panicked at /home/galactus/.cargo/registry/src/index.crates.io-6f17d22bba15001f/geyser-grpc-connector-0.7.1+yellowstone.1.11/src/grpc_subscription_autoreconnect.rs:245:29:
geyser stream closed on grpc_addr https://mango.rpcpool.com - retrying

2024-01-06T19:50:01.593070Z WARN geyser_grpc_connector::grpc_subscription_autoreconnect: ! error on grpc_addr https://mango.rpcpool.com - retrying: Status { code: Internal, message: "Unexpected EOF decoding stream.", source: None }

"Unexpected EOF decoding stream", tonic

Problem

The full block stream cannot keep up with slot progression on the chain and also not with block meta sent via geyser.

Lag is approx 42 slots in 60 seconds (mainnet)!

Did not observe that lag on testnet.

Investigation

grpcurl -proto geyser.proto -H "x-token: $MAINNET_API_TOKEN" -max-msg-sz 10000000 -format json -d @ :443 geyser.Geyser.Subscribe <<EOM
{
"accounts": {},
"slots": {},
"transactions": {},
"blocks": {
"block_client": {
"account_include": [],
"include_transactions": true,
"include_accounts": false,
"include_entries": false
}
},
"blocks_meta": {},
"entry": {}
}
EOM | jq '.block.slot'

run debug_blockstream_lag against mainnet - make sure that the unpatched GrpcClient gets used in create_geyser_reconnecting_stream:

2024-03-25T11:01:09.907830Z INFO debug_blockstream_lag: got block update (blue)!!! slot: 256337980
2024-03-25T11:01:09.907839Z INFO debug_blockstream_lag: delta: 25
2024-03-25T11:01:10.036505Z TRACE geyser_grpc_connector::grpc_subscription_autoreconnect_streams: > recv update message from grpc_addr ...
2024-03-25T11:01:10.036561Z INFO debug_blockstream_lag: got block update (blue)!!! slot: 256337981
2024-03-25T11:01:10.036569Z INFO debug_blockstream_lag: delta: 24
2024-03-25T11:01:10.153134Z TRACE geyser_grpc_connector::grpc_subscription_autoreconnect_streams: > recv update message from grpc_addr ....
2024-03-25T11:01:10.153198Z INFO debug_blockstream_lag: got blockmeta update (green)!!! slot: 256338006
2024-03-25T11:01:10.307920Z TRACE geyser_grpc_connector::grpc_subscription_autoreconnect_streams: > recv update message from grpc_addr ...
2024-03-25T11:01:10.307972Z INFO debug_blockstream_lag: got block update (blue)!!! slot: 256337982