So we are scratching our heads about this one. The leaderlogs reported that our pool was supposed to get 7 blocks for epoch 299. Looking at ADAPools and pooltool, both say that we only minted 6. Here is the leaderlog entry for the block that we missed:
{
“no”: 6,
“slot”: 44152950,
“slotInEpoch”: 348150,
“at”: “2021-10-31T15:27:21-07:00”
},
And here is the log entry in our block producing node logs:
[2021-10-31 22:27:21.02 UTC] Chain extended, new tip: 4068c7b5a249ea06b75a227cc0556422043c69cd2b5844f515e2d8c918e7bc4e at slot 44152950
Also here is another thing that’s puzzling, as of this writing gLiveView says that we’ve minted 32 blocks. The block producing node was restarted at the beginning of epoch 298. So that means 32 blocks since epoch 298. Adding the number of blocks published on pooltool since epoch 298 yields 31 (i.e the block for 2021-10-31T15:27:21-07:00 is missing if you look at all the time stamps for the all the logs).
A bit more info, looking at our grafana monitoring for 10/31/2021, there is nothing out of the ordinary there. Everything is in the green. CPU is OK, memory is OK, and the TX count was increasing. Based on the info available to me our pool was in good health.
So a few questions:
-
what does that log entry mean? Does it mean that our node minted the block?
-
What else can I look at?
-
Has anyone experienced this before?
Sorry for the long post. I hope it makes sense. Let me know if you have any questions or anything I can clarify.