Hi,
today I just realized that my node stops processing TX. In paralell I got warning that the hard disk space is less that 1GB. I have deleted some files and now i have more than 4Gb. This is the node status after 8 hours runnig:
Is it possible that my node is banned due to low level (not lack of) HDD space ? If yes what should I do to get back my status?
Just only my cardano dir is more than 13GB (total is 35GB) but in some tutorials 20GB is the minimum.
Hi!
till you can see new tip log statement then the node is healthy.
so if something went wrong the tip also should stop increasing.
The errorpolicy log is “just” a notice…
Thank you for your quick answer.
My experince is that a healty node isn’t enough to be a part of the transactions: after 12 happy hours of working my node stoped TX processing. Propably the problem was that my relays were connected togather. After I cut this connection it took 3-4 hours to start working. I got this without any warning or something and the sync was ok during the whole time.
One more thing: the other part of the message contains an expession “ErrorPolicySuspendConsumer” witch is scary…
yes, you are right - so you need incoming peer connections to have TX processing…
do you know how many incoming connections the node has?
so once this status comes back - check the tip, and in connections as well…
This status is always there. My node is continusly in sync. It is reachable by poolvet and:
Relay node 92.249.148.66:6000 is in [topology.json]
The blocknode has 1/1 connection with the relay.
thats way my suspicion is that my node is somehow banned.
once I had this printout but in another context:
opened 10:18PM - 15 Dec 20 UTC
closed 06:27AM - 03 Apr 21 UTC
bug
*External*
**Area**
*Other*
**Summary**
node not syncing, errors found … in console log:
```
[dell:cardano.node.ChainDB:Info:5] [2020-12-15 22:05:59.07 UTC] Opened db with immutable tip at genesis (origin) and tip genesis (origin)
[dell:cardano.node.ChainDB:Notice:34] [2020-12-15 22:05:59.07 UTC] Chain extended, new tip: d2d90d10993b3eb309f5485a5413cb9c9fe4f088e79b7b4e815dbbe8fcb8e4b7 at slot 0
[dell:cardano.node.DnsSubscription:Notice:62] [2020-12-15 22:05:59.08 UTC] [String "Connection Attempt Start, destination 54.176.195.194:3001",String "SubscriptionTrace",String "\"relays-new.cardano-mainnet.iohk.io\""]
[dell:cardano.node.DnsSubscription:Notice:63] [2020-12-15 22:05:59.10 UTC] [String "Connection Attempt Start, destination 18.159.69.220:3001",String "SubscriptionTrace",String "\"relays-new.cardano-mainnet.iohk.io\""]
[dell:cardano.node.DnsSubscription:Notice:64] [2020-12-15 22:05:59.13 UTC] [String "Connection Attempt Start, destination 18.159.165.127:3001",String "SubscriptionTrace",String "\"relays-new.cardano-mainnet.iohk.io\""]
[dell:cardano.node.DnsSubscription:Notice:63] [2020-12-15 22:05:59.13 UTC] [String "Connection Attempt End, destination 18.159.69.220:3001 outcome: ConnectSuccess",String "SubscriptionTrace",String "\"relays-new.cardano-mainnet.iohk.io\""]
[dell:cardano.node.DnsSubscription:Notice:65] [2020-12-15 22:05:59.15 UTC] [String "Connection Attempt Start, destination 3.18.83.182:3001",String "SubscriptionTrace",String "\"relays-new.cardano-mainnet.iohk.io\""]
[dell:cardano.node.DnsSubscription:Notice:64] [2020-12-15 22:05:59.16 UTC] [String "Connection Attempt End, destination 18.159.165.127:3001 outcome: ConnectSuccessLast",String "SubscriptionTrace",String "\"relays-new.cardano-mainnet.iohk.io\""]
[dell:cardano.node.ErrorPolicy:Notice:54] [2020-12-15 22:05:59.16 UTC] [String "ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = \"Parallel connection cancelled\", seStack = []}))) 1s",String "ErrorPolicyTrace",String "54.176.195.194:3001"]
[dell:cardano.node.ErrorPolicy:Notice:54] [2020-12-15 22:05:59.16 UTC] [String "ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = \"Parallel connection cancelled\", seStack = []}))) 1s",String "ErrorPolicyTrace",String "3.18.83.182:3001"]
[dell:cardano.node.DnsSubscription:Error:63] [2020-12-15 22:06:09.23 UTC] [String "Application Exception: 18.159.69.220:3001 ExceededTimeLimit (ChainSync (Header (HardForkBlock (': * ByronBlock (': * (ShelleyBlock (ShelleyEra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Allegra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Mary StandardCrypto)) ('[] *))))))) (Tip HardForkBlock (': * ByronBlock (': * (ShelleyBlock (ShelleyEra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Allegra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Mary StandardCrypto)) ('[] *))))))) (ServerAgency TokNext TokCanAwait)",String "SubscriptionTrace",String "\"relays-new.cardano-mainnet.iohk.io\""]
[dell:cardano.node.ErrorPolicy:Notice:54] [2020-12-15 22:06:09.23 UTC] [String "ErrorPolicySuspendConsumer (Just (ApplicationExceptionTrace ExceededTimeLimit (ChainSync (Header (HardForkBlock (': * ByronBlock (': * (ShelleyBlock (ShelleyEra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Allegra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Mary StandardCrypto)) ('[] *))))))) (Tip HardForkBlock (': * ByronBlock (': * (ShelleyBlock (ShelleyEra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Allegra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Mary StandardCrypto)) ('[] *))))))) (ServerAgency TokNext TokCanAwait))) 20s",String "ErrorPolicyTrace",String "18.159.69.220:3001"]
[dell:cardano.node.DnsSubscription:Error:64] [2020-12-15 22:06:09.26 UTC] [String "Application Exception: 18.159.165.127:3001 ExceededTimeLimit (ChainSync (Header (HardForkBlock (': * ByronBlock (': * (ShelleyBlock (ShelleyEra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Allegra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Mary StandardCrypto)) ('[] *))))))) (Tip HardForkBlock (': * ByronBlock (': * (ShelleyBlock (ShelleyEra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Allegra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Mary StandardCrypto)) ('[] *))))))) (ServerAgency TokNext TokCanAwait)",String "SubscriptionTrace",String "\"relays-new.cardano-mainnet.iohk.io\""]
[dell:cardano.node.ErrorPolicy:Notice:54] [2020-12-15 22:06:09.26 UTC] [String "ErrorPolicySuspendConsumer (Just (ApplicationExceptionTrace ExceededTimeLimit (ChainSync (Header (HardForkBlock (': * ByronBlock (': * (ShelleyBlock (ShelleyEra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Allegra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Mary StandardCrypto)) ('[] *))))))) (Tip HardForkBlock (': * ByronBlock (': * (ShelleyBlock (ShelleyEra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Allegra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Mary StandardCrypto)) ('[] *))))))) (ServerAgency TokNext TokCanAwait))) 20s",String "ErrorPolicyTrace",String "18.159.165.127:3001"]
```
**Steps to reproduce**
started the node with the following command:
```
./cardano-node run --topology configs/mainnet-topology.json --database-path storage/ --socket-path storage/node.socket --host-addr 127.0.0.1 --port 3001 --config configs/mainnet-config.json --shelley-kes-key kes.skey --shelley-vrf-key vrf.skey --shelley-operational-certificate node.cert
```
**Expected behavior**
cardano-cli shelley query tip --mainnet returns with other then this
```
{
"blockNo": 0,
"headerHash": "d2d90d10993b3eb309f5485a5413cb9c9fe4f088e79b7b4e815dbbe8fcb8e4b7",
"slotNo": 0
}
```
**System info (please complete the following information):**
- OS: Ubuntu
- Version: 18.04
- Node version: 1.24.2
**Additional context**
also not working with earlier versions of node. It worked around 1 week ago.
So but still it can occur…