My BP and relay nodes both are stuck while syncing at Epoch 207. They stuck here before and I deleted my db folder and restarted them. But they are stucked again.
(BP node)
┌────────────────────────┬────────────┬────────────────────────┐
│ Uptime: 11:26:25 │ Port: 6000 │ Guild LiveView v1.20.7 │
│------------------------└────────────┴────────────────────────┤
│ Epoch 207 [99.9%] (node) │
│ 4d 06:06:21 until epoch boundary (chain) │
│ ▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌ │
│ │
│ Block : 4490490 Tip (ref) : 30477219 │
│ Slot : 21579 Tip (node) : 4492779 │
│ Density : 100.000 Status : syncing (14.7%) │
│--------------------------------------------------------------│
│ Processed TX : 0 Out / In │
│ Mempool TX/Bytes : 0 / 0 Peers : 1 1 │
└──────────────────────────────────────────────────────────────┘
TG Announcement/Support channel: t.me/guild_operators_official
Here is the log
[cardano:cardano.node.IpSubscription:Error:27672] [2021-05-26 15:30:38.93 UTC] IPs: 0.0.0.0:0 [67.205.167.232:6000] Application Exception: 67.205.167.232:6000 ExceededTimeLimit (ChainSync (Header (HardForkBlock (': * ByronBlock (': * (ShelleyBlock (ShelleyEra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Allegra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Mary StandardCrypto)) ('[] *))))))) (Tip HardForkBlock (': * ByronBlock (': * (ShelleyBlock (ShelleyEra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Allegra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Mary StandardCrypto)) ('[] *))))))) (ServerAgency TokNext TokMustReply)
[cardano:cardano.node.IpSubscription:Info:27672] [2021-05-26 15:30:38.93 UTC] IPs: 0.0.0.0:0 [67.205.167.232:6000] Closed socket to 67.205.167.232:6000
[cardano:cardano.node.ErrorPolicy:Notice:52] [2021-05-26 15:30:38.93 UTC] IP 67.205.167.232:6000 ErrorPolicySuspendConsumer (Just (ApplicationExceptionTrace ExceededTimeLimit (ChainSync (Header (HardForkBlock (': * ByronBlock (': * (ShelleyBlock (ShelleyEra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Allegra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Mary StandardCrypto)) ('[] *))))))) (Tip HardForkBlock (': * ByronBlock (': * (ShelleyBlock (ShelleyEra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Allegra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Mary StandardCrypto)) ('[] *))))))) (ServerAgency TokNext TokMustReply))) 20s
[cardano:cardano.node.IpSubscription:Info:54] [2021-05-26 15:30:39.94 UTC] IPs: 0.0.0.0:0 [67.205.167.232:6000] Restarting Subscription after 136.015240043s desired valency 1 current valency 0
[cardano:cardano.node.IpSubscription:Info:54] [2021-05-26 15:30:39.94 UTC] IPs: 0.0.0.0:0 [67.205.167.232:6000] Trying to connect to 67.205.167.232:6000
[cardano:cardano.node.IpSubscription:Info:27701] [2021-05-26 15:30:39.94 UTC] IPs: 0.0.0.0:0 [67.205.167.232:6000] Connection Attempt Start, destination 67.205.167.232:6000
[cardano:cardano.node.IpSubscription:Notice:54] [2021-05-26 15:30:39.94 UTC] IPs: 0.0.0.0:0 [67.205.167.232:6000] Waiting 0.025s before attempting a new connection
[cardano:cardano.node.IpSubscription:Notice:27701] [2021-05-26 15:30:39.94 UTC] IPs: 0.0.0.0:0 [67.205.167.232:6000] Connection Attempt End, destination 67.205.167.232:6000 outcome: ConnectSuccessLast
[cardano:cardano.node.ErrorPolicy:Warning:57] [2021-05-26 15:34:02.99 UTC] IP 67.205.167.232:42925 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (MuxError MuxBearerClosed "<socket: 94> closed when reading data, waiting on next header True"))) 20s 20s
[cardano:cardano.node.IpSubscription:Error:27701] [2021-05-26 15:35:08.96 UTC] IPs: 0.0.0.0:0 [67.205.167.232:6000] Application Exception: 67.205.167.232:6000 ExceededTimeLimit (ChainSync (Header (HardForkBlock (': * ByronBlock (': * (ShelleyBlock (ShelleyEra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Allegra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Mary StandardCrypto)) ('[] *))))))) (Tip HardForkBlock (': * ByronBlock (': * (ShelleyBlock (ShelleyEra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Allegra StandardCrypto)) (': * (ShelleyBlock (ShelleyMAEra 'Mary StandardCrypto)) ('[] *))))))) (ServerAgency TokNext TokMustReply)
[cardano:cardano.node.IpSubscription:Info:27701] [2021-05-26 15:35:08.96 UTC] IPs: 0.0.0.0:0 [67.205.167.232:6000] Closed socket to 67.205.167.232:6000
My relay node is stuck at the same Epoch
┌────────────────────────┬────────────┬────────────────────────┐
│ Uptime: 11:24:40 │ Port: 6000 │ Guild LiveView v1.20.7 │
│------------------------└────────────┴────────────────────────┤
│ Epoch 207 [99.9%] (node) │
│ 4d 06:10:21 until epoch boundary (chain) │
│ ▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌▌ │
│ │
│ Block : 4490490 Tip (ref) : 30476979 │
│ Slot : 21579 Tip (node) : 4492779 │
│ Density : 100.000 Status : syncing (14.7%) │
│--------------------------------------------------------------│
│ Processed TX : 0 Out / In │
│ Mempool TX/Bytes : 0 / 0 Peers : 1 1 │
└──────────────────────────────────────────────────────────────┘
TG Announcement/Support channel: t.me/guild_operators_official
The process just stuck here. Happened last time as well.
Here is the log
[relay1:cardano.node.BlockFetchDecision:Info:45] [2021-05-26 15:35:16.21 UTC] [TraceLabelPeer (ConnectionId {localAddress = 67.205.167.232:39101, remoteAddress = <my.bp.node.ip>:6000}) (Left FetchDeclineChainNotPlausible),TraceLabelPeer (ConnectionId {localAddress = 67.205.167.232:38071, remoteAddress = 54.169.163.188:3001}) (Right [At (Block {blockPointSlot = SlotNo 4492781, blockPointHash = 541ba0e498b7c3f926b27a53923b73566c1d1a6b694a9648eed0f479676bd24c})])]
[relay1:cardano.node.DnsSubscription:Error:91951] [2021-05-26 15:35:16.43 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Application Exception: 54.169.163.188:3001 HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492779) 2c50916d3f53d2d1d3366a619527128139d20875a2a14e98085398e55844656b (BlockNo 4490490)) (Tip (SlotNo 30476920) 555f3ca87869522bda8945e27851db7ec08560a6dca6a9dde6e34e6c02f43fb9 (BlockNo 5769090))
Any ideas?