Node not syncing after epoch 207 (14.9%) Please help

Hello Everyone,

Thank you for trying to help :slight_smile:

I am new to the cardano nodes and I been trying for a couple of days to have one up and running. However, I seem to always get hung up on the syncing process on epoch 207.

I am following the CoinCashews guide for the installation.

Thanks again for your help!

	May 22 03:13:59 CarnitasRelay1 cardano-node[113428]: [Carnitas:cardano.node.DnsSubscription:Notice:99959] [2021-05-22 03:13:59.68 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End>
May 22 03:13:59 CarnitasRelay1 cardano-node[113428]: [Carnitas:cardano.node.DnsSubscription:Notice:99960] [2021-05-22 03:13:59.71 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End>
May 22 03:13:59 CarnitasRelay1 cardano-node[113428]: [Carnitas:cardano.node.ErrorPolicy:Notice:54] [2021-05-22 03:13:59.71 UTC] IP 52.58.171.193:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptio>
May 22 03:14:00 CarnitasRelay1 cardano-node[113428]: [Carnitas:cardano.node.BlockFetchDecision:Info:45] [2021-05-22 03:14:00.38 UTC] [TraceLabaelPeer (ConnectionId {localAddress = 143.198.137.123:33195, >
May 22 03:14:00 CarnitasRelay1 cardano-node[113428]: [Carnitas:cardano.node.BlockFetchDecision:Info:45] [2021-05-22 03:14:00.38 UTC] [TraceLabelPeer (ConnectionId {localAddress = 143.198.137.123:33195, >
May 22 03:14:00 CarnitasRelay1 cardano-node[113428]: [Carnitas:cardano.node.DnsSubscription:Error:99959] [2021-05-22 03:14:00.39 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Application Exception: >
May 22 03:14:00 CarnitasRelay1 cardano-node[113428]: [Carnitas:cardano.node.ErrorPolicy:Warning:54] [2021-05-22 03:14:00.39 UTC] IP 3.0.229.88:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrac>
May 22 03:14:00 CarnitasRelay1 cardano-node[113428]: [Carnitas:cardano.node.BlockFetchDecision:Info:45] [2021-05-22 03:14:00.40 UTC] [TraceLabelPeer (ConnectionId {localAddress = 143.198.137.123:33195, >
May 22 03:14:00 CarnitasRelay1 cardano-node[113428]: [Carnitas:cardano.node.DnsSubscription:Error:99960] [2021-05-22 03:14:00.41 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Application Exception: >
May 22 03:14:00 CarnitasRelay1 cardano-node[113428]: [Carnitas:cardano.node.ErrorPolicy:Warning:54] [2021-05-22 03:14:00.41 UTC] IP 54.179.126.222:3001 ErrorPolicySuspendPeer (Just (ApplicationException>

image

I tried restarting it and it won’t start.

image

May 22 04:06:28 CarnitasRelay1 cardano-node[26135]: [Carnitas:cardano.node.ErrorPolicy:Warning:64] [2021-05-22 04:06:28.45 UTC] IP 54.254.117.140:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30090096) b9363b43e9694c91b4852ed97788c1d1fc227b986faf4a9528a6ae0ce4c6ed25 (BlockNo 5749639))))) 200s 200s

May 22 04:07:47 CarnitasRelay1 cardano-node[26135]: [Carnitas:cardano.node.DnsSubscription:Notice:723] [2021-05-22 04:07:47.57 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 54.255.126.22:3001
May 22 04:07:47 CarnitasRelay1 cardano-node[26135]: [Carnitas:cardano.node.DnsSubscription:Notice:724] [2021-05-22 04:07:47.60 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 13.229.13.24:3001
May 22 04:07:47 CarnitasRelay1 cardano-node[26135]: [Carnitas:cardano.node.DnsSubscription:Notice:723] [2021-05-22 04:07:47.75 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End, destination 54.255.126.22:3001 outcome: ConnectSuccess
May 22 04:07:47 CarnitasRelay1 cardano-node[26135]: [Carnitas:cardano.node.DnsSubscription:Notice:724] [2021-05-22 04:07:47.78 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End, destination 13.229.13.24:3001 outcome: ConnectSuccessLast
1 Like

Is your firewall opened? and can you provide a log of start up.

Do you have a your topology file configured?

Thank you for getting back to me.

What do I need to open from the firewall?
This is the log from when the node starts

-- Logs begin at Fri 2021-05-21 21:10:55 UTC. --
May 22 05:34:35 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.basicInfo.slotsPerKESPeriodAllegra:Notice:5] [2021-05-22 05:34:35.01 UTC] 129600
May 22 05:34:35 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.basicInfo.slotLengthMary:Notice:5] [2021-05-22 05:34:35.01 UTC] 1s
May 22 05:34:35 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.basicInfo.epochLengthMary:Notice:5] [2021-05-22 05:34:35.01 UTC] 432000
May 22 05:34:35 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.basicInfo.slotsPerKESPeriodMary:Notice:5] [2021-05-22 05:34:35.01 UTC] 129600
May 22 05:34:35 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.addresses:Notice:5] [2021-05-22 05:34:35.01 UTC] [SocketInfo 0.0.0.0:6000]
May 22 05:34:35 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.diffusion-mode:Notice:5] [2021-05-22 05:34:35.01 UTC] InitiatorAndResponderDiffusionMode
May 22 05:34:35 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.dns-producers:Notice:5] [2021-05-22 05:34:35.01 UTC] [DnsSubscriptionTarget {dstDomain = "relays-new.cardano-mainnet.iohk.io", dstPort = 3001, dstValency = 2}]
May 22 05:34:35 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ip-producers:Notice:5] [2021-05-22 05:34:35.01 UTC] IPSubscriptionTarget {ispIps = [], ispValency = 0}
May 22 05:34:36 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ChainDB:Info:5] [2021-05-22 05:34:36.70 UTC] Opened imm db with immutable tip at ec0c94dd92541aed3727dfc1a13cd6a64f461f2502f8579f887a2897115ab78e at slot 4490639 and chunk 207
May 22 05:34:36 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ChainDB:Info:5] [2021-05-22 05:34:36.82 UTC] Opened vol db
May 22 05:34:37 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ChainDB:Info:5] [2021-05-22 05:34:37.94 UTC] Replaying ledger from snapshot DiskSnapshot {dsNumber = 4490639, dsSuffix = Nothing} at ec0c94dd92541aed3727dfc1a13cd6a64f461f2502f8579f887a2897115ab78e at slot 4490639
May 22 05:34:37 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ChainDB:Info:5] [2021-05-22 05:34:37.94 UTC] Opened lgr db
May 22 05:34:39 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ChainDB:Info:5] [2021-05-22 05:34:39.07 UTC] Opened db with immutable tip at ec0c94dd92541aed3727dfc1a13cd6a64f461f2502f8579f887a2897115ab78e at slot 4490639 and tip f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 at slot 4492799
May 22 05:34:45 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:77] [2021-05-22 05:34:45.26 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 18.184.236.47:3001
May 22 05:34:45 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:79] [2021-05-22 05:34:45.29 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 18.159.8.231:3001
May 22 05:34:45 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:80] [2021-05-22 05:34:45.31 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 54.151.113.34:3001
May 22 05:34:45 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:80] [2021-05-22 05:34:45.32 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End, destination 54.151.113.34:3001 outcome: ConnectSuccess
May 22 05:34:45 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Error:80] [2021-05-22 05:34:45.34 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Application Exception: 54.151.113.34:3001 HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095391) 2f4e3814f99024fa7b615a69978e9e4eeb04d14ee9bd43356d22a364bfb967e1 (BlockNo 5749893))
May 22 05:34:45 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Warning:64] [2021-05-22 05:34:45.34 UTC] IP 54.151.113.34:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095391) 2f4e3814f99024fa7b615a69978e9e4eeb04d14ee9bd43356d22a364bfb967e1 (BlockNo 5749893))))) 200s 200s
May 22 05:34:45 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:97] [2021-05-22 05:34:45.35 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 13.114.93.89:3001
May 22 05:34:45 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:98] [2021-05-22 05:34:45.38 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 18.133.133.57:3001
May 22 05:34:45 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:99] [2021-05-22 05:34:45.40 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 3.133.45.145:3001
May 22 05:34:45 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:77] [2021-05-22 05:34:45.42 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End, destination 18.184.236.47:3001 outcome: ConnectSuccess
May 22 05:34:45 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:100] [2021-05-22 05:34:45.44 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 54.250.21.52:3001
May 22 05:34:45 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:79] [2021-05-22 05:34:45.44 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End, destination 18.159.8.231:3001 outcome: ConnectSuccessLast
May 22 05:34:45 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Notice:64] [2021-05-22 05:34:45.44 UTC] IP 13.114.93.89:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 05:34:45 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Notice:64] [2021-05-22 05:34:45.44 UTC] IP 18.133.133.57:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 05:34:45 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Notice:64] [2021-05-22 05:34:45.44 UTC] IP 3.133.45.145:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 05:34:45 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Notice:64] [2021-05-22 05:34:45.44 UTC] IP 54.250.21.52:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 05:34:46 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Error:79] [2021-05-22 05:34:46.07 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Application Exception: 18.159.8.231:3001 HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095391) 2f4e3814f99024fa7b615a69978e9e4eeb04d14ee9bd43356d22a364bfb967e1 (BlockNo 5749893))
May 22 05:34:46 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Warning:64] [2021-05-22 05:34:46.07 UTC] IP 18.159.8.231:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095391) 2f4e3814f99024fa7b615a69978e9e4eeb04d14ee9bd43356d22a364bfb967e1 (BlockNo 5749893))))) 200s 200s
May 22 05:34:46 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Error:77] [2021-05-22 05:34:46.07 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Application Exception: 18.184.236.47:3001 HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095391) 2f4e3814f99024fa7b615a69978e9e4eeb04d14ee9bd43356d22a364bfb967e1 (BlockNo 5749893))
May 22 05:34:46 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Warning:64] [2021-05-22 05:34:46.07 UTC] IP 18.184.236.47:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095391) 2f4e3814f99024fa7b615a69978e9e4eeb04d14ee9bd43356d22a364bfb967e1 (BlockNo 5749893))))) 200s 200s
May 22 05:34:55 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:140] [2021-05-22 05:34:55.26 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 18.184.236.47:3001
May 22 05:34:55 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:141] [2021-05-22 05:34:55.28 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 18.159.8.231:3001
May 22 05:34:55 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:142] [2021-05-22 05:34:55.31 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 54.151.113.34:3001
May 22 05:34:55 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:142] [2021-05-22 05:34:55.31 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End, destination 54.151.113.34:3001 outcome: ConnectSuccess
May 22 05:34:55 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Error:142] [2021-05-22 05:34:55.33 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Application Exception: 54.151.113.34:3001 HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095391) 2f4e3814f99024fa7b615a69978e9e4eeb04d14ee9bd43356d22a364bfb967e1 (BlockNo 5749893))
May 22 05:34:55 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Warning:64] [2021-05-22 05:34:55.33 UTC] IP 54.151.113.34:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095391) 2f4e3814f99024fa7b615a69978e9e4eeb04d14ee9bd43356d22a364bfb967e1 (BlockNo 5749893))))) 200s 200s
May 22 05:34:55 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:159] [2021-05-22 05:34:55.34 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 13.114.93.89:3001
May 22 05:34:55 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:160] [2021-05-22 05:34:55.36 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 18.133.133.57:3001
May 22 05:34:55 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:161] [2021-05-22 05:34:55.39 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 3.133.45.145:3001
May 22 05:34:55 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:162] [2021-05-22 05:34:55.41 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 54.250.21.52:3001
May 22 05:34:55 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:140] [2021-05-22 05:34:55.42 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End, destination 18.184.236.47:3001 outcome: ConnectSuccess
May 22 05:34:55 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:141] [2021-05-22 05:34:55.43 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End, destination 18.159.8.231:3001 outcome: ConnectSuccessLast
May 22 05:34:55 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Notice:64] [2021-05-22 05:34:55.45 UTC] IP 13.114.93.89:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 05:34:55 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Notice:64] [2021-05-22 05:34:55.45 UTC] IP 18.133.133.57:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 05:34:55 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Notice:64] [2021-05-22 05:34:55.45 UTC] IP 3.133.45.145:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 05:34:55 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Notice:64] [2021-05-22 05:34:55.45 UTC] IP 54.250.21.52:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 05:34:56 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Error:141] [2021-05-22 05:34:56.05 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Application Exception: 18.159.8.231:3001 HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095391) 2f4e3814f99024fa7b615a69978e9e4eeb04d14ee9bd43356d22a364bfb967e1 (BlockNo 5749893))
May 22 05:34:56 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Warning:64] [2021-05-22 05:34:56.05 UTC] IP 18.159.8.231:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095391) 2f4e3814f99024fa7b615a69978e9e4eeb04d14ee9bd43356d22a364bfb967e1 (BlockNo 5749893))))) 200s 200s
May 22 05:34:56 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Error:140] [2021-05-22 05:34:56.07 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Application Exception: 18.184.236.47:3001 HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095391) 2f4e3814f99024fa7b615a69978e9e4eeb04d14ee9bd43356d22a364bfb967e1 (BlockNo 5749893))
May 22 05:34:56 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Warning:64] [2021-05-22 05:34:56.07 UTC] IP 18.184.236.47:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095391) 2f4e3814f99024fa7b615a69978e9e4eeb04d14ee9bd43356d22a364bfb967e1 (BlockNo 5749893))))) 200s 200s
May 22 05:35:05 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:205] [2021-05-22 05:35:05.27 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 18.184.236.47:3001
May 22 05:35:05 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:206] [2021-05-22 05:35:05.30 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 18.159.8.231:3001
May 22 05:35:05 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:207] [2021-05-22 05:35:05.32 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 54.151.113.34:3001
May 22 05:35:05 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:207] [2021-05-22 05:35:05.34 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End, destination 54.151.113.34:3001 outcome: ConnectSuccess
May 22 05:35:05 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:221] [2021-05-22 05:35:05.35 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 13.114.93.89:3001
May 22 05:35:05 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Error:207] [2021-05-22 05:35:05.37 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Application Exception: 54.151.113.34:3001 HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095410) 0969f1d987435ae48efeec1f316fbd5ad96b585728306ff19ba604635be2c246 (BlockNo 5749895))
May 22 05:35:05 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Warning:64] [2021-05-22 05:35:05.37 UTC] IP 54.151.113.34:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095410) 0969f1d987435ae48efeec1f316fbd5ad96b585728306ff19ba604635be2c246 (BlockNo 5749895))))) 200s 200s
May 22 05:35:05 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:225] [2021-05-22 05:35:05.37 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 18.133.133.57:3001
May 22 05:35:05 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:226] [2021-05-22 05:35:05.40 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 3.133.45.145:3001
May 22 05:35:05 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:205] [2021-05-22 05:35:05.43 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End, destination 18.184.236.47:3001 outcome: ConnectSuccess
May 22 05:35:05 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:227] [2021-05-22 05:35:05.43 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 54.250.21.52:3001
May 22 05:35:05 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:206] [2021-05-22 05:35:05.45 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End, destination 18.159.8.231:3001 outcome: ConnectSuccessLast
May 22 05:35:05 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Notice:64] [2021-05-22 05:35:05.45 UTC] IP 13.114.93.89:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 05:35:05 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Notice:64] [2021-05-22 05:35:05.45 UTC] IP 18.133.133.57:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 05:35:05 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Notice:64] [2021-05-22 05:35:05.45 UTC] IP 3.133.45.145:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 05:35:05 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Notice:64] [2021-05-22 05:35:05.46 UTC] IP 54.250.21.52:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 05:35:05 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Error:206] [2021-05-22 05:35:05.95 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Application Exception: 18.159.8.231:3001 HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095410) 0969f1d987435ae48efeec1f316fbd5ad96b585728306ff19ba604635be2c246 (BlockNo 5749895))
May 22 05:35:05 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Warning:64] [2021-05-22 05:35:05.95 UTC] IP 18.159.8.231:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095410) 0969f1d987435ae48efeec1f316fbd5ad96b585728306ff19ba604635be2c246 (BlockNo 5749895))))) 200s 200s
May 22 05:35:06 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Error:205] [2021-05-22 05:35:06.07 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Application Exception: 18.184.236.47:3001 HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095410) 0969f1d987435ae48efeec1f316fbd5ad96b585728306ff19ba604635be2c246 (BlockNo 5749895))
May 22 05:35:06 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Warning:64] [2021-05-22 05:35:06.07 UTC] IP 18.184.236.47:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095410) 0969f1d987435ae48efeec1f316fbd5ad96b585728306ff19ba604635be2c246 (BlockNo 5749895))))) 200s 200s

I get this error after a while.

May 22 05:37:15 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Error:759] [2021-05-22 05:37:15.80 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Application Exception: 54.250.21.52:3001 HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095508) 626d3af2d2375689243de7c0627a6478429edaab43c2eaf704676845e5db895e (BlockNo 5749899))
May 22 05:37:15 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Warning:64] [2021-05-22 05:37:15.80 UTC] IP 54.250.21.52:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095508) 626d3af2d2375689243de7c0627a6478429edaab43c2eaf704676845e5db895e (BlockNo 5749899))))) 200s 200s
May 22 05:37:25 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:777] [2021-05-22 05:37:25.27 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 54.250.21.52:3001
May 22 05:37:25 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Notice:777] [2021-05-22 05:37:25.38 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End, destination 54.250.21.52:3001 outcome: ConnectSuccess
May 22 05:37:25 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Warning:66] [2021-05-22 05:37:25.38 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Failed to start all required subscriptions
May 22 05:37:25 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.DnsSubscription:Error:777] [2021-05-22 05:37:25.83 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Application Exception: 54.250.21.52:3001 HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095550) 34e93248651b8c9f84c11797310e3e2b73314e697e38cd4c7b965c3d86321acb (BlockNo 5749900))
May 22 05:37:25 CarnitasRelay1 cardano-node[38772]: [Carnitas:cardano.node.ErrorPolicy:Warning:64] [2021-05-22 05:37:25.83 UTC] IP 54.250.21.52:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30095550) 34e93248651b8c9f84c11797310e3e2b73314e697e38cd4c7b965c3d86321acb (BlockNo 5749900))))) 200s 200s

this is my topology file

  GNU nano 4.8                                                                              mainnet-topologyu.json                                                                                         
 {
    "Producers": [
      {
        "addr": "relays-new.cardano-mainnet.iohk.io",
        "port": 3001,
        "valency": 2
      }
    ]
  }

My other server (currently stuck on epoch 207, have not restarted it) is showing this error.

-- Logs begin at Fri 2021-05-21 21:49:52 UTC. --
May 22 05:55:26 Tortilla cardano-node[113394]: [Tortilla:cardano.node.IpSubscription:Error:54] [2021-05-22 05:55:26.60 UTC] IPs: 0.0.0.0:0 [143.198.137.123:6000] Failed to start all required subscriptions
May 22 05:55:27 Tortilla cardano-node[113394]: [Tortilla:cardano.node.IpSubscription:Info:54] [2021-05-22 05:55:27.60 UTC] IPs: 0.0.0.0:0 [143.198.137.123:6000] Restarting Subscription after 1.001284418s desired valency 1 current valency 0
May 22 05:55:36 Tortilla cardano-node[113394]: [Tortilla:cardano.node.IpSubscription:Info:54] [2021-05-22 05:55:36.61 UTC] IPs: 0.0.0.0:0 [143.198.137.123:6000] Trying to connect to 143.198.137.123:6000
May 22 05:55:36 Tortilla cardano-node[113394]: [Tortilla:cardano.node.IpSubscription:Info:97724] [2021-05-22 05:55:36.61 UTC] IPs: 0.0.0.0:0 [143.198.137.123:6000] Connection Attempt Start, destination 143.198.137.123:6000
May 22 05:55:36 Tortilla cardano-node[113394]: [Tortilla:cardano.node.IpSubscription:Notice:54] [2021-05-22 05:55:36.61 UTC] IPs: 0.0.0.0:0 [143.198.137.123:6000] Waiting 0.025s before attempting a new connection
May 22 05:55:36 Tortilla cardano-node[113394]: [Tortilla:cardano.node.IpSubscription:Error:97724] [2021-05-22 05:55:36.61 UTC] IPs: 0.0.0.0:0 [143.198.137.123:6000] Connection Attempt Exception, destination 143.198.137.123:6000 exception: Network.Socket.connect: <socket: 48>: does not exist (Connection refused)
May 22 05:55:36 Tortilla cardano-node[113394]: [Tortilla:cardano.node.IpSubscription:Info:97724] [2021-05-22 05:55:36.61 UTC] IPs: 0.0.0.0:0 [143.198.137.123:6000] Closed socket to 143.198.137.123:6000
May 22 05:55:36 Tortilla cardano-node[113394]: [Tortilla:cardano.node.ErrorPolicy:Notice:52] [2021-05-22 05:55:36.61 UTC] IP 143.198.137.123:6000 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace Network.Socket.connect: <socket: 48>: does not exist (Connection refused))) 20s
May 22 05:55:36 Tortilla cardano-node[113394]: [Tortilla:cardano.node.IpSubscription:Error:54] [2021-05-22 05:55:36.63 UTC] IPs: 0.0.0.0:0 [143.198.137.123:6000] Failed to start all required subscriptions
May 22 05:55:37 Tortilla cardano-node[113394]: [Tortilla:cardano.node.IpSubscription:Info:54] [2021-05-22 05:55:37.63 UTC] IPs: 0.0.0.0:0 [143.198.137.123:6000] Restarting Subscription after 1.026133269s desired valency 1 current valency 0
May 22 05:55:46 Tortilla cardano-node[113394]: [Tortilla:cardano.node.IpSubscription:Info:54] [2021-05-22 05:55:46.61 UTC] IPs: 0.0.0.0:0 [143.198.137.123:6000] Skipping peer 143.198.137.123:6000
May 22 05:55:46 Tortilla cardano-node[113394]: [Tortilla:cardano.node.IpSubscription:Error:54] [2021-05-22 05:55:46.61 UTC] IPs: 0.0.0.0:0 [143.198.137.123:6000] Failed to start all required subscriptions

Hello,

What guide did u used to install the nodes?

I see this error for first Relay

VRFKeyBadNonce (Nonce “81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c”)

Try to download again the files (for mainnet) from:

https://docs.cardano.org/projects/cardano-node/en/latest/stake-pool-operations/getConfigFiles_AND_Connect.html

For the second Relay it seems there is n issue with the socket

Hi Alex, thank you for the help.

i used this guide
Guide: How to build a Cardano Stake Pool - CoinCashew

i will try downloading the files again, do I need to modify them?

also, I am not sure if I’m understanding correctly but the second one is the node producer and it is trying to connect to the relay but since the relay has not sync, it is bouncing back?

i will try downloading the files again, do I need to modify them?

Nope, just download them and try after (restart the node)

also, I am not sure if I’m understanding correctly but the second one is the node producer and it is trying to connect to the relay but since the relay has not sync, it is bouncing back?

Keep the IOHK nodes in topology file till the nodes will be synced

1 Like

Hi Alex,

I tried to download the json files again and started the node again and it wouldn’t start. It show the same errors as previously mentioned.
I went ahead and deleted the db directory to try to start a fresh sync and I started right away. However, it got stuck again at epoch 207.

Do u have nodes which are working?

Exact same issue, block and slot. have tried multiple fresh installs on various AWS regions etc all fresh builds. Epoch 207, Block 4490510, Slot 21599

1 Like

No I don’t. This is my first set of nodes. Like @AdaAllDay i have tried to set them up multiple times and get stuck in the same place

2 Likes

Tryto download the files for mainnet from here…

https://docs.cardano.org/projects/cardano-node/en/latest/stake-pool-operations/getConfigFiles_AND_Connect.html

1 Like

Hi Alex,

I did download them from there per your previous suggestion but it still got stuck on epoch 207.

This is the error i am getting after updating the mainnet files from your referred source.
This happens once it gets to 100% of epoch 207.

-- Logs begin at Fri 2021-05-21 21:10:55 UTC. --
May 22 17:27:11 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Notice:85198] [2021-05-22 17:27:11.79 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End, destination 3.129.158.233:3001 outcome: ConnectSuccess
May 22 17:27:11 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Notice:85195] [2021-05-22 17:27:11.79 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End, destination 18.159.46.171:3001 outcome: ConnectSuccessLast
May 22 17:27:11 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.ErrorPolicy:Notice:54] [2021-05-22 17:27:11.79 UTC] IP 3.126.150.220:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 17:27:11 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.ErrorPolicy:Notice:54] [2021-05-22 17:27:11.79 UTC] IP 18.130.187.168:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 17:27:11 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.ErrorPolicy:Notice:54] [2021-05-22 17:27:11.79 UTC] IP 3.127.133.53:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 17:27:11 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.ErrorPolicy:Notice:54] [2021-05-22 17:27:11.79 UTC] IP 52.29.138.13:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 17:27:12 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Error:85198] [2021-05-22 17:27:12.07 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Application Exception: 3.129.158.233:3001 HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30138140) 6dc00b89d466b96707a814959aef377ccdc98e28c76f0e4cd86fc3b05f2aa5c9 (BlockNo 5752057))
May 22 17:27:12 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.ErrorPolicy:Warning:54] [2021-05-22 17:27:12.07 UTC] IP 3.129.158.233:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30138140) 6dc00b89d466b96707a814959aef377ccdc98e28c76f0e4cd86fc3b05f2aa5c9 (BlockNo 5752057))))) 200s 200s
May 22 17:27:12 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Error:85195] [2021-05-22 17:27:12.40 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Application Exception: 18.159.46.171:3001 HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30138140) 6dc00b89d466b96707a814959aef377ccdc98e28c76f0e4cd86fc3b05f2aa5c9 (BlockNo 5752057))
May 22 17:27:12 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.ErrorPolicy:Warning:54] [2021-05-22 17:27:12.40 UTC] IP 18.159.46.171:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30138140) 6dc00b89d466b96707a814959aef377ccdc98e28c76f0e4cd86fc3b05f2aa5c9 (BlockNo 5752057))))) 200s 200s
May 22 17:27:21 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Notice:85234] [2021-05-22 17:27:21.64 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 3.126.150.220:3001
May 22 17:27:21 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Notice:85235] [2021-05-22 17:27:21.67 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 18.130.187.168:3001
May 22 17:27:21 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Notice:85236] [2021-05-22 17:27:21.69 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 3.129.158.233:3001
May 22 17:27:21 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Notice:85237] [2021-05-22 17:27:21.72 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 3.127.133.53:3001
May 22 17:27:21 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Notice:85238] [2021-05-22 17:27:21.74 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 52.29.138.13:3001
May 22 17:27:21 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Notice:85236] [2021-05-22 17:27:21.76 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End, destination 3.129.158.233:3001 outcome: ConnectSuccess
May 22 17:27:21 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Notice:85239] [2021-05-22 17:27:21.77 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 3.13.149.172:3001
May 22 17:27:21 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Notice:85234] [2021-05-22 17:27:21.79 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End, destination 3.126.150.220:3001 outcome: ConnectSuccessLast
May 22 17:27:21 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.ErrorPolicy:Notice:54] [2021-05-22 17:27:21.79 UTC] IP 18.130.187.168:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 17:27:21 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.ErrorPolicy:Notice:54] [2021-05-22 17:27:21.79 UTC] IP 3.127.133.53:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 17:27:21 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.ErrorPolicy:Notice:54] [2021-05-22 17:27:21.79 UTC] IP 52.29.138.13:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 17:27:21 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.ErrorPolicy:Notice:54] [2021-05-22 17:27:21.79 UTC] IP 3.13.149.172:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 17:27:22 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Error:85236] [2021-05-22 17:27:22.04 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Application Exception: 3.129.158.233:3001 HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30138140) 6dc00b89d466b96707a814959aef377ccdc98e28c76f0e4cd86fc3b05f2aa5c9 (BlockNo 5752057))
May 22 17:27:22 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.ErrorPolicy:Warning:54] [2021-05-22 17:27:22.04 UTC] IP 3.129.158.233:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30138140) 6dc00b89d466b96707a814959aef377ccdc98e28c76f0e4cd86fc3b05f2aa5c9 (BlockNo 5752057))))) 200s 200s
May 22 17:27:22 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Error:85234] [2021-05-22 17:27:22.41 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Application Exception: 3.126.150.220:3001 HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30138140) 6dc00b89d466b96707a814959aef377ccdc98e28c76f0e4cd86fc3b05f2aa5c9 (BlockNo 5752057))
May 22 17:27:22 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.ErrorPolicy:Warning:54] [2021-05-22 17:27:22.41 UTC] IP 3.126.150.220:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce "81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c") (SlotNo 4492800) (Nonce "67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7") (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = "6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212\&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183\&6"}, certifiedProof = CertPraosVRF "@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN'\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX"}))]})))) (Tip (SlotNo 4492799) f8084c61b6a238acec985b59310b6ecec49c0ab8352249afd7268da5cff2a457 (BlockNo 4490510)) (Tip (SlotNo 30138140) 6dc00b89d466b96707a814959aef377ccdc98e28c76f0e4cd86fc3b05f2aa5c9 (BlockNo 5752057))))) 200s 200s
May 22 17:27:31 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Notice:85272] [2021-05-22 17:27:31.64 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 3.126.150.220:3001
May 22 17:27:31 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Notice:85273] [2021-05-22 17:27:31.67 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 18.130.187.168:3001
May 22 17:27:31 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Notice:85274] [2021-05-22 17:27:31.69 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 3.127.133.53:3001
May 22 17:27:31 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Notice:85275] [2021-05-22 17:27:31.72 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 52.29.138.13:3001
May 22 17:27:31 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Notice:85276] [2021-05-22 17:27:31.74 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt Start, destination 3.13.149.172:3001
May 22 17:27:31 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Notice:85272] [2021-05-22 17:27:31.79 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End, destination 3.126.150.220:3001 outcome: ConnectSuccess
May 22 17:27:31 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.DnsSubscription:Notice:85273] [2021-05-22 17:27:31.80 UTC] Domain: "relays-new.cardano-mainnet.iohk.io" Connection Attempt End, destination 18.130.187.168:3001 outcome: ConnectSuccessLast
May 22 17:27:31 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.ErrorPolicy:Notice:54] [2021-05-22 17:27:31.80 UTC] IP 3.127.133.53:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 17:27:31 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.ErrorPolicy:Notice:54] [2021-05-22 17:27:31.80 UTC] IP 52.29.138.13:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
May 22 17:27:31 CarnitasRelay1 cardano-node[1184548]: [Carnitas:cardano.node.ErrorPolicy:Notice:54] [2021-05-22 17:27:31.80 UTC] IP 3.13.149.172:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = "Parallel connection cancelled", seStack = []}))) 1s
1 Like

AWS machines? Still looking but I have a feeling port forwarding is an issue. Makes no sense as these worked for a month prior but everything I am finding is pointing that direction…

I’m using DigitalOcean however since these are test and not going live all firewalls are off.

@ToTheMoonADA Thank you so much!

here is the link to the guide we are doing,
Guide: How to build a Cardano Stake Pool - CoinCashew

1 Like

I’m having the exact same issue and followed the same guide you did @AdaAllDay. It’s interesting because the Shelly era started at Epoch 208, so I think it’s related. I’m just not sure what to do about it. I am self hosted and have verified I have port 6000 forwarded to my relay node.

It seems that the block producing node wants to sync with the relay node and the relay node wants to sync from the peer in the topology file

Worked great right up until the end of epoch 207 then I get these errors:

May 22 17:57:05 crypto-2 cardano-node[1064648]: [crypto-2:cardano.node.BlockFetchDecision:Info:68] [2021-05-22 17:57:05.19 UTC] [TraceLabelPeer (ConnectionId {localAddress = 172.16.10.22:43849, remoteAddress = 172.16.10.21:6000}) (Left FetchDeclineChainNotPlausible),TraceLabelPeer (ConnectionId {localAddress = 172.16.10.22:33591, remoteAddress = 18.158.99.68:3001}) (Left FetchDeclineInFlightOtherPeer),TraceLabelPeer (ConnectionId {localAddress = 172.16.10.22:42747, remoteAddress = 18.159.46.171:3001}) (Right [At (Block {blockPointSlot = SlotNo 4492773, blockPointHash = cf86e7606f115ea36a89d02a64df4131986037fb022b4ac57d9e6641ff94d349}),At (Block {blockPointSlot = SlotNo 4492774, blockPointHash = e18f4e2938583222892ac74fa477b7e008c110786c0becbe12b1a2e75a5afd98}),At (Block {blockPointSlot = SlotNo 4492775, blockPointHash = 53c79734aed5dfbb8c441196eeb9a0b04a19e2ad07c72926b2df418260b27831}),At (Block {blockPointSlot = SlotNo 4492776, blockPointHash = afec71b2722b0693ce82045c68ea86f332927d43c171537d4bb89dae5a854e02}),At (Block {blockPointSlot = SlotNo 4492777, blockPointHash = af94a5faa6f3b599a58d2512b0d6a999f548f7ff6eb2a07405f3f7f8bb1d58f6})])]
May 22 17:57:05 crypto-2 cardano-node[1064648]: [crypto-2:cardano.node.BlockFetchDecision:Info:68] [2021-05-22 17:57:05.31 UTC] [TraceLabelPeer (ConnectionId {localAddress = 172.16.10.22:43849, remoteAddress = 172.16.10.21:6000}) (Left FetchDeclineChainNotPlausible),TraceLabelPeer (ConnectionId {localAddress = 172.16.10.22:33591, remoteAddress = 18.158.99.68:3001}) (Left FetchDeclineInFlightOtherPeer),TraceLabelPeer (ConnectionId {localAddress = 172.16.10.22:42747, remoteAddress = 18.159.46.171:3001}) (Right [At (Block {blockPointSlot = SlotNo 4492778, blockPointHash = b4f1b24a140dd007297232d38e8e0fedce5adf2051a4e7208d1b505fa2bde9ac})])]
May 22 17:57:05 crypto-2 cardano-node[1064648]: [crypto-2:cardano.node.DnsSubscription:Error:11476] [2021-05-22 17:57:05.32 UTC] Domain: “relays-new.cardano-mainnet.iohk.io” Application Exception: 18.159.46.171:3001 HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce “81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c”) (SlotNo 4492800) (Nonce “67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7”) (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = “6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183&6”}, certifiedProof = CertPraosVRF “@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN’\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX”}))]})))) (Tip (SlotNo 4492759) 9f045b56c4129f922c4c40cbf8b9b829033fa4656476d5a5317281190d737bb9 (BlockNo 4490470)) (Tip (SlotNo 30139914) eab3415739a0becfd9b6a125ac91ad5f65b16c1cca76f05fe7f314a0b60cebec (BlockNo 5752157))
May 22 17:57:05 crypto-2 cardano-node[1064648]: [crypto-2:cardano.node.ErrorPolicy:Warning:77] [2021-05-22 17:57:05.32 UTC] IP 18.159.46.171:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce “81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c”) (SlotNo 4492800) (Nonce “67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7”) (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = “6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183&6”}, certifiedProof = CertPraosVRF “@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN’\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX”}))]})))) (Tip (SlotNo 4492759) 9f045b56c4129f922c4c40cbf8b9b829033fa4656476d5a5317281190d737bb9 (BlockNo 4490470)) (Tip (SlotNo 30139914) eab3415739a0becfd9b6a125ac91ad5f65b16c1cca76f05fe7f314a0b60cebec (BlockNo 5752157))))) 200s 200s
May 22 17:57:05 crypto-2 cardano-node[1064648]: [crypto-2:cardano.node.DnsSubscription:Error:11477] [2021-05-22 17:57:05.33 UTC] Domain: “relays-new.cardano-mainnet.iohk.io” Application Exception: 18.158.99.68:3001 HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce “81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c”) (SlotNo 4492800) (Nonce “67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7”) (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = “6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183&6”}, certifiedProof = CertPraosVRF “@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN’\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX”}))]})))) (Tip (SlotNo 4492759) 9f045b56c4129f922c4c40cbf8b9b829033fa4656476d5a5317281190d737bb9 (BlockNo 4490470)) (Tip (SlotNo 30139914) eab3415739a0becfd9b6a125ac91ad5f65b16c1cca76f05fe7f314a0b60cebec (BlockNo 5752157))
May 22 17:57:05 crypto-2 cardano-node[1064648]: [crypto-2:cardano.node.ErrorPolicy:Warning:77] [2021-05-22 17:57:05.33 UTC] IP 18.158.99.68:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 4492800, blockPointHash = aa83acbf5904c0edfe4d79b3689d3d00fcfc553cf360fd2229b98d464c28e9de})) (HeaderProtocolError (HardForkValidationErrFromEra S (Z (WrapValidationErr {unwrapValidationErr = ChainTransitionError [OverlayFailure (VRFKeyBadNonce (Nonce “81e47a19e6b29b0a65b9591762ce5143ed30d0261e5d24a3201752506b20f15c”) (SlotNo 4492800) (Nonce “67f10d861ce22c2afcdc48cb20dc1014e7b2ca97319ac945326ccf3425a5a2e7”) (CertifiedVRF {certifiedOutput = OutputVRF {getOutputVRFBytes = “6\236Sx\209\245\EOT\SUBY\235\141\150\230\GS\233o\tP\251A\180\159\245\DC1\247\188\DEL\209\t\212&8>\GS$\190p4\230t\156f\DC2p\r\213\206\176\198ew\184\138\EM\174(k\DC3!\209[\206\SUB\183&6”}, certifiedProof = CertPraosVRF “@Z\163p\255\NUL\149D\162\190J\165\188R\196Ec3\244\249\182W\GSf\197Y\r.V)\208\139:6\t\244\189\ENQ\STX\237]\v\225\171\219\DEL*\183j\174\174G\254\DC1\ESC\ETX5\164\228\222\246F\147\SYN’\148\184\211\193\202qP\SI\SYN\177\226DrL\ETX”}))]})))) (Tip (SlotNo 4492759) 9f045b56c4129f922c4c40cbf8b9b829033fa4656476d5a5317281190d737bb9 (BlockNo 4490470)) (Tip (SlotNo 30139914) eab3415739a0becfd9b6a125ac91ad5f65b16c1cca76f05fe7f314a0b60cebec (BlockNo 5752157))))) 200s 200s
May 22 17:57:05 crypto-2 cardano-node[1064648]: [crypto-2:cardano.node.BlockFetchDecision:Info:68] [2021-05-22 17:57:05.33 UTC] before next, messages elided = 1
May 22 17:57:05 crypto-2 cardano-node[1064648]: [crypto-2:cardano.node.BlockFetchDecision:Info:68] [2021-05-22 17:57:05.33 UTC] [TraceLabelPeer (ConnectionId {localAddress = 172.16.10.22:43849, remoteAddress = 172.16.10.21:6000}) (Left FetchDeclineChainNotPlausible),TraceLabelPeer (ConnectionId {localAddress = 172.16.10.22:33591, remoteAddress = 18.158.99.68:3001}) (Left FetchDeclineInFlightOtherPeer),TraceLabelPeer (ConnectionId {localAddress = 172.16.10.22:42747, remoteAddress = 18.159.46.171:3001}) (Right [At (Block {blockPointSlot = SlotNo 4492781, blockPointHash = 541ba0e498b7c3f926b27a53923b73566c1d1a6b694a9648eed0f479676bd24c}),At (Block {blockPointSlot = SlotNo 4492782, blockPointHash = 6fed2fb10404749c50b1c566a1654286ec2cf7a0fbcf311a7b708970c8bbf65d}),At (Block {blockPointSlot = SlotNo 4492783, blockPointHash = 7b0944f613d6bfa7ce692179f01298ddfd37f21fae294d143300c026c937202c}),At (Block {blockPointSlot = SlotNo 4492784, blockPointHash = ef317bc5b803a3b2b2e93189e54602789717051d7c68e0e4998c405b9a84ec89}),At (Block {blockPointSlot = SlotNo 4492785, blockPointHash = 296dee05f9adff0818bfa20ff85db8d56a25ca3c707c9f727beccbfb1ed08268}),At (Block {blockPointSlot = SlotNo 4492786, blockPointHash = 2e64ba001cacad3f11492178b6a65cf39bec8580bd24fd38949b08e3048a85c4}),At (Block {blockPointSlot = SlotNo 4492787, blockPointHash = 8c2da336b1ff49ee6f46fb2c414251e2aaca2982d2a4a6ea68e1ad1cad5227df}),At (Block {blockPointSlot = SlotNo 4492788, blockPointHash = e6fd47586aedffadd7c8c1a41ee9bf7219b3aa6ac895add7f5b081731877a516}),At (Block {blockPointSlot = SlotNo 4492789, blockPointHash = deb06c6d7f5bfd34f831bdeef6e6296943f27f7d398896d2c53637fc3e95dede}),At (Block {blockPointSlot = SlotNo 4492790, blockPointHash = 762279b67c650af23245f9377fa379209f2e48822930bd4c68c4a0af399ee8e5}),At (Block {blockPointSlot = SlotNo 4492791, blockPointHash = b33886367730f6e8f75250520b783e2c47c933d5e09aa8e3d593489561688e9f}),At (Block {blockPointSlot = SlotNo 4492792, blockPointHash = 2560861214cf7431455ba8a93d645e947ab533cf00a0092a149e47b9aef4ba25}),At (Block {blockPointSlot = SlotNo 4492793, blockPointHash = a5a5c235200bbe91f16cd3e5dcb67369c25dcfb1279c83d22021f5d960c485e6}),At (Block {blockPointSlot = SlotNo 4492794, blockPointHash = 5c196e7394ace0449ba5a51c919369699b13896e97432894b4f0354dce8670b6}),At (Block {blockPointSlot = SlotNo 4492795, blockPointHash = 2548ad5d0d9d33d50ab43151f574474454017a733e307229fa509c4987ca9782})])]

1 Like

I will build a node from scratch in a bit and get back to this thread with some findings. It maybe an real issue with the 1.27 release…

For what its worth I had no issues till 1.27… so dont spend to much time rebuilding machines (I’ve already spent it for you :slight_smile: )

have you try downgrading to 1.26.2 ; allowing for a full sync then upgrading to 1.27.0?

Ok, just fixed it!. check the last comment in this thread:

I replaced these files on both my block producer and relay’s cardano-my-node directory with the ones from the mainnet link there. Then restart the cardano service on both nodes.
mainnet-byron-genesis.json
mainnet-config.json
mainnet-shelley-genesis.json
mainnet-topology.json

4 Likes