Testnet Not Syncing After 99% Please see the logs sent below

Aug 10 04:46:49 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:46:49.30 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Failed to start all required subscriptions
Aug 10 04:46:59 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:46:59.18 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2a05:d014:e00:a202:0:1:0:3]:3001
Aug 10 04:46:59 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:46:59.18 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2a05:d01c:321:2100:0:1:0:3]:3001
Aug 10 04:46:59 AZUSWVLNX00737 cardanorelay[1316391]: #033[35m[AZUSWVLN:cardano.node.DnsSubscription:Notice:1318]#033[0m [2022-08-10 11:46:59.18 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 184.169.196.177:3001
Aug 10 04:46:59 AZUSWVLNX00737 cardanorelay[1316391]: #033[35m[AZUSWVLN:cardano.node.DnsSubscription:Notice:1318]#033[0m [2022-08-10 11:46:59.18 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt End, destination 184.169.196.177:3001 outcome: ConnectSuccessLast
Aug 10 04:46:59 AZUSWVLNX00737 cardanorelay[1316391]: #033[31m[AZUSWVLN:cardano.node.DnsSubscription:Error:1318]#033[0m [2022-08-10 11:46:59.23 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Application Exception: 184.169.196.177:3001 HeaderError (At (Block {blockPointSlot = SlotNo 64387391, blockPointHash = f58545f02a8961b17256a888ea2722bcf60fd4fe25e317daa96c6391048d97f2})) (HeaderEnvelopeError (OtherHeaderEnvelopeError (HardForkEnvelopeErrFromEra S (S (S (S (S (Z (WrapEnvelopeErr {unwrapEnvelopeErr = ObsoleteNode 7 6}))))))))) (Tip (SlotNo 64387360) 6eabf4fe6c29694bac6a1e73ee6412721b9a0c23a618f8f19e64b65e2d80331f (BlockNo 3734422)) (Tip (SlotNo 65762676) 137cf9a7a0f990bb841fedad4f17ffcbc020ce5b8fb4f10d82c12153c1a8dacf (BlockNo 3770442))
Aug 10 04:46:59 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.ErrorPolicy:Warning:559]#033[0m [2022-08-10 11:46:59.23 UTC] IP 184.169.196.177:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 64387391, blockPointHash = f58545f02a8961b17256a888ea2722bcf60fd4fe25e317daa96c6391048d97f2})) (HeaderEnvelopeError (OtherHeaderEnvelopeError (HardForkEnvelopeErrFromEra S (S (S (S (S (Z (WrapEnvelopeErr {unwrapEnvelopeErr = ObsoleteNode 7 6}))))))))) (Tip (SlotNo 64387360) 6eabf4fe6c29694bac6a1e73ee6412721b9a0c23a618f8f19e64b65e2d80331f (BlockNo 3734422)) (Tip (SlotNo 65762676) 137cf9a7a0f990bb841fedad4f17ffcbc020ce5b8fb4f10d82c12153c1a8dacf (BlockNo 3770442))))) 200s 200s
Aug 10 04:46:59 AZUSWVLNX00737 cardanorelay[1316391]: #033[31m[AZUSWVLN:cardano.node.DnsSubscription:Error:1315]#033[0m [2022-08-10 11:46:59.30 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Application Exception: 3.72.137.52:3001 ExceededTimeLimit (Handshake) (ServerAgency TokConfirm)
Aug 10 04:46:59 AZUSWVLNX00737 cardanorelay[1316391]: #033[35m[AZUSWVLN:cardano.node.ErrorPolicy:Notice:559]#033[0m [2022-08-10 11:46:59.30 UTC] IP 3.72.137.52:3001 ErrorPolicySuspendConsumer (Just (ApplicationExceptionTrace ExceededTimeLimit (Handshake) (ServerAgency TokConfirm))) 20s
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:09.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2a05:d01c:321:2100:0:1:0:3]:3001
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:09.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2600:1f16:fae:3000:0:1:0:2]:3001
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[35m[AZUSWVLN:cardano.node.DnsSubscription:Notice:1337]#033[0m [2022-08-10 11:47:09.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 184.169.196.177:3001
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:09.16 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2600:1f1c:d4f:6d00:0:1:0:1]:3001
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[35m[AZUSWVLN:cardano.node.DnsSubscription:Notice:1337]#033[0m [2022-08-10 11:47:09.16 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt End, destination 184.169.196.177:3001 outcome: ConnectSuccess
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:09.16 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2406:da18:99d:9200:0:1:0:4]:3001
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:09.16 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2406:da14:5df:b300:0:1:0:3]:3001
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[35m[AZUSWVLN:cardano.node.DnsSubscription:Notice:1338]#033[0m [2022-08-10 11:47:09.16 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 13.41.9.54:3001
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:09.19 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2406:da14:5df:b300:0:1:0:1]:3001
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:09.19 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2a05:d014:e00:a201:0:1:0:2]:3001
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:09.19 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2a05:d014:e00:a202:0:1:0:3]:3001
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[35m[AZUSWVLN:cardano.node.DnsSubscription:Notice:1352]#033[0m [2022-08-10 11:47:09.19 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 54.199.108.71:3001
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[31m[AZUSWVLN:cardano.node.DnsSubscription:Error:1337]#033[0m [2022-08-10 11:47:09.25 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Application Exception: 184.169.196.177:3001 HeaderError (At (Block {blockPointSlot = SlotNo 64387391, blockPointHash = f58545f02a8961b17256a888ea2722bcf60fd4fe25e317daa96c6391048d97f2})) (HeaderEnvelopeError (OtherHeaderEnvelopeError (HardForkEnvelopeErrFromEra S (S (S (S (S (Z (WrapEnvelopeErr {unwrapEnvelopeErr = ObsoleteNode 7 6}))))))))) (Tip (SlotNo 64387360) 6eabf4fe6c29694bac6a1e73ee6412721b9a0c23a618f8f19e64b65e2d80331f (BlockNo 3734422)) (Tip (SlotNo 65762676) 137cf9a7a0f990bb841fedad4f17ffcbc020ce5b8fb4f10d82c12153c1a8dacf (BlockNo 3770442))
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.ErrorPolicy:Warning:559]#033[0m [2022-08-10 11:47:09.25 UTC] IP 184.169.196.177:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 64387391, blockPointHash = f58545f02a8961b17256a888ea2722bcf60fd4fe25e317daa96c6391048d97f2})) (HeaderEnvelopeError (OtherHeaderEnvelopeError (HardForkEnvelopeErrFromEra S (S (S (S (S (Z (WrapEnvelopeErr {unwrapEnvelopeErr = ObsoleteNode 7 6}))))))))) (Tip (SlotNo 64387360) 6eabf4fe6c29694bac6a1e73ee6412721b9a0c23a618f8f19e64b65e2d80331f (BlockNo 3734422)) (Tip (SlotNo 65762676) 137cf9a7a0f990bb841fedad4f17ffcbc020ce5b8fb4f10d82c12153c1a8dacf (BlockNo 3770442))))) 200s 200s
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[35m[AZUSWVLN:cardano.node.DnsSubscription:Notice:1352]#033[0m [2022-08-10 11:47:09.30 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt End, destination 54.199.108.71:3001 outcome: ConnectSuccess
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[35m[AZUSWVLN:cardano.node.DnsSubscription:Notice:1338]#033[0m [2022-08-10 11:47:09.31 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt End, destination 13.41.9.54:3001 outcome: ConnectSuccessLast
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[31m[AZUSWVLN:cardano.node.DnsSubscription:Error:1352]#033[0m [2022-08-10 11:47:09.78 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Application Exception: 54.199.108.71:3001 HeaderError (At (Block {blockPointSlot = SlotNo 64387391, blockPointHash = f58545f02a8961b17256a888ea2722bcf60fd4fe25e317daa96c6391048d97f2})) (HeaderEnvelopeError (OtherHeaderEnvelopeError (HardForkEnvelopeErrFromEra S (S (S (S (S (Z (WrapEnvelopeErr {unwrapEnvelopeErr = ObsoleteNode 7 6}))))))))) (Tip (SlotNo 64387360) 6eabf4fe6c29694bac6a1e73ee6412721b9a0c23a618f8f19e64b65e2d80331f (BlockNo 3734422)) (Tip (SlotNo 65762676) 137cf9a7a0f990bb841fedad4f17ffcbc020ce5b8fb4f10d82c12153c1a8dacf (BlockNo 3770442))
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.ErrorPolicy:Warning:559]#033[0m [2022-08-10 11:47:09.78 UTC] IP 54.199.108.71:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 64387391, blockPointHash = f58545f02a8961b17256a888ea2722bcf60fd4fe25e317daa96c6391048d97f2})) (HeaderEnvelopeError (OtherHeaderEnvelopeError (HardForkEnvelopeErrFromEra S (S (S (S (S (Z (WrapEnvelopeErr {unwrapEnvelopeErr = ObsoleteNode 7 6}))))))))) (Tip (SlotNo 64387360) 6eabf4fe6c29694bac6a1e73ee6412721b9a0c23a618f8f19e64b65e2d80331f (BlockNo 3734422)) (Tip (SlotNo 65762676) 137cf9a7a0f990bb841fedad4f17ffcbc020ce5b8fb4f10d82c12153c1a8dacf (BlockNo 3770442))))) 200s 200s
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[31m[AZUSWVLN:cardano.node.DnsSubscription:Error:1338]#033[0m [2022-08-10 11:47:09.94 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Application Exception: 13.41.9.54:3001 HeaderError (At (Block {blockPointSlot = SlotNo 64387391, blockPointHash = f58545f02a8961b17256a888ea2722bcf60fd4fe25e317daa96c6391048d97f2})) (HeaderEnvelopeError (OtherHeaderEnvelopeError (HardForkEnvelopeErrFromEra S (S (S (S (S (Z (WrapEnvelopeErr {unwrapEnvelopeErr = ObsoleteNode 7 6}))))))))) (Tip (SlotNo 64387360) 6eabf4fe6c29694bac6a1e73ee6412721b9a0c23a618f8f19e64b65e2d80331f (BlockNo 3734422)) (Tip (SlotNo 65762676) 137cf9a7a0f990bb841fedad4f17ffcbc020ce5b8fb4f10d82c12153c1a8dacf (BlockNo 3770442))
Aug 10 04:47:09 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.ErrorPolicy:Warning:559]#033[0m [2022-08-10 11:47:09.94 UTC] IP 13.41.9.54:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 64387391, blockPointHash = f58545f02a8961b17256a888ea2722bcf60fd4fe25e317daa96c6391048d97f2})) (HeaderEnvelopeError (OtherHeaderEnvelopeError (HardForkEnvelopeErrFromEra S (S (S (S (S (Z (WrapEnvelopeErr {unwrapEnvelopeErr = ObsoleteNode 7 6}))))))))) (Tip (SlotNo 64387360) 6eabf4fe6c29694bac6a1e73ee6412721b9a0c23a618f8f19e64b65e2d80331f (BlockNo 3734422)) (Tip (SlotNo 65762676) 137cf9a7a0f990bb841fedad4f17ffcbc020ce5b8fb4f10d82c12153c1a8dacf (BlockNo 3770442))))) 200s 200s
Aug 10 04:47:19 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:19.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2600:1f16:fae:3000:0:1:0:2]:3001
Aug 10 04:47:19 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:19.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2600:1f1c:d4f:6d00:0:1:0:1]:3001
Aug 10 04:47:19 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:19.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2406:da18:99d:9200:0:1:0:4]:3001
Aug 10 04:47:19 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:19.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2406:da14:5df:b300:0:1:0:3]:3001
Aug 10 04:47:19 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:19.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2406:da14:5df:b300:0:1:0:1]:3001
Aug 10 04:47:19 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:19.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2a05:d014:e00:a201:0:1:0:2]:3001
Aug 10 04:47:19 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:19.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2a05:d014:e00:a202:0:1:0:3]:3001
Aug 10 04:47:19 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:19.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2a05:d01c:321:2100:0:1:0:3]:3001
Aug 10 04:47:19 AZUSWVLNX00737 cardanorelay[1316391]: #033[35m[AZUSWVLN:cardano.node.DnsSubscription:Notice:1387]#033[0m [2022-08-10 11:47:19.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 184.169.196.177:3001
Aug 10 04:47:19 AZUSWVLNX00737 cardanorelay[1316391]: #033[35m[AZUSWVLN:cardano.node.DnsSubscription:Notice:1387]#033[0m [2022-08-10 11:47:19.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt End, destination 184.169.196.177:3001 outcome: ConnectSuccess
Aug 10 04:47:19 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:19.16 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Failed to start all required subscriptions
Aug 10 04:47:20 AZUSWVLNX00737 cardanorelay[1316391]: #033[31m[AZUSWVLN:cardano.node.DnsSubscription:Error:1387]#033[0m [2022-08-10 11:47:20.15 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Application Exception: 184.169.196.177:3001 MuxError MuxBearerClosed "<socket: 86> closed when reading data, waiting on next header True"
Aug 10 04:47:20 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.ErrorPolicy:Warning:559]#033[0m [2022-08-10 11:47:20.15 UTC] IP 184.169.196.177:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (MuxError MuxBearerClosed "<socket: 86> closed when reading data, waiting on next header True"))) 20s 20s
Aug 10 04:47:29 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:29.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2600:1f1c:d4f:6d00:0:1:0:1]:3001
Aug 10 04:47:29 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:29.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2406:da18:99d:9200:0:1:0:4]:3001
Aug 10 04:47:29 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:29.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2406:da14:5df:b300:0:1:0:3]:3001
Aug 10 04:47:29 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:29.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2406:da14:5df:b300:0:1:0:1]:3001
Aug 10 04:47:29 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:29.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2a05:d014:e00:a201:0:1:0:2]:3001
Aug 10 04:47:29 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:29.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2a05:d014:e00:a202:0:1:0:3]:3001
Aug 10 04:47:29 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:29.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2a05:d01c:321:2100:0:1:0:3]:3001
Aug 10 04:47:29 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:29.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2600:1f16:fae:3000:0:1:0:2]:3001
Aug 10 04:47:29 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:29.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Failed to start all required subscriptions
Aug 10 04:47:39 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:39.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2406:da18:99d:9200:0:1:0:4]:3001
Aug 10 04:47:39 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:39.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2406:da14:5df:b300:0:1:0:3]:3001
Aug 10 04:47:39 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:39.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2406:da14:5df:b300:0:1:0:1]:3001
Aug 10 04:47:39 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:39.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2a05:d014:e00:a201:0:1:0:2]:3001
Aug 10 04:47:39 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:39.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2a05:d014:e00:a202:0:1:0:3]:3001
Aug 10 04:47:39 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:39.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2a05:d01c:321:2100:0:1:0:3]:3001
Aug 10 04:47:39 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:39.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2600:1f16:fae:3000:0:1:0:2]:3001
Aug 10 04:47:39 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:39.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2600:1f1c:d4f:6d00:0:1:0:1]:3001
Aug 10 04:47:39 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:39.21 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Failed to start all required subscriptions
Aug 10 04:47:49 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:49.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2406:da14:5df:b300:0:1:0:3]:3001
Aug 10 04:47:49 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:49.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2406:da14:5df:b300:0:1:0:1]:3001
Aug 10 04:47:49 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:49.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2a05:d014:e00:a201:0:1:0:2]:3001
Aug 10 04:47:49 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:49.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2a05:d014:e00:a202:0:1:0:3]:3001
Aug 10 04:47:49 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:49.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2a05:d01c:321:2100:0:1:0:3]:3001
Aug 10 04:47:49 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:49.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2600:1f16:fae:3000:0:1:0:2]:3001
Aug 10 04:47:49 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:49.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2600:1f1c:d4f:6d00:0:1:0:1]:3001
Aug 10 04:47:49 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:49.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Unsupported remote target address [2406:da18:99d:9200:0:1:0:4]:3001
Aug 10 04:47:49 AZUSWVLNX00737 cardanorelay[1316391]: #033[35m[AZUSWVLN:cardano.node.DnsSubscription:Notice:1395]#033[0m [2022-08-10 11:47:49.14 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 184.169.196.177:3001
Aug 10 04:47:49 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.DnsSubscription:Warning:561]#033[0m [2022-08-10 11:47:49.22 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Failed to start all required subscriptions
Aug 10 04:47:49 AZUSWVLNX00737 cardanorelay[1316391]: #033[35m[AZUSWVLN:cardano.node.DnsSubscription:Notice:1395]#033[0m [2022-08-10 11:47:49.22 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt End, destination 184.169.196.177:3001 outcome: ConnectSuccess
Aug 10 04:47:49 AZUSWVLNX00737 cardanorelay[1316391]: #033[31m[AZUSWVLN:cardano.node.DnsSubscription:Error:1395]#033[0m [2022-08-10 11:47:49.29 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Application Exception: 184.169.196.177:3001 HeaderError (At (Block {blockPointSlot = SlotNo 64387391, blockPointHash = f58545f02a8961b17256a888ea2722bcf60fd4fe25e317daa96c6391048d97f2})) (HeaderEnvelopeError (OtherHeaderEnvelopeError (HardForkEnvelopeErrFromEra S (S (S (S (S (Z (WrapEnvelopeErr {unwrapEnvelopeErr = ObsoleteNode 7 6}))))))))) (Tip (SlotNo 64387360) 6eabf4fe6c29694bac6a1e73ee6412721b9a0c23a618f8f19e64b65e2d80331f (BlockNo 3734422)) (Tip (SlotNo 65762824) fdfc78eee612e0df9c8277d34339cf5b26cba93ac8136665a6d0b8b871391ea3 (BlockNo 3770443))
Aug 10 04:47:49 AZUSWVLNX00737 cardanorelay[1316391]: #033[33m[AZUSWVLN:cardano.node.ErrorPolicy:Warning:559]#033[0m [2022-08-10 11:47:49.29 UTC] IP 184.169.196.177:3001 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (HeaderError (At (Block {blockPointSlot = SlotNo 64387391, blockPointHash = f58545f02a8961b17256a888ea2722bcf60fd4fe25e317daa96c6391048d97f2})) (HeaderEnvelopeError (OtherHeaderEnvelopeError (HardForkEnvelopeErrFromEra S (S (S (S (S (Z (WrapEnvelopeErr {unwrapEnvelopeErr = ObsoleteNode 7 6}))))))))) (Tip (SlotNo 64387360) 6eabf4fe6c29694bac6a1e73ee6412721b9a0c23a618f8f19e64b65e2d80331f (BlockNo 3734422)) (Tip (SlotNo 65762824) fdfc78eee612e0df9c8277d34339cf5b26cba93ac8136665a6d0b8b871391ea3 (BlockNo 3770443))))) 200

Hi,

Which version did u install?

Cheers,

we recently updated the version to 1.35

Due to the testing of the Vasil hard fork, testnet is currently somehow in a state of flux. The latest information is that testnet should be run with 1.35.2:

If you are running a node, you should maybe follow https://t.me/SPOannouncements and/or https://discord.com/invite/78G5WDRP47.

3 Likes
Aug 16 03:54:59 AZUSWVLNX00737 cardanorelay[2034929]: #033[33m[AZUSWVLN:cardano.node.ErrorPolicy:Warning:67]#033[0m [2022-08-16 10:54:59.70 UTC] IP 172.30.213.9:37715 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (MuxError (MuxIOException Network.Socket.recvBuf: resource vanished (Connection reset by peer)) "(recv errored)"))) 20s 20s
Aug 16 03:58:20 AZUSWVLNX00737 cardanorelay[2034929]: #033[33m[AZUSWVLN:cardano.node.ErrorPolicy:Warning:67]#033[0m [2022-08-16 10:58:20.72 UTC] IP 172.30.213.9:36089 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (MuxError (MuxIOException Network.Socket.recvBuf: resource vanished (Connection reset by peer)) "(recv errored)"))) 20s 20s
Aug 16 04:00:11 AZUSWVLNX00737 cardanorelay[2034929]: #033[33m[AZUSWVLN:cardano.node.ErrorPolicy:Warning:67]#033[0m [2022-08-16 11:00:11.76 UTC] IP 172.30.213.9:33085 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (MuxError (MuxIOException Network.Socket.recvBuf: resource vanished (Connection reset by peer)) "(recv errored)"))) 20s 20s
Aug 16 04:03:32 AZUSWVLNX00737 cardanorelay[2034929]: #033[33m[AZUSWVLN:cardano.node.ErrorPolicy:Warning:67]#033[0m [2022-08-16 11:03:32.79 UTC] IP 172.30.213.9:33517 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (MuxError (MuxIOException Network.Socket.recvBuf: resource vanished (Connection reset by peer)) "(recv errored)"))) 20s 20s
Aug 16 04:06:33 AZUSWVLNX00737 cardanorelay[2034929]: #033[33m[AZUSWVLN:cardano.node.ErrorPolicy:Warning:67]#033[0m [2022-08-16 11:06:33.83 UTC] IP 172.30.213.9:33749 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (MuxError (MuxIOException Network.Socket.recvBuf: resource vanished (Connection reset by peer)) "(recv errored)"))) 20s 20s
Aug 16 04:09:09 AZUSWVLNX00737 cardanorelay[2034929]: #033[33m[AZUSWVLN:cardano.node.ErrorPolicy:Warning:67]#033[0m [2022-08-16 11:09:09.87 UTC] IP 172.30.213.9:40229 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (MuxError (MuxIOException Network.Socket.recvBuf: resource vanished (Connection reset by peer)) "(recv errored)"))) 20s 20s
Aug 16 04:11:45 AZUSWVLNX00737 cardanorelay[2034929]: #033[33m[AZUSWVLN:cardano.node.ErrorPolicy:Warning:67]#033[0m [2022-08-16 11:11:45.92 UTC] IP 172.30.213.9:42873 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (MuxError (MuxIOException Network.Socket.recvBuf: resource vanished (Connection reset by peer)) "(recv errored)"))) 20s 20s
Aug 16 04:16:15 AZUSWVLNX00737 cardanorelay[2034929]: #033[33m[AZUSWVLN:cardano.node.ErrorPolicy:Warning:67]#033[0m [2022-08-16 11:16:15.96 UTC] IP 172.30.213.9:36241 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (MuxError (MuxIOException Network.Socket.recvBuf: resource vanished (Connection reset by peer)) "(recv errored)"))) 20s 20s
Aug 16 04:19:16 AZUSWVLNX00737 cardanorelay[2034929]: #033[33m[AZUSWVLN:cardano.node.ErrorPolicy:Warning:67]#033[0m [2022-08-16 11:19:16.97 UTC] IP 172.30.213.9:42541 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (MuxError (MuxIOException Network.Socket.recvBuf: resource vanished (Connection reset by peer)) "(recv errored)"))) 20s 20s
Aug 16 04:22:38 AZUSWVLNX00737 cardanorelay[2034929]: #033[33m[AZUSWVLN:cardano.node.ErrorPolicy:Warning:67]#033[0m [2022-08-16 11:22:38.02 UTC] IP 172.30.213.9:42597 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (MuxError (MuxIOException Network.Socket.recvBuf: resource vanished (Connection reset by peer)) "(recv errored)"))) 20s 20s
Aug 16 04:27:28 AZUSWVLNX00737 cardanorelay[2034929]: #033[33m[AZUSWVLN:cardano.node.ErrorPolicy:Warning:67]#033[0m [2022-08-16 11:27:28.04 UTC] IP 172.30.213.9:43661 ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (MuxError (MuxIOException Network.Socket.recvBuf: resource vanished (Connection reset by peer)) "(recv errored)"))) 20s 20s

We have updated t 1.35.3 as we didn’t find 1.35.2 repo anywhere but, facing the above issue.
Below is the status from the gLive:
CardanoSyn

As said: 1.35.3 will not work on testnet. It really won’t.

Since they haven’t done a release of 1.35.2, you will have to compile it. Just checkout 1.35.2 from the Github instead of the latest version.

2 Likes

May I know the process ? how and where to download and install the 1.35.2 version. please if you have a runbook

You could follow: https://developers.cardano.org/docs/get-started/installing-cardano-node/

But replace git checkout $(curl -s https://api.github.com/repos/input-output-hk/cardano-node/releases/latest | jq -r .tag_name) by git checkout 1.35.2 (since you want exactly that version).

1 Like

https://api.github.com/repos/input-output-hk/cardano-node/releases doesn’t have 1.35.2 at all… how do we checkout ? but, what we found is it is present at Release 1.35.2: Merge pull request #4220 from input-output-hk/jordan/release-1.35-deps · input-output-hk/cardano-node · GitHub

Yes, it is present as a tag. They just did not make a release of it (to prevent people installing it on mainnet and breaking everything).

And, since it is a tag, you can check it out with git checkout 1.35.2.

This really worked and thanks a ton but, facing the below issue while submitting the signed certs for our stakepool:
[7:04 PM] Siripurapu, Siva Krishna
Command failed: transaction submit Error: Error while submitting tx: ShelleyTxValidationError ShelleyBasedEraBabbage (ApplyTxError [DelegsFailure (DelplFailure (DelegFailure (StakeDelegationImpossibleDELEG (KeyHashObj (KeyHash “9674eed46230c507db0553a1e69aed38e557096c70b98b0234bb95a1”)))))])

According to https://forum.cardano.org/t/error-while-submitting-stake-pool-registration-transaction/78064/14, StakeDelegationImpossibleDELEG happens if the stake address of (one of) the pool owners is not registered. That has to be done first.

Is it a fact that testnet won’t work on 1.35.3 at all? We started our testnet node on 1.35.3 and when it reached 95% or so, it got stuck on starting.


>
{"app":[],"at":"2022-08-28T13:25:00.81Z","data":{"address":"35.203.146.206:6000","event":"ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (InvalidBlock (At (B>
{"app":[],"at":"2022-08-28T13:25:00.85Z","data":{"domain":"\"nt4.paradoxicalsphere.com\"","event":"Application Exception: 209.121.143.41:6081 InvalidBlock (At (Block >
{"app":[],"at":"2022-08-28T13:25:00.85Z","data":{"address":"209.121.143.41:6081","event":"ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (InvalidBlock (At (B>
{"app":[],"at":"2022-08-28T13:25:01.12Z","data":{"address":"213.32.245.149:3001","event":"ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (InvalidBlock (At (B>
{"app":[],"at":"2022-08-28T13:25:01.22Z","data":{"address":"95.216.173.194:6666","event":"ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (InvalidBlock (At (B>
{"app":[],"at":"2022-08-28T13:25:01.23Z","data":{"address":"195.191.47.222:6000","event":"ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (InvalidBlock (At (B>
{"app":[],"at":"2022-08-28T13:25:05.73Z","data":{"address":"172.8.215.51:43405","event":"ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (MuxError (MuxIOExcep>
{"app":[],"at":"2022-08-28T13:25:10.58Z","data":{"domain":"\"node1.cardano.gratis\"","event":"Failed to start all required subscriptions","kind":"SubscriptionTrace"},>
{"app":[],"at":"2022-08-28T13:25:10.58Z","data":{"domain":"\"cardanorelay2.ddns.net\"","event":"Failed to start all required subscriptions","kind":"SubscriptionTrace">
{"app":[],"at":"2022-08-28T13:25:10.58Z","data":{"domain":"\"nt4.paradoxicalsphere.com\"","event":"Failed to start all required subscriptions","kind":"SubscriptionTra>
{"app":[],"at":"2022-08-28T13:25:11.07Z","data":{"address":"213.32.245.149:3001","event":"ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (InvalidBlock (At (B>
{"app":[],"at":"2022-08-28T13:25:11.15Z","data":{"address":"95.216.173.194:6666","event":"ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (InvalidBlock (At (B>
{"app":[],"at":"2022-08-28T13:25:11.20Z","data":{"address":"195.191.47.222:6000","event":"ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (InvalidBlock (At (B>
{"app":[],"at":"2022-08-28T13:25:20.58Z","data":{"domain":"\"nt4.paradoxicalsphere.com\"","event":"Failed to start all required subscriptions","kind":"SubscriptionTra>
{"app":[],"at":"2022-08-28T13:25:20.58Z","data":{"domain":"\"node1.cardano.gratis\"","event":"Failed to start all required subscriptions","kind":"SubscriptionTrace"},>
{"app":[],"at":"2022-08-28T13:25:20.58Z","data":{"domain":"\"cardanorelay2.ddns.net\"","event":"Failed to start all required subscriptions","kind":"SubscriptionTrace">
{"app":[],"at":"2022-08-28T13:25:30.58Z","data":{"domain":"\"nt4.paradoxicalsphere.com\"","event":"Failed to start all required subscriptions","kind":"SubscriptionTra>
{"app":[],"at":"2022-08-28T13:25:30.58Z","data":{"domain":"\"node1.cardano.gratis\"","event":"Failed to start all required subscriptions","kind":"SubscriptionTrace"},>
{"app":[],"at":"2022-08-28T13:25:30.61Z","data":{"domain":"\"cardanorelay2.ddns.net\"","event":"Failed to start all required subscriptions","kind":"SubscriptionTrace">
{"app":[],"at":"2022-08-28T13:25:40.58Z","data":{"domain":"\"cardanorelay2.ddns.net\"","event":"Failed to start all required subscriptions","kind":"SubscriptionTrace">
{"app":[],"at":"2022-08-28T13:25:40.58Z","data":{"domain":"\"nt4.paradoxicalsphere.com\"","event":"Failed to start all required subscriptions","kind":"SubscriptionTra>
{"app":[],"at":"2022-08-28T13:25:40.58Z","data":{"domain":"\"node1.cardano.gratis\"","event":"Failed to start all required subscriptions","kind":"SubscriptionTrace"},>
{"app":[],"at":"2022-08-28T13:25:50.59Z","data":{"domain":"\"cardanorelay2.ddns.net\"","event":"Failed to start all required subscriptions","kind":"SubscriptionTrace">
{"app":[],"at":"2022-08-28T13:25:50.59Z","data":{"domain":"\"nt4.paradoxicalsphere.com\"","event":"Failed to start all required subscriptions","kind":"SubscriptionTra>
{"app":[],"at":"2022-08-28T13:25:50.59Z","data":{"domain":"\"node1.cardano.gratis\"","event":"Failed to start all required subscriptions","kind":"SubscriptionTrace"},>
{"app":[],"at":"2022-08-28T13:26:00.59Z","data":{"domain":"\"nt4.paradoxicalsphere.com\"","event":"Failed to start all required subscriptions","kind":"SubscriptionTra>
{"app":[],"at":"2022-08-28T13:26:00.59Z","data":{"domain":"\"cardanorelay2.ddns.net\"","event":"Failed to start all required subscriptions","kind":"SubscriptionTrace">
{"app":[],"at":"2022-08-28T13:26:00.59Z","data":{"domain":"\"node1.cardano.gratis\"","event":"Failed to start all required subscriptions","kind":"SubscriptionTrace"},>
{"app":[],"at":"2022-08-28T13:26:01.96Z","data":{"kind":"LogMessage","message":"tx-submit-webapi.Network.Socket.bind: resource busy (Address already in use)"},"env":">

image

As far as I understand, the ‘legacy’ testnet will not work with 1.35.3. It only works up to 1.35.2. If you check out the IOG announcements surrounding this, they have this table for what node version as well as other information - Discord

nt4.paradoxicalsphere.com that shows up in your log messages is my subdomain. I shut off the preprod node this morning. Does that help?

CHG

Hey how is it going. We solved it by downgrading the testnet relay to 1.35.2 to fix this issue. Good to hear from you tho :+1:t4: