Starting new: node doesn't start/sync

A friend asked me to help him get a stake pool setup so I’ve been investigating for a couple of weeks. Cardano stake pooling seems pretty interesting and something I’d like to work on getting up and running. I have some linux experience, but brand new to Cardano and the crypto environment.

I’m running ubuntu 20.04 and using the cardano-foundation videos/guild, coincashew, and guild operators documentation.

I’ve been able to work through getting prereqs installed and building the node. Have NOT been able to get it to start up correctly.

When I get to startup I run this:

 cardano-node run \
 --topology testnet-topology.json \
 --database-path db \
 --socket-path db/node.socket \
 --host-addr  0.0.0.0 \
 --port 3001 \
 --config testnet-config.json

And get output like this:

Listening on http://127.0.0.1:12798
[relay-CN:cardano.node.networkMagic:Notice:5] [2021-04-20 17:13:08.50 UTC] NetworkMagic 1097911063
[relay-CN:cardano.node.basicInfo.protocol:Notice:5] [2021-04-20 17:13:08.50 UTC] Byron; Shelley
[relay-CN:cardano.node.basicInfo.version:Notice:5] [2021-04-20 17:13:08.50 UTC] 1.26.2
[relay-CN:cardano.node.basicInfo.commit:Notice:5] [2021-04-20 17:13:08.50 UTC] 3531289c9f79eab7ac5d3272ce6e6821504fec4c
[relay-CN:cardano.node.basicInfo.nodeStartTime:Notice:5] [2021-04-20 17:13:08.50 UTC] 2021-04-20 17:13:08.508251866 UTC
[relay-CN:cardano.node.basicInfo.systemStartTime:Notice:5] [2021-04-20 17:13:08.50 UTC] 2019-07-24 20:20:16 UTC
[relay-CN:cardano.node.basicInfo.slotLengthByron:Notice:5] [2021-04-20 17:13:08.50 UTC] 20s
[relay-CN:cardano.node.basicInfo.epochLengthByron:Notice:5] [2021-04-20 17:13:08.50 UTC] 21600
[relay-CN:cardano.node.basicInfo.slotLengthShelley:Notice:5] [2021-04-20 17:13:08.50 UTC] 1s
[relay-CN:cardano.node.basicInfo.epochLengthShelley:Notice:5] [2021-04-20 17:13:08.50 UTC] 432000
[relay-CN:cardano.node.basicInfo.slotsPerKESPeriodShelley:Notice:5] [2021-04-20 17:13:08.50 UTC] 129600
[relay-CN:cardano.node.basicInfo.slotLengthAllegra:Notice:5] [2021-04-20 17:13:08.50 UTC] 1s
[relay-CN:cardano.node.basicInfo.epochLengthAllegra:Notice:5] [2021-04-20 17:13:08.50 UTC] 432000
[relay-CN:cardano.node.basicInfo.slotsPerKESPeriodAllegra:Notice:5] [2021-04-20 17:13:08.50 UTC] 129600
[relay-CN:cardano.node.basicInfo.slotLengthMary:Notice:5] [2021-04-20 17:13:08.50 UTC] 1s
[relay-CN:cardano.node.basicInfo.epochLengthMary:Notice:5] [2021-04-20 17:13:08.50 UTC] 432000
[relay-CN:cardano.node.basicInfo.slotsPerKESPeriodMary:Notice:5] [2021-04-20 17:13:08.50 UTC] 129600
[relay-CN:cardano.node.addresses:Notice:5] [2021-04-20 17:13:08.50 UTC] [SocketInfo 0.0.0.0:3001]
[relay-CN:cardano.node.diffusion-mode:Notice:5] [2021-04-20 17:13:08.50 UTC] InitiatorAndResponderDiffusionMode
[relay-CN:cardano.node.dns-producers:Notice:5] [2021-04-20 17:13:08.50 UTC] [DnsSubscriptionTarget {dstDomain = "relays-new.cardano-testnet.iohkdev.io", dstPort = 3001, dstValency = 2}]
[relay-CN:cardano.node.ip-producers:Notice:5] [2021-04-20 17:13:08.50 UTC] IPSubscriptionTarget {ispIps = [], ispValency = 0}
[relay-CN:cardano.node.ChainDB:Info:5] [2021-04-20 17:13:08.52 UTC] Opened imm db with immutable tip at genesis (origin) and chunk 0
[relay-CN:cardano.node.ChainDB:Info:5] [2021-04-20 17:13:08.52 UTC] Opened vol db
[relay-CN:cardano.node.ChainDB:Info:5] [2021-04-20 17:13:08.52 UTC] Replaying ledger from genesis
[relay-CN:cardano.node.ChainDB:Info:5] [2021-04-20 17:13:08.52 UTC] Opened lgr db
[relay-CN:cardano.node.ChainDB:Info:5] [2021-04-20 17:13:08.52 UTC] Opened db with immutable tip at genesis (origin) and tip genesis (origin)
[relay-CN:cardano.node.ChainDB:Notice:34] [2021-04-20 17:13:08.52 UTC] Chain extended, new tip: 1e64e74bd7ac76d6806480a28017deb0aedd356fb61844ec95c429ae2f30c7c3 at slot 0
[relay-CN:cardano.node.DnsSubscription:Notice:66] [2021-04-20 17:13:08.57 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 18.132.238.21:3001
[relay-CN:cardano.node.DnsSubscription:Notice:67] [2021-04-20 17:13:08.59 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 18.159.64.253:3001
[relay-CN:cardano.node.DnsSubscription:Notice:68] [2021-04-20 17:13:08.62 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 54.151.49.138:3001
[relay-CN:cardano.node.DnsSubscription:Notice:69] [2021-04-20 17:13:08.64 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 54.250.11.33:3001
[relay-CN:cardano.node.DnsSubscription:Notice:70] [2021-04-20 17:13:08.67 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 175.41.160.108:3001
[relay-CN:cardano.node.DnsSubscription:Notice:71] [2021-04-20 17:13:08.69 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 3.9.80.183:3001
[relay-CN:cardano.node.DnsSubscription:Notice:72] [2021-04-20 17:13:08.72 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 3.124.178.139:3001
[relay-CN:cardano.node.DnsSubscription:Notice:73] [2021-04-20 17:13:08.74 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 3.128.220.55:3001
[relay-CN:cardano.node.DnsSubscription:Error:68] [2021-04-20 17:15:18.93 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Exception, destination 54.151.49.138:3001 exception: Network.Socket.connect: <socket: 27>: timeout (Connection timed out)
[relay-CN:cardano.node.DnsSubscription:Error:71] [2021-04-20 17:15:18.93 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Exception, destination 3.9.80.183:3001 exception: Network.Socket.connect: <socket: 30>: timeout (Connection timed out)
[relay-CN:cardano.node.DnsSubscription:Error:72] [2021-04-20 17:15:18.93 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Exception, destination 3.124.178.139:3001 exception: Network.Socket.connect: <socket: 31>: timeout (Connection timed out)
[relay-CN:cardano.node.DnsSubscription:Error:67] [2021-04-20 17:15:18.93 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Exception, destination 18.159.64.253:3001 exception: Network.Socket.connect: <socket: 26>: timeout (Connection timed out)
[relay-CN:cardano.node.DnsSubscription:Error:66] [2021-04-20 17:15:18.93 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Exception, destination 18.132.238.21:3001 exception: Network.Socket.connect: <socket: 24>: timeout (Connection timed out)
[relay-CN:cardano.node.DnsSubscription:Error:73] [2021-04-20 17:15:18.93 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Exception, destination 3.128.220.55:3001 exception: Network.Socket.connect: <socket: 32>: timeout (Connection timed out)
[relay-CN:cardano.node.DnsSubscription:Error:69] [2021-04-20 17:15:18.93 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Exception, destination 54.250.11.33:3001 exception: Network.Socket.connect: <socket: 28>: timeout (Connection timed out)
[relay-CN:cardano.node.DnsSubscription:Error:70] [2021-04-20 17:15:18.93 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Exception, destination 175.41.160.108:3001 exception: Network.Socket.connect: <socket: 29>: timeout (Connection timed out)
[relay-CN:cardano.node.ErrorPolicy:Notice:52] [2021-04-20 17:15:18.93 UTC] IP 54.151.49.138:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace Network.Socket.connect: <socket: 27>: timeout (Connection timed out))) 20s
[relay-CN:cardano.node.ErrorPolicy:Notice:52] [2021-04-20 17:15:18.93 UTC] IP 3.124.178.139:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace Network.Socket.connect: <socket: 31>: timeout (Connection timed out))) 20s
[relay-CN:cardano.node.ErrorPolicy:Notice:52] [2021-04-20 17:15:18.93 UTC] IP 18.159.64.253:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace Network.Socket.connect: <socket: 26>: timeout (Connection timed out))) 20s
[relay-CN:cardano.node.ErrorPolicy:Notice:52] [2021-04-20 17:15:18.93 UTC] IP 18.132.238.21:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace Network.Socket.connect: <socket: 24>: timeout (Connection timed out))) 20s
[relay-CN:cardano.node.ErrorPolicy:Notice:52] [2021-04-20 17:15:18.93 UTC] IP 3.128.220.55:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace Network.Socket.connect: <socket: 32>: timeout (Connection timed out))) 20s
[relay-CN:cardano.node.ErrorPolicy:Notice:52] [2021-04-20 17:15:18.93 UTC] IP 54.250.11.33:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace Network.Socket.connect: <socket: 28>: timeout (Connection timed out))) 20s
[relay-CN:cardano.node.DnsSubscription:Warning:55] [2021-04-20 17:15:18.93 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Failed to start all required subscriptions
[relay-CN:cardano.node.ErrorPolicy:Notice:52] [2021-04-20 17:15:18.93 UTC] IP 175.41.160.108:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace Network.Socket.connect: <socket: 29>: timeout (Connection timed out))) 20s
[relay-CN:cardano.node.ErrorPolicy:Notice:52] [2021-04-20 17:15:18.93 UTC] IP 3.9.80.183:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace Network.Socket.connect: <socket: 30>: timeout (Connection timed out))) 20s
[relay-CN:cardano.node.DnsSubscription:Warning:55] [2021-04-20 17:15:19.93 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Failed to start all required subscriptions
[relay-CN:cardano.node.DnsSubscription:Warning:55] [2021-04-20 17:15:29.93 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Failed to start all required subscriptions
[relay-CN:cardano.node.DnsSubscription:Notice:81] [2021-04-20 17:15:39.93 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 3.128.220.55:3001
[relay-CN:cardano.node.DnsSubscription:Notice:82] [2021-04-20 17:15:39.96 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 3.124.178.139:3001
[relay-CN:cardano.node.DnsSubscription:Notice:83] [2021-04-20 17:15:39.98 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 3.9.80.183:3001
[relay-CN:cardano.node.DnsSubscription:Notice:84] [2021-04-20 17:15:40.01 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 175.41.160.108:3001
[relay-CN:cardano.node.DnsSubscription:Notice:85] [2021-04-20 17:15:40.03 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 54.250.11.33:3001
[relay-CN:cardano.node.DnsSubscription:Notice:86] [2021-04-20 17:15:40.06 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 54.151.49.138:3001
[relay-CN:cardano.node.DnsSubscription:Notice:87] [2021-04-20 17:15:40.08 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 18.159.64.253:3001
[relay-CN:cardano.node.DnsSubscription:Notice:88] [2021-04-20 17:15:40.11 UTC] Domain: "relays-new.cardano-testnet.iohkdev.io" Connection Attempt Start, destination 18.132.238.21:3001

If I use my public IP in the startup command it simple fails to start at all and goes back to the CL.

InvalidYaml (Just (YamlException “Yaml file not found: testnet-config.json”))

cardano-node: YAML exception:
Yaml file not found: testnet-config.jsonrelay@relay-CNODE:~/git/cardano-node/scripts$

It seems like a configuration or port issue to me. I’d like to get much more comfortable with the process on testnet and really play with it, but have hit a wall here. Any help or advice would be appreciated.

Thanks

Hi!

So far so good…
can you check that relays-new.cardano-testnet.iohkdev.io:3001 is reachable from your node?
netcat -znv relays-new.cardano-testnet.iohkdev.io 3001

I get this,

relay@relay-CNODE:~$ netcat -znv relays-new.cardano-testnet.iohkdev.io 3001
netcat: getaddrinfo for host “relays-new.cardano-testnet.iohkdev.io” port 3001: Name or service not known

So doesn’t look like I’m getting out. I disabled ufw while troubleshooting so that should not be contributing to the problem. Are there specific NAT considerations I should look at?

1 Like

sorry, I thought that hostname can be used with the command, but only IP addresses.
so try to get the IP with ping relays-new.cardano-testnet.iohkdev.io then use the IP

$ netcat -znv 3.128.220.55 3001
Connection to 3.128.220.55 3001 port [tcp/*] succeeded!

relay@relay-CNODE:~$ netcat -znv 3.128.220.55 3001
netcat: connect to 3.128.220.55 port 3001 (tcp) failed: Connection timed out

I’m now getting timed out. Progress of sorts. This looks to me like a port issue. I can run the command from my local terminal and get this, netcat -znv 3.128.220.55 3001
3.128.220.55 3001 (redwood-broker) open.

Thanks for the direction, laplasz!!! I’ll work on the network and maybe rebuild locally to test and eliminate variables. I have linux experience, but it’s never been my strength. It’s been fun digging into all this.

1 Like

it seems a routing issue… instead of a port issue.
yes, best way to learn these kind of things…

also you can try other addresses by visiting this site - the list contains other relays on testnet
https://explorer.cardano-testnet.iohkdev.io/relays/topology.json

Update here. The problem above did appear to be a routing issue. I changed networks and was able to startup and run. Received a lot of chain extended, new tip notifications. So I left it running, went to lunch and came back to it errored out. And now it won’t start and run correctly. I get these messages now.

relay@relay-test3:~/relay$ cardano-node run \

–topology testnet-topology.json
–database-path db
–socket-path db/node.socket
–host-addr 0.0.0.0
–port 3001
–config testnet-config.json
Listening on http://127.0.0.1:12798
[relay-te:cardano.node.networkMagic:Notice:5] [2021-04-27 17:11:25.06 UTC] NetworkMagic 1097911063
[relay-te:cardano.node.basicInfo.protocol:Notice:5] [2021-04-27 17:11:25.07 UTC] Byron; Shelley
[relay-te:cardano.node.basicInfo.version:Notice:5] [2021-04-27 17:11:25.07 UTC] 1.26.2
[relay-te:cardano.node.basicInfo.commit:Notice:5] [2021-04-27 17:11:25.07 UTC] 3531289c9f79eab7ac5d3272ce6e6821504fec4c
[relay-te:cardano.node.basicInfo.nodeStartTime:Notice:5] [2021-04-27 17:11:25.07 UTC] 2021-04-27 17:11:25.070009149 UTC
[relay-te:cardano.node.basicInfo.systemStartTime:Notice:5] [2021-04-27 17:11:25.07 UTC] 2019-07-24 20:20:16 UTC
[relay-te:cardano.node.basicInfo.slotLengthByron:Notice:5] [2021-04-27 17:11:25.07 UTC] 20s
[relay-te:cardano.node.basicInfo.epochLengthByron:Notice:5] [2021-04-27 17:11:25.07 UTC] 21600
[relay-te:cardano.node.basicInfo.slotLengthShelley:Notice:5] [2021-04-27 17:11:25.07 UTC] 1s
[relay-te:cardano.node.basicInfo.epochLengthShelley:Notice:5] [2021-04-27 17:11:25.07 UTC] 432000
[relay-te:cardano.node.basicInfo.slotsPerKESPeriodShelley:Notice:5] [2021-04-27 17:11:25.07 UTC] 129600
[relay-te:cardano.node.basicInfo.slotLengthAllegra:Notice:5] [2021-04-27 17:11:25.07 UTC] 1s
[relay-te:cardano.node.basicInfo.epochLengthAllegra:Notice:5] [2021-04-27 17:11:25.07 UTC] 432000
[relay-te:cardano.node.basicInfo.slotsPerKESPeriodAllegra:Notice:5] [2021-04-27 17:11:25.07 UTC] 129600
[relay-te:cardano.node.basicInfo.slotLengthMary:Notice:5] [2021-04-27 17:11:25.07 UTC] 1s
[relay-te:cardano.node.basicInfo.epochLengthMary:Notice:5] [2021-04-27 17:11:25.07 UTC] 432000
[relay-te:cardano.node.basicInfo.slotsPerKESPeriodMary:Notice:5] [2021-04-27 17:11:25.07 UTC] 129600
[relay-te:cardano.node.addresses:Notice:5] [2021-04-27 17:11:25.06 UTC] [SocketInfo 0.0.0.0:3001]
[relay-te:cardano.node.diffusion-mode:Notice:5] [2021-04-27 17:11:25.06 UTC] InitiatorAndResponderDiffusionMode
[relay-te:cardano.node.dns-producers:Notice:5] [2021-04-27 17:11:25.06 UTC] [DnsSubscriptionTarget {dstDomain = “relays-new.cardano-testnet.iohkdev.io”, dstPort = 3001, dstValency = 2}]
[relay-te:cardano.node.ip-producers:Notice:5] [2021-04-27 17:11:25.06 UTC] IPSubscriptionTarget {ispIps = , ispValency = 0}
[relay-te:cardano.node.ChainDB:Info:5] [2021-04-27 17:11:25.16 UTC] Opened imm db with immutable tip at 0d0bd7950b92b79613ce6bd104b2f031b5c7c29d5467fe2ebfbe514814bf44a5 at slot 25112383 and chunk 1162
[relay-te:cardano.node.ChainDB:Info:5] [2021-04-27 17:11:25.31 UTC] Opened vol db
[relay-te:cardano.node.ChainDB:Info:5] [2021-04-27 17:11:25.82 UTC] Replaying ledger from snapshot DiskSnapshot {dsNumber = 25110951, dsSuffix = Nothing} at dc72770a817932bd043915add8bcbbc9a45f1c16da4dbd2db318658a55eeef18 at slot 25110951
[relay-te:cardano.node.ChainDB:Info:5] [2021-04-27 17:11:25.82 UTC] Replayed block: slot SlotNo 25110992 of At (SlotNo 25112383)
[relay-te:cardano.node.ChainDB:Info:5] [2021-04-27 17:11:25.83 UTC] before next, messages elided = 25111048
[relay-te:cardano.node.ChainDB:Info:5] [2021-04-27 17:11:25.83 UTC] Replayed block: slot SlotNo 25112383 of At (SlotNo 25112383)
[relay-te:cardano.node.ChainDB:Info:5] [2021-04-27 17:11:25.83 UTC] Opened lgr db
[relay-te:cardano.node.ChainDB:Info:5] [2021-04-27 17:11:28.62 UTC] Opened db with immutable tip at 0d0bd7950b92b79613ce6bd104b2f031b5c7c29d5467fe2ebfbe514814bf44a5 at slot 25112383 and tip 0632966aa54fe1286b95d6801a775ca316e9188a56fa16409ab8a738e3254ba2 at slot 25173740
[relay-te:cardano.node.DnsSubscription:Notice:69] [2021-04-27 17:11:28.63 UTC] Domain: “relays-new.cardano-testnet.iohkdev.io” Connection Attempt Start, destination 3.128.220.55:3001
[relay-te:cardano.node.DnsSubscription:Notice:70] [2021-04-27 17:11:28.66 UTC] Domain: “relays-new.cardano-testnet.iohkdev.io” Connection Attempt Start, destination 3.129.133.68:3001
[relay-te:cardano.node.DnsSubscription:Notice:69] [2021-04-27 17:11:28.67 UTC] Domain: “relays-new.cardano-testnet.iohkdev.io” Connection Attempt End, destination 3.128.220.55:3001 outcome: ConnectSuccess
[relay-te:cardano.node.DnsSubscription:Notice:71] [2021-04-27 17:11:28.69 UTC] Domain: “relays-new.cardano-testnet.iohkdev.io” Connection Attempt Start, destination 52.58.117.45:3001
[relay-te:cardano.node.DnsSubscription:Notice:70] [2021-04-27 17:11:28.70 UTC] Domain: “relays-new.cardano-testnet.iohkdev.io” Connection Attempt End, destination 3.129.133.68:3001 outcome: ConnectSuccessLast
[relay-te:cardano.node.ErrorPolicy:Notice:55] [2021-04-27 17:11:28.70 UTC] IP 52.58.117.45:3001 ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = “Parallel connection cancelled”, seStack = }))) 1s
[relay-te:cardano.node.ChainDB:Notice:37] [2021-04-27 17:11:28.86 UTC] Chain extended, new tip: 1aac7e62f085a4409c71b0d8b8fad25000fd54259bf679f4e29452f25e608c81 at slot 25173754
[relay-te:cardano.node.ChainDB:Info:37] [2021-04-27 17:11:28.99 UTC] before next, messages elided = 80063783060794
[relay-te:cardano.node.ChainDB:Info:37] [2021-04-27 17:11:28.99 UTC] Valid candidate 4a6938fc8fb202a91f6ee37e1299963c5f61b2347591aea69ceea950583e8098 at slot 25174324
[relay-te:cardano.node.ChainDB:Error:37] [2021-04-27 17:11:28.99 UTC] Candidate contains blocks from future exceeding clock skew limit: 4a6938fc8fb202a91f6ee37e1299963c5f61b2347591aea69ceea950583e8098 at slot 25174324, slots 4a6938fc8fb202a91f6ee37e1299963c5f61b2347591aea69ceea950583e8098@25174324
^C[relay-te:cardano.node.DnsSubscription:Error:69] [2021-04-27 17:12:36.42 UTC] Domain: “relays-new.cardano-testnet.iohkdev.io” Application Exception: 3.128.220.55:3001 SubscriberError {seType = SubscriberWorkerCancelled, seMessage = “SubscriptionWorker exiting”, seStack = }
[relay-te:cardano.node.DnsSubscription:Error:70] [2021-04-27 17:12:36.42 UTC] Domain: “relays-new.cardano-testnet.iohkdev.io” Application Exception: 3.129.133.68:3001 SubscriberError {seType = SubscriberWorkerCancelled, seMessage = “SubscriptionWorker exiting”, seStack = }
[relay-te:cardano.node.ChainDB:Info:5] [2021-04-27 17:12:36.42 UTC] Closed db with immutable tip at 4b054af84616fe5bc9328535042a108143a8be8227462172a478e0585f112d0a at slot 25113150 and tip 56dbee3c1b59d51609a39a9a3baf7c6c0c0d90b1ade23e6690f5797286e6d22b at slot 25174271

Nothing changed from when I started up this morning to later in the day failing. Anything jump out to the experts to check? I’m doing this all on testnet.

try to add other relays to the topology.json from this list:
https://explorer.cardano-testnet.iohkdev.io/relays/topology.json
If not help then I would delete the database folder and start sync again.

While adding the additional relays to the topology file, I received messages that the formatting was incorrect. Deleted and re-downloaded the testnet topo file, started right up. Didn’t have to delete db folder or anything else.

Seems to be online and working now,
[relay-te:cardano.node.ChainDB:Notice:39] [2021-04-27 19:32:45.47 UTC] Chain extended, new tip: 8d96c4df50f2eade4a8375869167060d55110cc3c4b643fbe4711f8fc7270b60 at slot 216569
[relay-te:cardano.node.ChainDB:Notice:39] [2021-04-27 19:32:45.47 UTC] Chain extended, new tip: 3a684d22e730dd12e6130edc3e04aa2c27f99970e7d1a467daacce2efa245f6b at slot 216570
[relay-te:cardano.node.ChainDB:Notice:39] [2021-04-27 19:32:46.72 UTC] Chain extended, new tip: 536ce0a8e867b4ba10b658e75d8589a960e19e8495b3d48e5d31ac21e350c049 at slot 217759
[relay-te:cardano.node.ChainDB:Notice:39] [2021-04-27 19:32:47.97 UTC] Chain extended, new tip: ce7c377dc36af1ce8572a906c95405ecbdaea91ed4bff64e4480b7ae68fb48c9 at slot 218393
[relay-te:cardano.node.ChainDB:Notice:39] [2021-04-27 19:32:49.22 UTC] Chain extended, new tip: 84e3d6cab91953593151eded8913cf868ccb91044840b8f0382657514fa9b452 at slot 219233
[relay-te:cardano.node.ChainDB:Notice:39] [2021-04-27 19:32:50.48 UTC] Chain extended, new tip: 2ca08ab198e48072986fd291ea3c8a2b44ad7ef77872efaec642f589dd224638 at slot 220087
[relay-te:cardano.node.ChainDB:Notice:39] [2021-04-27 19:32:51.73 UTC] Chain extended, new tip: 75e6c7af4c7e96e08b14b2adc306328075b91ac3d56df84b9727c2c9ccb01fc9 at slot 221097
[relay-te:cardano.node.ChainDB:Notice:39] [2021-04-27 19:32:52.98 UTC] Chain extended, new tip: 8b1d685f5e41d7b9b40221a6c2aa2eb61bd2dde4b5f5fd7a6fb2b4b703a7250b at slot 221895
[relay-te:cardano.node.ChainDB:Notice:39] [2021-04-27 19:32:54.23 UTC] Chain extended, new tip: 132d28cb8230bfe4b28f8f88c31bb782f18eda8abe546f050ec9102dcc95c30d at slot 222710
[relay-te:cardano.node.ChainDB:Notice:39] [2021-04-27 19:32:55.48 UTC] Chain extended, new tip: 9ff294eff8da233599ae6c9e6579fd4e5b1d66b0847c57dd5d144e170cb45323 at slot 223480
[relay-te:cardano.node.ChainDB:Notice:39] [2021-04-27 19:32:56.74 UTC] Chain extended, new tip: cd87ab2749cc5e0e03acf2448fe5fe58cea6f3cf3804cf5c6fe4a8b8f6901ae9 at slot 224309
[relay-te:cardano.node.ChainDB:Notice:39] [2021-04-27 19:32:57.99 UTC] Chain extended, new tip: 698e8826ba5e7a5247cd88cdede51023bc22e6606945958a52dea6e54a95a10e at slot 225236
[relay-te:cardano.node.ChainDB:Notice:39] [2021-04-27 19:32:59.24 UTC] Chain extended, new tip: d49b8245edbc6d4ebfc67e23e98a029344f472d74b27b86da01468790f387722 at slot 226045
[relay-te:cardano.node.ChainDB:Notice:39] [2021-04-27 19:33:00.49 UTC] Chain extended, new tip: f63499957a48dd78068df33f464d0f62abad081f9f401c60978253dcfb7b32ad at slot 226936

yes - so you just basically restarted the node… this can do the trick sometimes…:slight_smile: