Node not syncing after epoch 207 (14.9%) Please help

What do you recommend?

to upgrade the memory to 16G

now I assume you have only 8G

on that specific one I had 4gb, just upgraded to 8gb. Lets see how that works out. I will keep you updated.

I have another fresh installation with 8gb currently syncing. It is at about 58%, but will not be ready to report on that one till the morning.

hmm 4G not enough for sure, let’s see with 8G how it’s working

2 Likes

FYI - been battling this for a few days (and a few other self induced issues). Went from 4G t3a.mediums on AWS to t3.XL’s. Instantly solved. Thanks Alexd1985

1 Like

Looks like it is working now! Thank you @Alexd1985. I will continue setting up the node and will update all of the results.

image

1 Like

I strongly recommend you walk away from the t3* instance and move to the m5a or c5a.
Also add swap to your 8gb memory instances.

1 Like

Thanks for the suggestion, just getting them back up right now, but reviewing the instances and reserved options from AWS is certainly on the list for later.

I had the same problem, thank you for fix it!

But there is something witch I dont understand:
my node starts to work files without mainnet- prefix, but with the new files has it and I dont have to modify the env file. Why?

because env file has default values for config files - or have you specified path to the files?

#CONFIG="${CNODE_HOME}/files/config.json"               # Override automatic detection of node config path
#TOPOLOGY="${CNODE_HOME}/files/topology.json"           # Override default topology.json path

how does your env file look like?

yes, but I have to add the mainnet prefix before config.json and works well with the new json files.
BTW i think replacing the topology.json is not needed to fix the problem.

I had the same issue, stock on epoch 207 @99.9%

THANK YOU for this response. the guide encourages you to change the external IP with no warning of waiting for it to sync based on the downloaded mainnet-topology.

Still have the issue?

No Sir, I re-download mainnet-topology and am keeping it pointing to ihok and not the relay IP, until it syncs to 100%. All is working thank you!

1 Like

Hey! I’m having the same issue.

I have a raspberry pi with 8 gb of ram + 4 gb of swap. I followed CoinCashew guide but relay resets at epoch 207, it deletes the socket and doesn’t sync anymore. I can get it running again by deleting the db folder and restart the service. But that only works until it gets to 207 again… .gLiveView says “Could Not Connect to a Running Instance, 3 Failed Attempts in a Row!”

I’ve tried downloading the mainnetfiles, but the issue remains.
I followed htop until the moment it resets and both memory and cpu seem fine.
I’ve tried changing, as @Alexd1985 proposes, the ShelleyGenesisHash in mainnet-config.json from the “67f10…” to “1a3b…” but a logged error demands I change it back to “67f10…” or it doesn’t continue syncing.

Any ideas? Much appreciated!

Re-download the files for mainnet and reset the node

https://hydra.iohk.io/build/7191656/download/1/index.html

I have already tried deleting the mainnet files, then doing

wget https://hydra.iohk.io/build/6198010/download/1/mainnet-config.json
wget https://hydra.iohk.io/build/6198010/download/1/mainnet-byron-genesis.json
wget https://hydra.iohk.io/build/6198010/download/1/mainnet-shelley-genesis.json
wget https://hydra.iohk.io/build/6198010/download/1/mainnet-topology.json

then deleting the db, then restarting the node. It still breaks, after 12 hours~, at epoch 207.
Mmm, I’m know realising I only did that for the relay, will doing it to the BP help?

Type sudo journalctl -e -f -u cardano-node

Do not delete the db

Yes:

Aug 10 18:07:52 ubuntu cardano-node[1087442]: [ubuntu:cardano.node.BlockFetchDecision:Info:679] [2021-08-10 17:07:52.56 UTC] [TraceLabelPeer (ConnectionId {localAddress = 192.168.1.5:38531, remoteAddress = 3.129.177.185:3001}) (Left FetchDeclineInFlightOtherPeer),TraceLabelPeer (ConnectionId {localAddress = 192.168.1.5:35059, remoteAddress = 3.130.47.105:3001}) (Right [At (Block {blockPointSlot = SlotNo 4492776, blockPointHash = afec71b2722b0693ce82045c68ea86f332927d43c171537d4bb89dae5a854e02}),At (Block {blockPointSlot = SlotNo 4492777, blockPointHash = af94a5faa6f3b599a58d2512b0d6a999f548f7ff6eb2a07405f3f7f8bb1d58f6}),At (Block {blockPointSlot = SlotNo 4492778, blockPointHash = b4f1b24a140dd007297232d38e8e0fedce5adf2051a4e7208d1b505fa2bde9ac}),At (Block {blockPointSlot = SlotNo 4492779, blockPointHash = 2c50916d3f53d2d1d3366a619527128139d20875a2a14e98085398e55844656b}),At (Block {blockPointSlot = SlotNo 4492780, blockPointHash = bfdb854da7be13d121ad66f3ebdd50facc021d1d691835a7b41025813d429626}),At (Block {blockPointSlot = SlotNo 4492781, blockPointHash = 541ba0e498b7c3f926b27a53923b73566c1d1a6b694a9648eed0f479676bd24c}),At (Block {blockPointSlot = SlotNo 4492782, blockPointHash = 6fed2fb10404749c50b1c566a1654286ec2cf7a0fbcf311a7b708970c8bbf65d})])]
Aug 10 18:07:52 ubuntu cardano-node[1087442]: /usr/local/bin/cardano-node: symbol lookup error: /usr/local/bin/cardano-node: undefined symbol: crypto_vrf_publickeybytes
Aug 10 18:07:52 ubuntu systemd[1]: cardano-node.service: Main process exited, code=exited, status=127/n/a
Aug 10 18:07:52 ubuntu systemd[1]: cardano-node.service: Failed with result 'exit-code'.
Aug 10 18:07:57 ubuntu systemd[1]: cardano-node.service: Scheduled restart job, restart counter is at 76.
Aug 10 18:07:57 ubuntu systemd[1]: Stopped Cardano node service.
Aug 10 18:07:57 ubuntu systemd[1]: Started Cardano node service.
Aug 10 18:08:02 ubuntu cardano-node[1087465]: Listening on http://127.0.0.1:12798
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.networkMagic:Notice:5] [2021-08-10 17:08:02.22 UTC] NetworkMagic 764824073
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.protocol:Notice:5] [2021-08-10 17:08:02.22 UTC] Byron; Shelley
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.version:Notice:5] [2021-08-10 17:08:02.22 UTC] 1.27.0
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.commit:Notice:5] [2021-08-10 17:08:02.22 UTC] b83e4025785be16cb5ee5231a6e9939d93564b40
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.nodeStartTime:Notice:5] [2021-08-10 17:08:02.22 UTC] 2021-08-10 17:08:02.221703106 UTC
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.systemStartTime:Notice:5] [2021-08-10 17:08:02.22 UTC] 2017-09-23 21:44:51 UTC
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.slotLengthByron:Notice:5] [2021-08-10 17:08:02.22 UTC] 20s
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.epochLengthByron:Notice:5] [2021-08-10 17:08:02.22 UTC] 21600
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.slotLengthShelley:Notice:5] [2021-08-10 17:08:02.22 UTC] 1s
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.epochLengthShelley:Notice:5] [2021-08-10 17:08:02.22 UTC] 432000
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.slotsPerKESPeriodShelley:Notice:5] [2021-08-10 17:08:02.22 UTC] 129600
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.slotLengthAllegra:Notice:5] [2021-08-10 17:08:02.22 UTC] 1s
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.epochLengthAllegra:Notice:5] [2021-08-10 17:08:02.22 UTC] 432000
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.slotsPerKESPeriodAllegra:Notice:5] [2021-08-10 17:08:02.22 UTC] 129600
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.slotLengthMary:Notice:5] [2021-08-10 17:08:02.22 UTC] 1s
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.epochLengthMary:Notice:5] [2021-08-10 17:08:02.22 UTC] 432000
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.slotsPerKESPeriodMary:Notice:5] [2021-08-10 17:08:02.22 UTC] 129600
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.slotLengthAlonzo:Notice:5] [2021-08-10 17:08:02.22 UTC] 1s
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.epochLengthAlonzo:Notice:5] [2021-08-10 17:08:02.22 UTC] 432000
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.basicInfo.slotsPerKESPeriodAlonzo:Notice:5] [2021-08-10 17:08:02.22 UTC] 129600
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.addresses:Notice:5] [2021-08-10 17:08:02.22 UTC] [SocketInfo 0.0.0.0:6000]
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.diffusion-mode:Notice:5] [2021-08-10 17:08:02.22 UTC] InitiatorAndResponderDiffusionMode
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.dns-producers:Notice:5] [2021-08-10 17:08:02.22 UTC] [DnsSubscriptionTarget {dstDomain = "relays-new.cardano-mainnet.iohk.io", dstPort = 3001, dstValency = 2}]
Aug 10 18:08:03 ubuntu cardano-node[1087465]: [ubuntu:cardano.node.ip-producers:Notice:5] [2021-08-10 17:08:02.22 UTC] IPSubscriptionTarget {ispIps = [], ispValency = 0}

The db directory is missing the socket file, how do I get it back without deleting?

This is ur problem