Testnet Node 1.19.1 syncing issues

Hello everyone,

Trying to run a node in AWS. I followed the following instructions:

https://cardano-foundation.gitbook.io/stake-pool-course/stake-pool-guide/getting-started/install-node

The node installs successfully and I’m able to start the node with the following command:

 cardano-node run \
 --topology testnet-topology.json \
 --database-path db \
 --socket-path db/node.socket \
 --host-addr x.x.x.x \
 --port 3001 \
 --config testnet-config.json

The node starts syncing but it starts failing after 30.07% with the following message:

[ip-172-3:cardano.node.release:Notice:5] [2021-01-06 15:52:47.92 UTC] CardanoProtocol
[ip-172-3:cardano.node.networkMagic:Notice:5] [2021-01-06 15:52:47.92 UTC] NetworkMagic 1097911063
[ip-172-3:cardano.node.version:Notice:5] [2021-01-06 15:52:47.92 UTC] 1.19.1
[ip-172-3:cardano.node.commit:Notice:5] [2021-01-06 15:52:47.92 UTC] 497afd7dedc5d5b9bdcdb0e3cac6a50bd9f7dd54
[ip-172-3:cardano.node.ChainDB:Info:5] [2021-01-06 15:52:47.95 UTC] Opened imm db with immutable tip at dbcc3051a9f43d4ecf2b9edc352ff066b3d4c5f0149583efeb33cbf5313fa3f1 at slot 13637761 and chunk 631
[ip-172-3:cardano.node.ChainDB:Info:5] [2021-01-06 15:52:48.02 UTC] Opened vol db
[ip-172-3:cardano.node.ChainDB:Info:5] [2021-01-06 15:52:48.60 UTC] Replaying ledger from snapshot DiskSnapshot 29 at 852e52005b3dab6ddc58891d659d33b41018cc755d03671f35081de4a0a29a3d at slot 13637407
[ip-172-3:cardano.node.ChainDB:Info:5] [2021-01-06 15:52:48.63 UTC] Replayed block: slot SlotNo 13637440 of At (SlotNo 13637761)
[ip-172-3:cardano.node.ChainDB:Info:5] [2021-01-06 15:52:48.63 UTC] before next, messages elided = 13637481
[ip-172-3:cardano.node.ChainDB:Info:5] [2021-01-06 15:52:48.63 UTC] Replayed block: slot SlotNo 13637761 of At (SlotNo 13637761)
[ip-172-3:cardano.node.ChainDB:Info:5] [2021-01-06 15:52:48.63 UTC] Opened lgr db
[ip-172-3:cardano.node.ChainDB:Info:5] [2021-01-06 15:52:51.24 UTC] Opened db with immutable tip at dbcc3051a9f43d4ecf2b9edc352ff066b3d4c5f0149583efeb33cbf5313fa3f1 at slot 13637761 and tip 343aafda8deee6f54065da31887c01a4aa038ac96b7fffebb4d50716066af77a at slot 13694286
[ip-172-3:cardano.node.DnsSubscription:Notice:59] [2021-01-06 15:52:51.24 UTC] [String "Connection Attempt Start, destination 13.250.156.57:3001",String "SubscriptionTrace",String "\"relays-new.cardano-testnet.iohkdev.io\""]
[ip-172-3:cardano.node.DnsSubscription:Notice:60] [2021-01-06 15:52:51.27 UTC] [String "Connection Attempt Start, destination 18.132.238.21:3001",String "SubscriptionTrace",String "\"relays-new.cardano-testnet.iohkdev.io\""]
[ip-172-3:cardano.node.DnsSubscription:Notice:61] [2021-01-06 15:52:51.29 UTC] [String "Connection Attempt Start, destination 18.133.130.172:3001",String "SubscriptionTrace",String "\"relays-new.cardano-testnet.iohkdev.io\""]
[ip-172-3:cardano.node.DnsSubscription:Notice:62] [2021-01-06 15:52:51.32 UTC] [String "Connection Attempt Start, destination 54.177.182.253:3001",String "SubscriptionTrace",String "\"relays-new.cardano-testnet.iohkdev.io\""]
[ip-172-3:cardano.node.DnsSubscription:Notice:63] [2021-01-06 15:52:51.34 UTC] [String "Connection Attempt Start, destination 54.248.196.117:3001",String "SubscriptionTrace",String "\"relays-new.cardano-testnet.iohkdev.io\""]
[ip-172-3:cardano.node.DnsSubscription:Notice:60] [2021-01-06 15:52:51.35 UTC] [String "Connection Attempt End, destination 18.132.238.21:3001 outcome: ConnectSuccess",String "SubscriptionTrace",String "\"relays-new.cardano-testnet.iohkdev.io\""]
[ip-172-3:cardano.node.DnsSubscription:Notice:62] [2021-01-06 15:52:51.37 UTC] [String "Connection Attempt End, destination 54.177.182.253:3001 outcome: ConnectSuccessLast",String "SubscriptionTrace",String "\"relays-new.cardano-testnet.iohkdev.io\""]
[ip-172-3:cardano.node.ErrorPolicy:Notice:55] [2021-01-06 15:52:51.37 UTC] [String "ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = \"Parallel connection cancelled\", seStack = []}))) 1s",String "ErrorPolicyTrace",String "13.250.156.57:3001"]
[ip-172-3:cardano.node.ErrorPolicy:Notice:55] [2021-01-06 15:52:51.37 UTC] [String "ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = \"Parallel connection cancelled\", seStack = []}))) 1s",String "ErrorPolicyTrace",String "18.133.130.172:3001"]
[ip-172-3:cardano.node.ErrorPolicy:Notice:55] [2021-01-06 15:52:51.37 UTC] [String "ErrorPolicySuspendConsumer (Just (ConnectionExceptionTrace (SubscriberError {seType = SubscriberParallelConnectionCancelled, seMessage = \"Parallel connection cancelled\", seStack = []}))) 1s",String "ErrorPolicyTrace",String "54.248.196.117:3001"]
[ip-172-3:cardano.node.DnsSubscription:Error:62] [2021-01-06 15:52:52.53 UTC] [String "Application Exception: 54.177.182.253:3001 MuxError MuxBearerClosed \"<socket: 27> closed when reading data, waiting on next header True\"",String "SubscriptionTrace",String "\"relays-new.cardano-testnet.iohkdev.io\""]
[ip-172-3:cardano.node.ErrorPolicy:Warning:55] [2021-01-06 15:52:52.53 UTC] [String "ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (MuxError MuxBearerClosed \"<socket: 27> closed when reading data, waiting on next header True\"))) 20s 20s",String "ErrorPolicyTrace",String "54.177.182.253:3001"]
[ip-172-3:cardano.node.DnsSubscription:Error:60] [2021-01-06 15:52:52.62 UTC] [String "Application Exception: 18.132.238.21:3001 MuxError MuxBearerClosed \"<socket: 25> closed when reading data, waiting on next header True\"",String "SubscriptionTrace",String "\"relays-new.cardano-testnet.iohkdev.io\""]
[ip-172-3:cardano.node.ErrorPolicy:Warning:55] [2021-01-06 15:52:52.62 UTC] [String "ErrorPolicySuspendPeer (Just (ApplicationExceptionTrace (MuxError MuxBearerClosed \"<socket: 25> closed when reading data, waiting on next header True\"))) 20s 20s",String "ErrorPolicyTrace",String "18.132.238.21:3001"]

Any ideas of what I’m doing wrong?

The following command:

cardano-cli shelley query tip --testnet-magic 1097911063

Always returns:

{
    "blockNo": 2143523,
    "headerHash": "343aafda8deee6f54065da31887c01a4aa038ac96b7fffebb4d50716066af77a",
    "slotNo": 13694286
}

I have node version 1.19.1:

cardano-node 1.19.1 - linux-x86_64 - ghc-8.6
git rev 497afd7dedc5d5b9bdcdb0e3cac6a50bd9f7dd54

I have tried deleting the db folder and starting over but it still fails at the same percentage.

I don’t know when was release the guide or how it’s working this tesnet version but in mainnet we are running version 1.24.2

Can u try to install in testnet also the version 1.24.2; is it available?

I’ll try I’ll let you know. Thanks for the reply!

Hey Alex,

I get the following output when trying to run the node:

Listening on http://0.0.0.0:12798
[ip-172-3:cardano.node.networkMagic:Notice:5] [2021-01-06 18:20:38.53 UTC] NetworkMagic 1097911063
[ip-172-3:cardano.node.basicInfo.protocol:Notice:5] [2021-01-06 18:20:38.53 UTC] Byron; Shelley
[ip-172-3:cardano.node.basicInfo.version:Notice:5] [2021-01-06 18:20:38.53 UTC] 1.24.2
[ip-172-3:cardano.node.basicInfo.commit:Notice:5] [2021-01-06 18:20:38.53 UTC] 400d18092ce604352cf36fe5f105b0d7c78be074
[ip-172-3:cardano.node.basicInfo.nodeStartTime:Notice:5] [2021-01-06 18:20:38.53 UTC] 2021-01-06 18:20:38.53449174 UTC
[ip-172-3:cardano.node.basicInfo.systemStartTime:Notice:5] [2021-01-06 18:20:38.53 UTC] 2019-07-24 20:20:16 UTC
[ip-172-3:cardano.node.basicInfo.slotLengthByron:Notice:5] [2021-01-06 18:20:38.53 UTC] 20s
[ip-172-3:cardano.node.basicInfo.epochLengthByron:Notice:5] [2021-01-06 18:20:38.53 UTC] 21600
[ip-172-3:cardano.node.basicInfo.slotLengthShelley:Notice:5] [2021-01-06 18:20:38.53 UTC] 1s
[ip-172-3:cardano.node.basicInfo.epochLengthShelley:Notice:5] [2021-01-06 18:20:38.53 UTC] 432000
[ip-172-3:cardano.node.basicInfo.slotsPerKESPeriodShelley:Notice:5] [2021-01-06 18:20:38.53 UTC] 129600
[ip-172-3:cardano.node.basicInfo.slotLengthAllegra:Notice:5] [2021-01-06 18:20:38.53 UTC] 1s
[ip-172-3:cardano.node.basicInfo.epochLengthAllegra:Notice:5] [2021-01-06 18:20:38.53 UTC] 432000
[ip-172-3:cardano.node.basicInfo.slotsPerKESPeriodAllegra:Notice:5] [2021-01-06 18:20:38.53 UTC] 129600
[ip-172-3:cardano.node.basicInfo.slotLengthMary:Notice:5] [2021-01-06 18:20:38.53 UTC] 1s
[ip-172-3:cardano.node.basicInfo.epochLengthMary:Notice:5] [2021-01-06 18:20:38.53 UTC] 432000
[ip-172-3:cardano.node.basicInfo.slotsPerKESPeriodMary:Notice:5] [2021-01-06 18:20:38.53 UTC] 129600
[ip-172-3:cardano.node.addresses:Notice:5] [2021-01-06 18:20:38.55 UTC] [SocketInfo 68.32.57.208:3001]
[ip-172-3:cardano.node.diffusion-mode:Notice:5] [2021-01-06 18:20:38.55 UTC] InitiatorAndResponderDiffusionMode
[ip-172-3:cardano.node.dns-producers:Notice:5] [2021-01-06 18:20:38.55 UTC] [DnsSubscriptionTarget {dstDomain = "relays-new.cardano-testnet.iohkdev.io", dstPort = 3001, dstValency = 2}]
[ip-172-3:cardano.node.ip-producers:Notice:5] [2021-01-06 18:20:38.55 UTC] IPSubscriptionTarget {ispIps = [], ispValency = 0}
[ip-172-3:cardano.node.ChainDB:Info:5] [2021-01-06 18:20:38.55 UTC] Opened imm db with immutable tip at genesis (origin) and chunk 0
[ip-172-3:cardano.node.ChainDB:Info:5] [2021-01-06 18:20:38.55 UTC] Opened vol db
[ip-172-3:cardano.node.ChainDB:Info:5] [2021-01-06 18:20:38.55 UTC] Replaying ledger from genesis
[ip-172-3:cardano.node.ChainDB:Info:5] [2021-01-06 18:20:38.55 UTC] Opened lgr db
[ip-172-3:cardano.node.ChainDB:Info:5] [2021-01-06 18:20:38.55 UTC] Opened db with immutable tip at genesis (origin) and tip 1e64e74bd7ac76d6806480a28017deb0aedd356fb61844ec95c429ae2f30c7c3 at slot 0
[ip-172-3:cardano.node.ChainDB:Info:5] [2021-01-06 18:20:38.56 UTC] Closed db with immutable tip at genesis (origin) and tip 1e64e74bd7ac76d6806480a28017deb0aedd356fb61844ec95c429ae2f30c7c3 at slot 0

Shutting down..

cardano-node: Network.Socket.bind: unsupported operation (Cannot assign requested address)

Perhaps this version is not supported in testnet … interesting

I found this:

Cardano 2.4.0: Shelley Performance Enhancement and New Functionality - Release Notes – IOHK Support.

The latest version of the node, [Cardano Node 1.21.1](https://github.com/input-output-hk/cardano-node/releases/tag/1.21.1) was deployed to both the testnet and mainnet, and was released on 7 October, 2020.

I’m trying on 1.21.1 let’s see what happens.

Wait few min

The latest version of the node , Cardano Node 1.21. 1 was deployed to both the testnet and mainnet, and was released on 7 October, 2020.Dec 16, 2020

U are right

Same error though :frowning:

And it still breaks at 30%

Strange… I don’t know; I mean can be an issue with IOHK servers but for testnet I don’t know what other servers to use

Update your node to 1.24.2
Now we are on allegra era and ur nodes will not sync anymore if u not using 1.24.2 version

After that tell me what script/command do u use to start the node.

U need to use --allega-era to your command, as testnet is in Allegra now.

Hey Alex,

I have installed 1.24.2.

 cardano-node run \
 --topology testnet-topology.json \
 --database-path db \
 --socket-path db/node.socket \
 --host-addr x.x.x.x \
 --port 3001 \
 --config testnet-config.json

Above is the command.

ok, and when u are starting the node?
what is the err?

I saw above the err:

cardano-node: Network.Socket.bind: unsupported operation (Cannot assign requested address)

try to use : --host-addr 0.0.0.0 \ instead your node IP (0.0.0.0 means it binds to all interfaces.)

1 Like

I have the node running I’ll let you know if it crosses the 30% :slight_smile:

it will :stuck_out_tongue:

1 Like

Slowly syncing at 34% How long does it take?

What is the epoch number? When I started my last relay it took 1 day (if I remeber well) to sync100%

Epoc 106 Block 2209251

yeah, I know it will take a while, depending also the HW configuration of server, the internet speed, etc

I am also getting the Network.Socket.bind: does not exist (No such file or directory) error. My node is running on 1.25.1 in the testnet. Are you able to confirm if this version was deployed to the testnet and mainnet?

Yes, 1.25.1 is the latest release for mainnet; how do u start ur node? As systemd or manually?