Cntools Cardano node stuck Epoc 0 Status starting

Staking & Delegation Operate a Stake Pool
1

Hi,

My nodes ( relays and BP ) are stuck on stuck Epoc 0 Status starting, I tried to upgrad the relay but got ( you are in ‘detached HEAD’ state. HEAD is now at …Merge #… ) and kept me on v1.29.1

I’m stuck with this I can’t sync and can’t upgrade, the nodes were working before and minted blocks before, I used cntools, the cnode.service is running on relay and BP, I also rebooted both machines, I’m just lokking for a way out, to transfer ADA in cli-wallet. either by upgrade to I can send transactions or recovery of some sort.

Any help greatly appreciated

The static content from env does not match with guild-operators repository, do you want to download the updated file? (yes/no):

A new version of Guild LiveView is available
Installed Version : v1.20.10
Available Version : v1.25.1

Do you want to upgrade to the latest version of Guild LiveView? (yes/no):

> Cardano Node - (Relay - Mainnet) : 1.29.1 [8617cc39] <

┌───────────────────────┬────────────┬─────────────────────────┐
│ Uptime: 00:05:19 │ Port: 6000 │ Guild LiveView v1.20.10 │
│-----------------------└────────────┴─────────────────────────┤
│ Epoch 0 [0.0%] (node) │
│ 2d 10:16:39 until epoch boundary (chain) │
│ ▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖▖ │
│ │
│ Block : 0 Tip (ref) : 51371001 │
│ Slot : 0 Tip (node) : 0 │
│ Density : 0.0 Status : starting… │
│--------------------------------------------------------------│
│ Processed TX : 0 Out / In │
│ Mempool TX/Bytes : 0 / 0 Peers : 0 0 │
└──────────────────────────────────────────────────────────────┘

The BP node also says that

│ KES current/remaining : 0 / 0 │
│ KES expiration date : 2022-01-22 21:44:51 UTC

2

try

cardano-node - -version
which cardano-node

sudo systemctl status cnode
journalctl -e -f -u cnode

3

Hi Alex1985,

Thank you for helping, I’m on 1.29.1

melqart@projectos-01:~/git/cardano-node$ cardano-node --version
cardano-node 1.29.1 - linux-x86_64 - ghc-8.10
git rev 4c59442958072657812c6c0bb8e0b4ab85ce1ba2

melqart@projectos-01:~/git/cardano-node$ journalctl -e -f -u cnode
Hint: You are currently not seeing messages from other users and the system.
Users in groups ‘adm’, ‘systemd-journal’ can see all messages.
Pass -q to turn off this notice.
– Logs begin at Sun 2021-10-03 06:27:41 UTC. –
Jan 14 02:16:30 projectos-01 cnode[3642722]: WARN: A prior running Cardano node was not cleanly shutdown, socket file still exists. Cleaning up.
Jan 14 02:16:34 projectos-01 cnode[3642794]: Listening on http://127.0.0.1:12798
Jan 15 02:16:17 projectos-01 cnode[3642794]: Shutting down…
Jan 15 02:16:28 projectos-01 cnode[3823681]: WARN: A prior running Cardano node was not cleanly shutdown, socket file still exists. Cleaning up.
Jan 15 02:16:29 projectos-01 cnode[3823760]: Listening on http://127.0.0.1:12798
Jan 16 02:16:30 projectos-01 cnode[4013812]: WARN: A prior running Cardano node was not cleanly shutdown, socket file still exists. Cleaning up.
Jan 16 02:16:31 projectos-01 cnode[4013901]: Listening on http://127.0.0.1:12798
Jan 17 02:16:31 projectos-01 cnode[10490]: WARN: A prior running Cardano node was not cleanly shutdown, socket file still exists. Cleaning up.
Jan 17 02:16:32 projectos-01 cnode[10568]: Listening on http://127.0.0.1:12798
Jan 18 02:16:31 projectos-01 cnode[201793]: WARN: A prior running Cardano node was not cleanly shutdown, socket file still exists. Cleaning up.
Jan 18 02:16:32 projectos-01 cnode[201871]: Listening on http://127.0.0.1:12798
Jan 19 02:16:32 projectos-01 cnode[393771]: WARN: A prior running Cardano node was not cleanly shutdown, socket file still exists. Cleaning up.
Jan 19 02:16:33 projectos-01 cnode[393854]: Listening on http://127.0.0.1:12798
Jan 20 02:16:33 projectos-01 cnode[585777]: WARN: A prior running Cardano node was not cleanly shutdown, socket file still exists. Cleaning up.
Jan 20 02:16:34 projectos-01 cnode[585863]: Listening on http://127.0.0.1:12798
Jan 21 02:16:34 projectos-01 cnode[785187]: WARN: A prior running Cardano node was not cleanly shutdown, socket file still exists. Cleaning up.
Jan 21 02:16:35 projectos-01 cnode[785281]: Listening on http://127.0.0.1:12798
Jan 22 02:16:35 projectos-01 cnode[984951]: WARN: A prior running Cardano node was not cleanly shutdown, socket file still exists. Cleaning up.
Jan 22 02:16:36 projectos-01 cnode[985039]: Listening on http://127.0.0.1:12798
– Reboot –
Jan 23 09:12:42 projectos-01 cnode[1398]: WARN: A prior running Cardano node was not cleanly shutdown, socket file still exists. Cleaning up.
Jan 23 09:12:44 projectos-01 cnode[1482]: Listening on http://127.0.0.1:12798

4

Ok, then upgrade the nodes to 1.33.0 but u will need also to upgrade cabal and ghc


ghcup upgrade
ghcup install ghc 8.10.4
ghcup set ghc 8.10.4
ghcup install cabal 3.4.0.0
ghcup set cabal 3.4.0.0
cabal update
ghc --version
cabal --version
5

Hi Alex,

I tried to upgrade using ( https://forum.cardano.org/t/manual-upgrade-to-1-33-0-for-cntools-users/913060 )

but I got

melqart@projectos-01:~/git/cardano-node$ git checkout 1.33.0
Note: switching to ‘1.33.0’.

You are in ‘detached HEAD’ state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

git switch -c

Or undo this operation with:

git switch -

Turn off this advice by setting config variable advice.detachedHead to false

HEAD is now at 814df2c14 Merge #3458

Then when I did checked version I was still on 1.29.1

cardano-node 1.29.1 - linux-x86_64 - ghc-8.10
git rev 8617cc395b9493d9b5fa05bebc8644a7384c103e

6

man, u will need to build the node

if u want use my script for CNTOOLS users

https://forum.cardano.org/t/script-for-node-software-upgrade-cntools-users/91065

7

Hi Alex,

I also got

2:/git/cardano-node$ sudo ghcup upgrade
sudo: ghcup: command not found

8

If u are using cntools … use my above script

1.33.0 will take longer to start first time , around 3-4 hours (ledger changed)

As ling u will see on glive the CPU over 100% and the MEM slowly increase… it’s fine… just have patience

9

Thank you Alex, I’ll try it now, cheers

1 Like
10

Hi Alex,

I run the script and after it finishedc it asked to run gLive and I did I was asked to update env file after answering yes I got below, I’m still on v 1.29.1, any ideas, than you in advance

Guild scripts has now been upgraded to support cardano-node 1.32.1 or higher (1.29.1 found).
Please update cardano-node (note that you should ideally update your config too) or use tagged branches for older node version.

ERROR: gLiveView failed to load common env file
Please verify set values in ‘User Variables’ section in env file or log an issue on GitHub

$ cardano-node --version
cardano-node 1.29.1 - linux-x86_64 - ghc-8.10
git rev 8617cc395b9493d9b5fa05bebc8644a7384c103e

11

try

cd /usr/local/bin
ls -l

I believe u have the old bin files which should be removed

12

Hi, which files I need to remove

:/usr/local/bin$ ls -l
total 158996
-rwxr-xr-x 1 root root 75718816 Feb 19 2021 cardano-cli-Feb-19
-rwxr-xr-x 1 root root 87055600 Feb 19 2021 cardano-node-Feb-19
lrwxrwxrwx 1 root root 10 Apr 20 2021 ghc → ghc-8.10.2
-rwxr-xr-x 1 root root 264 Apr 20 2021 ghc-8.10.2
lrwxrwxrwx 1 root root 14 Apr 20 2021 ghc-pkg → ghc-pkg-8.10.2
-rwxr-xr-x 1 root root 296 Apr 20 2021 ghc-pkg-8.10.2
lrwxrwxrwx 1 root root 11 Apr 20 2021 ghci → ghci-8.10.2
-rwxr-xr-x 1 root root 62 Apr 20 2021 ghci-8.10.2
lrwxrwxrwx 1 root root 18 Apr 20 2021 haddock → haddock-ghc-8.10.2
-rwxr-xr-x 1 root root 255 Apr 20 2021 haddock-ghc-8.10.2
-rwxr-xr-x 1 root root 228 Apr 20 2021 hp2ps
-rwxr-xr-x 1 root root 226 Apr 20 2021 hpc
-rwxr-xr-x 1 root root 937 Apr 20 2021 hsc2hs
lrwxrwxrwx 1 root root 13 Apr 20 2021 runghc → runghc-8.10.2
-rwxr-xr-x 1 root root 273 Apr 20 2021 runghc-8.10.2
lrwxrwxrwx 1 root root 6 Apr 20 2021 runhaskell → runghc

13

cardano-cli and cardano-node

14

Hi ALex,

removed files and restarted cnode.service, but ghc is not updating still

$ ghcup install ghc 8.10.4
ghcup: command not found

$ ghc --version
The Glorious Glasgow Haskell Compilation System, version 8.10.2

15

And if u type now

cardano-node - -version

16

Still the same

$ cardano-node --version
cardano-node 1.29.1 - linux-x86_64 - ghc-8.10
git rev 8617cc395b9493d9b5fa05bebc8644a7384c103e

17

nano /.bashrc
and share the last lines with exports
also type
cd ${HOME}/.cabal/bin/
ls -l

18

export CARDANO_NODE_SOCKET_PATH=/home/melqart/src/cardano-node/relay/db/socket
PATH=/home/melqart/.local/bin:/home/melqart/.local/bin:/home/melqart/.local/bin:/home/melqart/.local/bin:/home/melqart/.local/bin:/home/melqart/.local/bin:/home/melqart/.local/bin:/usr/loc>
export LD_LIBRARY_PATH=/usr/local/lib:/usr/local/lib:
export NODE_CONFIG=mainnet
export NODE_BUILD_NUM=5416636
export CARDANO_NODE_SOCKET_PATH=/home/melqart/src/cardano-node/relay/db/socket
export CNODE_HOME=/opt/cardano/cnode
export LD_LIBRARY_PATH=/usr/local/lib:/usr/local/lib:/usr/local/lib:
export PKG_CONFIG_PATH=/usr/local/lib/pkgconfig:
export LD_LIBRARY_PATH=/usr/local/lib:$LD_LIBRARY_PATH
[ -f “/home/melqart/.ghcup/env” ] && source “/home/melqart/.ghcup/env” # ghcup-env

There is no bin unver cabal

~/.cabal$ ls -l
-rw-rw-r-- 1 5392 Jan 23 13:59 config
drwxrwxr-x 34096 Jan 23 13:59 packages

19

Hmm… are u sure u are not using the coincashew guide…?
U have to cleanup the bashrc file
should look like this (ignore the 3rd export line; the line with cargo )

image

20

Ok, cleand the bashrc file

Managed to remove ghc-8-10.2 and install update ghc-8.10.7

Updating with the script again