How to update KES key to an active running pool?

Staking & Delegation Operate a Stake Pool
21

Nov 02 01:05:40 node cardano-node[190911]: [node:cardano.node.Forge:Error:143] [2021-11-02 01:05:40.00 UTC] fromList [(“val”,Object (fromList [(“kind”,String “TraceNoLedgerView”),(“slot”,Number 4.4248849e7)])),(“credentials”,String “Cardano”)]

Nov 02 01:05:41 node cardano-node[190911]: [node:cardano.node.LeadershipCheck:Info:143] [2021-11-02 01:05:41.00 UTC] {“kind”:“TraceStartLeadershipCheck”,“chainDensity”:5.0e-2,“slot”:44248850,“delegMapSize”:913114,“utxoSize”:3759243,“credentials”:“Cardano”}

Nov 02 01:05:41 node cardano-node[190911]: [node:cardano.node.Forge:Error:143] [2021-11-02 01:05:41.00 UTC] fromList [(“val”,Object (fromList [(“kind”,String “TraceNoLedgerView”),(“slot”,Number 4.424885e7)])),(“credentials”,String “Cardano”)]

Nov 02 01:05:42 node cardano-node[190911]: [node:cardano.node.LeadershipCheck:Info:143] [2021-11-02 01:05:42.00 UTC] {“kind”:“TraceStartLeadershipCheck”,“chainDensity”:5.0e-2,“slot”:44248851,“delegMapSize”:913114,“utxoSize”:3759243,“credentials”:“Cardano”}

Nov 02 01:05:42 node cardano-node[190911]: [node:cardano.node.Forge:Error:143] [2021-11-02 01:05:42.00 UTC] fromList [(“val”,Object (fromList [(“kind”,String “TraceNoLedgerView”),(“slot”,Number 4.4248851e7)])),(“credentials”,String “Cardano”)]

this is what is currently printing in journalctl -e -f -u

22

sudo systemctl status cardano-node

23

cardano-node.service - Cardano node service
Loaded: loaded (/etc/systemd/system/cardano-node.service; enabled; vendor preset: enabled)
Active: active (running) since Tue 2021-11-02 00:58:25 UTC; 17min ago
Main PID: 190904 (bash)
Tasks: 10 (limit: 38434)
Memory: 5.0G
CGroup: /system.slice/cardano-node.service
├─190904 /bin/bash -c /home/doubled/cardano-my-node/startBlockProducingNode.sh
└─190911 cardano-node run --topology /home/doubled/cardano-my-node/mainnet-topology.json --database-p>

Nov 02 01:15:56 node cardano-node[190911]: [node:cardano.node.LeadershipCheck:Info:143] [2021-11-02 01:15:56.00 UT>
Nov 02 01:15:56 node cardano-node[190911]: [node:cardano.node.Forge:Error:143] [2021-11-02 01:15:56.00 UTC] fromLi>
Nov 02 01:15:57 node cardano-node[190911]: [node:cardano.node.LeadershipCheck:Info:143] [2021-11-02 01:15:57.00 UT>
Nov 02 01:15:57 node cardano-node[190911]: [node:cardano.node.Forge:Error:143] [2021-11-02 01:15:57.00 UTC] fromLi>
Nov 02 01:15:58 node cardano-node[190911]: [node:cardano.node.LeadershipCheck:Info:143] [2021-11-02 01:15:58.00 UT>
Nov 02 01:15:58 node cardano-node[190911]: [node:cardano.node.Forge:Error:143] [2021-11-02 01:15:58.00 UTC] fromLi>
Nov 02 01:15:59 node cardano-node[190911]: [node:cardano.node.LeadershipCheck:Info:143] [2021-11-02 01:15:59.00 UT>
Nov 02 01:15:59 node cardano-node[190911]: [node:cardano.node.Forge:Error:143] [2021-11-02 01:15:59.00 UTC] fromLi>
Nov 02 01:16:00 node cardano-node[190911]: [node:cardano.node.LeadershipCheck:Info:143] [2021-11-02 01:16:00.00 UT>
Nov 02 01:16:00 node cardano-node[190911]: [node:cardano.node.Forge:Error:143] [2021-11-02 01:16:00.00 UTC] fromLi>
lines 1-20/20 (END)

24

Nov 02 01:19:29 node cardano-node[190911]: [node:cardano.node.IpSubscription:Error:397] [2021-11-02 01:19:29.70 UTC] IPs: 0.0.0.0:0 [192.168.1.13:6000] Application Exception: 192.168.1.13:6000 ExceededTimeLimit (ChainSync (Header (HardForkBlock (’: * ByronBlock (’: * (ShelleyBlock (ShelleyEra StandardCrypto)) (’: * (ShelleyBlock (ShelleyMAEra ‘Allegra StandardCrypto)) (’: * (ShelleyBlock (ShelleyMAEra ‘Mary StandardCrypto)) (’: * (ShelleyBlock (AlonzoEra StandardCrypto)) (’ *)))))))) (Tip HardForkBlock (’: * ByronBlock (’: * (ShelleyBlock (ShelleyEra StandardCrypto)) (’: * (ShelleyBlock (ShelleyMAEra ‘Allegra StandardCrypto)) (’: * (ShelleyBlock (ShelleyMAEra ‘Mary StandardCrypto)) (’: * (ShelleyBlock (AlonzoEra StandardCrypto)) (’ *)))))))) (ServerAgency TokNext TokMustReply)

Nov 02 01:19:29 node cardano-node[190911]: [node:cardano.node.IpSubscription:Info:397] [2021-11-02 01:19:29.70 UTC] IPs: 0.0.0.0:0 [192.168.1.13:6000] Closed socket to 192.168.1.13:6000

Nov 02 01:19:29 node cardano-node[190911]: [node:cardano.node.ErrorPolicy:Notice:151] [2021-11-02 01:19:29.70 UTC] IP 192.168.1.13:6000 ErrorPolicySuspendConsumer (Just (ApplicationExceptionTrace ExceededTimeLimit (ChainSync (Header (HardForkBlock (’: * ByronBlock (’: * (ShelleyBlock (ShelleyEra StandardCrypto)) (’: * (ShelleyBlock (ShelleyMAEra ‘Allegra StandardCrypto)) (’: * (ShelleyBlock (ShelleyMAEra ‘Mary StandardCrypto)) (’: * (ShelleyBlock (AlonzoEra StandardCrypto)) (’ *)))))))) (Tip HardForkBlock (’: * ByronBlock (’: * (ShelleyBlock (ShelleyEra StandardCrypto)) (’: * (ShelleyBlock (ShelleyMAEra ‘Allegra StandardCrypto)) (’: * (ShelleyBlock (ShelleyMAEra ‘Mary StandardCrypto)) (’: * (ShelleyBlock (AlonzoEra StandardCrypto)) (’ *)))))))) (ServerAgency TokNext TokMustReply))) 20s

Nov 02 01:19:30 node cardano-node[190911]: [node:cardano.node.LeadershipCheck:Info:143] [2021-11-02 01:19:30.00 UTC] {“kind”:“TraceStartLeadershipCheck”,“chainDensity”:5.0e-2,“slot”:44249679,“delegMapSize”:913114,“utxoSize”:3759243,“credentials”:“Cardano”}

Nov 02 01:19:30 node cardano-node[190911]: [node:cardano.node.Forge:Error:143] [2021-11-02 01:19:30.00 UTC] fromList [(“val”,Object (fromList [(“kind”,String “TraceNoLedgerView”),(“slot”,Number 4.4249679e7)])),(“credentials”,String “Cardano”)]

Nov 02 01:19:30 node cardano-node[190911]: [node:cardano.node.IpSubscription:Info:153] [2021-11-02 01:19:30.71 UTC] IPs: 0.0.0.0:0 [192.168.1.13:6000] Restarting Subscription after 242.677943008s desired valency 1 current valency 0

Nov 02 01:19:30 node cardano-node[190911]: [node:cardano.node.IpSubscription:Info:153] [2021-11-02 01:19:30.71 UTC] IPs: 0.0.0.0:0 [192.168.1.13:6000] Skipping peer 192.168.1.13:6000

25

It’s seems the node is running… do you see the Producer on Relays as IN peers?

26

yes. the only thing that is concerning is in live view, it shows ‘kes current/remaining as 0/0’ with the expiration date as todays date and status is stuck starting

27

because it’s stuck as starting… but why … the starting script for Producer it’s using port 6000?

28

that is correct.

29

and glive also shows you port 6000 right?
can u share the ouput for nano env ? only the first 10 lines

30

yup.
#!/usr/bin/env bash

shellcheck disable=SC2034,SC2086,SC2230,SC2009,SC2206,SC2062,SC2059,SC2229,SC2154,SC2162,SC2120

######################################

User Variables - Change as desired

Leave as is if unsure

######################################

#CNODEBIN=“${HOME}/.cabal/bin/cardano-node” # Override automatic detection of cardano-node executable
#CCLI=“${HOME}/.cabal/bin/cardano-cli” # Override automatic detection of cardano-cli executable
#CNCLI=“${HOME}/.cargo/bin/cncli” # Override automatic detection of executable (https://github.com/AndrewWestberg/cncli)
#CNODE_HOME=“/opt/cardano/cnode” # Override default CNODE_HOME path (defaults to /opt/cardano/cnode)
CNODE_PORT=6000 # Set node port
CONFIG=“${NODE_HOME}/mainnet-config.json” # Override automatic detection of node config path
SOCKET=“${NODE_HOME}/db/socket” # Override automatic detection of path to socket
#TOPOLOGY=“${CNODE_HOME}/files/topology.json” # Override default topology.json path
#LOG_DIR=“${CNODE_HOME}/logs” # Folder where your logs will be sent to (must pre-exist)
#DB_DIR=“${CNODE_HOME}/db” # Folder to store the cardano-node blockchain db
#UPDATE_CHECK=“Y” # Check for updates to scripts, it will still be prompted before proceeding (Y|N).
#TMP_DIR=“/tmp/cnode” # Folder to hold temporary files in the various scripts, each script might create additional subfolders
#USE_EKG=“Y” # Use EKG metrics from the node instead of Prometheus. Prometheus metrics yield slightly better performance but can be unresponsive at times (default EKG)
#EKG_HOST=127.0.0.1 # Set node EKG host IP
#EKG_PORT=12788 # Override automatic detection of node EKG port
#PROM_HOST=127.0.0.1 # Set node Prometheus host IP
#PROM_PORT=12798 # Override automatic detection of node Prometheus port
#EKG_TIMEOUT=3

31

looks fine, can you download again the glive? If on Relay you have the Producer connected as IN and OUT peers, it looks there is and issue only with the glive

wget https://raw.githubusercontent.com/cardano-community/guild-operators/master/scripts/cnode-helper-scripts/gLiveView.sh
32

Both block producer and relay show connection to each other as well as other peers connected in and out of relay. but both relay and producer are stuck starting… even after re downloading gLive…

33

you think it would be worth restarting from scratch?

34

Nope, I think I found yesterday the issue

Try cardano-node - -version
which cardano-node
cd /usr/local/bin
ls -l

Share the outputs

35

Is this your personal understanding? :smiley:

1 Like
37

What happened?

38

cardano-node --version

cardano-node 1.30.1 - linux-x86_64 - ghc-8.10

git rev 0fb43f4e3da8b225f4f86557aed90a183981a64f

/usr/local/bin $ ls -l

total 254364

-rwxr-xr-x 1 root root 116451576 Oct 3 23:21 cardano-cli

-rwxr-xr-x 1 root root 127616888 Oct 3 23:21 cardano-node

-rwxr-xr-x 1 1001 121 16392536 Sep 18 13:43 cncli

39

And if u type which cardano-node

PS: what is the ticker of the pool?

40

which cardano-node
/usr/local/bin/cardano-node

Ticker CVSP

every thing was working fine until my kes expired…

41

understand, perhaps because you didn’t restarted the producer before…

can u try nano $HOME/.bashrc and show me the last lines with exports

(on adapools the relay is fine…the only issue is with the scripts glive I think)

but you said that on all nodes u have the same issue… perhaps the env updated to a new version?