# Relay node suddenly go down after 3 months

**URL:** <https://forum.cardano.org/t/relay-node-suddenly-go-down-after-3-months/67050>\
**Category:** Setup a Stake Pool\
**Created:** [17 July 2021 20:35 UTC](https://forum.cardano.org/t/relay-node-suddenly-go-down-after-3-months/67050 "2021-07-17T20:35:40Z")\
**Posts on this page:** 13\
**Page:** 1

<div class="post-metadata">

**Author:** ![conniec1](https://avatars.discourse-cdn.com/v4/letter/c/c0e974/32.png) [@conniec1](https://forum.cardano.org/u/conniec1)\
**Post date:** [17 July 2021 20:35 UTC](https://forum.cardano.org/t/relay-node-suddenly-go-down-after-3-months/67050/1 "2021-07-17T20:35:40Z")

</div>

Hi ,  
My relay node have been running for 3 months now, today I found it seems go down, 0 blocks,slots, everything 0. I restart the node and still see the same (below picture).

Could you please share what is the cause if any clue , can you please suggest how should I recover from it?

![image](https://us1.discourse-cdn.com/flex023/uploads/cardano/original/3X/b/3/b339d5aee61b25c629171d57b99552adde4bb95c.png)

---

<div class="post-metadata">

**Author:** ![Alexd1985](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.cardano.org/alexd1985/32/23759_2.png) [@Alexd1985](https://forum.cardano.org/u/Alexd1985)\
**Post date:** [17 July 2021 20:42 UTC](https://forum.cardano.org/t/relay-node-suddenly-go-down-after-3-months/67050/2 "2021-07-17T20:42:04Z")

</div>

journalctl -e -f -u cardano-node

or

journalctl -e -f -u cnode

---

<div class="post-metadata">

**Author:** ![conniec1](https://avatars.discourse-cdn.com/v4/letter/c/c0e974/32.png) [@conniec1](https://forum.cardano.org/u/conniec1)\
**Post date:** [17 July 2021 21:49 UTC](https://forum.cardano.org/t/relay-node-suddenly-go-down-after-3-months/67050/3 "2021-07-17T21:49:17Z")

</div>

I ran the command and it seems restart the node, however seems it still stuck at the “starting…” phase  
 ![image](https://us1.discourse-cdn.com/flex023/uploads/cardano/original/3X/a/8/a8d824ec45210069ccba289266f468a535c7fc5d.png)

---

<div class="post-metadata">

**Author:** ![conniec1](https://avatars.discourse-cdn.com/v4/letter/c/c0e974/32.png) [@conniec1](https://forum.cardano.org/u/conniec1)\
**Post date:** [17 July 2021 22:07 UTC](https://forum.cardano.org/t/relay-node-suddenly-go-down-after-3-months/67050/4 "2021-07-17T22:07:39Z")

</div>

It works! thanks for your help!

---

<div class="post-metadata">

**Author:** ![conniec1](https://avatars.discourse-cdn.com/v4/letter/c/c0e974/32.png) [@conniec1](https://forum.cardano.org/u/conniec1)\
**Post date:** [18 July 2021 00:50 UTC](https://forum.cardano.org/t/relay-node-suddenly-go-down-after-3-months/67050/5 "2021-07-18T00:50:26Z")

</div>

@Alexd1985 ,  
It works originally after restart, however it seems back to starting… phase again, what could be the cause of failing so soon, in less than an couple hours?  
Should I restart or there is some other known issues?

Looks like is run out of disk space issue? I check df -k . , it is 98%. How should I make up more space?

---

<div class="post-metadata">

**Author:** ![Alexd1985](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.cardano.org/alexd1985/32/23759_2.png) [@Alexd1985](https://forum.cardano.org/u/Alexd1985)\
**Post date:** [18 July 2021 05:27 UTC](https://forum.cardano.org/t/relay-node-suddenly-go-down-after-3-months/67050/6 "2021-07-18T05:27:10Z")

</div>

Delete the log files

---

<div class="post-metadata">

**Author:** ![conniec1](https://avatars.discourse-cdn.com/v4/letter/c/c0e974/32.png) [@conniec1](https://forum.cardano.org/u/conniec1)\
**Post date:** [19 July 2021 03:25 UTC](https://forum.cardano.org/t/relay-node-suddenly-go-down-after-3-months/67050/7 "2021-07-19T03:25:33Z")

</div>

When I run the topologyUpdater.sh script, the message show my node is out of sync  
", “clientIp”: “x.x.76.39”, “msg”: “blockNo 2606181 seems out of sync. please retry” }

I retried a couple times, and still the same. What should I do?  
This is my 2nd relay node. the first relay node seems okay  
This is the 2nd note gLview  
 ![image](https://us1.discourse-cdn.com/flex023/uploads/cardano/original/3X/0/3/036aea15cac21a10ca1637b2f4018044e0f74d27.png)

---

<div class="post-metadata">

**Author:** ![Xpriens](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.cardano.org/xpriens/32/45030_2.png) [@Xpriens](https://forum.cardano.org/u/Xpriens)\
**Post date:** [19 July 2021 09:22 UTC](https://forum.cardano.org/t/relay-node-suddenly-go-down-after-3-months/67050/8 "2021-07-19T09:22:28Z")

</div>

Delete db restart and let it resync. It once happened to one of my relays as well.  
You might want to change the topology file and remove the extra out connections because they slow down the sync process.

---

<div class="post-metadata">

**Author:** ![conniec1](https://avatars.discourse-cdn.com/v4/letter/c/c0e974/32.png) [@conniec1](https://forum.cardano.org/u/conniec1)\
**Post date:** [19 July 2021 16:05 UTC](https://forum.cardano.org/t/relay-node-suddenly-go-down-after-3-months/67050/9 "2021-07-19T16:05:15Z")

</div>

do you mean on the relay node, delete the DB and change mainnet.topology.json?  
BTW, this is my 2 nd relay node.

---

<div class="post-metadata">

**Author:** ![Xpriens](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.cardano.org/xpriens/32/45030_2.png) [@Xpriens](https://forum.cardano.org/u/Xpriens)\
**Post date:** [20 July 2021 08:44 UTC](https://forum.cardano.org/t/relay-node-suddenly-go-down-after-3-months/67050/10 "2021-07-20T08:44:58Z")

</div>

Yep, exactly

---

<div class="post-metadata">

**Author:** ![conniec1](https://avatars.discourse-cdn.com/v4/letter/c/c0e974/32.png) [@conniec1](https://forum.cardano.org/u/conniec1)\
**Post date:** [20 July 2021 16:13 UTC](https://forum.cardano.org/t/relay-node-suddenly-go-down-after-3-months/67050/11 "2021-07-20T16:13:42Z")

</div>

There are 3 directories inside DB, will it broke if I delete the DB?  
do you mean cardano-my-node/db?

---

<div class="post-metadata">

**Author:** ![Xpriens](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.cardano.org/xpriens/32/45030_2.png) [@Xpriens](https://forum.cardano.org/u/Xpriens)\
**Post date:** [21 July 2021 08:05 UTC](https://forum.cardano.org/t/relay-node-suddenly-go-down-after-3-months/67050/12 "2021-07-21T08:05:38Z")

</div>

Yes this is the directory. If you delete the files in there and let the node resync it will recreate them.

---

<div class="post-metadata">

**Author:** ![cyberruss](https://avatars.discourse-cdn.com/v4/letter/c/4bbf92/32.png) [@cyberruss](https://forum.cardano.org/u/cyberruss)\
**Post date:** [21 July 2021 08:26 UTC](https://forum.cardano.org/t/relay-node-suddenly-go-down-after-3-months/67050/13 "2021-07-21T08:26:51Z")

</div>

`df -h` to check disk space. There are some easy bash options to check which directories will be using the space. As Alex mentions above it is almost certainly be the log files. You can delete everything in the log directory and restart the node and you will be fine.

When you ran out of disk space you probably broke the db as well, given it is now re-synching.
