Hi fellow SPOs,
Upgraded all nodes to 1.29.0 yesterday. After approx 3 hours of running, I’ve finally encountered the much dreaded alert from my system telling me that the relay nodes are running out of memory (around 1.5% left). Nodes were able to run on previous version (1.27.0) without burning as much.
These are the configs:
- Producer and Relay nodes run on 8GB ram
- “TraceMempool” is set to false in relay node
- Relay node memory consumption is around 86% - 90% while producer node is around 81% - 85%. The increase is likely due to relay having more peers to connect to.
With Alonzo upgrade around the corner, I fear that 8GB ram is not going to be sufficient. So fellow SPOs, what are there some of the memory optimization tips that you have used?
I’m aware of the following discussions:
Or do we resign to the fact that 16GB is the new minimum…