What do Prometheus metrics mean?

Hi guys!
I am maintaining some Cardano nodes including a staking pool (validator).
Now, I faced the idea to get mor information about node operation and exposed the Prometheus metrics. But I don’t understand what they actually mean and cannot find any clue: there is no metadata in the Prometheus output, as well as no article in the docs.
Can you please help me to figure it out?

Thanks in advance!

I am including the list with metrics below:

rts_gc_cpu_ms 343522
cardano_node_metrics_RTS_gcticks_int 925
cardano_node_metrics_blockfetchclient_blockdelay_cdfThree 1.0
cardano_node_metrics_slotInEpoch_int 300847
cardano_node_metrics_Mem_resident_int 292917248
rts_gc_mutator_cpu_ms 334264
rts_gc_num_gcs 2654
cardano_node_metrics_slotNum_int 12483247
rts_gc_init_wall_ms 1
cardano_node_metrics_blockNum_int 262200
rts_gc_max_bytes_used 79643704
rts_gc_wall_ms 86150968
cardano_node_metrics_blockfetchclient_blockdelay_cdfOne 1.0
rts_gc_gc_cpu_ms 9258
rts_gc_par_tot_bytes_copied 2058381680
cardano_node_metrics_blockfetchclient_blocksize 1510
rts_gc_mutator_wall_ms 86145742
rts_gc_current_bytes_used 95389888
cardano_node_metrics_RTS_gcHeapBytes_int 255852544
cardano_node_metrics_RTS_mutticks_int 33425
cardano_node_metrics_epoch_int 32
cardano_node_metrics_RTS_gcMajorNum_int 37
rts_gc_num_bytes_usage_samples 37
cardano_node_metrics_blockfetchclient_blockdelay_cdfFive 1.0
rts_gc_par_max_bytes_copied 1434360104
cardano_node_metrics_forks_int 38
cardano_node_metrics_RTS_gcMinorNum_int 2617
cardano_node_metrics_nodeStartTime_int 1668080299
rts_gc_par_avg_bytes_copied 2058381680
cardano_node_metrics_Stat_cputicks_int 34351
cardano_node_metrics_Stat_threads_int 13
rts_gc_bytes_copied 2058381680
cardano_node_metrics_RTS_gcLiveBytes_int 95389888
rts_gc_bytes_allocated 94786669984
rts_gc_peak_megabytes_allocated 244
rts_gc_cumulative_bytes_used 1918328016
cardano_node_metrics_density_real 4.995836802664446e-2
rts_gc_current_bytes_slop 9496384
cardano_node_metrics_blockfetchclient_blockdelay_s 0.242885482
rts_gc_init_cpu_ms 1
rts_gc_gc_wall_ms 5225
ekg_server_timestamp_ms 1668166449368
rts_gc_max_bytes_slop 4625672

A bit details are here:

Additionally, maybe try some dashboards for Grafana and those dashboards do utilize those metrics, so that should give you a bit of hint too. Here are separate thread about Grafana dashboards. I personally recommend following:

https://raw.githubusercontent.com/coincashew/coincashew/master/.gitbook/assets/grafana-monitor-cardano-nodes-by-kaze%20(1).json

If you still puzzled by some, try to google…

1 Like