Grafana Stopped working

Staking & Delegation Operate a Stake Pool
#1

Hello guys, need some help on Grafana.
Stopped working today. No changes has been made whatsoever.
http://127.0.0.1:5000/ - This site can’t be reached
So I checked the following:

  1. tunnel is up
  2. I can successfully access Prometheus http://127.0.0.1:9090/graph
  3. Grafana service is up
    2021-06-09 21_42_41_ _opt_cardano_monitoring_grafana
    2021-06-09 21_42_41_ _opt_cardano_monitoring_grafana2270×321 39.7 KB
  4. netstat -tulpn shows the following (I am not sure if 5000 on ipv4 should be listened ?)
    2021-06-09 21_43_56- _opt_cardano_monitoring_grafana

I am not sure what has changed or grfana updated itself still does not work. Any ideas ?

#2

Try to restart the grafana process

#3

Hi Alex Tried to restart service also restarted server as well

#4

Try from the server

telnet 127.0.0.1 5000

U should see connected

#5

That works
2021-06-09 22_14_572_opt_cardano_monitoring_grafana

#6

Try now from the remote device

#7

Did not work
2021-06-09 22_19_44-Command Prompt

#8

Then, something is blocking the port

#9

But wait… 127.0.0.1 should be the local host… I think it’s not relevant

#10

You are correct I have tunnel in the putty
2021-06-09 22_22_55-PuTTY Configuration

#11

This is what concerns me
2021-06-09 22_24_21 _opt_cardano_monitoring_grafana

#12

Looks like it only listens on IPv6 should it be like that ?

#13

I have the same ,

Try journalctl -e -f -u grafana-server.service

#14

Shows bunch of those

2021-06-09 22_52_25
2021-06-09 22_52_252265×502 88.5 KB

#15

Says no data source but my understanding was I suppose to see home page regardless.

#16

Try this perhaps it will help

1 Like
#17

Hi Alex, I do not believe this article will be helpful in this particular case. So what I did for testing purposes I have opened 5000 on the firewall on public IP and was able to access Grafana. so looks like issues somewhere in the tunnel routing. so i am looking at Grafana config /opt/cardano/monitoring/grafana/conf/defaults.ini do you know if there is any other config files ? I what to see which interface it is set to listen.

#18

Well, is it normal that systemd logs say “Could not find data source” and “changing state to=alerting” ?

Where do you want it to be accessed from ? External IP or local machine ? It’s also possible to listen on loopback interface and access it remotely, and securely, using an SSH tunnel…

#19

@raph_cardano thx for your time man, but please read the whole post.

#20

I read up until the point you didn’t want to try a proposed solution (which seems applicable to the first post and another one in the thread). And I also proposed you to make the service a bit more secure but that does not seem to be of interest either. If your service works when used locally, then it will work with an SSH tunnel (since it just redirects the local port) but nevermind.What don’t you tell us the solution you expect, so that we may be of any help ? :wink: