What's Actually Happening

Grafana alerts are not sending notifications. Alert rules fire but notifications are not received.

The Error You'll See

  • Alert shows "Firing" but no notification received
  • Contact point test fails
  • Notification policy not routing alerts

Why This Happens

  1. 1.Contact point misconfigured
  2. 2.Notification policy missing
  3. 3.Alert rule issues
  4. 4.Silences blocking
  5. 5.Network connectivity

Step 1: Check Contact Point

bash
# Alerting > Contact points
# Test contact point

Step 2: Test Notification

bash
# In Grafana UI:
# Alerting > Contact points > Test

Step 3: Check Notification Policy

bash
# Alerting > Notification policies
# Verify routing tree

Step 4: Check Alert Rule

bash
# Alerting > Alert rules
# Verify query and condition

Step 5: Check Silences

bash
# Alerting > Silences
# Check for active silences

Step 6: Check Grafana Logs

bash
journalctl -u grafana-server -f
docker logs grafana

Step 7: Verify SMTP Settings

ini
# In grafana.ini
[smtp]
enabled = true
host = smtp.example.com:587
user = myuser
password = mypassword

Step 8: Check Alert State

bash
curl http://admin:password@localhost:3000/api/alertmanager/grafana/api/v2/alerts

Step 9: Restart Grafana

bash
systemctl restart grafana-server
docker restart grafana

Step 10: Test Webhook

bash
curl -X POST http://webhook-url -d '{"message":"test"}'
  • [Fix Grafana Dashboard Not Loading](/articles/fix-grafana-dashboard-not-loading)
  • [Fix Prometheus Query Timeout](/articles/fix-prometheus-query-timeout)