What's Actually Happening

Grafana alerts are being silenced and not sending notifications when they should fire.

The Error You'll See

bash
# Alert shows in Grafana UI:
State: Firing (Silenced)

Why This Happens

  1. 1.Silence rule active - Manual silence not expired
  2. 2.Notification policy match - Policy routing to mute
  3. 3.Contact point disabled - Notification disabled
  4. 4.Timing issue - Alert timing settings wrong

Step 1: Check Silence Rules

```bash # In Grafana UI: # Alerting > Silences

# Check active silences via API: curl -u admin:admin http://localhost:3000/api/alertmanager/grafana/api/v2/silences ```

Step 2: Delete Silence

```bash # Via API: curl -X DELETE -u admin:admin http://localhost:3000/api/alertmanager/grafana/api/v2/silence/<silence-id>

# Or in UI: # Alerting > Silences > Delete ```

Step 3: Check Notification Policies

```bash # In Grafana UI: # Alerting > Notification policies

# Check for mute timings # Check group_by settings ```

Step 4: Verify Contact Points

```bash # In Grafana UI: # Alerting > Contact points

# Test contact point: # Click "Test" button ```

Grafana Alert Checklist

CheckLocationExpected
SilencesAlertingNone active
PoliciesNotificationCorrect routing
Contact pointsAlertingEnabled

Verify the Fix

bash
# Alert fires and sends notification
# No "Silenced" status
  • [Fix Grafana Dashboard Loading](/articles/fix-grafana-dashboard-loading)
  • [Fix Prometheus Alert Not Firing](/articles/fix-alertmanager-notification-failed)