To pause an active alert click on the pause symbol to the left hand side of the alert. For Example This alert has now been added to the paused list of alerts: