1) Create an alert queue with "Maintenance equal to Yes"
2) Create an Escalation Policy & Action as shown below and apply this to above alert queue
Alert queue assignment
3) Escalation Action
4) Once the policy is enabled, it automatically clears alerts from this "Maintenance" alert queue. We may check in "Action History" screen to see how many alerts have been cleared by this policy