Hi Akshat,
Please select "suppress multiple alert option from the alert rule
refer - Creating, Changing, and Deleting Alert Rules - Process Integration Monitoring - SAP Library
If you do not want further alerts to be generated once the rule has been met until the first alert has been confirmed, select the Suppress Multiple Alerts of This Rule checkbox.