Stop Alerts once Invoice Status is reached

RiKi ✭✭✭✭

The automation workflow was setup that when Invoice Status is "INVOICE - Vendor Confirmed Payment", the rows would be locked. There are already alerts set when the invoice is "INVOICE - submitted to client" which notifies the submitter. How do I stop the previous alerts? There is no option in the action list to stop the alert, only creating it.