Not aware of any facility for that specific task. Do you know if the alerts appear by order of creation, or some other property? If so, then it could perhaps be possible to build an application/script to read all of the alerts for an ERL, sort them, delete the existing ones, and recreate them in the desired order.
However, as you mention, this would require some development and care in testing/executing, including test platforms (like the DevNet Sandbox) good backups and restore procedures...best practices for development on any enterprise platform, really. It is perhaps arguable that if the system is too important and too fragile to contemplate this kind of maintenance activity then it's at high risk anyway - it may be good to see if there are ways to improve availability/robustness.
