Attachment added to support comments below:
The answer is that for each delivery service you can specify a maximum number of delivery attempts, and the time period between those attempts.
For example you may want to have:
Which would retry failed deliveries once every hour for 24 hours.
These settings are service parameters on the delivery service: