Fool's Guilt

noun
Guilt suffered in spite of the reasonableness or necessity of the causative action.

Example scenario: An urgent request has to be turned down due to a lack of available time.