Paralipophobia

Paralipophobia is the fear of neglecting duty.