Surdophobia

Surdophobia is the fear of deaf people.