Surdophobia

Surdophobia is a word that refers to the fear of deaf people.