Erimophobia

Eremophobia is the fear of deserts. Deserts are barren and isolated that a person being out could be afraid to get lost.