Caramelaphobia

Caramelaphobia, less commonly known as karamelaphobia (from Greek karamela, meaning candy) is the fear of candy. . Struggling to chew hard candies then choking is one trigger of caramelaphobia. Another trigger is that candies are sugary, so people suffering saccharophobia would avoid candies. Children fearing candies would refuse to go trick-or-treating on Halloween.

Also, people with dairy allergies may have this.