Facing your fears when you have low self-esteem makes a big difference in how you view yourself. When you struggle with low self-esteem, you tend to hold particular self-limiting beliefs about yourself Fear starts in the part of the brain called the amygdala. According to Smithsonian Magazine, “A threat stimulus, such as the sight of a predator, triggers a fear response in the amygdala, which activates areas involved in preparation for motor functions involved in fight or flight.