Staring at the Other

After reading some of Rosemarie Garland-Thomson's article, it got me thinking about how much of an effect our eyes have on others and like she says "staring is an embodied and relational visual exchange that carries complex cultural and historical meanings." So why do you think it is that when we stare or look at someone, it is automatically in our nature to pre-judge them before knowing them? Who created this idea of whats normal vs. what is not and who decided that visual encounter with someone was what characterized them as a person?