In every learning situation or environment, human psychology plays a significant role. English speaking is a language skill that is highly affected by human psychology. This research aimed at describing the psychological factor that affects negatively the English speaking performance for the English learners in Indonesia. A descriptive qualitative design was used to conduct this research. The research was consisted of theoretical review, field notes, observations, and unstructured interviews. The participants were 20 students. The data were analyzed using the interactive analysis technique developed by Miles and Huberman (1994). The results of the research reveal that the psychological factor truly affects negatively the students' English speaking performance. Although most of the students think that they have good level of English vocabulary and grammar, they are insecure while speaking English. Most of the problems were (1) Fear of making mistakes (2) Feeling shy (3) Feeling hesitated (4) lack of confidence while speaking English. Finally, some suggestions expected to be significant remedies to overcome the problem were proposed by the researcher.