This study investigates the effects that three different test presentation formats, i.e., written Korean, written English and aural English, have on EFL learners' listening comprehension. A total of 169 Korean college students participated in this study. The participants were divided into six groups, by three presentation format types and two proficiency levels. They were presented with multiple-choice English listening tests. The results of the study showed that listening questions using the written Korean presentation mode were the easiest for them, while the aural English options were the most challenging. The analysis showed that high and low proficiency level students performed differently on the listening tests. The high level students performed best in written Korean and written English test formats, and had the most trouble with aural English tests. Students of both proficiency levels performed measurably better with test options written in Korean as compared to the other two presentation modes. Results of the post-test survey showed that test options written in participants' L1 were most preferred by the students, while the aural English option was the least favorable test method. However, the participants considered the aural English test mode to be the most fair and appropriate method of assessing test-takers' listening comprehension abilities.