This paper aims to provide insights into the challenges of Communicative Language Teaching (CLT) practice at higher secondary level in Bangladeshi rural settings. Employing qualitative approach, in-depth interviews were conducted with 24 rural English language teachers to explore the problems they face in CLT implementation. The interview data were scrutinized using thematic analysis. Three major themes emerge from the analysis which are: (i) pedagogical factors; (ii) contextual factors; and (iii) personal factors that obstruct CLT implementation to reach at its expected outcome. The paper reveals the gap between the objectives of the present ELT curriculum and teachers' practices. The teachers are optimistic with CLT approach for improving students' English skill, but they need viable support to overcome the factors working as the barriers of its proper implementation. Based on the teachers' suggestion, the study recommends the aligning of curriculum and test format, and also the training and logistic support for the teachers to overcome the issues surrounding the CLT implementation in the rural context of Bangladesh.