The widespread use of technological devices in an academic classroom brought with it many learning opportunities, but also posed a challenge of handling the off-task technology use in class. The literature on this topic is growing, but we still know relatively little about students' and instructors' perceptions regarding the off-task technology use in class. This paper addressed this gap by examining (1) how do students and instructors perceive technology in the classroom, and (2) who do they believe should be responsible for minimizing off-task technology use in class? Analyzing data from a mixed-method study with students and instructors in a Canadian university, we show that while students acknowledged that the off-task technology use can be distracting, they considered it a matter of personal autonomy, which can only be regulated when it creates distractions for others. The instructors had a more complex view and posed some challenging questions about the relationship between student engagement and technological distractions, the impact of technology on learning process, and the responsibility of educators in higher education. In conclusion, we reflect on some of the questions that ought to be considered when handling the off-task technology in an academic classroom.