Background: The use of computers has increased in speaking assessments; however, there are concerns about how the absence of an interlocutor affects performance on speaking tests. Method: In the current study, the test scores and the underlying factor structures of monologic tasks were compared between two delivery modes: computer delivery and face-to-face modes. Seventy-nine Japanese students responded to two monologic tasks delivered via both modes in a counterbalanced design. Results: One-way multivariate analysis of variance results showed no significant differences between the test scores assigned to the two modes. Exploratory factor analysis did not reveal differences in the underlying factor structures of the two modes. Conclusions: The findings provide evidence for the use of monologic tasks in computer-delivered speaking tests.