Introduction: Reading comprehension is an important skill in the fast pace global society in which we now live. However, reading comprehension is a rather complex process that involves the dynamic interaction of cognitive and metacognitive skills. Method: In the present study, we investigated whether a newly-developed text inconsistency detection task adequately measured inconsistency detection and reparation. We validated the measure employing a sample of 146 undergraduate students in Chile. We also explored whether the validated measure significantly positively predicted performance on a standardized reading comprehension measure and whether it was able to adequately discriminate between proficient and poor readers. Results: We found that the final solution of inconsistency detection task was unidimensional and explained approximately 68% of the variability in the items. Further, inconsistency detection and reparation positively significantly predicted reading comprehension performance, and it was able to successfully discriminate between proficient and poor readers. Implications for learning and educational practice are discussed. Discussion and Conclusion: We demonstrated that our proposed text inconsistency detection test can be successfully and efficiently employed to invoke readers' skill at monitoring reading comprehension by challenging them to detect inconsistencies and pursue the metacognitive process of reparation (i.e., control).