Web-based standard setting holds promise for reducing the travel and logistical inconveniences of traditional, face-to-face standard setting meetings. However, because there are few published reports of setting standards via remote meeting technology, little is known about the practical potential of the approach, including technical feasibility of implementing common standard setting methods and whether such an approach presents threats to validity and reliability. In previous work, we demonstrated the feasibility of implementing a modified Angoff methodology in a virtual environment (Katz, Tannenbaum,& Kannan, 2009). This paper presents results from two studies in which we compare cutscores set through face-to-face meetings and through the web-based approach on two operational tests, one of digital literacy and one of French.