This study introduces a new method of evaluating human comprehension in the context of machine translation using a language translation program known as the FALCon (Forward Area Language Converter). The participants include 48 freshmen from the United States Military Academy enrolled in the General Psychology course, PL100. Results of this study have brought a few key points for consideration in Arabic machine translation. First, human understanding is not a factor to be ignored in gauging the usefulness of such translators. Secondly, the type of translation used can depend on the type of information needed, whether it is key people and places or the general plans or opinions. An even better method would combine the two types (probably through human interpretation) to have one complete translation with both key details and the right concepts. Combining the strengths of the two types is especially important in developing a training strategy to employ translators like the FALCON for intelligence gathering. (Contains 6 figures.)