Researchers have examined the use of homemade PowerPoint games as an instructional technique to improve learning outcomes. However, test data have shown no significant difference in performance between high school chemistry students who created games and students who did not (Siko, Barbour, & Toker, 2011). One of the justifications for the use of the games is that students will, with practice, write higher-order questions when constructing the games. Two subject matter experts rated over 2,500 questions from games created by students in an environmental chemistry class through thematic analysis using Bloom's taxonomy as a coding scheme. The students wrote primarily recall questions, and students who created games on two occasions did not write more questions than students who only created games once. This suggests that changes to the question-writing aspect of the game project may be necessary in order to see improvements in achievement when compared to control groups. (Contains 3 tables and 4 figures.)