The purpose of this replication study was to examine the effects of accompaniment on evaluations of solo instrumental performances. Although previous findings have indicated that instrumental music education majors' evaluations of soloists were not independent of accompaniment, it is unknown whether more experienced evaluators are similarly affected by accompaniment. In addition to using a new population (in-service band directors), we also extended the previous study by asking participants whether they believed their evaluations of a soloist were influenced by the accompaniment provided. Participants (N = 58) listened to six excerpts of Haydn's "Concerto for Trumpet," which we created by pairing different recordings of solo trumpet performance (good or bad) with piano accompaniment (good, bad, or none). Participants evaluated the accuracy and expressivity of the soloist in each excerpt. Similar to the previous study, results indicated that participants discriminated between good and bad solo performances successfully, but a significant three-way interaction among solo, accompaniment, and order indicated that these differences were further influenced by the quality/presence of accompaniment and order. Most participants (72.4%) believed that their evaluations of the soloist were not influenced by the piano accompaniment, primarily because they were able to focus on the soloist or because they followed the instructions provided.