Background: speechBITE (http://www.speechbite.com) is an online database established in order to help speech and language therapists gain faster access to relevant research that can used in clinical decision-making. In addition to containing more than 3000 journal references, the database also provides methodological ratings on the PEDro-P (an adapted version of the PEDro) scale to assist clinicians in identifying the scientific quality of randomized (RCTs) and non-randomized control trials (NRCTs). While reliability of the PEDro scale has been established by similar allied health databases, the reliability of the PEDro-P scale has yet to be reported. Aims: To examine the reliability of PEDro-P scale ratings undertaken by raters on the speechBITE database and benchmark these results to the published reliability for the original PEDro scale. Both the total score (out of ten) as well as each of the 11 scale items were included in this analysis. Methods & Procedures: speechBITE's volunteer rater network of 17 members rated the first 100 RCTs and NRCTs on the website. The criterion and overall scores for these ratings were compared with previously published reliability studies using the PEDro scale. Intra-class correlations and per cent agreement measures were used to establish and benchmark reliability. Outcomes & Results: The speechBITE PEDro-P ratings ranged from fair to excellent for both the total score and for each of the 11 scale items. Furthermore, reliability was equal to that of other databases. Conclusions & Implications: speechBITE users can be confident of the reliability of ratings published on the website. Further analysis of differences between this study and previous PEDro scale reliability studies are discussed. (Contains 5 tables.)