A reliability generalization study was completed on the Patterns of Adaptive Learning Survey achievement goal orientation scales to assess the prediction of (a) the different orientation scales, (b) the adaptation of items to meet research needs, (c) the number of respondents completing the instrument, and (d) the publication date cited for the manual used on reliability variation in articles that reported sample specific reliability coefficients. The results of analyses suggested that the evolution of the scales has improved the consistency of the scores derived, lending more credence to inferences that are based on the scores from the more recent versions of the instrument. Nevertheless, examples of poor to marginal coefficients were observed in some cases.