A basic framework is proposed to distinguish between the many ways in which Virtual Learning Environments (VLEs) can be evaluated. This includes the purpose of the evaluation, the type of methods that might be used and the measures employed. The framework is not intended to cover all applications but offers one means of structuring a review of past studies or may provide guidance on the type of study to conduct. A pilot study is introduced which compares an online course using different platforms which aims to measure engagement, participation and achievement of goals.