The Examination of Rater Consistency when using the Credit Matrix Model in Victoria and Tasmania

Staffing

S. Gillis, L.Calvitto, T.K.C. Nguyen, M. Wu & P. Griffin,

Summary

The Victorian Qualifications Authority (VQA) commissioned the Assessment Research Centre at the University of Melbourne to examine the degree to which the Detailed and Level Descriptors, thought to underpin the Credit Matrix, yielded consistent outcomes when administered to units of learning. Specifically, the study sought to examine the level of agreement in ratings that were made by different experts, when judging the complexity of a range of identified qualification units drawn from a range of industry sectors. Separate rating exercises were conducted in Tasmania and in Victoria.

Funding

Victorian Qualifications Authority

Publications

Gillis, S., Nguyen, T.K.C. (2005). The credit matrix rating exercise conducted in Tasmania: Final Report submitted to the Victorian Qualifications Authority, Melbourne.

Gillis, S., Griffin , P., Wu, M., Calvitto, L., & Nguyen, C. (2004). Credit Matrix Model: Analysis and Report on Consistency. Assessment Research Centre, Melbourne .