Inter-rater reliability or agreement can be thought of the consistency measure if a fixed number of raters assign numerical ratings to a number of cases/patients.
This project aims to review the availsble inter-rater reliability measures and provide an expansion where required.