Video quality assessment and inter-rater reliability:
In terms of Essential and Ideal Video Completeness Criteria, the mean score was 1.62 points out of a possible total 8 points, indicating poor video quality. In terms of inter-rater reliability of this metric across 3 raters, the inter-rater correlation was moderate with Fleiss-kappa score 0.42 [P < 0.01]
The average total DISCERN score was 31.3 (out of a possible 80), indicating a low reliability of the information presented. In the breakdown of the DISCERN score (see table 3), the mean scores for the categories representing stating explicit aims, achieving those aims, remaining relevant to the topic, having explicit sources of information and stating the date of the information performed well (scores above 2.5 points) with the majority of the remaining categories scoring less than 2 points. The inter-rater correlation coefficient was 0.78 [95% CI = 0.58 - 0.90] indicating good reliability between raters.