Table 3

Agreement at the individual level between test-retest for weights, scores and MCDA estimates obtained with the MCDA Value Matrix

Weights

Scores

MCDA Estimates


Number of test-retest pairs

120*

112

8

Mean of test data

4.03

1.33

1.23

Mean of retest data

3.74

1.28

1.20

ICC (3,1)

0.578

0.681

0.656

ICC (1,1)

0.546

0.682

0.687

Proportion of pairs with no test-retest difference (%)

50.8

65.2

NA

Proportion of pairs with test-retest difference of 1 point (%)

39.2

28.6

NA

Proportion of pairs with test-retest difference of 2 points (%)

10.0

6.3

NA


*8 evaluators × 15 components; 8 evaluators × 14 components (component Q1 was not scored for case study)

NA: Not applicable

ICC: intra-class correlation coefficient, defined according to Shrout and Fleiss (1979) [40]

Goetghebeur et al. Cost Effectiveness and Resource Allocation 2010 8:4   doi:10.1186/1478-7547-8-4

Open Data