R0: PASS — 10/10 seeds reproduce Test A exactly
## Means: R@B / P@B
3000 G: CNT 0.857/0.142 0.938/0.129 0.977/0.118 HARD 0.763/0.213 0.935/0.134 0.977/0.118 SOFT 0.781/0.162 0.841/0.136 0.978/0.118
3000 L: CNT 0.842/0.131 0.895/0.121 0.929/0.117 HARD 0.676/0.132 0.893/0.123 0.929/0.117 SOFT 0.681/0.124 0.848/0.123 0.929/0.117
10000 G: CNT 0.853/0.141 0.948/0.128 0.983/0.116 HARD 0.827/0.232 0.879/0.193 0.984/0.117 SOFT 0.820/0.159 0.901/0.138 0.989/0.118
10000 L: CNT 0.872/0.132 0.927/0.120 0.967/0.115 HARD 0.764/0.145 0.838/0.130 0.967/0.115 SOFT 0.782/0.132 0.821/0.119 0.967/0.115
30000 G: CNT 0.848/0.140 0.950/0.128 0.986/0.116 HARD 0.834/0.233 0.883/0.195 0.987/0.117 SOFT 0.835/0.160 0.925/0.140 0.961/0.121
30000 L: CNT 0.894/0.132 0.943/0.120 0.982/0.114 HARD 0.823/0.164 0.907/0.144 0.980/0.115 SOFT 0.875/0.143 0.918/0.127 0.950/0.117
## Predictions
E1 G: FAIL — R@3K SOFT − CNT 3000: -0.097 [-0.108, -0.086]; 10000: -0.047 [-0.055, -0.039]; 30000: -0.024 [-0.026, -0.022]
E2 G: PASS — R@3K SOFT − HARD at 30000 +0.042 [+0.039, +0.046]
E3 G: PASS — P@3K SOFT − CNT at 30000 +0.012 [+0.012, +0.013]
E1 L: FAIL — R@3K SOFT − CNT 3000: -0.047 [-0.096, +0.001]; 10000: -0.106 [-0.132, -0.080]; 30000: -0.024 [-0.043, -0.006]
E2 L: PASS — R@3K SOFT − HARD at 30000 +0.011 [+0.006, +0.016]
E3 L: PASS — P@3K SOFT − CNT at 30000 +0.008 [+0.005, +0.010]