## Level-1 link F1 (mean)
tier W G S1 S2 BEST-G
3000 0.156 0.705 0.668 0.516 0.603
10000 0.272 0.734 0.674 0.510 0.593
30000 0.380 0.735 0.672 0.511 0.592
## Level-2 type recall at budget (mean)
tier 3000: budget 300 1000 3000 10000 all
C-G 0.722 0.857 0.942 0.977 0.979 (list 10570)
HARD 0.673 0.763 0.795 0.795 0.795 (list 2072)
GRADED 0.730 0.811 0.840 0.978 0.979 (list 10570)
GRADED-G 0.691 0.782 0.817 0.978 0.979 (list 10570)
GRADED-R 0.719 0.822 0.924 0.977 0.979 (list 10570)
tier 10000: budget 300 1000 3000 10000 all
C-G 0.717 0.853 0.947 0.984 0.995 (list 17434)
HARD 0.711 0.827 0.878 0.881 0.881 (list 3614)
GRADED 0.745 0.847 0.874 0.893 0.995 (list 17434)
GRADED-G 0.743 0.850 0.879 0.977 0.995 (list 17434)
GRADED-R 0.717 0.869 0.946 0.984 0.995 (list 17434)
tier 30000: budget 300 1000 3000 10000 all
C-G 0.706 0.848 0.950 0.986 0.999 (list 23859)
HARD 0.704 0.834 0.883 0.899 0.899 (list 5187)
GRADED 0.744 0.844 0.885 0.899 0.999 (list 23859)
GRADED-G 0.744 0.850 0.890 0.910 0.999 (list 23859)
GRADED-R 0.706 0.853 0.953 0.987 0.999 (list 23859)
## Predictions
F1: FAIL — 3000: BEST-G-G -0.102[-0.109]; 10000: BEST-G-G -0.141[-0.146]; 30000: BEST-G-G -0.143
F2: PASS — 3000:0.979 10000:0.995 30000:0.999 | HARD 3000:0.795 10000:0.881 30000:0.899
F3a: FAIL — 3000: GRADED-C-G@1K -0.046[-0.059]; 10000: GRADED-C-G@1K -0.006[-0.012]; 30000: GRADED-C-G@1K -0.005[-0.008]
F3b (GRADED >= HARD at B = |HARD list|): see note — compared at the largest common budget below each HARD list size:
3000: |HARD| 2072, budget 1000: GRADED 0.811 vs HARD 0.763
10000: |HARD| 3614, budget 3000: GRADED 0.874 vs HARD 0.878
30000: |HARD| 5187, budget 3000: GRADED 0.885 vs HARD 0.883
F4: FAIL — GRADED-GRADED-G@1K 3000: +0.029[+0.009]; 10000: -0.004[-0.011]
F5: FAIL — GRADED-R-C-G@1K 3000: -0.035[-0.070]; 10000: +0.016[+0.013]; 30000: +0.005[+0.003]