| … | … | @@ -0,0 +1,27 @@ |
| 1 | # Test LV — Linas's clusterer as layer 1 — results | |
| 2 | ||
| 3 | Run `results-LV/1792366731` (code `1f8e6b6`, 10 seeds). Scored against PREREG-LV (`bd0d982`) by `summarize-LV.py`. Scorer fix | |
| 4 | before reading the verdicts: the L-MST reference first picked up Test A-U's MPG row (0.680); it now reads the MST | |
| 5 | row (0.700), as pre-registered. No verdict changed. | |
| 6 | ||
| 7 | | | prediction (30K) | verdict | | |
| 8 | |---|---|---| | |
| 9 | | L1 | a token's own LV-I class beats one label per word on senses | **FAIL** +0.003 [−0.004, +0.011] | | |
| 10 | | L2 | MST over LV-I labels beats the word MST | **FAIL** −0.026 (0.544 vs 0.570) | | |
| 11 | | L3 | LV-I within 0.02 of the exchange classes' parse | **FAIL** −0.156 (0.544 vs 0.700) | | |
| 12 | | L4 | LV-I helps level 2 (ucomp type recall vs word MST) | **PASS** +0.013 (0.267 vs 0.254) | | |
| 13 | ||
| 14 | Held-out labels at 30K (V-measure / many-to-one / labels / share of tokens in a class / sense): | |
| 15 | LV-I 0.658 / 0.759 / 1,190 / 0.47 / 0.753; LV-A (as Linas's stack runs) 0.722 / 0.918 / 1,170 / 0.26 / 0.828. | |
| 16 | Merges: 100 of 100 loops at 10K and 30K (the loop limit, not the MI cutoff, ended the run). | |
| 17 | ||
| 18 | ## What it says | |
| 19 | ||
| 20 | 1. **Under Linas's own call the clusterer covers too little to be a layer.** | |
| 21 | About half the tokens (LV-I) or a quarter (LV-A) get a class; the rest stay as single words, so there are | |
| 22 | ~1,200 labels and the class-pair MI is nearly as sparse as word MI. The re-parse is slightly *worse* than words. | |
| 23 | 2. **No per-occurrence sense effect** (L1): the partial-merge mechanism does not separate senses at this scale. | |
| 24 | LV-A's high many-to-one (0.92) is word identity, not good classes. | |
| 25 | 3. **This tests the documented setting, not the method's ceiling.** 100 loops hit the limit; Linas runs his | |
| 26 | clustering far longer. Running to convergence (more loops, all words ranked) is the fair next test of the | |
| 27 | method; its cost is unknown. Round 2 onward of the port is still unverified against Linas (parked divergence). |
| … | … | @@ -0,0 +1 @@ |
| 1 | 1f8e6b6b97ab56483d2009fd9cad1b388005bfd3 |
| … | … | @@ -0,0 +1,102 @@ |
| 1 | Q 1 3000 LV-I 0.60496 0.69281 1190 0.57021 0.62558 0.62791 | |
| 2 | N 1 3000 LV-I 95 | |
| 3 | Q 1 3000 LV-A 0.72050 0.93596 1220 0.14932 0.88295 0.88295 | |
| 4 | N 1 3000 LV-A 58 | |
| 5 | Q 1 10000 LV-I 0.65444 0.74329 1192 0.48658 0.66538 0.84333 | |
| 6 | N 1 10000 LV-I 100 | |
| 7 | Q 1 10000 LV-A 0.72813 0.93870 1187 0.22938 0.86331 0.86396 | |
| 8 | N 1 10000 LV-A 100 | |
| 9 | Q 1 30000 LV-I 0.67779 0.79123 1205 0.45767 0.88050 0.88050 | |
| 10 | N 1 30000 LV-I 100 | |
| 11 | Q 1 30000 LV-A 0.72241 0.92918 1194 0.27342 0.82642 0.82642 | |
| 12 | N 1 30000 LV-A 100 | |
| 13 | # seed=1 V=1607 heldout_sents=2000 | |
| 14 | GUARD C1 PASS tp=5002 kept=5002 gold=5002 | |
| 15 | GUARD C5 PASS gold=5002 conn=5002 comp=5002 | |
| 16 | # tier=3000 train_toks=22033 | |
| 17 | P 1 3000 LV-I MST 0.44151 0.44151 0.44151 | |
| 18 | X 1 3000 C-LV-I 2 6479 | |
| 19 | X 1 3000 C-LV-I 3 10935 | |
| 20 | X 1 3000 C-LV-I 4 11727 | |
| 21 | X 1 3000 C-LV-I 5 10111 | |
| 22 | X 1 3000 C-LV-I 6 7898 | |
| 23 | A 1 3000 C-LV-I 47150 1.00000 0.57430 0.17954 4825 15434 | |
| 24 | X 1 3000 M-LV-I-ucomp-MST 2 951 | |
| 25 | X 1 3000 M-LV-I-ucomp-MST 3 1379 | |
| 26 | X 1 3000 M-LV-I-ucomp-MST 4 1719 | |
| 27 | X 1 3000 M-LV-I-ucomp-MST 5 1866 | |
| 28 | X 1 3000 M-LV-I-ucomp-MST 6 1515 | |
| 29 | A 1 3000 M-LV-I-ucomp-MST 7430 0.37078 0.15855 0.32875 4825 2327 | |
| 30 | # tier=10000 train_toks=72741 | |
| 31 | P 1 10000 LV-I MST 0.48429 0.48429 0.48429 | |
| 32 | X 1 10000 C-LV-I 2 15345 | |
| 33 | X 1 10000 C-LV-I 3 31240 | |
| 34 | X 1 10000 C-LV-I 4 36298 | |
| 35 | X 1 10000 C-LV-I 5 32457 | |
| 36 | X 1 10000 C-LV-I 6 25512 | |
| 37 | A 1 10000 C-LV-I 140852 1.00000 0.63358 0.16835 4825 18159 | |
| 38 | X 1 10000 M-LV-I-ucomp-MST 2 2439 | |
| 39 | X 1 10000 M-LV-I-ucomp-MST 3 4446 | |
| 40 | X 1 10000 M-LV-I-ucomp-MST 4 5744 | |
| 41 | X 1 10000 M-LV-I-ucomp-MST 5 6211 | |
| 42 | X 1 10000 M-LV-I-ucomp-MST 6 5171 | |
| 43 | A 1 10000 M-LV-I-ucomp-MST 24011 0.37637 0.19710 0.30000 4825 3170 | |
| 44 | # tier=30000 train_toks=217958 | |
| 45 | P 1 30000 LV-I MST 0.53913 0.53913 0.53913 | |
| 46 | X 1 30000 C-LV-I 2 31823 | |
| 47 | X 1 30000 C-LV-I 3 71393 | |
| 48 | X 1 30000 C-LV-I 4 96159 | |
| 49 | X 1 30000 C-LV-I 5 92437 | |
| 50 | X 1 30000 C-LV-I 6 75241 | |
| 51 | A 1 30000 C-LV-I 367053 1.00000 0.71171 0.15738 4825 21820 | |
| 52 | X 1 30000 M-LV-I-ucomp-MST 2 5130 | |
| 53 | X 1 30000 M-LV-I-ucomp-MST 3 12011 | |
| 54 | X 1 30000 M-LV-I-ucomp-MST 4 17535 | |
| 55 | X 1 30000 M-LV-I-ucomp-MST 5 19570 | |
| 56 | X 1 30000 M-LV-I-ucomp-MST 6 16438 | |
| 57 | A 1 30000 M-LV-I-ucomp-MST 70684 0.41223 0.27358 0.30261 4825 4362 | |
| 58 | # seed=1 V=1607 heldout_sents=2000 | |
| 59 | GUARD C1 PASS tp=5002 kept=5002 gold=5002 | |
| 60 | GUARD C5 PASS gold=5002 conn=5002 comp=5002 | |
| 61 | # tier=3000 train_toks=22033 | |
| 62 | P 1 3000 LV-A MST 0.45127 0.45127 0.45127 | |
| 63 | X 1 3000 C-LV-A 2 8266 | |
| 64 | X 1 3000 C-LV-A 3 13056 | |
| 65 | X 1 3000 C-LV-A 4 12461 | |
| 66 | X 1 3000 C-LV-A 5 10298 | |
| 67 | X 1 3000 C-LV-A 6 7920 | |
| 68 | A 1 3000 C-LV-A 52001 1.00000 0.43399 0.17811 4825 11757 | |
| 69 | X 1 3000 M-LV-A-ucomp-MST 2 1210 | |
| 70 | X 1 3000 M-LV-A-ucomp-MST 3 1440 | |
| 71 | X 1 3000 M-LV-A-ucomp-MST 4 1656 | |
| 72 | X 1 3000 M-LV-A-ucomp-MST 5 1767 | |
| 73 | X 1 3000 M-LV-A-ucomp-MST 6 1518 | |
| 74 | A 1 3000 M-LV-A-ucomp-MST 7591 0.37244 0.12456 0.33688 4825 1784 | |
| 75 | # tier=10000 train_toks=72741 | |
| 76 | P 1 10000 LV-A MST 0.52040 0.52040 0.52040 | |
| 77 | X 1 10000 C-LV-A 2 17462 | |
| 78 | X 1 10000 C-LV-A 3 35373 | |
| 79 | X 1 10000 C-LV-A 4 37986 | |
| 80 | X 1 10000 C-LV-A 5 33000 | |
| 81 | X 1 10000 C-LV-A 6 25593 | |
| 82 | A 1 10000 C-LV-A 149414 1.00000 0.56166 0.16565 4825 16360 | |
| 83 | X 1 10000 M-LV-A-ucomp-MST 2 2988 | |
| 84 | X 1 10000 M-LV-A-ucomp-MST 3 4902 | |
| 85 | X 1 10000 M-LV-A-ucomp-MST 4 5932 | |
| 86 | X 1 10000 M-LV-A-ucomp-MST 5 6243 | |
| 87 | X 1 10000 M-LV-A-ucomp-MST 6 5270 | |
| 88 | A 1 10000 M-LV-A-ucomp-MST 25335 0.42238 0.20642 0.33057 4825 3013 | |
| 89 | # tier=30000 train_toks=217958 | |
| 90 | P 1 30000 LV-A MST 0.57151 0.57151 0.57151 | |
| 91 | X 1 30000 C-LV-A 2 34825 | |
| 92 | X 1 30000 C-LV-A 3 86049 | |
| 93 | X 1 30000 C-LV-A 4 105453 | |
| 94 | X 1 30000 C-LV-A 5 96738 | |
| 95 | X 1 30000 C-LV-A 6 76264 | |
| 96 | A 1 30000 C-LV-A 399329 1.00000 0.64104 0.15792 4825 19586 | |
| 97 | X 1 30000 M-LV-A-ucomp-MST 2 6728 | |
| 98 | X 1 30000 M-LV-A-ucomp-MST 3 14639 | |
| 99 | X 1 30000 M-LV-A-ucomp-MST 4 18495 | |
| 100 | X 1 30000 M-LV-A-ucomp-MST 5 19320 | |
| 101 | X 1 30000 M-LV-A-ucomp-MST 6 16205 | |
| 102 | A 1 30000 M-LV-A-ucomp-MST 75387 0.46321 0.27440 0.34372 4825 3852 |
| … | … | @@ -0,0 +1,102 @@ |
| 1 | Q 10 3000 LV-I 0.61570 0.69228 1153 0.54788 0.66722 0.66722 | |
| 2 | N 10 3000 LV-I 97 | |
| 3 | Q 10 3000 LV-A 0.71951 0.93162 1210 0.13532 0.82907 0.82907 | |
| 4 | N 10 3000 LV-A 48 | |
| 5 | Q 10 10000 LV-I 0.63506 0.69916 1159 0.52250 0.65068 0.62055 | |
| 6 | N 10 10000 LV-I 100 | |
| 7 | Q 10 10000 LV-A 0.72584 0.91297 1139 0.25942 0.84110 0.84110 | |
| 8 | N 10 10000 LV-A 100 | |
| 9 | Q 10 30000 LV-I 0.67882 0.81075 1157 0.43568 0.81322 0.81254 | |
| 10 | N 10 30000 LV-I 100 | |
| 11 | Q 10 30000 LV-A 0.71608 0.91057 1162 0.20246 0.81457 0.81457 | |
| 12 | N 10 30000 LV-A 100 | |
| 13 | # seed=10 V=1607 heldout_sents=2000 | |
| 14 | GUARD C1 PASS tp=4978 kept=4978 gold=4978 | |
| 15 | GUARD C5 PASS gold=4978 conn=4978 comp=4978 | |
| 16 | # tier=3000 train_toks=21781 | |
| 17 | P 10 3000 LV-I MST 0.45860 0.45860 0.45860 | |
| 18 | X 10 3000 C-LV-I 2 6175 | |
| 19 | X 10 3000 C-LV-I 3 10552 | |
| 20 | X 10 3000 C-LV-I 4 11394 | |
| 21 | X 10 3000 C-LV-I 5 9810 | |
| 22 | X 10 3000 C-LV-I 6 7601 | |
| 23 | A 10 3000 C-LV-I 45532 1.00000 0.58881 0.17401 4808 16269 | |
| 24 | X 10 3000 M-LV-I-ucomp-MST 2 868 | |
| 25 | X 10 3000 M-LV-I-ucomp-MST 3 1387 | |
| 26 | X 10 3000 M-LV-I-ucomp-MST 4 1785 | |
| 27 | X 10 3000 M-LV-I-ucomp-MST 5 1872 | |
| 28 | X 10 3000 M-LV-I-ucomp-MST 6 1598 | |
| 29 | A 10 3000 M-LV-I-ucomp-MST 7510 0.37438 0.16847 0.31727 4808 2553 | |
| 30 | # tier=10000 train_toks=72856 | |
| 31 | P 10 10000 LV-I MST 0.51883 0.51883 0.51883 | |
| 32 | X 10 10000 C-LV-I 2 14341 | |
| 33 | X 10 10000 C-LV-I 3 28661 | |
| 34 | X 10 10000 C-LV-I 4 35039 | |
| 35 | X 10 10000 C-LV-I 5 32013 | |
| 36 | X 10 10000 C-LV-I 6 25383 | |
| 37 | A 10 10000 C-LV-I 135437 1.00000 0.65537 0.16260 4808 19379 | |
| 38 | X 10 10000 M-LV-I-ucomp-MST 2 2144 | |
| 39 | X 10 10000 M-LV-I-ucomp-MST 3 4242 | |
| 40 | X 10 10000 M-LV-I-ucomp-MST 4 5789 | |
| 41 | X 10 10000 M-LV-I-ucomp-MST 5 6302 | |
| 42 | X 10 10000 M-LV-I-ucomp-MST 6 5397 | |
| 43 | A 10 10000 M-LV-I-ucomp-MST 23874 0.41473 0.22983 0.30208 4808 3658 | |
| 44 | # tier=30000 train_toks=218274 | |
| 45 | P 10 30000 LV-I MST 0.55297 0.55297 0.55297 | |
| 46 | X 10 30000 C-LV-I 2 33601 | |
| 47 | X 10 30000 C-LV-I 3 76253 | |
| 48 | X 10 30000 C-LV-I 4 99506 | |
| 49 | X 10 30000 C-LV-I 5 93899 | |
| 50 | X 10 30000 C-LV-I 6 75598 | |
| 51 | A 10 30000 C-LV-I 378857 1.00000 0.67533 0.15298 4808 21225 | |
| 52 | X 10 30000 M-LV-I-ucomp-MST 2 5696 | |
| 53 | X 10 30000 M-LV-I-ucomp-MST 3 12419 | |
| 54 | X 10 30000 M-LV-I-ucomp-MST 4 17321 | |
| 55 | X 10 30000 M-LV-I-ucomp-MST 5 18996 | |
| 56 | X 10 30000 M-LV-I-ucomp-MST 6 16715 | |
| 57 | A 10 30000 M-LV-I-ucomp-MST 71147 0.40557 0.24896 0.28588 4808 4187 | |
| 58 | # seed=10 V=1607 heldout_sents=2000 | |
| 59 | GUARD C1 PASS tp=4978 kept=4978 gold=4978 | |
| 60 | GUARD C5 PASS gold=4978 conn=4978 comp=4978 | |
| 61 | # tier=3000 train_toks=21781 | |
| 62 | P 10 3000 LV-A MST 0.46083 0.46083 0.46083 | |
| 63 | X 10 3000 C-LV-A 2 8367 | |
| 64 | X 10 3000 C-LV-A 3 13122 | |
| 65 | X 10 3000 C-LV-A 4 12358 | |
| 66 | X 10 3000 C-LV-A 5 10045 | |
| 67 | X 10 3000 C-LV-A 6 7623 | |
| 68 | A 10 3000 C-LV-A 51515 1.00000 0.43199 0.17666 4808 11757 | |
| 69 | X 10 3000 M-LV-A-ucomp-MST 2 1224 | |
| 70 | X 10 3000 M-LV-A-ucomp-MST 3 1433 | |
| 71 | X 10 3000 M-LV-A-ucomp-MST 4 1669 | |
| 72 | X 10 3000 M-LV-A-ucomp-MST 5 1774 | |
| 73 | X 10 3000 M-LV-A-ucomp-MST 6 1547 | |
| 74 | A 10 3000 M-LV-A-ucomp-MST 7647 0.37542 0.12001 0.31478 4808 1833 | |
| 75 | # tier=10000 train_toks=72856 | |
| 76 | P 10 10000 LV-A MST 0.52896 0.52896 0.52896 | |
| 77 | X 10 10000 C-LV-A 2 17124 | |
| 78 | X 10 10000 C-LV-A 3 34649 | |
| 79 | X 10 10000 C-LV-A 4 37828 | |
| 80 | X 10 10000 C-LV-A 5 32947 | |
| 81 | X 10 10000 C-LV-A 6 25528 | |
| 82 | A 10 10000 C-LV-A 148076 1.00000 0.56240 0.16147 4808 16746 | |
| 83 | X 10 10000 M-LV-A-ucomp-MST 2 2876 | |
| 84 | X 10 10000 M-LV-A-ucomp-MST 3 4838 | |
| 85 | X 10 10000 M-LV-A-ucomp-MST 4 5889 | |
| 86 | X 10 10000 M-LV-A-ucomp-MST 5 6156 | |
| 87 | X 10 10000 M-LV-A-ucomp-MST 6 5339 | |
| 88 | A 10 10000 M-LV-A-ucomp-MST 25098 0.42575 0.20403 0.31133 4808 3151 | |
| 89 | # tier=30000 train_toks=218274 | |
| 90 | P 10 30000 LV-A MST 0.57052 0.57052 0.57052 | |
| 91 | X 10 30000 C-LV-A 2 36377 | |
| 92 | X 10 30000 C-LV-A 3 87907 | |
| 93 | X 10 30000 C-LV-A 4 107109 | |
| 94 | X 10 30000 C-LV-A 5 97364 | |
| 95 | X 10 30000 C-LV-A 6 76447 | |
| 96 | A 10 30000 C-LV-A 405204 1.00000 0.62292 0.15400 4808 19448 | |
| 97 | X 10 30000 M-LV-A-ucomp-MST 2 7364 | |
| 98 | X 10 30000 M-LV-A-ucomp-MST 3 14614 | |
| 99 | X 10 30000 M-LV-A-ucomp-MST 4 18596 | |
| 100 | X 10 30000 M-LV-A-ucomp-MST 5 19100 | |
| 101 | X 10 30000 M-LV-A-ucomp-MST 6 16358 | |
| 102 | A 10 30000 M-LV-A-ucomp-MST 76032 0.43823 0.24168 0.30635 4808 3793 |
| … | … | @@ -0,0 +1,102 @@ |
| 1 | Q 2 3000 LV-I 0.59903 0.69549 1166 0.56560 0.79163 0.79163 | |
| 2 | N 2 3000 LV-I 100 | |
| 3 | Q 2 3000 LV-A 0.71253 0.90834 1181 0.18352 0.79070 0.79070 | |
| 4 | N 2 3000 LV-A 76 | |
| 5 | Q 2 10000 LV-I 0.61593 0.70930 1182 0.54607 0.64710 0.81077 | |
| 6 | N 2 10000 LV-I 100 | |
| 7 | Q 2 10000 LV-A 0.72832 0.94265 1176 0.17034 0.85290 0.85290 | |
| 8 | N 2 10000 LV-A 84 | |
| 9 | Q 2 30000 LV-I 0.66505 0.76368 1177 0.50086 0.62993 0.63129 | |
| 10 | N 2 30000 LV-I 100 | |
| 11 | Q 2 30000 LV-A 0.71757 0.91538 1162 0.29505 0.83469 0.83605 | |
| 12 | N 2 30000 LV-A 100 | |
| 13 | # seed=2 V=1607 heldout_sents=2000 | |
| 14 | GUARD C1 PASS tp=5023 kept=5023 gold=5023 | |
| 15 | GUARD C5 PASS gold=5023 conn=5023 comp=5023 | |
| 16 | # tier=3000 train_toks=21780 | |
| 17 | P 2 3000 LV-I MST 0.45632 0.45632 0.45632 | |
| 18 | X 2 3000 C-LV-I 2 6195 | |
| 19 | X 2 3000 C-LV-I 3 10504 | |
| 20 | X 2 3000 C-LV-I 4 11259 | |
| 21 | X 2 3000 C-LV-I 5 9768 | |
| 22 | X 2 3000 C-LV-I 6 7574 | |
| 23 | A 2 3000 C-LV-I 45300 1.00000 0.56772 0.16969 4814 16106 | |
| 24 | X 2 3000 M-LV-I-ucomp-MST 2 865 | |
| 25 | X 2 3000 M-LV-I-ucomp-MST 3 1417 | |
| 26 | X 2 3000 M-LV-I-ucomp-MST 4 1714 | |
| 27 | X 2 3000 M-LV-I-ucomp-MST 5 1867 | |
| 28 | X 2 3000 M-LV-I-ucomp-MST 6 1612 | |
| 29 | A 2 3000 M-LV-I-ucomp-MST 7475 0.36726 0.16140 0.30895 4814 2515 | |
| 30 | # tier=10000 train_toks=72490 | |
| 31 | P 2 10000 LV-I MST 0.49468 0.49468 0.49468 | |
| 32 | X 2 10000 C-LV-I 2 14894 | |
| 33 | X 2 10000 C-LV-I 3 30620 | |
| 34 | X 2 10000 C-LV-I 4 36162 | |
| 35 | X 2 10000 C-LV-I 5 32265 | |
| 36 | X 2 10000 C-LV-I 6 25254 | |
| 37 | A 2 10000 C-LV-I 139195 1.00000 0.62256 0.16568 4814 18089 | |
| 38 | X 2 10000 M-LV-I-ucomp-MST 2 2259 | |
| 39 | X 2 10000 M-LV-I-ucomp-MST 3 4368 | |
| 40 | X 2 10000 M-LV-I-ucomp-MST 4 5700 | |
| 41 | X 2 10000 M-LV-I-ucomp-MST 5 6182 | |
| 42 | X 2 10000 M-LV-I-ucomp-MST 6 5312 | |
| 43 | A 2 10000 M-LV-I-ucomp-MST 23821 0.35064 0.17034 0.26554 4814 3088 | |
| 44 | # tier=30000 train_toks=218306 | |
| 45 | P 2 30000 LV-I MST 0.54848 0.54848 0.54848 | |
| 46 | X 2 30000 C-LV-I 2 30265 | |
| 47 | X 2 30000 C-LV-I 3 67644 | |
| 48 | X 2 30000 C-LV-I 4 93545 | |
| 49 | X 2 30000 C-LV-I 5 91140 | |
| 50 | X 2 30000 C-LV-I 6 74907 | |
| 51 | A 2 30000 C-LV-I 357501 1.00000 0.71437 0.15084 4814 22799 | |
| 52 | X 2 30000 M-LV-I-ucomp-MST 2 4949 | |
| 53 | X 2 30000 M-LV-I-ucomp-MST 3 11196 | |
| 54 | X 2 30000 M-LV-I-ucomp-MST 4 17322 | |
| 55 | X 2 30000 M-LV-I-ucomp-MST 5 19353 | |
| 56 | X 2 30000 M-LV-I-ucomp-MST 6 16431 | |
| 57 | A 2 30000 M-LV-I-ucomp-MST 69251 0.42252 0.27669 0.30054 4814 4432 | |
| 58 | # seed=2 V=1607 heldout_sents=2000 | |
| 59 | GUARD C1 PASS tp=5023 kept=5023 gold=5023 | |
| 60 | GUARD C5 PASS gold=5023 conn=5023 comp=5023 | |
| 61 | # tier=3000 train_toks=21780 | |
| 62 | P 2 3000 LV-A MST 0.46201 0.46201 0.46201 | |
| 63 | X 2 3000 C-LV-A 2 7929 | |
| 64 | X 2 3000 C-LV-A 3 12696 | |
| 65 | X 2 3000 C-LV-A 4 12201 | |
| 66 | X 2 3000 C-LV-A 5 10019 | |
| 67 | X 2 3000 C-LV-A 6 7606 | |
| 68 | A 2 3000 C-LV-A 50451 1.00000 0.43228 0.16967 4814 12265 | |
| 69 | X 2 3000 M-LV-A-ucomp-MST 2 1132 | |
| 70 | X 2 3000 M-LV-A-ucomp-MST 3 1408 | |
| 71 | X 2 3000 M-LV-A-ucomp-MST 4 1619 | |
| 72 | X 2 3000 M-LV-A-ucomp-MST 5 1779 | |
| 73 | X 2 3000 M-LV-A-ucomp-MST 6 1577 | |
| 74 | A 2 3000 M-LV-A-ucomp-MST 7515 0.37183 0.11986 0.30955 4814 1864 | |
| 75 | # tier=10000 train_toks=72490 | |
| 76 | P 2 10000 LV-A MST 0.52614 0.52614 0.52614 | |
| 77 | X 2 10000 C-LV-A 2 18163 | |
| 78 | X 2 10000 C-LV-A 3 36319 | |
| 79 | X 2 10000 C-LV-A 4 38343 | |
| 80 | X 2 10000 C-LV-A 5 32951 | |
| 81 | X 2 10000 C-LV-A 6 25336 | |
| 82 | A 2 10000 C-LV-A 151112 1.00000 0.53511 0.16159 4814 15942 | |
| 83 | X 2 10000 M-LV-A-ucomp-MST 2 3096 | |
| 84 | X 2 10000 M-LV-A-ucomp-MST 3 5076 | |
| 85 | X 2 10000 M-LV-A-ucomp-MST 4 5957 | |
| 86 | X 2 10000 M-LV-A-ucomp-MST 5 6250 | |
| 87 | X 2 10000 M-LV-A-ucomp-MST 6 5370 | |
| 88 | A 2 10000 M-LV-A-ucomp-MST 25749 0.41525 0.19589 0.31890 4814 2957 | |
| 89 | # tier=30000 train_toks=218306 | |
| 90 | P 2 30000 LV-A MST 0.56522 0.56522 0.56522 | |
| 91 | X 2 30000 C-LV-A 2 36169 | |
| 92 | X 2 30000 C-LV-A 3 89689 | |
| 93 | X 2 30000 C-LV-A 4 106901 | |
| 94 | X 2 30000 C-LV-A 5 97055 | |
| 95 | X 2 30000 C-LV-A 6 76426 | |
| 96 | A 2 30000 C-LV-A 406240 1.00000 0.62609 0.15498 4814 19448 | |
| 97 | X 2 30000 M-LV-A-ucomp-MST 2 7228 | |
| 98 | X 2 30000 M-LV-A-ucomp-MST 3 14929 | |
| 99 | X 2 30000 M-LV-A-ucomp-MST 4 19065 | |
| 100 | X 2 30000 M-LV-A-ucomp-MST 5 19650 | |
| 101 | X 2 30000 M-LV-A-ucomp-MST 6 16600 | |
| 102 | A 2 30000 M-LV-A-ucomp-MST 77472 0.44308 0.25654 0.31937 4814 3867 |
| … | … | @@ -0,0 +1,102 @@ |
| 1 | Q 3 3000 LV-I 0.64380 0.73850 1190 0.53515 0.73638 0.78846 | |
| 2 | N 3 3000 LV-I 89 | |
| 3 | Q 3 3000 LV-A 0.71983 0.93536 1232 0.28113 0.90304 0.90304 | |
| 4 | N 3 3000 LV-A 57 | |
| 5 | Q 3 10000 LV-I 0.64889 0.72648 1179 0.51957 0.83784 0.83922 | |
| 6 | N 3 10000 LV-I 100 | |
| 7 | Q 3 10000 LV-A 0.72125 0.91516 1172 0.37317 0.79626 0.79626 | |
| 8 | N 3 10000 LV-A 100 | |
| 9 | Q 3 30000 LV-I 0.67390 0.78281 1210 0.46632 0.87957 0.87957 | |
| 10 | N 3 30000 LV-I 100 | |
| 11 | Q 3 30000 LV-A 0.71837 0.90846 1168 0.27023 0.81258 0.81326 | |
| 12 | N 3 30000 LV-A 100 | |
| 13 | # seed=3 V=1607 heldout_sents=2000 | |
| 14 | GUARD C1 PASS tp=4908 kept=4908 gold=4908 | |
| 15 | GUARD C5 PASS gold=4908 conn=4908 comp=4908 | |
| 16 | # tier=3000 train_toks=21946 | |
| 17 | P 3 3000 LV-I MST 0.45272 0.45272 0.45272 | |
| 18 | X 3 3000 C-LV-I 2 6769 | |
| 19 | X 3 3000 C-LV-I 3 11253 | |
| 20 | X 3 3000 C-LV-I 4 11694 | |
| 21 | X 3 3000 C-LV-I 5 10038 | |
| 22 | X 3 3000 C-LV-I 6 7838 | |
| 23 | A 3 3000 C-LV-I 47592 1.00000 0.55852 0.17970 4716 14658 | |
| 24 | X 3 3000 M-LV-I-ucomp-MST 2 958 | |
| 25 | X 3 3000 M-LV-I-ucomp-MST 3 1404 | |
| 26 | X 3 3000 M-LV-I-ucomp-MST 4 1682 | |
| 27 | X 3 3000 M-LV-I-ucomp-MST 5 1787 | |
| 28 | X 3 3000 M-LV-I-ucomp-MST 6 1572 | |
| 29 | A 3 3000 M-LV-I-ucomp-MST 7403 0.37956 0.16031 0.30620 4716 2469 | |
| 30 | # tier=10000 train_toks=72679 | |
| 31 | P 3 10000 LV-I MST 0.51454 0.51454 0.51454 | |
| 32 | X 3 10000 C-LV-I 2 14967 | |
| 33 | X 3 10000 C-LV-I 3 29823 | |
| 34 | X 3 10000 C-LV-I 4 35555 | |
| 35 | X 3 10000 C-LV-I 5 32186 | |
| 36 | X 3 10000 C-LV-I 6 25476 | |
| 37 | A 3 10000 C-LV-I 138007 1.00000 0.65119 0.16472 4716 18644 | |
| 38 | X 3 10000 M-LV-I-ucomp-MST 2 2111 | |
| 39 | X 3 10000 M-LV-I-ucomp-MST 3 4306 | |
| 40 | X 3 10000 M-LV-I-ucomp-MST 4 5796 | |
| 41 | X 3 10000 M-LV-I-ucomp-MST 5 6186 | |
| 42 | X 3 10000 M-LV-I-ucomp-MST 6 5292 | |
| 43 | A 3 10000 M-LV-I-ucomp-MST 23691 0.42048 0.22689 0.30235 4716 3539 | |
| 44 | # tier=30000 train_toks=218379 | |
| 45 | P 3 30000 LV-I MST 0.53201 0.53201 0.53201 | |
| 46 | X 3 30000 C-LV-I 2 32702 | |
| 47 | X 3 30000 C-LV-I 3 71599 | |
| 48 | X 3 30000 C-LV-I 4 96445 | |
| 49 | X 3 30000 C-LV-I 5 92487 | |
| 50 | X 3 30000 C-LV-I 6 75343 | |
| 51 | A 3 30000 C-LV-I 368576 1.00000 0.71098 0.15519 4716 21606 | |
| 52 | X 3 30000 M-LV-I-ucomp-MST 2 5047 | |
| 53 | X 3 30000 M-LV-I-ucomp-MST 3 11804 | |
| 54 | X 3 30000 M-LV-I-ucomp-MST 4 17283 | |
| 55 | X 3 30000 M-LV-I-ucomp-MST 5 19451 | |
| 56 | X 3 30000 M-LV-I-ucomp-MST 6 16520 | |
| 57 | A 3 30000 M-LV-I-ucomp-MST 70105 0.40310 0.26145 0.28080 4716 4391 | |
| 58 | # seed=3 V=1607 heldout_sents=2000 | |
| 59 | GUARD C1 PASS tp=4908 kept=4908 gold=4908 | |
| 60 | GUARD C5 PASS gold=4908 conn=4908 comp=4908 | |
| 61 | # tier=3000 train_toks=21946 | |
| 62 | P 3 3000 LV-A MST 0.45930 0.45930 0.45930 | |
| 63 | X 3 3000 C-LV-A 2 8602 | |
| 64 | X 3 3000 C-LV-A 3 13247 | |
| 65 | X 3 3000 C-LV-A 4 12494 | |
| 66 | X 3 3000 C-LV-A 5 10258 | |
| 67 | X 3 3000 C-LV-A 6 7865 | |
| 68 | A 3 3000 C-LV-A 52466 1.00000 0.43427 0.18063 4716 11338 | |
| 69 | X 3 3000 M-LV-A-ucomp-MST 2 1244 | |
| 70 | X 3 3000 M-LV-A-ucomp-MST 3 1479 | |
| 71 | X 3 3000 M-LV-A-ucomp-MST 4 1628 | |
| 72 | X 3 3000 M-LV-A-ucomp-MST 5 1686 | |
| 73 | X 3 3000 M-LV-A-ucomp-MST 6 1523 | |
| 74 | A 3 3000 M-LV-A-ucomp-MST 7560 0.37744 0.11705 0.32056 4716 1722 | |
| 75 | # tier=10000 train_toks=72679 | |
| 76 | P 3 10000 LV-A MST 0.53306 0.53306 0.53306 | |
| 77 | X 3 10000 C-LV-A 2 17661 | |
| 78 | X 3 10000 C-LV-A 3 35580 | |
| 79 | X 3 10000 C-LV-A 4 38193 | |
| 80 | X 3 10000 C-LV-A 5 33044 | |
| 81 | X 3 10000 C-LV-A 6 25640 | |
| 82 | A 3 10000 C-LV-A 150118 1.00000 0.56404 0.16515 4716 16107 | |
| 83 | X 3 10000 M-LV-A-ucomp-MST 2 3008 | |
| 84 | X 3 10000 M-LV-A-ucomp-MST 3 5056 | |
| 85 | X 3 10000 M-LV-A-ucomp-MST 4 5927 | |
| 86 | X 3 10000 M-LV-A-ucomp-MST 5 6018 | |
| 87 | X 3 10000 M-LV-A-ucomp-MST 6 5241 | |
| 88 | A 3 10000 M-LV-A-ucomp-MST 25250 0.43766 0.20399 0.32099 4716 2997 | |
| 89 | # tier=30000 train_toks=218379 | |
| 90 | P 3 30000 LV-A MST 0.55012 0.55012 0.55012 | |
| 91 | X 3 30000 C-LV-A 2 34558 | |
| 92 | X 3 30000 C-LV-A 3 85788 | |
| 93 | X 3 30000 C-LV-A 4 104425 | |
| 94 | X 3 30000 C-LV-A 5 96252 | |
| 95 | X 3 30000 C-LV-A 6 76263 | |
| 96 | A 3 30000 C-LV-A 397286 1.00000 0.64822 0.15630 4716 19558 | |
| 97 | X 3 30000 M-LV-A-ucomp-MST 2 6606 | |
| 98 | X 3 30000 M-LV-A-ucomp-MST 3 13952 | |
| 99 | X 3 30000 M-LV-A-ucomp-MST 4 17515 | |
| 100 | X 3 30000 M-LV-A-ucomp-MST 5 18720 | |
| 101 | X 3 30000 M-LV-A-ucomp-MST 6 16341 | |
| 102 | A 3 30000 M-LV-A-ucomp-MST 73134 0.40437 0.22392 0.28220 4716 3742 |
| … | … | @@ -0,0 +1,102 @@ |
| 1 | Q 4 3000 LV-I 0.62460 0.71971 1185 0.53305 0.66917 0.76047 | |
| 2 | N 4 3000 LV-I 83 | |
| 3 | Q 4 3000 LV-A 0.72681 0.93997 1211 0.20084 0.87325 0.87325 | |
| 4 | N 4 3000 LV-A 52 | |
| 5 | Q 4 10000 LV-I 0.62664 0.71572 1180 0.50790 0.72955 0.72803 | |
| 6 | N 4 10000 LV-I 100 | |
| 7 | Q 4 10000 LV-A 0.72396 0.92425 1174 0.22117 0.78788 0.78788 | |
| 8 | N 4 10000 LV-A 92 | |
| 9 | Q 4 30000 LV-I 0.64554 0.73913 1206 0.49888 0.74441 0.74441 | |
| 10 | N 4 30000 LV-I 100 | |
| 11 | Q 4 30000 LV-A 0.72277 0.92006 1165 0.17575 0.83390 0.83390 | |
| 12 | N 4 30000 LV-A 100 | |
| 13 | # seed=4 V=1607 heldout_sents=2000 | |
| 14 | GUARD C1 PASS tp=4900 kept=4900 gold=4900 | |
| 15 | GUARD C5 PASS gold=4900 conn=4900 comp=4900 | |
| 16 | # tier=3000 train_toks=21802 | |
| 17 | P 4 3000 LV-I MST 0.44362 0.44362 0.44362 | |
| 18 | X 4 3000 C-LV-I 2 6479 | |
| 19 | X 4 3000 C-LV-I 3 10933 | |
| 20 | X 4 3000 C-LV-I 4 11544 | |
| 21 | X 4 3000 C-LV-I 5 9864 | |
| 22 | X 4 3000 C-LV-I 6 7651 | |
| 23 | A 4 3000 C-LV-I 46471 1.00000 0.56192 0.17888 4716 14814 | |
| 24 | X 4 3000 M-LV-I-ucomp-MST 2 931 | |
| 25 | X 4 3000 M-LV-I-ucomp-MST 3 1312 | |
| 26 | X 4 3000 M-LV-I-ucomp-MST 4 1677 | |
| 27 | X 4 3000 M-LV-I-ucomp-MST 5 1828 | |
| 28 | X 4 3000 M-LV-I-ucomp-MST 6 1650 | |
| 29 | A 4 3000 M-LV-I-ucomp-MST 7398 0.36980 0.14695 0.30052 4716 2306 | |
| 30 | # tier=10000 train_toks=72633 | |
| 31 | P 4 10000 LV-I MST 0.50016 0.50016 0.50016 | |
| 32 | X 4 10000 C-LV-I 2 14646 | |
| 33 | X 4 10000 C-LV-I 3 29035 | |
| 34 | X 4 10000 C-LV-I 4 34908 | |
| 35 | X 4 10000 C-LV-I 5 31750 | |
| 36 | X 4 10000 C-LV-I 6 25218 | |
| 37 | A 4 10000 C-LV-I 135557 1.00000 0.64737 0.16190 4716 18857 | |
| 38 | X 4 10000 M-LV-I-ucomp-MST 2 2188 | |
| 39 | X 4 10000 M-LV-I-ucomp-MST 3 4235 | |
| 40 | X 4 10000 M-LV-I-ucomp-MST 4 5794 | |
| 41 | X 4 10000 M-LV-I-ucomp-MST 5 6259 | |
| 42 | X 4 10000 M-LV-I-ucomp-MST 6 5374 | |
| 43 | A 4 10000 M-LV-I-ucomp-MST 23850 0.38316 0.20844 0.29006 4716 3389 | |
| 44 | # tier=30000 train_toks=217946 | |
| 45 | P 4 30000 LV-I MST 0.53371 0.53371 0.53371 | |
| 46 | X 4 30000 C-LV-I 2 31046 | |
| 47 | X 4 30000 C-LV-I 3 68770 | |
| 48 | X 4 30000 C-LV-I 4 95115 | |
| 49 | X 4 30000 C-LV-I 5 91963 | |
| 50 | X 4 30000 C-LV-I 6 74968 | |
| 51 | A 4 30000 C-LV-I 361862 1.00000 0.70420 0.15261 4716 21762 | |
| 52 | X 4 30000 M-LV-I-ucomp-MST 2 5062 | |
| 53 | X 4 30000 M-LV-I-ucomp-MST 3 11355 | |
| 54 | X 4 30000 M-LV-I-ucomp-MST 4 17246 | |
| 55 | X 4 30000 M-LV-I-ucomp-MST 5 19316 | |
| 56 | X 4 30000 M-LV-I-ucomp-MST 6 16347 | |
| 57 | A 4 30000 M-LV-I-ucomp-MST 69326 0.39207 0.25021 0.28182 4716 4187 | |
| 58 | # seed=4 V=1607 heldout_sents=2000 | |
| 59 | GUARD C1 PASS tp=4900 kept=4900 gold=4900 | |
| 60 | GUARD C5 PASS gold=4900 conn=4900 comp=4900 | |
| 61 | # tier=3000 train_toks=21802 | |
| 62 | P 4 3000 LV-A MST 0.47100 0.47100 0.47100 | |
| 63 | X 4 3000 C-LV-A 2 8079 | |
| 64 | X 4 3000 C-LV-A 3 12880 | |
| 65 | X 4 3000 C-LV-A 4 12243 | |
| 66 | X 4 3000 C-LV-A 5 10062 | |
| 67 | X 4 3000 C-LV-A 6 7668 | |
| 68 | A 4 3000 C-LV-A 50932 1.00000 0.44847 0.18092 4716 11690 | |
| 69 | X 4 3000 M-LV-A-ucomp-MST 2 1228 | |
| 70 | X 4 3000 M-LV-A-ucomp-MST 3 1468 | |
| 71 | X 4 3000 M-LV-A-ucomp-MST 4 1604 | |
| 72 | X 4 3000 M-LV-A-ucomp-MST 5 1747 | |
| 73 | X 4 3000 M-LV-A-ucomp-MST 6 1618 | |
| 74 | A 4 3000 M-LV-A-ucomp-MST 7665 0.39334 0.14037 0.34425 4716 1923 | |
| 75 | # tier=10000 train_toks=72633 | |
| 76 | P 4 10000 LV-A MST 0.53079 0.53079 0.53079 | |
| 77 | X 4 10000 C-LV-A 2 17718 | |
| 78 | X 4 10000 C-LV-A 3 35541 | |
| 79 | X 4 10000 C-LV-A 4 38009 | |
| 80 | X 4 10000 C-LV-A 5 32874 | |
| 81 | X 4 10000 C-LV-A 6 25459 | |
| 82 | A 4 10000 C-LV-A 149601 1.00000 0.55322 0.16328 4716 15979 | |
| 83 | X 4 10000 M-LV-A-ucomp-MST 2 3105 | |
| 84 | X 4 10000 M-LV-A-ucomp-MST 3 4975 | |
| 85 | X 4 10000 M-LV-A-ucomp-MST 4 5777 | |
| 86 | X 4 10000 M-LV-A-ucomp-MST 5 6222 | |
| 87 | X 4 10000 M-LV-A-ucomp-MST 6 5326 | |
| 88 | A 4 10000 M-LV-A-ucomp-MST 25405 0.43236 0.20568 0.31689 4716 3061 | |
| 89 | # tier=30000 train_toks=217946 | |
| 90 | P 4 30000 LV-A MST 0.57506 0.57506 0.57506 | |
| 91 | X 4 30000 C-LV-A 2 36158 | |
| 92 | X 4 30000 C-LV-A 3 89759 | |
| 93 | X 4 30000 C-LV-A 4 107248 | |
| 94 | X 4 30000 C-LV-A 5 96997 | |
| 95 | X 4 30000 C-LV-A 6 76113 | |
| 96 | A 4 30000 C-LV-A 406275 1.00000 0.62701 0.15692 4716 18844 | |
| 97 | X 4 30000 M-LV-A-ucomp-MST 2 6940 | |
| 98 | X 4 30000 M-LV-A-ucomp-MST 3 15012 | |
| 99 | X 4 30000 M-LV-A-ucomp-MST 4 18903 | |
| 100 | X 4 30000 M-LV-A-ucomp-MST 5 19468 | |
| 101 | X 4 30000 M-LV-A-ucomp-MST 6 16637 | |
| 102 | A 4 30000 M-LV-A-ucomp-MST 76960 0.45123 0.26124 0.32125 4716 3835 |
| … | … | @@ -0,0 +1,102 @@ |
| 1 | Q 5 3000 LV-I 0.64042 0.73263 1187 0.50375 0.88413 0.88413 | |
| 2 | N 5 3000 LV-I 84 | |
| 3 | Q 5 3000 LV-A 0.72344 0.93901 1219 0.12705 0.86855 0.86855 | |
| 4 | N 5 3000 LV-A 51 | |
| 5 | Q 5 10000 LV-I 0.65169 0.74972 1180 0.51771 0.72877 0.73004 | |
| 6 | N 5 10000 LV-I 100 | |
| 7 | Q 5 10000 LV-A 0.73125 0.94200 1187 0.18318 0.86248 0.86375 | |
| 8 | N 5 10000 LV-A 86 | |
| 9 | Q 5 30000 LV-I 0.63987 0.72749 1191 0.47548 0.69533 0.69346 | |
| 10 | N 5 30000 LV-I 100 | |
| 11 | Q 5 30000 LV-A 0.71919 0.91157 1166 0.26799 0.82492 0.82492 | |
| 12 | N 5 30000 LV-A 100 | |
| 13 | # seed=5 V=1607 heldout_sents=2000 | |
| 14 | GUARD C1 PASS tp=4953 kept=4953 gold=4953 | |
| 15 | GUARD C5 PASS gold=4953 conn=4953 comp=4953 | |
| 16 | # tier=3000 train_toks=21900 | |
| 17 | P 5 3000 LV-I MST 0.45313 0.45313 0.45313 | |
| 18 | X 5 3000 C-LV-I 2 6626 | |
| 19 | X 5 3000 C-LV-I 3 11191 | |
| 20 | X 5 3000 C-LV-I 4 11663 | |
| 21 | X 5 3000 C-LV-I 5 9974 | |
| 22 | X 5 3000 C-LV-I 6 7746 | |
| 23 | A 5 3000 C-LV-I 47200 1.00000 0.55855 0.17628 4757 15073 | |
| 24 | X 5 3000 M-LV-I-ucomp-MST 2 930 | |
| 25 | X 5 3000 M-LV-I-ucomp-MST 3 1284 | |
| 26 | X 5 3000 M-LV-I-ucomp-MST 4 1689 | |
| 27 | X 5 3000 M-LV-I-ucomp-MST 5 1864 | |
| 28 | X 5 3000 M-LV-I-ucomp-MST 6 1600 | |
| 29 | A 5 3000 M-LV-I-ucomp-MST 7367 0.37566 0.16229 0.30929 4757 2496 | |
| 30 | # tier=10000 train_toks=73066 | |
| 31 | P 5 10000 LV-I MST 0.51476 0.51476 0.51476 | |
| 32 | X 5 10000 C-LV-I 2 14525 | |
| 33 | X 5 10000 C-LV-I 3 28410 | |
| 34 | X 5 10000 C-LV-I 4 34643 | |
| 35 | X 5 10000 C-LV-I 5 31883 | |
| 36 | X 5 10000 C-LV-I 6 25553 | |
| 37 | A 5 10000 C-LV-I 135014 1.00000 0.66975 0.16417 4757 19407 | |
| 38 | X 5 10000 M-LV-I-ucomp-MST 2 2133 | |
| 39 | X 5 10000 M-LV-I-ucomp-MST 3 4263 | |
| 40 | X 5 10000 M-LV-I-ucomp-MST 4 5838 | |
| 41 | X 5 10000 M-LV-I-ucomp-MST 5 6449 | |
| 42 | X 5 10000 M-LV-I-ucomp-MST 6 5343 | |
| 43 | A 5 10000 M-LV-I-ucomp-MST 24026 0.40341 0.23166 0.30484 4757 3615 | |
| 44 | # tier=30000 train_toks=218533 | |
| 45 | P 5 30000 LV-I MST 0.53816 0.53816 0.53816 | |
| 46 | X 5 30000 C-LV-I 2 29438 | |
| 47 | X 5 30000 C-LV-I 3 65832 | |
| 48 | X 5 30000 C-LV-I 4 92401 | |
| 49 | X 5 30000 C-LV-I 5 91124 | |
| 50 | X 5 30000 C-LV-I 6 75259 | |
| 51 | A 5 30000 C-LV-I 354054 1.00000 0.73597 0.15440 4757 22675 | |
| 52 | X 5 30000 M-LV-I-ucomp-MST 2 4555 | |
| 53 | X 5 30000 M-LV-I-ucomp-MST 3 10976 | |
| 54 | X 5 30000 M-LV-I-ucomp-MST 4 16873 | |
| 55 | X 5 30000 M-LV-I-ucomp-MST 5 18950 | |
| 56 | X 5 30000 M-LV-I-ucomp-MST 6 16249 | |
| 57 | A 5 30000 M-LV-I-ucomp-MST 67603 0.40782 0.26824 0.29179 4757 4373 | |
| 58 | # seed=5 V=1607 heldout_sents=2000 | |
| 59 | GUARD C1 PASS tp=4953 kept=4953 gold=4953 | |
| 60 | GUARD C5 PASS gold=4953 conn=4953 comp=4953 | |
| 61 | # tier=3000 train_toks=21900 | |
| 62 | P 5 3000 LV-A MST 0.46225 0.46225 0.46225 | |
| 63 | X 5 3000 C-LV-A 2 8406 | |
| 64 | X 5 3000 C-LV-A 3 13079 | |
| 65 | X 5 3000 C-LV-A 4 12391 | |
| 66 | X 5 3000 C-LV-A 5 10164 | |
| 67 | X 5 3000 C-LV-A 6 7767 | |
| 68 | A 5 3000 C-LV-A 51807 1.00000 0.43115 0.17833 4757 11501 | |
| 69 | X 5 3000 M-LV-A-ucomp-MST 2 1225 | |
| 70 | X 5 3000 M-LV-A-ucomp-MST 3 1390 | |
| 71 | X 5 3000 M-LV-A-ucomp-MST 4 1585 | |
| 72 | X 5 3000 M-LV-A-ucomp-MST 5 1762 | |
| 73 | X 5 3000 M-LV-A-ucomp-MST 6 1577 | |
| 74 | A 5 3000 M-LV-A-ucomp-MST 7539 0.37040 0.12003 0.32278 4757 1769 | |
| 75 | # tier=10000 train_toks=73066 | |
| 76 | P 5 10000 LV-A MST 0.53146 0.53146 0.53146 | |
| 77 | X 5 10000 C-LV-A 2 18045 | |
| 78 | X 5 10000 C-LV-A 3 36097 | |
| 79 | X 5 10000 C-LV-A 4 38304 | |
| 80 | X 5 10000 C-LV-A 5 33242 | |
| 81 | X 5 10000 C-LV-A 6 25785 | |
| 82 | A 5 10000 C-LV-A 151473 1.00000 0.55581 0.16536 4757 15989 | |
| 83 | X 5 10000 M-LV-A-ucomp-MST 2 3112 | |
| 84 | X 5 10000 M-LV-A-ucomp-MST 3 5004 | |
| 85 | X 5 10000 M-LV-A-ucomp-MST 4 5930 | |
| 86 | X 5 10000 M-LV-A-ucomp-MST 5 6260 | |
| 87 | X 5 10000 M-LV-A-ucomp-MST 6 5332 | |
| 88 | A 5 10000 M-LV-A-ucomp-MST 25638 0.41623 0.19760 0.31105 4757 3022 | |
| 89 | # tier=30000 train_toks=218533 | |
| 90 | P 5 30000 LV-A MST 0.57857 0.57857 0.57857 | |
| 91 | X 5 30000 C-LV-A 2 34491 | |
| 92 | X 5 30000 C-LV-A 3 85845 | |
| 93 | X 5 30000 C-LV-A 4 106121 | |
| 94 | X 5 30000 C-LV-A 5 97351 | |
| 95 | X 5 30000 C-LV-A 6 76794 | |
| 96 | A 5 30000 C-LV-A 400602 1.00000 0.65209 0.15870 4757 19546 | |
| 97 | X 5 30000 M-LV-A-ucomp-MST 2 6786 | |
| 98 | X 5 30000 M-LV-A-ucomp-MST 3 14483 | |
| 99 | X 5 30000 M-LV-A-ucomp-MST 4 18840 | |
| 100 | X 5 30000 M-LV-A-ucomp-MST 5 19275 | |
| 101 | X 5 30000 M-LV-A-ucomp-MST 6 16240 | |
| 102 | A 5 30000 M-LV-A-ucomp-MST 75624 0.45155 0.26319 0.31955 4757 3918 |
| … | … | @@ -0,0 +1,102 @@ |
| 1 | Q 6 3000 LV-I 0.61910 0.71037 1183 0.53129 0.78864 0.78864 | |
| 2 | N 6 3000 LV-I 85 | |
| 3 | Q 6 3000 LV-A 0.72529 0.95094 1241 0.09996 0.88854 0.88854 | |
| 4 | N 6 3000 LV-A 35 | |
| 5 | Q 6 10000 LV-I 0.65183 0.73695 1185 0.48777 0.72465 0.72465 | |
| 6 | N 6 10000 LV-I 100 | |
| 7 | Q 6 10000 LV-A 0.72453 0.93543 1169 0.19179 0.88310 0.88310 | |
| 8 | N 6 10000 LV-A 100 | |
| 9 | Q 6 30000 LV-I 0.64738 0.73900 1179 0.49358 0.65088 0.65088 | |
| 10 | N 6 30000 LV-I 100 | |
| 11 | Q 6 30000 LV-A 0.71796 0.92095 1176 0.29995 0.84912 0.84912 | |
| 12 | N 6 30000 LV-A 100 | |
| 13 | # seed=6 V=1607 heldout_sents=2000 | |
| 14 | GUARD C1 PASS tp=5030 kept=5030 gold=5030 | |
| 15 | GUARD C5 PASS gold=5030 conn=5030 comp=5030 | |
| 16 | # tier=3000 train_toks=22127 | |
| 17 | P 6 3000 LV-I MST 0.44049 0.44049 0.44049 | |
| 18 | X 6 3000 C-LV-I 2 6525 | |
| 19 | X 6 3000 C-LV-I 3 11009 | |
| 20 | X 6 3000 C-LV-I 4 11719 | |
| 21 | X 6 3000 C-LV-I 5 10149 | |
| 22 | X 6 3000 C-LV-I 6 7949 | |
| 23 | A 6 3000 C-LV-I 47351 1.00000 0.55510 0.17485 4828 15327 | |
| 24 | X 6 3000 M-LV-I-ucomp-MST 2 873 | |
| 25 | X 6 3000 M-LV-I-ucomp-MST 3 1303 | |
| 26 | X 6 3000 M-LV-I-ucomp-MST 4 1713 | |
| 27 | X 6 3000 M-LV-I-ucomp-MST 5 1800 | |
| 28 | X 6 3000 M-LV-I-ucomp-MST 6 1534 | |
| 29 | A 6 3000 M-LV-I-ucomp-MST 7223 0.36765 0.14561 0.28942 4828 2429 | |
| 30 | # tier=10000 train_toks=73282 | |
| 31 | P 6 10000 LV-I MST 0.50190 0.50190 0.50190 | |
| 32 | X 6 10000 C-LV-I 2 14631 | |
| 33 | X 6 10000 C-LV-I 3 29212 | |
| 34 | X 6 10000 C-LV-I 4 35115 | |
| 35 | X 6 10000 C-LV-I 5 32338 | |
| 36 | X 6 10000 C-LV-I 6 25830 | |
| 37 | A 6 10000 C-LV-I 137126 1.00000 0.64354 0.15933 4828 19500 | |
| 38 | X 6 10000 M-LV-I-ucomp-MST 2 2066 | |
| 39 | X 6 10000 M-LV-I-ucomp-MST 3 4111 | |
| 40 | X 6 10000 M-LV-I-ucomp-MST 4 5794 | |
| 41 | X 6 10000 M-LV-I-ucomp-MST 5 6332 | |
| 42 | X 6 10000 M-LV-I-ucomp-MST 6 5338 | |
| 43 | A 6 10000 M-LV-I-ucomp-MST 23641 0.39312 0.21437 0.28822 4828 3591 | |
| 44 | # tier=30000 train_toks=217426 | |
| 45 | P 6 30000 LV-I MST 0.56458 0.56458 0.56458 | |
| 46 | X 6 30000 C-LV-I 2 30198 | |
| 47 | X 6 30000 C-LV-I 3 67714 | |
| 48 | X 6 30000 C-LV-I 4 93206 | |
| 49 | X 6 30000 C-LV-I 5 90499 | |
| 50 | X 6 30000 C-LV-I 6 74303 | |
| 51 | A 6 30000 C-LV-I 355920 1.00000 0.71520 0.15123 4828 22833 | |
| 52 | X 6 30000 M-LV-I-ucomp-MST 2 4908 | |
| 53 | X 6 30000 M-LV-I-ucomp-MST 3 11390 | |
| 54 | X 6 30000 M-LV-I-ucomp-MST 4 17112 | |
| 55 | X 6 30000 M-LV-I-ucomp-MST 5 18616 | |
| 56 | X 6 30000 M-LV-I-ucomp-MST 6 16368 | |
| 57 | A 6 30000 M-LV-I-ucomp-MST 68394 0.43186 0.28065 0.31748 4828 4268 | |
| 58 | # seed=6 V=1607 heldout_sents=2000 | |
| 59 | GUARD C1 PASS tp=5030 kept=5030 gold=5030 | |
| 60 | GUARD C5 PASS gold=5030 conn=5030 comp=5030 | |
| 61 | # tier=3000 train_toks=22127 | |
| 62 | P 6 3000 LV-A MST 0.46114 0.46114 0.46114 | |
| 63 | X 6 3000 C-LV-A 2 8563 | |
| 64 | X 6 3000 C-LV-A 3 13284 | |
| 65 | X 6 3000 C-LV-A 4 12638 | |
| 66 | X 6 3000 C-LV-A 5 10384 | |
| 67 | X 6 3000 C-LV-A 6 7985 | |
| 68 | A 6 3000 C-LV-A 52854 1.00000 0.41839 0.17674 4828 11429 | |
| 69 | X 6 3000 M-LV-A-ucomp-MST 2 1248 | |
| 70 | X 6 3000 M-LV-A-ucomp-MST 3 1368 | |
| 71 | X 6 3000 M-LV-A-ucomp-MST 4 1694 | |
| 72 | X 6 3000 M-LV-A-ucomp-MST 5 1689 | |
| 73 | X 6 3000 M-LV-A-ucomp-MST 6 1517 | |
| 74 | A 6 3000 M-LV-A-ucomp-MST 7516 0.37179 0.11330 0.31970 4828 1711 | |
| 75 | # tier=10000 train_toks=73282 | |
| 76 | P 6 10000 LV-A MST 0.52825 0.52825 0.52825 | |
| 77 | X 6 10000 C-LV-A 2 18179 | |
| 78 | X 6 10000 C-LV-A 3 36142 | |
| 79 | X 6 10000 C-LV-A 4 38747 | |
| 80 | X 6 10000 C-LV-A 5 33648 | |
| 81 | X 6 10000 C-LV-A 6 26063 | |
| 82 | A 6 10000 C-LV-A 152779 1.00000 0.53500 0.15928 4828 16217 | |
| 83 | X 6 10000 M-LV-A-ucomp-MST 2 3083 | |
| 84 | X 6 10000 M-LV-A-ucomp-MST 3 5004 | |
| 85 | X 6 10000 M-LV-A-ucomp-MST 4 5937 | |
| 86 | X 6 10000 M-LV-A-ucomp-MST 5 6131 | |
| 87 | X 6 10000 M-LV-A-ucomp-MST 6 5257 | |
| 88 | A 6 10000 M-LV-A-ucomp-MST 25412 0.42357 0.18683 0.30279 4828 2979 | |
| 89 | # tier=30000 train_toks=217426 | |
| 90 | P 6 30000 LV-A MST 0.56505 0.56505 0.56505 | |
| 91 | X 6 30000 C-LV-A 2 36120 | |
| 92 | X 6 30000 C-LV-A 3 89005 | |
| 93 | X 6 30000 C-LV-A 4 105885 | |
| 94 | X 6 30000 C-LV-A 5 96182 | |
| 95 | X 6 30000 C-LV-A 6 75682 | |
| 96 | A 6 30000 C-LV-A 402874 1.00000 0.61392 0.15331 4828 19333 | |
| 97 | X 6 30000 M-LV-A-ucomp-MST 2 7134 | |
| 98 | X 6 30000 M-LV-A-ucomp-MST 3 14481 | |
| 99 | X 6 30000 M-LV-A-ucomp-MST 4 18353 | |
| 100 | X 6 30000 M-LV-A-ucomp-MST 5 18983 | |
| 101 | X 6 30000 M-LV-A-ucomp-MST 6 16458 | |
| 102 | A 6 30000 M-LV-A-ucomp-MST 75409 0.44428 0.24337 0.31003 4828 3790 |
| … | … | @@ -0,0 +1,102 @@ |
| 1 | Q 7 3000 LV-I 0.62595 0.71832 1207 0.49019 0.77935 0.77935 | |
| 2 | N 7 3000 LV-I 73 | |
| 3 | Q 7 3000 LV-A 0.71801 0.92849 1221 0.12700 0.81478 0.81478 | |
| 4 | N 7 3000 LV-A 58 | |
| 5 | Q 7 10000 LV-I 0.62627 0.71686 1198 0.49532 0.74378 0.74378 | |
| 6 | N 7 10000 LV-I 100 | |
| 7 | Q 7 10000 LV-A 0.72746 0.92967 1188 0.23847 0.82650 0.82650 | |
| 8 | N 7 10000 LV-A 100 | |
| 9 | Q 7 30000 LV-I 0.64799 0.75307 1215 0.46924 0.74851 0.74917 | |
| 10 | N 7 30000 LV-I 100 | |
| 11 | Q 7 30000 LV-A 0.72434 0.93098 1190 0.19519 0.79562 0.79562 | |
| 12 | N 7 30000 LV-A 100 | |
| 13 | # seed=7 V=1607 heldout_sents=2000 | |
| 14 | GUARD C1 PASS tp=4942 kept=4942 gold=4942 | |
| 15 | GUARD C5 PASS gold=4942 conn=4942 comp=4942 | |
| 16 | # tier=3000 train_toks=22049 | |
| 17 | P 7 3000 LV-I MST 0.45212 0.45212 0.45212 | |
| 18 | X 7 3000 C-LV-I 2 6325 | |
| 19 | X 7 3000 C-LV-I 3 10962 | |
| 20 | X 7 3000 C-LV-I 4 11641 | |
| 21 | X 7 3000 C-LV-I 5 10033 | |
| 22 | X 7 3000 C-LV-I 6 7802 | |
| 23 | A 7 3000 C-LV-I 46763 1.00000 0.56528 0.17324 4764 15545 | |
| 24 | X 7 3000 M-LV-I-ucomp-MST 2 867 | |
| 25 | X 7 3000 M-LV-I-ucomp-MST 3 1379 | |
| 26 | X 7 3000 M-LV-I-ucomp-MST 4 1813 | |
| 27 | X 7 3000 M-LV-I-ucomp-MST 5 1882 | |
| 28 | X 7 3000 M-LV-I-ucomp-MST 6 1514 | |
| 29 | A 7 3000 M-LV-I-ucomp-MST 7455 0.38182 0.15638 0.29681 4764 2510 | |
| 30 | # tier=10000 train_toks=73005 | |
| 31 | P 7 10000 LV-I MST 0.48844 0.48844 0.48844 | |
| 32 | X 7 10000 C-LV-I 2 14950 | |
| 33 | X 7 10000 C-LV-I 3 29677 | |
| 34 | X 7 10000 C-LV-I 4 35545 | |
| 35 | X 7 10000 C-LV-I 5 32250 | |
| 36 | X 7 10000 C-LV-I 6 25518 | |
| 37 | A 7 10000 C-LV-I 137940 1.00000 0.65575 0.16526 4764 18904 | |
| 38 | X 7 10000 M-LV-I-ucomp-MST 2 2142 | |
| 39 | X 7 10000 M-LV-I-ucomp-MST 3 4317 | |
| 40 | X 7 10000 M-LV-I-ucomp-MST 4 5943 | |
| 41 | X 7 10000 M-LV-I-ucomp-MST 5 6389 | |
| 42 | X 7 10000 M-LV-I-ucomp-MST 6 5358 | |
| 43 | A 7 10000 M-LV-I-ucomp-MST 24149 0.37993 0.20361 0.29138 4764 3329 | |
| 44 | # tier=30000 train_toks=217853 | |
| 45 | P 7 30000 LV-I MST 0.54514 0.54514 0.54514 | |
| 46 | X 7 30000 C-LV-I 2 29583 | |
| 47 | X 7 30000 C-LV-I 3 66294 | |
| 48 | X 7 30000 C-LV-I 4 92267 | |
| 49 | X 7 30000 C-LV-I 5 90322 | |
| 50 | X 7 30000 C-LV-I 6 74399 | |
| 51 | A 7 30000 C-LV-I 352865 1.00000 0.73174 0.15603 4764 22342 | |
| 52 | X 7 30000 M-LV-I-ucomp-MST 2 4686 | |
| 53 | X 7 30000 M-LV-I-ucomp-MST 3 11509 | |
| 54 | X 7 30000 M-LV-I-ucomp-MST 4 17186 | |
| 55 | X 7 30000 M-LV-I-ucomp-MST 5 19229 | |
| 56 | X 7 30000 M-LV-I-ucomp-MST 6 16289 | |
| 57 | A 7 30000 M-LV-I-ucomp-MST 68899 0.41037 0.26868 0.29935 4764 4276 | |
| 58 | # seed=7 V=1607 heldout_sents=2000 | |
| 59 | GUARD C1 PASS tp=4942 kept=4942 gold=4942 | |
| 60 | GUARD C5 PASS gold=4942 conn=4942 comp=4942 | |
| 61 | # tier=3000 train_toks=22049 | |
| 62 | P 7 3000 LV-A MST 0.46662 0.46662 0.46662 | |
| 63 | X 7 3000 C-LV-A 2 8344 | |
| 64 | X 7 3000 C-LV-A 3 13162 | |
| 65 | X 7 3000 C-LV-A 4 12484 | |
| 66 | X 7 3000 C-LV-A 5 10259 | |
| 67 | X 7 3000 C-LV-A 6 7831 | |
| 68 | A 7 3000 C-LV-A 52080 1.00000 0.42380 0.17018 4764 11864 | |
| 69 | X 7 3000 M-LV-A-ucomp-MST 2 1201 | |
| 70 | X 7 3000 M-LV-A-ucomp-MST 3 1461 | |
| 71 | X 7 3000 M-LV-A-ucomp-MST 4 1701 | |
| 72 | X 7 3000 M-LV-A-ucomp-MST 5 1767 | |
| 73 | X 7 3000 M-LV-A-ucomp-MST 6 1498 | |
| 74 | A 7 3000 M-LV-A-ucomp-MST 7628 0.37762 0.11566 0.30748 4764 1792 | |
| 75 | # tier=10000 train_toks=73005 | |
| 76 | P 7 10000 LV-A MST 0.52670 0.52670 0.52670 | |
| 77 | X 7 10000 C-LV-A 2 18054 | |
| 78 | X 7 10000 C-LV-A 3 36089 | |
| 79 | X 7 10000 C-LV-A 4 38608 | |
| 80 | X 7 10000 C-LV-A 5 33328 | |
| 81 | X 7 10000 C-LV-A 6 25715 | |
| 82 | A 7 10000 C-LV-A 151794 1.00000 0.54954 0.16320 4764 16042 | |
| 83 | X 7 10000 M-LV-A-ucomp-MST 2 3071 | |
| 84 | X 7 10000 M-LV-A-ucomp-MST 3 5092 | |
| 85 | X 7 10000 M-LV-A-ucomp-MST 4 6003 | |
| 86 | X 7 10000 M-LV-A-ucomp-MST 5 6144 | |
| 87 | X 7 10000 M-LV-A-ucomp-MST 6 5279 | |
| 88 | A 7 10000 M-LV-A-ucomp-MST 25589 0.42527 0.19605 0.31061 4764 3007 | |
| 89 | # tier=30000 train_toks=217853 | |
| 90 | P 7 30000 LV-A MST 0.57735 0.57735 0.57735 | |
| 91 | X 7 30000 C-LV-A 2 35972 | |
| 92 | X 7 30000 C-LV-A 3 89514 | |
| 93 | X 7 30000 C-LV-A 4 106674 | |
| 94 | X 7 30000 C-LV-A 5 96582 | |
| 95 | X 7 30000 C-LV-A 6 75852 | |
| 96 | A 7 30000 C-LV-A 404594 1.00000 0.62930 0.15713 4764 19080 | |
| 97 | X 7 30000 M-LV-A-ucomp-MST 2 7127 | |
| 98 | X 7 30000 M-LV-A-ucomp-MST 3 15098 | |
| 99 | X 7 30000 M-LV-A-ucomp-MST 4 18951 | |
| 100 | X 7 30000 M-LV-A-ucomp-MST 5 19435 | |
| 101 | X 7 30000 M-LV-A-ucomp-MST 6 16404 | |
| 102 | A 7 30000 M-LV-A-ucomp-MST 77015 0.44836 0.25420 0.31324 4764 3866 |
| … | … | @@ -0,0 +1,102 @@ |
| 1 | Q 8 3000 LV-I 0.63533 0.71733 1176 0.50579 0.66132 0.66132 | |
| 2 | N 8 3000 LV-I 96 | |
| 3 | Q 8 3000 LV-A 0.71509 0.90954 1169 0.21098 0.81226 0.81226 | |
| 4 | N 8 3000 LV-A 73 | |
| 5 | Q 8 10000 LV-I 0.61535 0.68240 1167 0.54777 0.62545 0.60954 | |
| 6 | N 8 10000 LV-I 100 | |
| 7 | Q 8 10000 LV-A 0.71974 0.90848 1144 0.23709 0.83008 0.83008 | |
| 8 | N 8 10000 LV-A 100 | |
| 9 | Q 8 30000 LV-I 0.64756 0.72707 1170 0.46105 0.68695 0.68695 | |
| 10 | N 8 30000 LV-I 100 | |
| 11 | Q 8 30000 LV-A 0.72643 0.91116 1162 0.28966 0.83638 0.83638 | |
| 12 | N 8 30000 LV-A 100 | |
| 13 | # seed=8 V=1607 heldout_sents=2000 | |
| 14 | GUARD C1 PASS tp=4825 kept=4825 gold=4825 | |
| 15 | GUARD C5 PASS gold=4825 conn=4825 comp=4825 | |
| 16 | # tier=3000 train_toks=21908 | |
| 17 | P 8 3000 LV-I MST 0.44093 0.44093 0.44093 | |
| 18 | X 8 3000 C-LV-I 2 6718 | |
| 19 | X 8 3000 C-LV-I 3 11390 | |
| 20 | X 8 3000 C-LV-I 4 11822 | |
| 21 | X 8 3000 C-LV-I 5 10067 | |
| 22 | X 8 3000 C-LV-I 6 7800 | |
| 23 | A 8 3000 C-LV-I 47797 1.00000 0.56275 0.18419 4661 14241 | |
| 24 | X 8 3000 M-LV-I-ucomp-MST 2 951 | |
| 25 | X 8 3000 M-LV-I-ucomp-MST 3 1380 | |
| 26 | X 8 3000 M-LV-I-ucomp-MST 4 1604 | |
| 27 | X 8 3000 M-LV-I-ucomp-MST 5 1781 | |
| 28 | X 8 3000 M-LV-I-ucomp-MST 6 1571 | |
| 29 | A 8 3000 M-LV-I-ucomp-MST 7287 0.38061 0.16005 0.32350 4661 2306 | |
| 30 | # tier=10000 train_toks=72661 | |
| 31 | P 8 10000 LV-I MST 0.50000 0.50000 0.50000 | |
| 32 | X 8 10000 C-LV-I 2 14166 | |
| 33 | X 8 10000 C-LV-I 3 28221 | |
| 34 | X 8 10000 C-LV-I 4 34249 | |
| 35 | X 8 10000 C-LV-I 5 31674 | |
| 36 | X 8 10000 C-LV-I 6 25345 | |
| 37 | A 8 10000 C-LV-I 133655 1.00000 0.68805 0.16681 4661 19225 | |
| 38 | X 8 10000 M-LV-I-ucomp-MST 2 2062 | |
| 39 | X 8 10000 M-LV-I-ucomp-MST 3 4104 | |
| 40 | X 8 10000 M-LV-I-ucomp-MST 4 5473 | |
| 41 | X 8 10000 M-LV-I-ucomp-MST 5 6097 | |
| 42 | X 8 10000 M-LV-I-ucomp-MST 6 5211 | |
| 43 | A 8 10000 M-LV-I-ucomp-MST 22947 0.37696 0.21519 0.29491 4661 3401 | |
| 44 | # tier=30000 train_toks=217378 | |
| 45 | P 8 30000 LV-I MST 0.53837 0.53837 0.53837 | |
| 46 | X 8 30000 C-LV-I 2 29397 | |
| 47 | X 8 30000 C-LV-I 3 66575 | |
| 48 | X 8 30000 C-LV-I 4 91985 | |
| 49 | X 8 30000 C-LV-I 5 90036 | |
| 50 | X 8 30000 C-LV-I 6 74032 | |
| 51 | A 8 30000 C-LV-I 352025 1.00000 0.74233 0.15605 4661 22172 | |
| 52 | X 8 30000 M-LV-I-ucomp-MST 2 4689 | |
| 53 | X 8 30000 M-LV-I-ucomp-MST 3 11246 | |
| 54 | X 8 30000 M-LV-I-ucomp-MST 4 17135 | |
| 55 | X 8 30000 M-LV-I-ucomp-MST 5 19068 | |
| 56 | X 8 30000 M-LV-I-ucomp-MST 6 16033 | |
| 57 | A 8 30000 M-LV-I-ucomp-MST 68171 0.41193 0.27591 0.29625 4661 4341 | |
| 58 | # seed=8 V=1607 heldout_sents=2000 | |
| 59 | GUARD C1 PASS tp=4825 kept=4825 gold=4825 | |
| 60 | GUARD C5 PASS gold=4825 conn=4825 comp=4825 | |
| 61 | # tier=3000 train_toks=21908 | |
| 62 | P 8 3000 LV-A MST 0.46098 0.46098 0.46098 | |
| 63 | X 8 3000 C-LV-A 2 8111 | |
| 64 | X 8 3000 C-LV-A 3 12871 | |
| 65 | X 8 3000 C-LV-A 4 12282 | |
| 66 | X 8 3000 C-LV-A 5 10182 | |
| 67 | X 8 3000 C-LV-A 6 7812 | |
| 68 | A 8 3000 C-LV-A 51258 1.00000 0.43424 0.17061 4661 11863 | |
| 69 | X 8 3000 M-LV-A-ucomp-MST 2 1247 | |
| 70 | X 8 3000 M-LV-A-ucomp-MST 3 1398 | |
| 71 | X 8 3000 M-LV-A-ucomp-MST 4 1527 | |
| 72 | X 8 3000 M-LV-A-ucomp-MST 5 1693 | |
| 73 | X 8 3000 M-LV-A-ucomp-MST 6 1531 | |
| 74 | A 8 3000 M-LV-A-ucomp-MST 7396 0.37524 0.12336 0.29700 4661 1936 | |
| 75 | # tier=10000 train_toks=72661 | |
| 76 | P 8 10000 LV-A MST 0.53697 0.53697 0.53697 | |
| 77 | X 8 10000 C-LV-A 2 17740 | |
| 78 | X 8 10000 C-LV-A 3 35429 | |
| 79 | X 8 10000 C-LV-A 4 38088 | |
| 80 | X 8 10000 C-LV-A 5 33014 | |
| 81 | X 8 10000 C-LV-A 6 25573 | |
| 82 | A 8 10000 C-LV-A 149844 1.00000 0.55610 0.16246 4661 15955 | |
| 83 | X 8 10000 M-LV-A-ucomp-MST 2 3129 | |
| 84 | X 8 10000 M-LV-A-ucomp-MST 3 4960 | |
| 85 | X 8 10000 M-LV-A-ucomp-MST 4 5687 | |
| 86 | X 8 10000 M-LV-A-ucomp-MST 5 6019 | |
| 87 | X 8 10000 M-LV-A-ucomp-MST 6 5277 | |
| 88 | A 8 10000 M-LV-A-ucomp-MST 25072 0.43381 0.19867 0.31422 4661 2947 | |
| 89 | # tier=30000 train_toks=217378 | |
| 90 | P 8 30000 LV-A MST 0.57994 0.57994 0.57994 | |
| 91 | X 8 30000 C-LV-A 2 35182 | |
| 92 | X 8 30000 C-LV-A 3 84495 | |
| 93 | X 8 30000 C-LV-A 4 103747 | |
| 94 | X 8 30000 C-LV-A 5 95202 | |
| 95 | X 8 30000 C-LV-A 6 75397 | |
| 96 | A 8 30000 C-LV-A 394023 1.00000 0.64814 0.15502 4661 19488 | |
| 97 | X 8 30000 M-LV-A-ucomp-MST 2 7084 | |
| 98 | X 8 30000 M-LV-A-ucomp-MST 3 14201 | |
| 99 | X 8 30000 M-LV-A-ucomp-MST 4 18172 | |
| 100 | X 8 30000 M-LV-A-ucomp-MST 5 18821 | |
| 101 | X 8 30000 M-LV-A-ucomp-MST 6 16092 | |
| 102 | A 8 30000 M-LV-A-ucomp-MST 74370 0.45441 0.26089 0.31568 4661 3852 |
| … | … | @@ -0,0 +1,102 @@ |
| 1 | Q 9 3000 LV-I 0.61107 0.69947 1170 0.53434 0.87336 0.83388 | |
| 2 | N 9 3000 LV-I 86 | |
| 3 | Q 9 3000 LV-A 0.72381 0.94872 1209 0.12965 0.88569 0.88569 | |
| 4 | N 9 3000 LV-A 53 | |
| 5 | Q 9 10000 LV-I 0.64551 0.71984 1159 0.56725 0.69121 0.69666 | |
| 6 | N 9 10000 LV-I 100 | |
| 7 | Q 9 10000 LV-A 0.72661 0.93583 1187 0.16728 0.87935 0.87935 | |
| 8 | N 9 10000 LV-A 76 | |
| 9 | Q 9 30000 LV-I 0.65126 0.75961 1190 0.45901 0.80148 0.76727 | |
| 10 | N 9 30000 LV-I 100 | |
| 11 | Q 9 30000 LV-A 0.73101 0.92232 1157 0.27843 0.85312 0.85312 | |
| 12 | N 9 30000 LV-A 100 | |
| 13 | # seed=9 V=1607 heldout_sents=2000 | |
| 14 | GUARD C1 PASS tp=4964 kept=4964 gold=4964 | |
| 15 | GUARD C5 PASS gold=4964 conn=4964 comp=4964 | |
| 16 | # tier=3000 train_toks=22082 | |
| 17 | P 9 3000 LV-I MST 0.44558 0.44558 0.44558 | |
| 18 | X 9 3000 C-LV-I 2 6136 | |
| 19 | X 9 3000 C-LV-I 3 10494 | |
| 20 | X 9 3000 C-LV-I 4 11449 | |
| 21 | X 9 3000 C-LV-I 5 10004 | |
| 22 | X 9 3000 C-LV-I 6 7905 | |
| 23 | A 9 3000 C-LV-I 45988 1.00000 0.59021 0.17668 4800 16035 | |
| 24 | X 9 3000 M-LV-I-ucomp-MST 2 867 | |
| 25 | X 9 3000 M-LV-I-ucomp-MST 3 1324 | |
| 26 | X 9 3000 M-LV-I-ucomp-MST 4 1674 | |
| 27 | X 9 3000 M-LV-I-ucomp-MST 5 1811 | |
| 28 | X 9 3000 M-LV-I-ucomp-MST 6 1570 | |
| 29 | A 9 3000 M-LV-I-ucomp-MST 7246 0.36167 0.14917 0.29996 4800 2387 | |
| 30 | # tier=10000 train_toks=73202 | |
| 31 | P 9 10000 LV-I MST 0.52482 0.52482 0.52482 | |
| 32 | X 9 10000 C-LV-I 2 14944 | |
| 33 | X 9 10000 C-LV-I 3 29736 | |
| 34 | X 9 10000 C-LV-I 4 35636 | |
| 35 | X 9 10000 C-LV-I 5 32472 | |
| 36 | X 9 10000 C-LV-I 6 25814 | |
| 37 | A 9 10000 C-LV-I 138602 1.00000 0.66063 0.16801 4800 18874 | |
| 38 | X 9 10000 M-LV-I-ucomp-MST 2 2200 | |
| 39 | X 9 10000 M-LV-I-ucomp-MST 3 4302 | |
| 40 | X 9 10000 M-LV-I-ucomp-MST 4 5932 | |
| 41 | X 9 10000 M-LV-I-ucomp-MST 5 6284 | |
| 42 | X 9 10000 M-LV-I-ucomp-MST 6 5475 | |
| 43 | A 9 10000 M-LV-I-ucomp-MST 24193 0.42125 0.23708 0.32147 4800 3540 | |
| 44 | # tier=30000 train_toks=217891 | |
| 45 | P 9 30000 LV-I MST 0.54461 0.54461 0.54461 | |
| 46 | X 9 30000 C-LV-I 2 30562 | |
| 47 | X 9 30000 C-LV-I 3 69301 | |
| 48 | X 9 30000 C-LV-I 4 95368 | |
| 49 | X 9 30000 C-LV-I 5 91921 | |
| 50 | X 9 30000 C-LV-I 6 74898 | |
| 51 | A 9 30000 C-LV-I 362050 1.00000 0.72042 0.15631 4800 22123 | |
| 52 | X 9 30000 M-LV-I-ucomp-MST 2 4971 | |
| 53 | X 9 30000 M-LV-I-ucomp-MST 3 11664 | |
| 54 | X 9 30000 M-LV-I-ucomp-MST 4 17700 | |
| 55 | X 9 30000 M-LV-I-ucomp-MST 5 19545 | |
| 56 | X 9 30000 M-LV-I-ucomp-MST 6 16423 | |
| 57 | A 9 30000 M-LV-I-ucomp-MST 70303 0.39917 0.26667 0.30375 4800 4214 | |
| 58 | # seed=9 V=1607 heldout_sents=2000 | |
| 59 | GUARD C1 PASS tp=4964 kept=4964 gold=4964 | |
| 60 | GUARD C5 PASS gold=4964 conn=4964 comp=4964 | |
| 61 | # tier=3000 train_toks=22082 | |
| 62 | P 9 3000 LV-A MST 0.46513 0.46513 0.46513 | |
| 63 | X 9 3000 C-LV-A 2 8365 | |
| 64 | X 9 3000 C-LV-A 3 13124 | |
| 65 | X 9 3000 C-LV-A 4 12549 | |
| 66 | X 9 3000 C-LV-A 5 10344 | |
| 67 | X 9 3000 C-LV-A 6 7948 | |
| 68 | A 9 3000 C-LV-A 52330 1.00000 0.42042 0.17167 4800 11755 | |
| 69 | X 9 3000 M-LV-A-ucomp-MST 2 1221 | |
| 70 | X 9 3000 M-LV-A-ucomp-MST 3 1453 | |
| 71 | X 9 3000 M-LV-A-ucomp-MST 4 1656 | |
| 72 | X 9 3000 M-LV-A-ucomp-MST 5 1742 | |
| 73 | X 9 3000 M-LV-A-ucomp-MST 6 1561 | |
| 74 | A 9 3000 M-LV-A-ucomp-MST 7633 0.36542 0.11667 0.31674 4800 1768 | |
| 75 | # tier=10000 train_toks=73202 | |
| 76 | P 9 10000 LV-A MST 0.51983 0.51983 0.51983 | |
| 77 | X 9 10000 C-LV-A 2 18640 | |
| 78 | X 9 10000 C-LV-A 3 36980 | |
| 79 | X 9 10000 C-LV-A 4 39160 | |
| 80 | X 9 10000 C-LV-A 5 33622 | |
| 81 | X 9 10000 C-LV-A 6 26019 | |
| 82 | A 9 10000 C-LV-A 154421 1.00000 0.54042 0.16557 4800 15667 | |
| 83 | X 9 10000 M-LV-A-ucomp-MST 2 3204 | |
| 84 | X 9 10000 M-LV-A-ucomp-MST 3 4917 | |
| 85 | X 9 10000 M-LV-A-ucomp-MST 4 6039 | |
| 86 | X 9 10000 M-LV-A-ucomp-MST 5 6121 | |
| 87 | X 9 10000 M-LV-A-ucomp-MST 6 5498 | |
| 88 | A 9 10000 M-LV-A-ucomp-MST 25779 0.41063 0.18792 0.31330 4800 2879 | |
| 89 | # tier=30000 train_toks=217891 | |
| 90 | P 9 30000 LV-A MST 0.58909 0.58909 0.58909 | |
| 91 | X 9 30000 C-LV-A 2 34411 | |
| 92 | X 9 30000 C-LV-A 3 83869 | |
| 93 | X 9 30000 C-LV-A 4 103627 | |
| 94 | X 9 30000 C-LV-A 5 95828 | |
| 95 | X 9 30000 C-LV-A 6 75925 | |
| 96 | A 9 30000 C-LV-A 393660 1.00000 0.65208 0.15652 4800 19998 | |
| 97 | X 9 30000 M-LV-A-ucomp-MST 2 6802 | |
| 98 | X 9 30000 M-LV-A-ucomp-MST 3 14303 | |
| 99 | X 9 30000 M-LV-A-ucomp-MST 4 18435 | |
| 100 | X 9 30000 M-LV-A-ucomp-MST 5 19398 | |
| 101 | X 9 30000 M-LV-A-ucomp-MST 6 16462 | |
| 102 | A 9 30000 M-LV-A-ucomp-MST 75400 0.46979 0.27729 0.32970 4800 4037 |
| … | … | @@ -0,0 +1,4 @@ |
| 1 | 51b048cf6c0a2689019ae8502a349e257733853f72fd1f12e9fd1a96ec8bb816 l2.c | |
| 2 | d836689422948fa141f5a5981082a9b563246adbbb39514996a63219c648d3dd lv.py | |
| 3 | 577e806dc7c1942cd5624cecd81f48baaa5f19e81add39602fca7edde8f24fee ../ladder/port/cluster.c | |
| 4 | 2f4343faaa8bd25592fdadbc5bd38807f63d6823bcf85aff9eaeda50e96b8396 ../across-cluster/ac.c |
| … | … | @@ -0,0 +1,24 @@ |
| 1 | ## Held-out labels (mean): V-measure / many-to-one / labels / share in a class / sense / sense-COLL / merges | |
| 2 | 3000 LV-I: 0.622 / 0.712 / 1180.700 / 0.532 / 0.748 / 0.758 / 88.8 | |
| 3 | 3000 LV-A: 0.720 / 0.933 / 1211.300 / 0.164 / 0.855 / 0.855 / 56.1 | |
| 4 | 10000 LV-I: 0.637 / 0.720 / 1178.100 / 0.520 / 0.704 / 0.735 / 100.0 | |
| 5 | 10000 LV-A: 0.726 / 0.929 / 1172.300 / 0.227 / 0.842 / 0.842 / 93.8 | |
| 6 | 30000 LV-I: 0.658 / 0.759 / 1190.000 / 0.472 / 0.753 / 0.750 / 100.0 | |
| 7 | 30000 LV-A: 0.722 / 0.918 / 1170.200 / 0.255 / 0.828 / 0.828 / 100.0 | |
| 8 | ||
| 9 | ## Re-parse link F1 and level 2 (mean): link F1 / ucomp types / ucomp type recall / ucomp precision | |
| 10 | 3000 words(round 0) F1 0.455 ucomp recall 0.113; L-MST F1 0.626 | |
| 11 | LV-I: 0.449 / 7379 / 0.157 / 0.308 | |
| 12 | LV-A: 0.462 / 7569 / 0.121 / 0.319 | |
| 13 | 10000 words(round 0) F1 0.514 ucomp recall 0.185; L-MST F1 0.689 | |
| 14 | LV-I: 0.504 / 23820 / 0.213 / 0.296 | |
| 15 | LV-A: 0.528 / 25433 / 0.198 / 0.315 | |
| 16 | 30000 words(round 0) F1 0.570 ucomp recall 0.254; L-MST F1 0.700 | |
| 17 | LV-I: 0.544 / 69388 / 0.267 / 0.296 | |
| 18 | LV-A: 0.572 / 75680 / 0.256 / 0.316 | |
| 19 | ||
| 20 | ## Predictions (at 30000) | |
| 21 | L1: FAIL — sense LV-I − LV-I-COLL +0.003 [-0.004, +0.011] | |
| 22 | L2: FAIL — link F1 LV-I − word MST -0.026 [-0.035, -0.016] | |
| 23 | L3: FAIL — link F1 LV-I − L-MST -0.156 [-0.169, -0.144] (bar: lower > -0.02) | |
| 24 | L4: PASS — ucomp type recall LV-I − word MST +0.013 [+0.005, +0.021] |
| … | … | @@ -15,7 +15,7 @@ def load (d): |
| 15 | 15 | p = line.rstrip('\n').split('\t') |
| 16 | 16 | if p[0] == 'Q': Q[(int(p[2]), p[3], int(p[1]))] = tuple(map(float, p[4:10])) |
| 17 | 17 | elif p[0] == 'N': N[(int(p[2]), p[3], int(p[1]))] = int(p[4]) |
| 18 | elif p[0] == 'P': P[(int(p[2]), p[3], int(p[1]))] = float(p[7]) | |
| 18 | elif p[0] == 'P' and p[4] == 'MST': P[(int(p[2]), p[3], int(p[1]))] = float(p[7]) # MST rows only | |
| 19 | 19 | elif p[0] == 'A': A[(int(p[2]), p[3], int(p[1]))] = (int(p[4]), float(p[6]), float(p[7])) |
| 20 | 20 | elif p[0] == 'RP': RP[(int(p[2]), int(p[3]), int(p[1]))] = float(p[6]) |
| 21 | 21 | return Q, N, P, A, RP |